Word and Character Frequency Counter
Paste text and get three ranked tables: Words (tokens of letters and digits outside the CJK classes — Greek, Cyrillic and every other script included), Characters (Han, kana and Hangul counted one by one), and Bigrams (adjacent Han pairs). This tool does not segment Chinese — segmentation is a research problem; characters and bigrams keep every number reproducible by hand from the stated rules. Word matching uses Unicode simple case folding, not ordinary lowercasing.
Count
Only rows that meet this count appear. The total, unique item count, and percentage denominator still use all counted items.
| Rank | Item | Count | Percent |
|---|
Counting rules (shown beside the results, so every number can be rechecked)
- Classes: Han (U+4E00–U+9FFF, U+3400–U+4DBF), kana (U+3040–U+30FF) and Hangul (U+AC00–U+D7AF) count per character; every other Unicode letter or digit forms words — so Greek, Cyrillic, Arabic and other scripts land in the Words table. It is not a Latin-only table.
- Words: an apostrophe joins only with a word character on both sides (don't is one token; 'tis counts as tis); hyphens and all other punctuation separate. Matching folds with Unicode simple case folding (the simple case folding entries — C and S — of CaseFolding.txt, Unicode 16.0.0): Σ and ς both fold to σ — unlike lowercasing, under which ς stays ς. The display form is the most frequent original casing, ties going to the first occurrence.
- Bigrams: adjacent pairs inside a Han run only; punctuation ends a run; kana and Hangul form no bigrams. The Characters table does not normalise: visually identical text in different Unicode normalisation forms can count differently.
- Enabled stopwords are excluded before counting. A bigram is excluded if either character is a stopword. The Words table also applies the pure-number and minimum word length settings before counting.
- Each row's percentage is its share of the counted total for that table, rounded to one decimal (half away from zero). Minimum occurrence count filters rows after counting. For alpha alpha beta with a minimum count of 2, the total is 3 and alpha appears twice (66.7%). Rows sort by count, then by first occurrence.
- Default stopwords (English): a, about, above, after, again, against, all, am, an, and, any, are, as, at, be, because, been, before, being, below, between, both, but, by, could, did, do, does, doing, down, during, each, few, for, from, further, had, has, have, having, he, her, here, hers, herself, him, himself, his, how, i, if, in, into, is, it, its, itself, just, me, more, most, my, no, nor, not, now, of, off, on, once, only, or, other, our, ours, out, over, own, same, she, should, so, some, such, than, that, the, their, theirs, them, themselves, then, there, these, they, this, those, through, to, too, under, until, up, very, was, we, were, what, when, where, which, while, who, whom, why, will, with, you, your, yours, yourself
- Default stopwords (Chinese characters): 的了是在和也不這我你他她它們就都而及與或個中有被把從到對為以於其之者嗎呢吧啊所將但若如因由向跟給讓只
- The display shows the top 100 rows by default. frequency.csv exports every row in the current table that meets the minimum occurrence count.