garfieldnate / kengdic Goto Github PK

The data needs a lot of cleaning. Since there are 130K entries, it probably won't be possible to do it alone, and in order for the result to be consistent we're going to need to come up with editorial guidelines of some kind.

missing:
- 결합사
- 訟事辮

nth

,

=

@

Japanese vinegared rice vegetables = sushi?

?

\t)

the home of ..

should 어음 交換 be also 語音 交換? Online they seem to use hangeul everywhere, but the etymology seems sensical...

~

Try generating definitions, and possibly check for and flag low similarity with other known-good definitions.

There are 3 separate dictionary files in the repo. Figure out which one is the master file and delete the others, or combine the data if appropriate.

Some of the fields do not seem to contain useful data. Clean them up or remove them.

May in fact be better to generalize the concept to simplify alternative spellings.

Working notes:

hanja field should be an array:
- 淵魚,鰱魚
- 俛,袝
- 남동생 男同生 can also be written 男동생
- 청사초롱 靑紗초籠 can also have 燭 I feel like the 초 is 灯; but it's not kyoyuk
- 어음교환조합은행 can appear with spaces: 어음교환 조합은행 or 어음 교환 조합 은행, etc.
- 最정상급 for 최정상급 might get used instead of 最頂上級
- should 어음 交換 be also 語音 交換? Online they seem to use hangeul everywhere, but the etymology seems sensical...

Currently we have 7 fields; some information is missing (part of speech, morphology) and some information is contained in the gloss field (regional variants, multiple senses). Come up with a structure that we can use moving forward that will make the dictionary a bit more comprehensive and usable. Start by reviewing Jim Breen's work.

These are fairly straightforward to fix. See the list of issues at http://garfieldnate.github.io/kengdic/hanja%20length.txt.