minervatech / mecab

Yet another Japanese morphological analyzer

mecab

Yet another Japanese morphological analyzer

installation

First compile mecab.

git clone https://github.com/minervatech/mecab.git
cd mecab/mecab
./configure  --enable-utf8-only
make
make check
sudo make install

Mecab will be deployed to

/usr/local/etc/mecabrc
/usr/local/bin/mecab
/usr/local/bin/mecab-config

Then, compile dictionary. Use minerva/mecab as the original code have encoding problem.

cd mecab/mecab-ipadic
nkf -w --overwrite *.csv
nkf -w --overwrite *.def
./configure --with-charset=utf8
make
sudo make install
sudo ldconfig

Custom dictionary

Add arbitrary CSV file below mecab/mecab-ipadic and re-build dictionary

cd mecab/mecab-ipadic
vim Noun.new.csv
make clean
make
sudo make install

Use mecab-ipadic-neologd

cd mecab
git clone https://github.com/neologd/mecab-ipadic-neologd
echo `mecab-config --dicdir`"/mecab-ipadic-neologd" # Check target dir
./mecab-ipadic-neologd/bin/install-mecab-ipadic-neologd -n -a

Comparison

• ipadic

echo "10日放送の「中居正広のミになる図書館」（テレビ朝日系）で、SMAPの中居正広が、篠原信一の過去の勘違いを明かす一幕があった。" | mecab -d /usr/local/lib/mecab/dic/ipadic

• mecab-ipadic-neologd

echo "10日放送の「中居正広のミになる図書館」（テレビ朝日系）で、SMAPの中居正広が、篠原信一の過去の勘違いを明かす一幕があった。" | mecab -d /usr/local/lib/mecab/dic/mecab-ipadic-neologd

Python bindings

pip install mecab-python

mecab-ipadic-neologd

# coding: utf-8
import MeCab
 
input = '10日放送の「中居正広のミになる図書館」（テレビ朝日系）で、SMAPの中居正広が、篠原信一の過去の勘違いを明かす一幕があった。'
tagger = MeCab.Tagger("-Ochasen -d /usr/local/lib/mecab/dic/ipadic/")
tagger.parse('')
node = tagger.parseToNode(input)
while node:
    print (node.surface, node.feature)
    node = node.next

mecab-ipadic-neologd

# coding: utf-8
import MeCab
 
input = '10日放送の「中居正広のミになる図書館」（テレビ朝日系）で、SMAPの中居正広が、篠原信一の過去の勘違いを明かす一幕があった。'
tagger = MeCab.Tagger("-Ochasen -d /usr/local/lib/mecab/dic/mecab-ipadic-neologd/")
tagger.parse('')
node = tagger.parseToNode(input)
while node:
    print (node.surface, node.feature)
    node = node.next

Uninstall

cd /usr/local/lib
sudo rm libmecab.*
sudo rm -rf mecab/

cd /usr/local/bin/
sudo rm mecab
sudo rm mecab-config

cd  /usr/local/etc
sudo rm mecabrc