rspeer / wiki2text Goto Github PK

Would be nice if this was installable through nimble install wiki2text

Hi,
When I use the command given below on the terminal opened at the path given below I get an error. Could you please help me out.
path - /home/user/lol/nim-0.18.0
command used - bunzip2 -c wikipedia2text-toparticles.xml.bz2 | ./wiki2text > enwiki.txt
error - bash: ./wiki2text: No such file or directory

Hi,

Do you have any idea why the program could output an empty file?
I ran the command like written in the README:
bunzip2 -c enwiki-DATE-pages-articles.xml.bz2 | ./wiki2text > enwiki.txt
Where the .bz2 file is the dump of all abstracts of Wikipedia pages:
It's called enwiki-latest-abstract.xml.gz in the following link https://dumps.wikimedia.org/enwiki/latest/.

I'm working on Windows 10.
It might be helpful to note that the program DID work on a small file containing only one wikipedia page, but as said above did not work on the big dump (zipped it was about 500M, unzipped around 5G).

Thanks!

Hello,

First thank you for this project.

1. Is there a way to show a progression bar or percentage ?
2. Does the -t argument makes the output size bigger or of same size as without -t ?