Lack of Character Set Debug Information about babylontohtml

[alonrotem]

Thanks a lot for your feedback!
As I commented on the post itself:

Those bad characters have been discussed in the post and in the comments as well.
First, there is a problem with the program's ability to detect the right dictionary languages, and thus the right encoding (although those can be forcefully provided as command line args, they are ignored at a later stage of the dictionary analysis). This has also been mentioned as a bug.
Second, those pronunciation characters are not well handled and they leak to the HTML output (where they should not be present).
There is an option to extract the definitions with pyglossary, which handles the special characters better, then combine those into the output html file. The better versions of the dictionaries I've shared (English > Hebrew) were built that way.
I've been thinking about incorporating pyglossary into my project and using its abilities to better parse the .bgl file, but alas- not much time to do that yet..

As for the HTML format, it is, after all, following HTML (even XHTML, if I recall correctly) standards so in general it should be displayed properly in a browser (although not all the tags and attributes are classic HTML, many of them need to be parsed by Mobi and would have no effect (or erroneous) in a proper browser.