Comments (7)
we already use all texts in a page in a single translation api call
from manga-image-translator.
we already use all texts in a page in a single translation api call
My bad, than it is weird that it translates so weirdly as if each bubble is a different entity alltogether. I assume there is an issue somewhere.
Either some translation AI compehends bubbles as a separate entities, or something else, because gpt4 gets it perfectly, maybe we separate each bubble in such a way?
from manga-image-translator.
which api are you using?
from manga-image-translator.
which api are you using?
I used google, gpt3.5, gpt4 and deepl
from manga-image-translator.
I get what you mean. You can technically do something like this, particularly on offline models, and it does indeed improve translation quality.
However if you merge all text bubbles together, you get only one output translation. There is no trivial way to re split the single output translation to the original text bubbles, placing each text part into the original part.
You could add a special token or character as demarker that is not used in any language and therefore it will not be translated, to detect and keep track of the parts that compose each text bubble.
However for some languages the translation will change the position of parts of the text, resulting in misplaced text bubbles.
It might be interesting for languages that share the Subject Verb Object order. https://en.m.wikipedia.org/wiki/Subject%E2%80%93verb%E2%80%93object_word_order#:~:text=In%20linguistic%20typology%2C%20subject%E2%80%93verb,second%2C%20and%20the%20object%20third.
Nice suggestion overall
from manga-image-translator.
It still will improve translation quality ALOT, if we have all text from ONE PAGE translated in a bulk, we need another option to translate all texts from a chapter in a bulk the same way as we do now with one page.
from manga-image-translator.
we already use all texts in a page in a single translation api call
updated issue
from manga-image-translator.
Related Issues (20)
- 求助,翻译后图片残留原文字问题 HOT 1
- [Bug]: englishEnglish text detection don't work correctly HOT 1
- [Bug]: The translation of languages other than CJK is incomplete.
- [Bug]: Blur ramdom moments with no text
- [Feature Request]: OCR for English language HOT 4
- update model gpt4 HOT 3
- [Feature Request]: set up FROM which language to translate ONLY
- [Bug]: 在web模式下gui中无法正常上传原图 HOT 4
- [Feature Request]: how can i add any language?
- [Feature Request]: please Add KOR to deepl
- [Bug]: Output format PSD Error HOT 3
- [Feature Request]: run_as_kaggle
- 如何使用 HOT 1
- [Feature Request]: Store ocr images for lookup for performance
- May I know how to use deepl in python ? HOT 4
- [Feature Request]: please add translate to indonesia
- [Bug]: IndexError when rendered text has trailing space and text has only 2-3 symbols (like '? ' or '★ ')
- [Bug]: 使用Mac的Metal在OCR阶段会报错,识别出来的内容也不正确
- Question about the accuracy of the ocr_48px_ctc model. HOT 1
- [Feature Request]: api refactor with cloudpickle
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from manga-image-translator.