Comments (1)
Hi there,
The regions and reading order are normally done as a post processing step. The trained region models are specifically for detecting known page structures (e.g. distinction between marginalia and main text is necessary). The trained models use pixel wise classification. So to specifically answer your questions:
- The baseline ordering is done in post processing in the Loghi-tooling (https://github.com/knaw-huc/loghi-tooling) step. It is our ambition to also do something with AI models to get the reading order correct, however this is not something we will likely do in the near future
- The main method used in Loghi-tooling is to group text lines based on interline distance. And within these groups, the lines are ordered from top to bottom. The groups themselves are also ordered based on some handcrafted rules.
- The standard method does not use the region model at all. The trained region models are only there as an enhancement if you know your data has certain structures. All inference will work with just a baseline model
- I'm not sure I understand you correctly, but the trained region model does classification on a pixel level. And generally the only classes of paragraphs are too close together to be split by a background class. The region model serves more to distinguish main text from e.g. Signatures, images, or headers. Not make splits in the main text itself. If this is something you require, I suggest having a look at instance based models. These had the downside of being restricted to bounding boxes, which is why we chose the pixel based approach
I hope this clears up all your questions, and if not feel free to ask more
from laypa.
Related Issues (9)
- multithreading cpu training HOT 1
- Training too slow HOT 9
- Parameters for inference HOT 2
- Training both regions and baselines + different region types from eScriptorium HOT 16
- Baseline model fine-tuning config HOT 26
- Warning "No region type defined for eSc_dummyblock_c" when training a region model HOT 6
- Overlapping regions when training a region model HOT 1
- Parameters to improve region training HOT 10
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from laypa.