Comments (17)
Hi all. Sorry it took me a while to publish the PR while the code was already available.
Now the PR is there to be reviewed, I'm looking forward for your feedback.
from camelot.
Any update on this? My PDFs are 100s of pages and I can really use this feature.
from camelot.
👀
from camelot.
Hi @vinayak-mehta ,
Even I thought of implementing this. dramatiq or celery are my suggestions for asynchronous processing of pages.
from camelot.
I'm doing this with dask but it's chosen out of habit.
from camelot.
Is there any improvement in there? I have a file that has only one page. The page has a table (25 rows x 13 columns). read_pdf
function takes 10 seconds after that to_excel
takes only 100-150 ms. I'm thinking about 10 seconds is too long, am I wrong?
from camelot.
@selcukusta I think this is more about running multiple pages at the same time rather than speeding up the extraction of a single page.
But does anyone have a solution for multiple pages in parallel?
from camelot.
@selcukusta I think this is more about running multiple pages at the same time rather than speeding up the extraction of a single page.
Yes!
But does anyone have a solution for multiple pages in parallel?
Using multiprocessing, we should be able to distribute multiple pages on all cores, processing them in parallel.
from camelot.
I get this though
objc[53475]: +[__NSPlaceholderDate initialize] may have been in progress in another thread when fork() was called. We cannot safely call it or ignore it in the fork() child process. Crashing instead. Set a breakpoint on objc_initializeAfterForkError to debug.
Oh; what is the difference between https://github.com/atlanhq/camelot and https://github.com/camelot-dev/camelot ? Didn't notice two repos before now...
from camelot.
@selcukusta I think this is more about running multiple pages at the same time rather than speeding up the extraction of a single page.
But does anyone have a solution for multiple pages in parallel?
Yeah, I know. Actually it's related with that but the issue was closed and referenced to it.
from camelot.
Does anyone have an update? I've tried inheriting PageHandler and making pages multithreaded / multicore, and multi threading processing multiple pdfs, but I'm running into a ghostscript error (seems like it's not thread safe?)
from camelot.
I did implement a multi-threading layer above camelot.read_pdf using multiprocessing library.
I faced a couple of pitfalls doing it, so I can help on this if I may.
from camelot.
@phoewass That would be awesome if you're still interested!
from camelot.
can anyone tell me how to use multiprocess in camelot ? or did this issues still on progress ?
from camelot.
@phoewass @vinayak-mehta is this feature part of library now? If not, is there any way I can utilize multiprocessing to read multipage PDF?
from camelot.
Any updates on this features?
from camelot.
Hey!
As camelot is dead, we try to build a maintained fork at pypdf_table_extraction
.
There is a discussion about this in:
from camelot.
Related Issues (20)
- two bug!
- Installing camelot with "pip install -U 'camelot-py[base]'" installs version 0.9, instead of 0.11 HOT 2
- Match size of Lines mask with Image Table
- mac m1 Ghostscript is not installed. HOT 3
- Difficulties with Multi-line headers. Rows shifted down. HOT 5
- OSS-Fuzz Integration HOT 2
- Error in PyPDF2 3.0.0 HOT 6
- Updated documentation idea / installation screencasts HOT 2
- Release 0.11.0 uses deprecated pandas encoding parameter
- [Feature Request] Replace text
- Strip more than 1 string
- Test failures on ppc64el (PowerPC architecture), linux
- [Feature Request / Question] Use different OCR engine HOT 1
- fail when detect abnormal border table HOT 1
- IndexError in lattice HOT 1
- Tables ignored in lattice mode HOT 1
- if (bbox_intersection_area(ba, bb) / bbox_area(ba)) > 0.8: ZeroDivisionError: float division by zero HOT 6
- How to combine tabular and non-tabular content from a PDF?
- CLI: Margins option not processed
- Camelot Dependency Tree HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from camelot.