Comments (9)
is this still relevant?
from juriscraper.
Yes. The trick here is that we need to update these lockstep with CourtListener. As I understand it (and perhaps it's worth double checking this), if two libraries call for the same dependency, the newer one will just be chosen. So I think if we upgrade things here, that'll upgrade things for CourtListener as well. But I'm not sure how it really works.
I did just upgrade lxml and selenium though, and I did them lockstep with CL and it wasn't that bad.
from juriscraper.
do juriscraper and cl share unified processes on the same server? or do they share the same virtualenv?
from juriscraper.
from juriscraper.
why would two separate apps with separate requirements.txt files share the same env? Regardless, I think its good to strive to keep all packages up to date, as letting things fall behind become an exponential nightmare to cleanup later.
from juriscraper.
Maybe I misunderstand how virtualenvs work, but if CourtListener requires juriscraper, how can it have a separate env?
Agree about updates. That's kind of where things are at the moment — a nightmare.
from juriscraper.
oh, juriscraper is only installed as a dependency of CL? Maybe the problem here is that I don't really understand how CL and juriscraper interact with each other. However you set it up is probably correct and I'm just misunderstanding the setup.
from juriscraper.
I think we can move on from this issue - seems like we've done quite a lot of updates on dependencies @mlissner - feel free to correct me if im wrong here
from juriscraper.
Yeah, I'm OK closing this. Libraries should have liberal requirements, locking to the lowest version they support. Websites should have tight requirements, locking to the latest version, period.
So long as Juriscraper isn't holding us (or others) back, I'm cool. A test would be to export requirements.txt from CL. Remove Juriscraper and export again. If any deps are newer, then Juriscraper is an issue. But I'm not too worried about it generally.
from juriscraper.
Related Issues (20)
- IndexError: Parsing Attorney in ACMS docket JSON object HOT 1
- `opinions.united_states_backscrapers` folder excluded from tests HOT 1
- Include de_seq_num when available for downloading PACER documents HOT 1
- `massappct_u` failing with 'Site' object has no attribute 'headers'
- HTML parsing not working for `oklaag`
- Update PACER parsers to include office code, judge initials, and defendant number HOT 5
- new `colo` and `coloctapp` problems with opinion content display rendering HOT 1
- Make backscraper interval size a caller keyword argument
- Fill `nd` gap HOT 2
- Update Case Query Docket Number Parsing HOT 5
- `massappct_u` document downloads failing due to incorrect headers
- Ideas to improve Juriscraper HOT 1
- Opinion Types across Courts
- Cache-control header not set properly on AbstractSite? HOT 2
- `site.request["parameters"]` defined by an inheriting scraper is never used HOT 2
- Fill `minn` and `minnctapp` gaps HOT 1
- `cal` scrapers failing with SSLError HOT 2
- `nmariana` scraper not working HOT 1
- `nh` scraper is blocking "Juriscraper" user agent HOT 4
- Fill `nh` 2024 gap
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from juriscraper.