Comments (3)
Um, I feel stupid to have to ask, but I think I'm not following here. Is your point about the names of the files (i.e., to standardize on the names paths.txt
and urls.txt
) or is the point something else?
from archivers-harvesting-tools.
sorry, comes from another issue I think. Question was: de we require that the tools in the repo (not check-ia actually, but the other tools, which harvest web pages) make use of path.txt
and urts.txt
the wat that wget-loop
does? If we had such a requirement ,the pipeline app @b5 and @danielballan are building could prepopulate those files.
from archivers-harvesting-tools.
I'm closing this as I think these implementation questions will move to https://github.com/datatogether/archivertools. Feel free to reopen if you feel like this needs to be addressed here
from archivers-harvesting-tools.
Related Issues (9)
- Clean up README HOT 1
- Create a containerized version (e.g., Docker image) with all tools installed HOT 2
- ftp downloader tool is single threaded HOT 1
- AWS toolchain integration HOT 1
- What is the status of check-ia.py HOT 6
- Add a location for very short single-purpose scripts HOT 5
- Tools for harvesting ArcGIS REST endpoints? HOT 1
- Move contributing to it's own file HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from archivers-harvesting-tools.