Comments (6)
Good catch, we'd be happy to merge a PR to include all tiger data.
I believe that omitting that config blocks defaults to downloading all data, as per the planet
project.
from docker.
Those download errors are very annoying, for the census ftp site we used to have a mirror, I'll have to check if that's still running and up-to-date, we could switch to that.
For openaddresses and this long-standing yet intermittent unzip
bug I would like to find a solution, preferably one which doesn't require downloading to disk first, or at least one which doesn't shell-out a bunch if commands to the shell and necessitate a large tmp volume.
from docker.
I believe that omitting that config blocks defaults to downloading all data, as per the planet project.
@missinglink what are the downsides of downloading all the tiger data just for the north-america
build (apart from the oblivious longer download time)?
Also what would I lose if I were to omit the tiger data?
Thanks in advance!
from docker.
Hi, I just ran into this issue today. I would also like to know what the consequences are of omitting Tiger data. Is it worse to have incomplete Tiger data, or none at all?
from docker.
If you change the config to match the planet project it will download TIGER data for all the states:
https://github.com/pelias/docker/blob/master/projects/planet/pelias.json#L65-L71
Is it worse to have incomplete Tiger data, or none at all?
TIGER is only used for building the interpolation index, omitting TIGER will use address points from OpenStreetMap and OpenAddresses where available. Adding TIGER too will improve the interpolation accuracy but I can't give you an exact percentage.
Can someone please update the Washington County, OR
section to match the planet file above and open a PR?
from docker.
There are two reasons why I omitted most of the TIGER data when creating up the North America project:
- The US Census download server is very slow, so downloading the data takes a while
- The interpolation service takes an even longer time to process the data, so the
pelias prepare all/interpolation
step will take hours if all the data is included
Interpolation data is used only for the /v1/search
endpoint, and (we suspect) makes only a marginal difference (maybe 10% or less?), so it's omitted in favor of making the project easier to get started with.
I'm open to ideas for messaging things better or finding a better balance between ease of setup and completeness.
from docker.
Related Issues (20)
- PeliasModelError: invalid regex test, https://yavuzgallery.com should not match /https?:\/\// HOT 2
- Self hosted planet build result deviation HOT 5
- Elasticsearch Container keeps restarting HOT 7
- Can't import pelias docker for Quebec HOT 7
- Planet pelias json config openaddresses HOT 9
- Crash / Abort in Node create_thread on Ubuntu 20.04 HOT 1
- Pelias openaddress import seem not working
- North America openaddresses missing data and incomplete
- Missing Address Layer HOT 3
- network pelias_default was found but has incorrect label com.docker.compose.network set to "" HOT 2
- Duplicate key `csv-importer`
- A network with name pelias_default exists but was not created by compose HOT 4
- Cant start docker folowing documentation commands HOT 6
- update TIGER download to use the 2023 data HOT 2
- Interpolation error HOT 3
- Full Planet Import only takes 300GB in Elastic Search
- How to run Pelias geocoder in docker with my own .pbf file data without external data HOT 5
- Error at import process HOT 2
- Add India Region to Pelias Docker Demo Projects
- Error During Import Process with Pelias for OSM and Other Data Sources HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from docker.