javex / hotprices-au Goto Github PK
View Code? Open in Web Editor NEWLicense: MIT License
License: MIT License
There's a latest-canonical that has all combined data. Make it available and update the docs.
If there's a space in the search term it breaks URLs when e.g. pasting them so the part query should be URL encoded
Searching for Arnott caramel crowns only turns up coles but woolies has it too. Why is it missing?
I have noticed on the Coles page, that you can set your location for e.g. click and collect. I have also noticed that if you set your location to a different store, you get different prices for some items e.g. bananas. Not surprising because location does affect availability of things in different locations.
I couldn't see anything in the code that attempts to set headers, cookies, request params etc that might attempt to gather prices from different store/locations. Is this something you have attempted?
When re-running analysis the code should not break things like price history if the same scraped snapshot is used (i.e. we didn't re-scrape, just re-analyse). However, at the moment I've noticed in some cases this breaks in odd ways, not sure why. For example, even though the items are all there, the prices changes page somehow filtered out all items, possibly because of the price history got cleared. I haven't reproduced it yet so I'm not sure what exactly is happening there.
The root html
tag has a lang="de"
attribute we should update
There didn't seem to be a straightforward way so I skipped it for the initial version. Maybe a simple string match will do.
Current unit filters still make some assumptions e.g. "stk" instead of "ea".
Did a hotfix of Coles scraper in b6f0421 but obviously that's going to break again so we need to grab the correct version dynamically when starting up.
Most of the work is already done: https://aus.social/@NotADropbear/111175009841344799, will need to be added to the site tho
The original heissepreise has support for Dicounter brands, we should add the same for aussie stores
The categories in https://github.com/Javex/hotprices-au/blob/main/web/site/model/categories.js have not been updated yet, only a token one for fruit & veg to check feasibility. It probably makes sense to go through and update these to align better with how aussie products are organised by one of the stores and then map the other one across.
On mobile opening product search I see headers in the table like “Kette” instead of chain or store and also Preis and Aktionen. Those should be translated.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.