javex / hotprices-au Goto Github PK

There's a latest-canonical that has all combined data. Make it available and update the docs.

If there's a space in the search term it breaks URLs when e.g. pasting them so the part query should be URL encoded

Searching for Arnott caramel crowns only turns up coles but woolies has it too. Why is it missing?

I have noticed on the Coles page, that you can set your location for e.g. click and collect. I have also noticed that if you set your location to a different store, you get different prices for some items e.g. bananas. Not surprising because location does affect availability of things in different locations.

I couldn't see anything in the code that attempts to set headers, cookies, request params etc that might attempt to gather prices from different store/locations. Is this something you have attempted?

When re-running analysis the code should not break things like price history if the same scraped snapshot is used (i.e. we didn't re-scrape, just re-analyse). However, at the moment I've noticed in some cases this breaks in odd ways, not sure why. For example, even though the items are all there, the prices changes page somehow filtered out all items, possibly because of the price history got cleared. I haven't reproduced it yet so I'm not sure what exactly is happening there.

The root html tag has a lang="de" attribute we should update

There didn't seem to be a straightforward way so I skipped it for the initial version. Maybe a simple string match will do.

https://mastodon.au/@conorodowd/111170617108897122

Current unit filters still make some assumptions e.g. "stk" instead of "ea".

Did a hotfix of Coles scraper in b6f0421 but obviously that's going to break again so we need to grab the correct version dynamically when starting up.

Most of the work is already done: https://aus.social/@NotADropbear/111175009841344799, will need to be added to the site tho

The original heissepreise has support for Dicounter brands, we should add the same for aussie stores

The categories in https://github.com/Javex/hotprices-au/blob/main/web/site/model/categories.js have not been updated yet, only a token one for fruit & veg to check feasibility. It probably makes sense to go through and update these to align better with how aussie products are organised by one of the stores and then map the other one across.

On mobile opening product search I see headers in the table like “Kette” instead of chain or store and also Preis and Aktionen. Those should be translated.