Comments (12)
Are Amazon and BestBuy supported now?
from inventory-hunter.
Sorry, i cannot answer that. I was just trying to find an AMD card and found these new ones out there and added them to my own .yaml files.
I am also a newbie at this so my experience level is rather low.
Just thought I would attempt to help out someone that has taken the time and trouble to put something like this together. AMD's launch has been by far worse than Nvidia's 3000 series, which is so hard to believe.
Thank you Eric for all the work you've done and for sharing it with the community.
from inventory-hunter.
Fair enough - went and looked and the python does not have support for either...yet.
And I echo @bachalf 's gratitude...thank you Eric for making this.
from inventory-hunter.
And I echo @bachalf 's gratitude...thank you Eric for making this.
I second that. Anything to give us an edge against these bot bastages.
from inventory-hunter.
I found that Best Buy has their own API for searching their stores or online. You all probably already knew this, but thought i would throw this out there. I guess others have tried using python scrapers against Best Buy with no avail. Here is the link to Best Buys API. You have to sign up to get a key first before you can start using the the API.
https://bestbuyapis.github.io/api-documentation/#overview
from inventory-hunter.
Hi folks,
Rather than sticking an issue I thought I'd tag a question on to here...
As a UK-based Python and Docker n00b (currently on some AWS courses and we've been getting to grips with these tools, so it's actually quite fun to get stuck into something like this), naturally I'm going to be using different, UK-based websites.
I've set up my config yaml files for each of the sites. My query is, as I'm not using BestBuy, Microcentre, BHPhoto etc, do I need to replace all of these classes in the scraper.py file and create new ones for the sites I'm using, or could I just delete them and run with the generic one and see how I get on?
Thanks for everyone's time reading, really good way to get my toes into this sort of thing (and hopefully, cop a 1660 Super for my daughter's PC at the same time, lol!)
from inventory-hunter.
Thank you all for the kind words!
I am currently working on adding support for Best Buy and Amazon. Best Buy is a bit different from other retailers in that they can detect that a bot is trying to access their website. Fortunately, I have a solution in mind for how to get around it. I have yet to test Amazon, but I suspect they have a similar protection in place.
@bachalf Thanks for these links. I will add them to the repo.
@adamseab Can you tell me which retailers you are using in the UK?
The specific scraper classes such as NeweggScrapeResult
are intended to detect pricing and look in a specific place for the "add to cart" button. There's also a generic class called GenericScrapeResult
that searches the entire web page for the "add to cart" text. The generic class is used for websites that don't already have a specific class defined. It works most of the time, but it can break in some scenarios (e.g. when other products are promoted on the same webpage).
from inventory-hunter.
@EricJMarti Thank you for the reply! This is such a great project to dabble with :)
I've created config files for...
AWD-IT, Box, CCL, Currys, Overclockers, Scan and TechNextDay - I haven't actually got it running yet. I've been trying to get this running on a headless Raspberry Pi Zero (just so I can leave it ticking over somewhere in the house), but I think the Zero doesn't like Docker, so I'm going to re-try with a Pi 4B, or just let it run on the PC when I'm working :)
Thanks again!
from inventory-hunter.
hi @EricJMarti thx for this great tool!
I'm a spanish user and I want to use this with a spanish website .I've read that there is the GenericScrapeResult and I tried modifying that with the word 'Comprar' that I'm sure that is in the webpage, but the scraper says not in stock. I don't know if maybe I'm running the container with bad configuration or maybe I 've to say that I want to use the genericscraper in some way??, can you put some light into this plis?? thx a lot
from inventory-hunter.
@EricJMarti
With the 6900 XT coming out on the 8th of Dec, is there a way to get the links to the carss that will be available ahead of the release that way the scrapers can be ready and running prior to the cards being available giving us honest peeps a better chance?
from inventory-hunter.
Just added Best Buy and Amazon support. Please git pull
the latest code, rebuilt the Docker image, and restart your running Docker containers.
from inventory-hunter.
@EricJMarti Thank you for the reply! This is such a great project to dabble with :)
I've created config files for...
AWD-IT, Box, CCL, Currys, Overclockers, Scan and TechNextDay - I haven't actually got it running yet. I've been trying to get this running on a headless Raspberry Pi Zero (just so I can leave it ticking over somewhere in the house), but I think the Zero doesn't like Docker, so I'm going to re-try with a Pi 4B, or just let it run on the PC when I'm working :)
Thanks again!
Any chance you can share configs/code changes for Uk sites please ?
from inventory-hunter.
Related Issues (20)
- Can't read correct Amazon price due to NBSP
- email alerter failed to alert HOT 1
- Amazon track only prime shipping
- Can I use selenium to enter the verification code and submit HOT 1
- "0 in stock" false positive on Newegg
- best buy failing
- Adding Overclockers link doesn't trigger notification
- Adding scan.co.uk give Access denied
- Add custom words
- (UK) Is this working correctly? HOT 1
- How can I know itβs working? Possible to restart?
- error: FILENAME does not exist or is not a regular file HOT 2
- TypeError: argument of type 'NoneType' is not iterable
- Scrapper for samsclub reporting false positive
- scrape failed: caught exception during request: 'NoneType' object has no attribute 'text' HOT 2
- Synology DSM Execution Command HOT 1
- Role mentions in Discord
- armv6
- bash: docker_run.bash: command not found
- Allerts Issue HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from inventory-hunter.