GithubHelp home page GithubHelp logo

doitlikejustin / amazon-wish-lister Goto Github PK

View Code? Open in Web Editor NEW
392.0 392.0 84.0 269 KB

Retrieve Amazon Wishlist and output to JSON, XML, or PHP Array Object

Home Page: http://www.justinscarpetti.com/portfolio/amazon-wish-lister/

License: MIT License

JavaScript 0.40% PHP 96.71% CSS 2.89%

amazon-wish-lister's People

Contributors

doitlikejustin avatar edent avatar ethanclevenger91 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

amazon-wish-lister's Issues

Only getting first page of items

I'm on the UK amazon site, and if I view wishlists on the website it loads more items as you scroll down the page. The script is only returning the items that are displayed when the page first opens, not the hidden items that you have to scroll down to see.

how to actually use it to give gifts effectivly

I am trying to use this to automate my gift giving process...
I am able to pull json data from the api - however when I follow the link - it directs me to the generic product page - when I go to the 'buy now' button I see no way to send it to the person of the wish-list...

is this expected behavior? or any Ideas on what may be the issue?

Amazon wishlist update

It would appear Amazon changed their code to not allow bots to extract info. Therefore, this no longer works...?

My ID Returns "null"

Your ID works fine:
http://www.justinscarpetti.com/projects/amazon-wish-lister/api/?id=37XI10RRD17X2
but mine returns a "null"
http://www.justinscarpetti.com/projects/amazon-wish-lister/api/?id=AT9ERHVAMVGT5

I followed you instructions from your page (http://www.justinscarpetti.com/projects/amazon-wish-lister) but my user ID did not show.
So, I went to my Profile (http://www.amazon.com/gp/pdp/profile/AT9ERHVAMVGT5) and took the 13 digit number
Q: Does the ID have to be a Seller ID or can it be a standard buyer ID?
I tried to see what would happen if I switched out my ID with your in the profile http://www.amazon.com/gp/pdp/profile/37XI10RRD17X2 and it took me to an error page
Thanks for any help!

Invalid price JSON data fixed

Hi Justin,

I was looking at your wishlist scraper, and I was able to get it to return correct price data by fixing the class names. I forked your repo -- take a look at it and see what you think.

screen shot 2014-03-19 at 4 06 36 pm

Thanks.

work with baby and wedding registries

the baby registry and wedding registry have a very similar structure, but doesn't seem to scrape correctly if I have replace the full url with the one with the registry

Picking up the wrong price

$array[$i]['price'] = pq($item)->find('span.wlPriceBold strong')->html();

The above line is where it should pick up the price for the item. What is happening is that occasionally it is picking up the Used & New price instead. The striked-out price is never picked up, only the Used & New price.

null

Thank you for the code. I been using your code for a few years to pull an Amazon wish list and it worked great.
Today I'm trying after a year and it doesn't work. I used your site to pull the same wish list but it returns only 10 items. Can you please help me with the issue?

I'm never worked on PHP, but I think this is where the issue exists.

$items = pq('.g-items-section div[id^="item_"]');
//loop through items
foreach($items as $item)

though i have a few items on the wish list, it doesn't get into the foreach.

CSV?

I was looking for something like this, but I'm not sure what to do with the various output formats you have. What would be easier for me would be a CSV file I could import into a spreadsheet. Would it be possible to add that as an option, in addition to JSON, XML, and PHP? Thanks!

null

Hi !
Nice scraper, but could you check this list:

15QUHRVU564QK

Result: null
Using your demo site to enter ID.

Regards

Returns invalid Price and Ratings JSON data

I'm in the US and the demo, as well as my test wish lists, all return incorrect price and rating data.

Example:
I'm loading the JSON output from this URL:
http://www.justinscarpetti.com/projects/amazon-wish-lister/api/?id=31PZU8RK9FP4D&format=json

Here's a snippet of one JSON object output. (You can see old-price = N/A, new price isn't set, rating isn't set, and total-ratings isn't set)

  {
    "num": 1,
    "name": "Lupine 1-Inch Red 15-22-Inch Martingale Combo Collar for Large Dogs",
    "link": "http:\/\/www.amazon.com\/dp\/B001PNK5F6\/ref=gl_it_dp_v_S_ttl\/175-1155974-2931639?_encoding=UTF8&colid=31PZU8RK9FP4D&coliid=I1IN80OT8Z6UYO",
    "old-price": "N\/A",
    "new-price": "",
    "date-added": "November 20, 2013",
    "priority": "",
    "rating": "N\/A",
    "total-ratings": "",
    "comment": "",
    "picture": "http:\/\/ecx.images-amazon.com\/images\/I\/41AbIcYrA%2BL._SL500_SL135_.jpg",
    "page": 1
  }

Amazon may have updated something recently that threw off the screen scraper

how to get a user's id

I am very new to whole of amazon api. It would be really good if you could guide me. I want a user to visit my website and retrieve his wish list of amazon. How do i go about getting his user id in the first place?

Can't find package on composer

I am trying to use this package but can't find it on composer, is it on there?

If not is it a possibility that it could be added?

Demo returns null

Just tried this demo URL:

http://www.justinscarpetti.com/projects/amazon-wish-lister/api/?id=37XI10RRD17X2

Returns null in the page

Is this broken now?

old price is always n/a

from the demo page, i enter this wishlist id: 38RNAXKYXRZHG, and even though some prices have changed since I added to my wishlist, old_price always shows 'N/A'.

Safety issues

Hi Justin,
I plan on running this script on AWS and use this as a backend for an iOS app which uses a user's wishlist. Can you tell me about the potential legal issues and if I could get IP banned for using this screen scraping tool?

Sorry I put this as an issue, I didn't know how else I could comment.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.