3

On Amazon, clearly there is a tree where all the leaves are the products and you can narrow down a category to find the products.

For example, what I am looking is actually under the category Cell Phones & Accessories, and then Cell Phones and then Unlocked Cell Phones.

Is there up-to-date public dataset that has the mapping between category and ASIN (Amazon Stock ID)? so one can avoid scraping a certain category page by page?

Thanks!

enter image description here

Improve this question
3
  • The answer to this SO question doesnt get you all the way to your answer but it at least should help you get a full picture of the "leaves" and maybe use the API to get which items go to each leaf.
    – Mark Silverberg
    Sep 18, 2014 at 20:00
  • Another thought (but not full answer) is instead of scraping product pages, use the Sitemaps (and downstream sitemaps) linked to from the bottom of amazon.com/robots.txt
    – Mark Silverberg
    Sep 18, 2014 at 20:04
  • @Skram, I agree it is a great idea, I tried to parse all the sitemaps and turned out I only get 200K valid product URLs in the end, which is much less than I expected.
    – B.Mr.W.
    Sep 18, 2014 at 23:38

1 Answer 1

Reset to default
2

You can use the Amazon Product API to find the category breakdown on Amazon and corresponding products 4 sale.

This link explains how items for sale are organized under the API:

http://docs.aws.amazon.com/AWSECommerceService/latest/DG/CHAP_OrganizationofItemsforSaleonAmazon.html

This is the general link to the API: http://docs.aws.amazon.com/AWSECommerceService/latest/GSG/Welcome.html

Improve this answer
1
  • It looks really promising. I am only interested in all the ASINs (15K) under the category cellphones. I will accept your answer after I figure out how to use Amazon API. Thanks
    – B.Mr.W.
    Sep 18, 2014 at 23:44

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.