17

I'm searching for product data, right now I only need smartphone data. I need like every smartphone name and specifications like width, CPU speed, etc. Now I found some reference to semantics3.com which would be perfect, but the only problem is is that they don't allow you to download the data. For multiple reasons I really need to be able to download the data.

Does anybody have more info on this? Is there someone who provides a downloadable dataset like that? Or maybe do the manufactures like Samsung etc offer their smartphone data themselves? I couldn't find any real info on this topic so help would be very welcome. If there is nothing downloadable, would it be legal to scrape it?

Okay so lot's of people recommend scraping for example wikipedia and dbpedia etc. My issues with that however is the fact that the data is not really good organized and also not very complete. So my main question now be 1: "Do manufactures offer their data?(Like samsung offering a list of smartphones with their specs" 2: "Is scraping the website of a webshop or smartphone-comparision website legal, if they have not defined anything about scraping in the Terms?"

  • They allow you to download the data (for free) at 1000 requests per day. How fast do you need it? – philshem Apr 27 '15 at 9:52
  • No they don't, you may only temporary cache it but you may not download it, e.g. keep the results from the API stored. – vincent kleine Apr 27 '15 at 15:45
  • You might try contacting the folks from Phone Scoop -- they have a Phone Finder tool that lets you search for cell phones by feature, which might have the data that you're trying to get : phonescoop.com/phones/finder.php . Their Terms of Use prohibits derivative works & automated scraping, but they might give you a dump. (and if you strip the descriptive text, the objective data should be free from copyright restrictions ... the only issue is if they have an upstream source that they have a contract with that limits their distribution.) But you won't know unless you ask. – Joe Apr 28 '15 at 11:40
10
+50

In the future, Wikidata will be the best, but for now, the most pragmatic solution is to use DBpedia.

  1. Go to the Smartphone page of DBpedia
  2. Scroll to the is dbpprop:type of section
  3. On the right is a list of 300 smartphones
  4. Each of these pages has a lot of information like CPU speed, weight, battery, storage, etc
  5. This information is available as RDF/JSON/CSV. Here is an excerpt of the CSV:

Smartphone DBpedia CSV

The list of smartphones is also available as RDF/JSON/CSV, so it is very easy to download all of this information programmatically.

License: Creative Commons Attribution-ShareAlike 3.0 Unported License

  • could you please elaborate on that "future"? – Blauhirn Dec 14 '18 at 22:22
  • @Blauhirn: We are currently doing our best to convert information from Wikipedia infoboxes to Wikidata property values using tools such as HarvestTemplates and QuickStatements, but it is far from complete. DBpedia is still more complete, compare for instance live.dbpedia.org/page/HTC_Wildfire and wikidata.org/wiki/Q1566050 – Nicolas Raoul Dec 16 '18 at 4:25
7

I would suggest looking into scraping/programmatically downloading this data from Wikipedia. The data can be found in the right infobox of device pages (such as http://en.wikipedia.org/wiki/IPhone_3G). You can get a list of devices at http://en.wikipedia.org/wiki/Smartphone#Devices and also a comparison table which might have everything you want at http://en.wikipedia.org/wiki/Comparison_of_smartphones

Also see:

3

this stackexchange question has a lot of answers in regards to what you seek, but the most important one being the wurfl (wireless universal resource file) database:
http://sourceforge.net/projects/wurfl/files/WURFL%20Database/

https://stackoverflow.com/questions/6812293/is-there-any-information-database-which-lists-all-of-the-mobile-devices-and-spec

  • Could you please post an except showing what info is available for one device? Thanks! – Nicolas Raoul Apr 27 '15 at 6:50
  • The list of properties does not contain width or CPU speed. This database seems to be about software capabilities. See wurfl.sourceforge.net/help_doc.php – Nicolas Raoul Apr 27 '15 at 6:58
  • the other links provided have that data – albert Apr 27 '15 at 12:14
  • A link is not considered a good answer. Especially a link to a page that contains various answers. – Nicolas Raoul Apr 27 '15 at 15:32
  • a) your answer has links b) i already know this c) why don't you let the person asking the question respond d) nothing is ever good enough for you – albert Apr 27 '15 at 19:55
2

I would also recommend the same data source as Skram, but to get the list of articles here is what I recommend: Get it from Wikidata.

Wikidata has an item called smartphone model.

413 items have this model, which means they are smartphones (not counting the 11 false positives that are not in the main namespace):
https://www.wikidata.org/wiki/Special:WhatLinksHere/Q19723451

The cleanest way to get the list of items that are an instance of smartphone model is like this:
http://wdq.wmflabs.org/api?q=CLAIM[31:19723451] (JSON)

Once you have the items, you can get a few properties (like brand) directly from Wikidata, but unfortunately most of the infobox properties have not made it to Wikidata yet, so a bit of Infobox scraping is still needed at this point.

2

I was searching and no good options for this. so made a free restful api to get mobile device descriptions. 6700+ mobile device descriptions available now. you can use it in your applications.

but with this you cannot download the list but you can get the specs of a mobile. or i can create another method to get all devices under brand like that ;)

here is the website https://fonoapi.freshpixl.com/

and github here https://github.com/shakee93/fonoapi

i just made the php client to access the api. someone can help with other languages too..

Please drop me a message if you can help make it better. we help the community from community.

  • Can you please elaborate regarding your data source? (how dated it is? etc.) – N.N. Mar 29 '16 at 11:03
  • I can confirm that this is a very useful database. There is also new data added, although I have also noticed the weight of the Samsung S8 has been removed in the last few days. – Henry's Cat Jul 14 '17 at 12:23
2

To find all Samsung items please open this link http://www.samsung.com/ae/data-support/search/autocomplete?mType=json&q=samsung

1

The unique "primary key" of mobiles phones is the Type Allocation Code (TAC), which comes from the Groupe Speciale Mobile Association (GSMA):

Type Allocation Codes (TAC) are used to create International Mobile Equipment Identity numbers (IMEIs) for wireless devices. The IMEI is a unique 15 digit number and plays an important role in ensuring proper device operation on the network. The IMEI is defined and required by the GSM standards and is in daily use in networks globally.

The TAC is the first 8 digits of the IMEI code: 49-015420-323751

(source)

Unfortunately, as far as I know, the datasets are only available to members.


There are some efforts to compile this data in an open dataset, but the range and technical description seems limited. See, for example:

Public Research TAC Database: Last update was in 2011 unfortunately. Also it does not seem to contain info like width/CPU, only TAC number and phone name. Excerpt:

33010067;   Alcatel;    Radiotelephone ONE TOUCH POCKET   
-2

You can check smarphone database

We're looking for long answers that provide some explanation and context. Don't just give a one-line answer; explain why your answer is right, ideally with citations. Answers that don't include explanations may be removed.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.