10
votes
Accepted
Scraping pages to get prices can be considered as OpenData
There's a big difference between “available to the public” and “belonging to the public”. By accessing a privately-owned website, you are accepting its terms and conditions. These conditions typically ...
- 555
7
votes
Accepted
Open sports data
Open Sports Data has been around for awhile, as sports have some extremely involved fans.
Here is some data, references, and resources:
General Sports
Sports Data Query Language (SDQL)
...
- 11.9k
4
votes
Open sports data
Check out data.world - a social network for data people, that are building the world’s most collaborative, abundant, and meaningful data resource.
Below are some example sports-related datasets, and ...
- 221
4
votes
How to download an online ArcGIS Feature Layer without an ArcGIS license?
You can use QGIS to save the data from this service to all supported vector file formats.
I have tried adding the url https://dservices1.arcgis.com/0MSEUqKaxRlEPj5g/arcgis/services/...
- 141
3
votes
Is there a dataset having multiple files and multiple data formats (JSON+CSV+XML) for research purpose etc.?
Open Hampton Roads' datahub.io has a number of datasets with multiple file formats. At one point I would convert them to as many as possible, so you have a lot of options, including GIS data. Here's ...
- 11.9k
3
votes
Data set for Mcdonalds
Don't know if this will be of interest to you, but some of the datasets related to McDonald's on Quandl include the following:
News Sentiment History for McDondald's corp: https://www.quandl.com/...
- 1,036
3
votes
Accepted
Implications of "For official use only"
The warning says nothing about using the data. Unauthorized activities are prohibited. Don't set up your own website or store your vacation images on their servers even if there is unfettered access ...
- 552
3
votes
methods to build your own data set from public domain data sources
First, you "stand on the shoulders of giants." Very little research or data collection is done entirely from 'scratch' (where 'scratch' corresponds to your first example). You build off of previous ...
- 629
3
votes
Visualizing what airlines fly in the US Airports
The data you are looking for is already at openflights.org/data. The reason it's not displayed as a matrix (pivot table, non-normalized, crosstab) is that there are 9'541 listed airports and 19'845 ...
- 17.6k
3
votes
Is there a site that has comprehensive list of data, along with descriptions, meta data etc?
No. Though there's various parties trying to build or assemble such a collection, I've found the external links from this wikipedia page to be quite a good start:
https://en.wikipedia.org/wiki/...
- 1,453
3
votes
Looking for dataset of pharmacy Locations in Chicago area
The NPPES (npi) database released by CMS every month is one place to look. They have a record for everyone that has been issued an NPI number, which are needed to invoice and bill medicare and ...
- 31
3
votes
API for getting data from a disease name?
Have you tried a Wolfram Alpha search. There is a lot of information there.
Wolfram|Alpha: lung adenocarcinoma
You can get this information in Mathematica as well for analysis by using the ...
- 387
3
votes
Linked Open Data Statistics
LOD Cloud has some data/statistics from its beginnings, leading up to 2014, in a variety of formats:
LOD Cloud History
Related information:
LOD Cloud explains how they mined the data for their sets, ...
- 11.9k
3
votes
People check-in Dataset
You can find a Gowalla dataset at SNAP repository
https://snap.stanford.edu/data/loc-gowalla.html
Gowalla is a location-based social networking website where users share their locations by ...
- 41
3
votes
What is the simplest way to gather twitter data ongoing?
Maybe this tutorial does what you want.
"How to Save Tweets for any Twitter Hashtag in a Google Sheet"
http://www.labnol.org/internet/save-twitter-hashtag-tweets/6505/
I have used an older version ...
- 1,227
3
votes
Accepted
Where I should store (public) dataset for opensource project?
What makes you think storing data on GitHub is an abuse of GitHub?
It most certainly is not. GitHub showcases Open Data repositories as one of its features.
So use GitHub, you already are anyways.
If ...
- 11.9k
3
votes
Accepted
Site that provides up to date list of programming languages/frameworks to open source repositories using it?
Open Hub has something almost exactly like this, although I don't think there are specific pointers that say "we use this code, like this, here".
Firefox's profile profile shows some of the data ...
- 11.9k
3
votes
Datasets for daily maximum and mimimum temperature of a specific geographic area?
There are a couple of datasets at NOAA's National Centers for Environmental Information that can help. NDFD is good, but it is based on forecast model output and not station data ("ground truth"). For ...
- 31
3
votes
How to find the wikidata ID of a DBpedia concept?
Q1: Are all DBpedia concepts associated with its relevent wikidata ID?
Those kind of links are usually generated by the people on either side into the direction of the other side. Since it is ...
- 131
2
votes
Accepted
Where can I find natural language artifacts (requirements document, design documents, change requests) of open source software?
Thu Ubuntu linux distribution is developed in the open.
You might already know that not only the source code of the linux kernel is open-source (and of course developed by a whole lot of other ...
- 1,227
2
votes
Where can I find natural language artifacts (requirements document, design documents, change requests) of open source software?
Try this page: under the Natural Language section.
- 667
2
votes
Where to Find Data....Project Idea
The US Energy and Information department keeps a historical weekly dataset on gasoline prices by grade.
https://www.eia.gov/petroleum/gasdiesel/xls/pswrgvwall.xls
Here is another link on their site ...
- 8,647
2
votes
Accepted
Sierra Leone Ethnic Groups - Shapefile
Google search:african ethnic groups GIS
First item: ArcGIS.com | Feature Service - Ethnic Groups in Africa
- 387
2
votes
Scraping pages to get prices can be considered as OpenData
I think it depends of the nature of the site, not only the terms and conditions. In the case of privately owned health medicine information, it could be an exception because of the nature itself of ...
- 121
2
votes
Accepted
Open Data Portal/Software for Live Measurements: is there any?
usual suspects:
CKAN
JKAN
Plenario.io seems to be something along what you want...but I may be mistaken here
NASA seems like they will/do have a solution for this: they publish vast quantities ...
- 11.9k
2
votes
Data set for Mcdonalds
Statista has a number of datasets about McDonald's, you can cherry pick through here:
Statistics and facts on McDonald's
- 11.9k
2
votes
What is the simplest way to gather twitter data ongoing?
Would a database like this one be helpful? See https://www.quandl.com/data/TWITTER. It shows official Twitter statistics for 100,000 companies including followers, following, favorites, tweets and ...
- 1,036
2
votes
Open sports data
There's a bunch more sports data sets constantly being added to listen on this page at Sports-Statistics.com, including Fifa datasets, soccer datasets and APIs, cricket, baseball, f1 etc.
aside from ...
2
votes
Sports Clubs & Facilities
A handful of local governments offer datasets like this:
Recreational facilities in San Francisco: https://data.sfgov.org/d/z76i-7s65
Various datasets in Denver:
https://www.denvergov.org/opendata/...
- 523
2
votes
How might I go about linking databases of business records to ratings data (such as yelp or google places)?
BBB &Yelp both have Apis available
https://developer.bbb.org
https://www.yelp.com/developers
Only top scored, non community-wiki answers of a minimum length are eligible