10 votes
Accepted

Scraping pages to get prices can be considered as OpenData

There's a big difference between “available to the public” and “belonging to the public”. By accessing a privately-owned website, you are accepting its terms and conditions. These conditions typically ...
scruss's user avatar
  • 555
7 votes
Accepted

Open sports data

Open Sports Data has been around for awhile, as sports have some extremely involved fans. Here is some data, references, and resources: General Sports Sports Data Query Language (SDQL) ...
albert's user avatar
  • 11.9k
4 votes

Open sports data

Check out data.world - a social network for data people, that are building the world’s most collaborative, abundant, and meaningful data resource. Below are some example sports-related datasets, and ...
data.world's user avatar
4 votes

How to download an online ArcGIS Feature Layer without an ArcGIS license?

You can use QGIS to save the data from this service to all supported vector file formats. I have tried adding the url https://dservices1.arcgis.com/0MSEUqKaxRlEPj5g/arcgis/services/...
Michel Stuyts's user avatar
3 votes

Is there a dataset having multiple files and multiple data formats (JSON+CSV+XML) for research purpose etc.?

Open Hampton Roads' datahub.io has a number of datasets with multiple file formats. At one point I would convert them to as many as possible, so you have a lot of options, including GIS data. Here's ...
albert's user avatar
  • 11.9k
3 votes

Data set for Mcdonalds

Don't know if this will be of interest to you, but some of the datasets related to McDonald's on Quandl include the following: News Sentiment History for McDondald's corp: https://www.quandl.com/...
user37317's user avatar
  • 1,036
3 votes
Accepted

Implications of "For official use only"

The warning says nothing about using the data. Unauthorized activities are prohibited. Don't set up your own website or store your vacation images on their servers even if there is unfettered access ...
pndfam05's user avatar
  • 552
3 votes

methods to build your own data set from public domain data sources

First, you "stand on the shoulders of giants." Very little research or data collection is done entirely from 'scratch' (where 'scratch' corresponds to your first example). You build off of previous ...
LJB's user avatar
  • 629
3 votes

Visualizing what airlines fly in the US Airports

The data you are looking for is already at openflights.org/data. The reason it's not displayed as a matrix (pivot table, non-normalized, crosstab) is that there are 9'541 listed airports and 19'845 ...
philshem's user avatar
  • 17.6k
3 votes

Is there a site that has comprehensive list of data, along with descriptions, meta data etc?

No. Though there's various parties trying to build or assemble such a collection, I've found the external links from this wikipedia page to be quite a good start: https://en.wikipedia.org/wiki/...
Swier's user avatar
  • 1,453
3 votes

Looking for dataset of pharmacy Locations in Chicago area

The NPPES (npi) database released by CMS every month is one place to look. They have a record for everyone that has been issued an NPI number, which are needed to invoice and bill medicare and ...
hackg's user avatar
  • 31
3 votes

API for getting data from a disease name?

Have you tried a Wolfram Alpha search. There is a lot of information there. Wolfram|Alpha: lung adenocarcinoma You can get this information in Mathematica as well for analysis by using the ...
Edmund's user avatar
  • 387
3 votes

Linked Open Data Statistics

LOD Cloud has some data/statistics from its beginnings, leading up to 2014, in a variety of formats: LOD Cloud History Related information: LOD Cloud explains how they mined the data for their sets, ...
albert's user avatar
  • 11.9k
3 votes

People check-in Dataset

You can find a Gowalla dataset at SNAP repository https://snap.stanford.edu/data/loc-gowalla.html Gowalla is a location-based social networking website where users share their locations by ...
Bruno Moreno's user avatar
3 votes

What is the simplest way to gather twitter data ongoing?

Maybe this tutorial does what you want. "How to Save Tweets for any Twitter Hashtag in a Google Sheet" http://www.labnol.org/internet/save-twitter-hashtag-tweets/6505/ I have used an older version ...
knb's user avatar
  • 1,227
3 votes
Accepted

Where I should store (public) dataset for opensource project?

What makes you think storing data on GitHub is an abuse of GitHub? It most certainly is not. GitHub showcases Open Data repositories as one of its features. So use GitHub, you already are anyways. If ...
albert's user avatar
  • 11.9k
3 votes
Accepted

Site that provides up to date list of programming languages/frameworks to open source repositories using it?

Open Hub has something almost exactly like this, although I don't think there are specific pointers that say "we use this code, like this, here". Firefox's profile profile shows some of the data ...
albert's user avatar
  • 11.9k
3 votes

Datasets for daily maximum and mimimum temperature of a specific geographic area?

There are a couple of datasets at NOAA's National Centers for Environmental Information that can help. NDFD is good, but it is based on forecast model output and not station data ("ground truth"). For ...
threeiem's user avatar
3 votes

How to find the wikidata ID of a DBpedia concept?

Q1: Are all DBpedia concepts associated with its relevent wikidata ID? Those kind of links are usually generated by the people on either side into the direction of the other side. Since it is ...
np00's user avatar
  • 131
2 votes
Accepted

Where can I find natural language artifacts (requirements document, design documents, change requests) of open source software?

Thu Ubuntu linux distribution is developed in the open. You might already know that not only the source code of the linux kernel is open-source (and of course developed by a whole lot of other ...
knb's user avatar
  • 1,227
2 votes

Where can I find natural language artifacts (requirements document, design documents, change requests) of open source software?

Try this page: under the Natural Language section.
Bulrush's user avatar
  • 667
2 votes

Where to Find Data....Project Idea

The US Energy and Information department keeps a historical weekly dataset on gasoline prices by grade. https://www.eia.gov/petroleum/gasdiesel/xls/pswrgvwall.xls Here is another link on their site ...
Andrew - OpenGeoCode's user avatar
2 votes
Accepted

Sierra Leone Ethnic Groups - Shapefile

Google search:african ethnic groups GIS First item: ArcGIS.com | Feature Service - Ethnic Groups in Africa
Edmund's user avatar
  • 387
2 votes

Scraping pages to get prices can be considered as OpenData

I think it depends of the nature of the site, not only the terms and conditions. In the case of privately owned health medicine information, it could be an exception because of the nature itself of ...
Offray's user avatar
  • 121
2 votes
Accepted

Open Data Portal/Software for Live Measurements: is there any?

usual suspects: CKAN JKAN Plenario.io seems to be something along what you want...but I may be mistaken here NASA seems like they will/do have a solution for this: they publish vast quantities ...
albert's user avatar
  • 11.9k
2 votes

Data set for Mcdonalds

Statista has a number of datasets about McDonald's, you can cherry pick through here: Statistics and facts on McDonald's
albert's user avatar
  • 11.9k
2 votes

What is the simplest way to gather twitter data ongoing?

Would a database like this one be helpful? See https://www.quandl.com/data/TWITTER. It shows official Twitter statistics for 100,000 companies including followers, following, favorites, tweets and ...
user37317's user avatar
  • 1,036
2 votes

Open sports data

There's a bunch more sports data sets constantly being added to listen on this page at Sports-Statistics.com, including Fifa datasets, soccer datasets and APIs, cricket, baseball, f1 etc. aside from ...
David Jackson's user avatar
2 votes

Sports Clubs & Facilities

A handful of local governments offer datasets like this: Recreational facilities in San Francisco: https://data.sfgov.org/d/z76i-7s65 Various datasets in Denver: https://www.denvergov.org/opendata/...
Hayden Schiff's user avatar
2 votes

How might I go about linking databases of business records to ratings data (such as yelp or google places)?

BBB &Yelp both have Apis available https://developer.bbb.org https://www.yelp.com/developers
Aurielle Perlmann's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible