The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Hot answers tagged

20

The European Centre for Medium-Range Weather Forecasts (ECWMF) has a rather impressive data collection available via batch scripts, downloadable files or even tailored formats. The first two are freely available (under specific conditions) for non-commercial research but registration is necessary. Just to give an example, the GRIB dataset lists 4115 ...


13

For international and historical data, and for a modest number of requests per day, I personally recommend the Wunderground API. Once you register, you can get 500 free requests per day. The URL for historical data will look like this: http://api.wunderground.com/api/Your_Key/history_YYYYMMDD/q/CA/San_Francisco.json I've posted a sample code (python 2.7) ...


10

In the future, Wikidata will be the best, but for now, the most pragmatic solution is to use DBpedia. Go to the Smartphone page of DBpedia Scroll to the is dbpprop:type of section On the right is a list of 300 smartphones Each of these pages has a lot of information like CPU speed, weight, battery, storage, etc This information is available as RDF/JSON/CSV. ...


9

The Global Administrative Areas dataset is available as a shapefile or file geodatabase; http://gadm.org/ Also as several other handy formats (only available when you download an individual country though); Geopackage Google Earth KMZ R SpatialPolygonsDataFrame Given you're interested in Europe it might be best to download the whole globe (found here ...


9

I found the spatial history project, which give month to month changes of the front lines. The article covers all interesting information and you can download the dataset (after the first figure) - viz., EuropeanBorders_WWII.zip (~260 MB).


7

Two resources you might consider are: The European Social Survey The Comparative Study of Electoral Systems


7

The OpenCorporates project at https://opencorporates.com/ has more than 2.5 million entries for companies registered in the Netherlands as well: https://opencorporates.com/companies/nl APIs and developer information for the project can be found at http://api.opencorporates.com/


7

I would suggest looking into scraping/programmatically downloading this data from Wikipedia. The data can be found in the right infobox of device pages (such as http://en.wikipedia.org/wiki/IPhone_3G). You can get a list of devices at http://en.wikipedia.org/wiki/Smartphone#Devices and also a comparison table which might have everything you want at http://en....


7

london.gov has a crime dataset for 2014. It breaks down crime on a per month basis/number of incidents: http://data.london.gov.uk/dataset/recorded-crime-summary-data-london-lsoa-level


7

For US data, the NHGIS project is by far the best source. From their home page: The National Historical Geographic Information System (NHGIS) provides, free of charge, aggregate census data and GIS-compatible boundary files for the United States between 1790 and 2014. I also found that the Association of American Geographers runs this Historical GIS ...


7

Whilst onegeology.org is great, and certainly there are a lot of European Geology WMS and some WFS services available. In this situation I think that currently (a) you might be better off going to the EGDI portal. European Geological Data Infrastructure (EGDI) is a collective project of the European Geological Surveys, and EGDI is intended to showcase all ...


7

A simple google of "municipality 2017 shapefile of Luxembourg" gives me this link which provides this shapefile. In general the http://www.europeandataportal.eu is a good place to look for European data.


6

UK open data is available. See: http://data.gov.uk/dataset/metoffice_uklocs3hr_fc hourly observations for approximately 150 UK observing stations, daily site specific and 3 hourly site specific forecasts for approximately 5000 UK locations.


6

openkvk is a project to provide Dutch company data. The project has been running since 2009 and there's a mature API.


6

I think you may find European DEM data useful. It can be retrieved with this link : http://www.eea.europa.eu/data-and-maps/data/eu-dem This not really Open Data, rather free data that needs you to mention you used it, but I'm unsure I understood exactly what you need, because you mix the need for data and the need for extracted info from your data. To find ...


5

I have written some sample code for directly building a CSV starting with a given date and ending with a given date: https://github.com/joshmalina/pollution/blob/master/notebooks/Build_historical_weather_data.ipynb The city is currently set to Beijing, but you can change that easily. The data will also be cleaned of null values.


5

Here is my obligatory pointer to overpass turbo, a "graphic" way to explore the data quality for certain POIs (points of interest) in the OpenStreetMap database. This examplary query for amenity=restaurant in Rome (patience: the query takes several seconds to execute) yields (probably incomplete) 543 locations with varying metadata. How-to: For a given POI,...


5

I would take a look at these sources: OpenStreetMap (OSM) All about POIs (points of interest) in OSM Question on help.OSM about extracting POIs from a region Foursquare POI API (aka Venues) (note: not open data) Yelp Search / Business APIs (note: not open data)


5

Eurostat is a European institution which collects data from its member country's statistical institutions and gathers data itself, amongst others stats on the production of vegetables. Here are the stats for celery and celeriac production across all EU countries. A summation across all countries for the years 2000-2011 shows the following production in 1000 ...


5

There are several related opendata.stackexchange related questions to weather in Europe. Here is a compendium of questions/answers: Weather radar data for Europe, especially Latvia Database with monthly climate/weather data by country What data source for cloud coverage available with forecast and how to parse it? Historical Weather Forecasts How might ...


5

You should check out http://worldclim.org/. They have crunched a variety of data sets to produce average temperature and rainfall for each month of the year for most of the earth's surface at a sub-1km resolution. The data is downloadable as raster GIS files that you can load into PostGIS or desktop GIS packages. If you want the underlying data that they ...


5

The WHO provides global data for many cities. It doesn't seem to break down the overall air pollution into molecular components, though. Website with details Ambient (outdoor) air pollution database, by country and city (Excel file) Many individual cities or regions provide air quality data. A short example, although basically every city or region will ...


5

For Europe you can find historical data in this database: http://ec.europa.eu/eurostat/web/crime/database not with lat lon but rather NUTS-3 regions. you can obtain coordinates for the regions using geopy


5

I think a good source would be the COSMAS II-Korpora from the Institut für Deutsche Sprache. It seems there is free registration and downloads for non-commercial use.


5

If you want an official source for European administrative GIS data, check Eurostat's website. Eurostat is the statistical office of the European Union. They gather (GIS) data from member states. You will find among other the NUTS zones (administrative units), communes and commune centroids for different scales. The last reference year is 2013, but the data ...


4

German climate data is available at the DWD.


4

There are a large number of datasets covering international areas at the U.S. National Oceanographic and Atmospheric Administration (NOAA). You can see some of the global daily indicators at http://www.ncdc.noaa.gov/most-popular-data#ghcn and elsewhere on that page. I think the Global Historical Climatology Network-Daily (GHCN-D) is the data you are seeking....


4

For Great Britain, the Food Standards Authority make available an API which has the food hygiene ratings for every place that serves food in the local authorities that operate the scheme. Whilst this data does include places not normally open to the public (there are some office canteens, schools, etc.) their data is reasonably well classified and free to ...


4

The UK Department for Transport (DFT) provides a traffic data set for the city of London, for 2000 to 2013. Main page London About Metadata PDF There are two main data sets: AADF - Annual average daily flow AADF figures give the number of vehicles that will drive on that stretch of road on an average day of the year. For information on how AADFs are ...


4

For the UK, you can find Crime Datasets/Statistics at data.gov.uk published by Office for National Statistics licensed under Open Government Licence. Or directly at ONS site.


Only top voted, non community-wiki answers of a minimum length are eligible