8

Why don't you use OSM's API? A similar question was asked on gis: How to get a list of OSM relations (id numbers) of cities and countries only?


7

Whilst onegeology.org is great, and certainly there are a lot of European Geology WMS and some WFS services available. In this situation I think that currently (a) you might be better off going to the EGDI portal. European Geological Data Infrastructure (EGDI) is a collective project of the European Geological Surveys, and EGDI is intended to showcase all ...


5

...but extracting the hierarchical information is non-trivial. DBpedia T-Box dump is available to download as a separate file from this page. Wikidata classes and properties dumps are available to download as separate files from this page. I am searching for a database containing a hierarchical ontology of most objects. Many of the so-called upper ...


5

I suggest to try Geonames, which is a well-recognized open database of geolocalized places worldwide. Geonames links the name of places (from hotel to cities) to coordinates (longitude & latitude, in WGS84) as well as other information when available (population, zip code, ...). You can have a look of webservices based on geonames here. Among the ...


4

Can I suggest OneGeology.org. It's a portal for open geological data from around the world. It's mostly designed around their web map portal; http://portal.onegeology.org/OnegeologyGlobal/ which overlays Web Map Services (WMS) from many of the world's geological surveys. The complexity and number of layers can make it slow to load though. What I suspect ...


4

If you're fine with textual or GIS data, you'll probably find it in the NASA VIIRS Active Fire Data page. It's updated frequently and contains worldwide fire hotspots of the past 24 hours up to one week. There's also an archive for older data.


4

A quick an easy way to provide open access to your scraped data would be pushing it to GitHub or another easily accessible online repo in a text format (CSV/TSV or JSON if it's less structured -- this would also allow you to add timestamps for when data was scraped) and update it automatically. Without an explicit license to publish the data it may not be ...


4

No, the only currently supported database backend is PostgreSQL. It was chosen as it is an open source, well supported and widely available solution. Support for other backends would need to be added to the core library as new feature (CKAN uses SQLAlchemy as ORM, which would help). If someone is up for it they can check the contributing docs and get in ...


4

check (and collaborate!) at Data Packaged Core Datasets the specific datasets: https://github.com/datasets/population-city https://github.com/datasets/world-cities Both are related to https://github.com/datasets/country-codes PS: about OSM and its APIs, see also http://nominatim.openstreetmap.org/ Others: specialized datasets or building a dataset from a ...


3

I've developed an online REST service called GeoDB Cities that wraps the GeoNames data (and also leverages WikiData for translations). It should give you exactly what you need. You'll need to get the user's current GPS location (which you can do via the GeoLocation API supported by most modern browsers). Now just make a call to GeoDB to get the nearest ...


3

These sites are working for me: ftp://ftp.cs.rdg.ac.uk/pub/PETS2006/ ftp://ftp.cs.rdg.ac.uk/pub/groups/cvg/PETS2006/ Not working: http://ftp.cs.rdg.ac.uk/PETS2006/ So you'd have to replace the links in the documentation page with one of the two working sites above, or just manually download the specific files. From the documentation page: The ...


3

Check out citypopulation.de, a well-curated website of all the world's big citites and agglomerations. The guy who maintains the site (I think it is only one person, Thomas Brinkhoff - see the Terms of Use) has put a lot of thought into how to draw borders around "the cities", on how to define accurate city limits and also estimate the populations living ...


3

I received some help on it. Something along these lines with xor in Python did the job: with open('...dat', 'rb') as f: with open('...txt', 'w') as out: xor = 1 s = "" while True: c = f.read(1) if c == "" or len(c) == 0: break c = chr(ord(c) ^ xor) s += str(c) ...


3

I'm the head researcher for a commerical real estate brokerage firm. I don't know of a perfect source for what you are looking for, but here are some proxys you might try Paid option: Costar http://www.costar.com/ has what some of what you want, but they are a pay-for service. From time to time I've heard of them gifting data access for research purposes. I ...


3

Two U.S. federal options: InciWeb - Incident Information System - National Wildfire Coordinating Group (NWCG) Wildfire - Wildland Fire Information


3

I did a quick export of data from the 2014 5-year ACS of the population and median age of every ZIP code: https://numeracy.co/public/2lZ9jKZoehr


3

Nominatim has an API that gives data on at the very least the street level. You can provide a latitude and longitude and have an address returned.


2

American Fact Finder includes median age in their General Population and Housing Statistics reports; General Population and Housing Statistics for Zip Code 23662 is one such table, from the 2010 US Census. To get them all: not sure if American Fact Finder offers bulk download, but almost positive they do; if for some reason that is not an option, find a list ...


2

It seems as though right now, Qatar has open data policies in place, but are still fulfilling them on a case by case basis. They have explicitly stated on this site here: http://www.ictqatar.qa/en/qatar-digital-government/open-government/open-data the benefits of open data, and the type of data sets each department in Qatar will be fulfilling. If I had to ...


2

API (clean data) It's available at the Crime Data API end point, you have to first request a data.gov api key then you can access it on https://api.usa.gov/crime/fbi/sapi/api/agencies?api_key=<api_key> This is documented on the GitHub project crime-data-api, and the official Crime Data API page. On Dec 20, 2018, the result of the API call is 7.7MB ...


2

Opencorporates is a good start, if you tell us more about the geographies you are interested in we might be able to help more. Look also at the datasets listed here, all trade registries are free and available to download if you follow the link from their logo.


1

You can download a comprehensive file through UMich's ICPSR repository (sign up is free): https://www.icpsr.umich.edu/web/ICPSR/series/366 Here's a sample of the data – I believe the ICPSR's ToC doesn't allow publicly redistributing the full copy, but you'll get an idea of what it contains before signing up: https://docs.google.com/spreadsheets/d/...


1

For a really broad answer, you can use Wikidata via a Sparql query on the property "Academic Major". From my quick query, I think the data would need to be cleaned up a bit, and also made specific to US programs in your use.


1

If you are looking for data in the US, I would look at IPED. The Integrated Postsecondary Education Data System (IPEDS) is the Department of Education’s National Center for Education Statistics’ (NCES) core postsecondary education data collection program. Information is collected annually from all providers of postsecondary education in fundamental areas ...


1

The Internet Wrestling Database is a free resource of professional wrestling information.  http://www.profightdb.com/tos.html


1

The best solution so far came from comments. Thanks to @StanislavKralin who suggested to use public Wikidata as a source. Here's the link to SPARQL query that can be tried: http://tinyurl.com/y6wpk5q5.


1

It's a bit strange that the same unique ID can be associated with more than one name. The database schema must have a design problem. One solution might be to clean up your 50,000 transactions one day by standardizing the names associated with the IDs. Software like Open Refine can help you to normalize your data.


1

Free data (https://energy.usgs.gov/OilGas/AssessmentsData/WorldPetroleumAssessment/WorldGeologicMaps.aspx) U.S. Department of the Interior | U.S. Geological Survey | DOI Inspector General Atention! Between Caribbean and Former Soviet Union maps you can find Europe maps (in shapefile formates) ones. The projection system I guess it's geographic WGS84. With ...


1

The ISRIC (International Soil Reference and Information Centre) Soil Data Hub has world-wide soil data from multiple sources. You can search by data extent. It returned 102 search results for a rectangle drawn around Colorado. Results include a variety of information types such as carbon content, silt content, "harmonized world soil database" and many more. ...


1

The UN report The World’s Cities in 2018 lists every world city with a population of over 1 million people. World Population Review lists many cities, including cities with populations under 1 million. You would need to go through each letter of the alphabet to get them all.


Only top voted, non community-wiki answers of a minimum length are eligible