Hot answers tagged

6 votes
Accepted

Looking for open source LGBT datasets

There is not a lot of good nation-wide data on LGBT topics. Here are a few I was able to find for you. Some of them are already in CSV/TSV and/or Excel format (and therefore trivial to convert to CSV) ...
Mark Silverberg's user avatar
4 votes
Accepted

Looking for sample lat/long data of thousands of US addresses

Some time on Google brought up this list of 8902 Starbucks around the US: http://www.gpspassion.com/forumsen/topic.asp?TOPIC_ID=67416 Here it is as a gist: https://gist.github.com/dankohn/...
Dan Kohn's user avatar
  • 181
4 votes

How can I work with a 4GB csv file?

I am a big fan of tad which crunches these kind of files easily.
Steven's user avatar
  • 141
4 votes

Is it possible to download worldometer COVID-19 country data?

I don't think it is possible (from a read of faq, about) there seems to be no way to download data. Have a look at alternative data sources in another question, but of these I would use the Johns ...
Marcus D's user avatar
  • 1,104
4 votes

How can I work with a 4GB csv file?

I recently had to parse the 6GB NPPES file and here is how I did it: $ wget http://download.cms.gov/nppes/NPPES_Data_Dissemination_July_2017.zip $ unzip NPPES_Data_Dissemination_July_2017.zip $ split ...
Andrei Sura's user avatar
3 votes

College Scorecard API call returns all data in .json but only two fields in .csv

Many apologies for this issue, and also for this slow response. Open Data Maker hasn't had much work done on it recently, but we're currently in the process of transitioning it to new maintainers. ...
yoz's user avatar
  • 141
3 votes

Trying to link ZIP code to core-based statistical area

I think that you can get what you want from two resources: The R package noncensus contains a data set called zip_codes that lists the following features for each zip code: zip. U.S. ZIP (postal) ...
G5W's user avatar
  • 656
3 votes
Accepted

Master Song Database containing popular titles and artists

If you're looking for some other options, I suggest checking out the Wikipedia page on this topic. You can find it at the link below: List of online music databases I have not used them all, but ...
Lisa Beck's user avatar
  • 146
3 votes

Master Song Database containing popular titles and artists

The Million Song Dataset has this information as well as other features about the song itself. You can download the entire 300GB file as a flat file, or download a 1% sample. The full field list can ...
Amos Budde's user avatar
2 votes

How can I work with a 4GB csv file?

You can try nitroproc. It's currently a beta version I think, but allows to sort/summarize/filter/etc. It's free.
bob's user avatar
  • 21
2 votes

Australia Hotel/Motel Data

DMOZ is a directory and naturally is great for tasks like this. You're going to have to do all of the leg work though: Search DMOZ for Australia + Hotel
albert's user avatar
  • 11.9k
2 votes

Postal codes of China

They are hard to find them online but here is the list I suggest for you: http://www.gfk-geomarketing.com/en/digital_maps/china.html I suggest you to contact the Geography department at any ...
PROBERT's user avatar
  • 1,295
2 votes

Is there a set of data points available to draw an outline of the coast of the British Isles?

The European Environment Agency hosts shape files of European countries. The British Isles: http://www.eea.europa.eu/data-and-maps/data/eea-reference-grids-2/gis-files/great-britain-shapefile This ...
Swier's user avatar
  • 1,453
2 votes

Is there a set of data points available to draw an outline of the coast of the British Isles?

Check OpenStreetMaps Overpass API, which is geared at data consumers. The outline of British Isles is definitely available in OSM. It boils down to how to extract it from the database. After some ...
Grimaldi's user avatar
  • 488
2 votes

Is it possible to download worldometer COVID-19 country data?

to clear philshem's comment up for the non-programmers, here's what to do: Right click anywhere and open inspect element. Then click the search button at the top right and with the top search bar (not ...
Oscar's user avatar
  • 21
2 votes

Looking for sample lat/long data of thousands of US addresses

Try this one. It is HUD's dataset on inspection scores for multi-family dwellings providing subsidized housing. There are 20,000 addresses with lat/lon across the US. https://www.huduser.gov/portal/...
Andrew - OpenGeoCode's user avatar
1 vote
Accepted

How are the Human Rights Data Analysis Group (HRDAG) data delimited?

It is a tab-delimited file. You can read it in with the the readr package. For instance: readr::read_delim( '/Path-to-Folder/SL-TRC-data.csv', delim = '\t')
Kotebiya's user avatar
  • 2,959
1 vote

Time zones and country ISO codes

There is IANA tzdb with a list of all timezones. It's quite complex and changing since timezones change too, for example in Russia timezones changed several times during the last 20 years.
Ivan Begtin's user avatar
1 vote

Get list of all villages/towns in India

Yo can get all the required data from official website data.gov.in. The data seems to be divided into state level, so maybe you will have to download ~31 csvs'. They have csv, ods, etc. they also ...
Itachi's user avatar
  • 111
1 vote

How can I flter data from a stream of very large text files?

Have you looked at AWS Athena yet? It doesn't require any additional storage (besides the existing S3 bucket) and you can query the data (all of it) whenever you want - for example if your query ...
philarmour's user avatar
1 vote
Accepted

Sensor data trains dataset

Not sure if this dataset matches your requirements completely. At least it reads as a dataset from a German logistics company having sensors mounted on shipping containers. The description is in ...
ulrich's user avatar
  • 331
1 vote

Trying to link ZIP code to core-based statistical area

https://www.huduser.gov/portal/datasets/usps_crosswalk.html This has what you need. CBSA to Zip Code mapping.
user22733's user avatar
1 vote

Trying to link ZIP code to core-based statistical area

The LEHD program of the Census Bureau publishes crosswalks which map every Census Block to a number of other geography types, including ZCTA and CBSA. You could download one of these crosswalks, ...
Joe Germuska's user avatar
  • 5,488
1 vote

cattle and sheep production and reproduction records

There are several government datasets on farming/livestock. For the UK, I would look here: https://data.gov.uk/dataset/farming_statistics For the USA: http://www.ers.usda.gov/topics/animal-products/...
Andrew - OpenGeoCode's user avatar
1 vote

Grouped vocabulary list as .txt or .csv files

You can use the WordData function with the "UsageField" property in Wolfram Mathematica. Expand the Details section for more properties. WordData["litigation", "UsageField"] (* {{"litigation", "Noun"}...
Edmund's user avatar
  • 387
1 vote

Looking for sample lat/long data of thousands of US addresses

Some time ago I came across this OpenAddresses project: OpenAddresses.io. Something like 215 million addresses available, broken down I believe by US state for the US ones.
Peter Tirrell's user avatar
1 vote

Applying filters to headers in a huge CSV file

I'd suggest you look at TextQ (disclaimer - I'm its developer). It can import a big CSV file and allows you to manage its schema/structure: parse date and numbers in various formats; rename or hide ...
Geo Systems's user avatar
1 vote

How can I work with a 4GB csv file?

I've had good luck in R (without resorting to fancy packages) of reading CSVs up to and beyond that size. The nice thing about getting it in RAM, if you can swing it, is very fast manipulation.
Mike Dolan Fliss's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible