Questions tagged [csv]
Comma Separated Values (CSV) are a common interchange format for tabular data.
41
questions
1
vote
0answers
8 views
find similarities of special column in multiple csv file? [migrated]
I have a dataset containing user id and their locations. the users are on the move and they are not fix. so multiple locations are exist associated with each user. I sorted the dataset associated with ...
3
votes
1answer
55 views
Is it possible to download worldometer COVID-19 country data?
I want to download the raw data for COVID-19 cases in Sweden but can't find anywhere on worldometer to do it.
Does anyone know how to download the data as a csv file?
0
votes
0answers
10 views
What tool would you suggest I use if I have to analyze millions of rows of csv data? [migrated]
I'm using windows and can't change that. Novice at programming.
Something that'd let me make pivots easily to analyze would help. Basically I have about 20gb data of userids, spend, country and so on ...
2
votes
0answers
23 views
Is there such a thing as a public, curated list of people who WANT to be e-mailed?
I've always wanted to be able to send e-mails to a lot of people, for example to announce something.
However, there are ultra-strict rules for this and basically, you destroy your "reputation" if you ...
1
vote
0answers
12 views
Where can accurate information on the release dates of all video game consoles, peripherals and games were released be grabbed?
I've long wanted to compile a private "timeline" consisting of various video game consoles, peripherals and games which I want to remember and quickly be able to look up when they were released. I ...
1
vote
0answers
93 views
How can I download this dataset from Texas Department of Criminal Justice?
By browsing this question I've found this dataset that I'd like to use:
https://www.tdcj.texas.gov/death_row/dr_executed_offenders.html
How can I download it (once)? Including the features Offender ...
0
votes
0answers
24 views
Medical dataset for creating questionares (in csv/rdf formats so that I can import them into Neo4J directly)
I want to create a graph database of medical information in the form of entity nodes connected by relations and was wondering if any csv datasets existed that would allow me to directly import the ...
1
vote
0answers
29 views
Davis-Bacon wage dataset
Is anyone aware of a method or source for exporting Davis-Bacon wage information as a csv dataset?
https://www.wdol.gov/archdba.aspx
Assuming you have a particular DBA WD number you are interested ...
2
votes
1answer
382 views
Get list of all villages/towns in India
This might have been asked before but I couldn't get a similar question.
I am working on an application which will have addresses in India populated using dropdowns till 4 levels.
State => ...
1
vote
0answers
23 views
Obesity/Inactivity Data at a census tract level
Looking for obesity/inactivity data for adults at a census tract level for the state of California. Any good sources? Preferably in a format that can be uploaded to arcdesktop.
1
vote
0answers
17 views
Pain levels using GSR and heart rate measurements
I am looking for dataset(s) that classifies the GSR (skin conductivity) / heart rate readings to emotions and pain levels for machine learning purposes.
1
vote
1answer
42 views
How can I flter data from a stream of very large text files?
I have a stream of data being delivered to my Amazon S3 bucket in the form of tab-delimited text. I would like to scan as it comes in to keep a very small subset of the rows from that match certain ...
2
votes
1answer
175 views
Sensor data trains dataset
For an experiment I'm looking for a particular type of data set, been looking for quite a while but couldn't find any data sets which even remotely match this description. Are there any good datasets ...
3
votes
2answers
66 views
Is there a set of data points available to draw an outline of the coast of the British Isles?
I would like to plot a map of the coastline of the British Isles using gnuplot, for which I need a data set of points along the coast. Is this available in csv form, please, or help to convert it to ...
7
votes
3answers
1k views
Trying to link ZIP code to core-based statistical area
I have a dataset downloaded from the IRS reporting AGI by ZIP code (link: irs.gov). However, I'm interested in tying each ZIP code to statistical areas (whether it's [a] primary statistical area, [b] ...
1
vote
0answers
45 views
How can I deploy a sci-kit learn model when the data in use are .csv files?
I am dealing with accelerometer data (csv) as well as audio data stored in FTP server coming from an android app. Data is loaded from FTP in my notebook for exploratory analysis to extract features ...
3
votes
0answers
40 views
The W3C's tabular-data-model is de facto in use?
In nowadays (2016) what standard is a de facto standard for CSV file metadata, W3C's tabular-data-model or OKFN's tabular-data-package?
NOTES
Important to remember: these metadata standards (...
4
votes
2answers
2k views
Master Song Database containing popular titles and artists
I'm looking for a song database (sqlite, csv, etc.) Right now I'm searching through a list of songs from late 60s and early 70s on "http://www.song-database.com/" but I'm searching manually on the ...
1
vote
1answer
2k views
Postal codes of China
Where can I find geodata with postal codes of China with an open license (commercial use is allowed)? It may be shp, csv, kml. any geodata.
3
votes
1answer
325 views
College Scorecard API call returns all data in .json but only two fields in .csv
I'm trying to pull debt data from College Scorecard for Texas institutions using the following call:
https://api.data.gov/ed/collegescorecard/v1/schools.csv?school.state_fips=48&_page=0&...
6
votes
1answer
1k views
Looking for open source LGBT datasets
I have been looking for any general datasets about LGBT Americans. The type of file I look for are either CSV or TSV. Although my inquiry will hopefully yield some spatial indices at the county or ...
2
votes
2answers
52 views
cattle and sheep production and reproduction records
I am looking for some records (spread sheets) that I can use for teaching/analysis. I am specifically looking for dairy/beef cattle and sheep/goat farm production and reproduction records.
Appreciate ...
3
votes
2answers
402 views
Grouped vocabulary list as .txt or .csv files
I'm working on a project with email data.And simply i need to group up all the emails according to suitable categories. Therefore, i use the dictionary mapping method. So,
My project required lots ...
4
votes
3answers
5k views
Looking for sample lat/long data of thousands of US addresses
In order to test some mapping and geocoding functionality, I'm looking for a free data source containing a few thousand US addresses, including latitude and longitude. I need them distributed among a ...
6
votes
1answer
345 views
Finding tables in messy structured Excel / csv file to import them in DB
we have a lot of messy structured excel files containing tables somewhere on a sheet and we want to import these tables into a database to do some analytic on it. There problem is that we don't have ...
3
votes
1answer
209 views
Australia Hotel/Motel Data
I am wondering if there is anyone here that either has 2013-2015 list of hotels in Australia with contact phone numbers and if it had emails that would be a bonus.
I am currently putting an excel ...
5
votes
3answers
165 views
Water level historical data for California
I am looking for data attesting for the variation of fresh water availability in California over the years (ideally 20+ years). For instance river levels, river throughput, wells levels.
If data is ...
6
votes
1answer
317 views
Mapping CSV Header to RDF + SPARQL console
I would like to know your opinion about the next system:
with a large CSV file
convert it's header to RDF schema, in which exists only the CSV columns information and access point. This way there's ...
8
votes
2answers
444 views
What needs to be done to be 4 or 5-star open data?
I work at a University which is trying to open up some of its data. We make some of our data available as PDF or Excel documents.
The 5-star deployment scheme has been referenced a fair bit in Europe ...
12
votes
3answers
2k views
Where can I download photoperiod (daylength) data?
I'm looking to download photoperiod (day length) data for a variety of locations in Europe on a variety of dates. For each date and locations, I need to the number of hours of daylight.
Ideally, the ...
6
votes
1answer
76 views
DOL Wage and Hour data: Counting backwages under Fair Labor Standards Act
I have a question about the Wage and Hour Compliance Action Data of the Department of Labor's Wage and Hour division:
http://prd-enforce-xfr-02.dol.gov/data_catalog/WHD/whd_whisard_20141105.csv.zip
...
3
votes
2answers
649 views
Applying filters to headers in a huge CSV file
I am working with a CSV file that is approximately 500 MB.
When I open this file in Excel, the wrong data is displayed under the column headers. I suspect this may be due to the large size of the CSV ...
5
votes
1answer
203 views
“DBpedia as Tables” not having all the properties
I browsed a sample for available data at http://dbpedia.org/page/Sachin_Tendulkar. I wanted these properties as columns, so I downloaded the CSV files from http://wiki.dbpedia.org/DBpediaAsTables.
...
3
votes
1answer
197 views
A DB of banks for each country
I'm looking for a free database of banks (preferably with their web sites, phone numbers, etc) for each country in a convenient format, not html. Is there any?
4
votes
1answer
36 views
Which licence and format should I use for the Norwegian language “data” I am creating?
While learning a foreign language, I am creating my own list of verbs (with their variants when conjugated), list of idioms, nouns (with plural form), etc.
As an example, let's focus on the verbs: I ...
12
votes
2answers
312 views
Where to upload open data? (no online data editing needed)
I have CSV and RDF files that I would like to upload somewhere so that everyone can download them.
What is the most appropriate website for this?
I need at least:
Easily upload, just select the ...
4
votes
2answers
130 views
Wiki site for data tables
Recently I participated in a digital humanities hackathon where we created programs for automatic handling of texts. For example, one program involved automatic detection of Biblical phrases in modern ...
86
votes
20answers
152k views
How can I work with a 4GB csv file?
What's the best way to access a 4GB csv file?
I would like get a 'cut' of this open data set: Full Replacement Monthly NPI File, available here http://nppes.viva-it.com/NPI_Files.html
Specifically, ...
13
votes
5answers
363 views
How to publish open data on my website? (Or: from CSV to RDFa)
I already spent some time importing data in a tabular form from a PDF published by an official institution. I would like to publish this table on my website. The data is nicely formatted in CSV.
Is ...
19
votes
7answers
560 views
Keeping track of updates to open data published as CSV
I looked through several related questions here (e.g. Tools for merging similar datasets continuously) but nothing seemed to quite answer my question. So, apologies in advance if I missed something.
...
26
votes
12answers
3k views
Metadata standards and best practices for data dictionaries for CSV files/data
We publish most of our machine-readable open data in CSV format.
What are best practices and/or standards to publish data dictionaries (e.g. definitions of columns in CSV files including human-...
