Questions tagged [data-format]

For questions regarding data formats and file formats, such as comparison of different data formats or recommendations of a file format.

Filter by
Sorted by
Tagged with
48
votes
6answers
17k views

A Python guide for open data file formats

If you are an open data researcher you will need to handle a lot of different file formats from datasets. Sadly, most of the time, you don’t have the opportunity to choose which file format is the ...
85
votes
20answers
146k views

How can I work with a 4GB csv file?

What's the best way to access a 4GB csv file? I would like get a 'cut' of this open data set: Full Replacement Monthly NPI File, available here http://nppes.viva-it.com/NPI_Files.html Specifically, ...
11
votes
5answers
487 views

Standards for self-documenting text files?

One of the advantages of most scientific file formats is that you have a block of attached metadata that tells a reader how to read / interpret the file (what the fields are, for the most part -- how ...
7
votes
1answer
104 views

Format for exchanging open data catalogs

There are a number of catalogs of open data portals out there. Like many well intended efforts, many of them go stale for long periods of time or altogether. One way to combat this problem is to have ...
7
votes
1answer
87 views

Protocol/software to publish weather information online

I've got a temperature and humidity sensor that captures the data outside the house and whose data I collect every 5 minutes. Is there a standard protocol/format that I can use to publish those data ...