Questions tagged [data-format]
For questions regarding data formats and file formats, such as comparison of different data formats or recommendations of a file format.
71
questions
0
votes
2
answers
128
views
Structure of Results Appear to Change Based on Query
If I run this query: https://api.data.gov/ed/collegescorecard/v1/schools?latest.school.city=Los Angeles&api_key=XXXXXXXXXXX, then the results look something like this:
However, if I run this ...
1
vote
2
answers
24
views
What data format (from German destatis) is that?
I would like to identify that data format. Is there an official name for it that I could use in a search engine (of my trust) to go on with research about supporting tools? Is this a (quasi) ...
- 111
1
vote
2
answers
40
views
Are there domain standards for open data?
When talking about open data the 5-star principle has paved our way. And although the highest level, linked data, is machine readable, it is not application friendly from a reusability perspective. By ...
- 459
0
votes
1
answer
28
views
No inactive_ingredient field when query for drug substance in Drug Label API
I am looking for the inactive ingredients for a dozen of different drugs. However when querying in the Label API, most results return without an "inactive_ingredient" field. The field only ...
- 1
1
vote
0
answers
18
views
Customs trade data of Brazil and China needed
I'm looking for customs trade data of Brazil and China.
For Brazil I need export of poultry meat (HS-code 0207)
For China I need import to country.
And all these data must contain such information as: ...
- 11
1
vote
0
answers
22
views
Datex-II: malformed OpenLR?
My reading of Datex-II (as of version 2.3) is that OpenLR locations are specified roughly like this for linear features:
…
<SituationRecord …>
<!-- description of the event here -->
&...
- 161
1
vote
0
answers
33
views
Seeking 2016 Census tract based Census Data for City of Toronto, Canada
I have gone through all the links that have been posted over the stack exchange forum and other forums. I did go through Statistics Canada and found what I needed. But this data is in the row form and ...
- 203
1
vote
1
answer
120
views
openFDA: Is there any way to match NDC data in different format?
I'd like to know whether or not there is a possible way to match NDC codes in different formats by using openFDA API like Recall Enforcement Reports. For example, matching 0187-0798-30 with 0187-079-...
- 11
3
votes
2
answers
71
views
Common but out-of-the-ordinary file formats
I am wondering what some file formats are that are out of the scope of "normal" file formats you typically find on the web. The "normal" file formats I'm not considering in this post are:
Image ...
- 377
1
vote
0
answers
36
views
Davis-Bacon wage dataset
Is anyone aware of a method or source for exporting Davis-Bacon wage information as a csv dataset?
https://www.wdol.gov/archdba.aspx
Assuming you have a particular DBA WD number you are interested ...
- 11
2
votes
1
answer
36
views
Seeking source of curated/cleansed data for 2016 Canadian Census?
I am working with open data sources and the 2016 Canadian Census is of great interest to me. The Canadian Statistics website provides boundary files, which work great, and some aggregated census data, ...
- 31
1
vote
0
answers
71
views
Looking for specific datasets with demographic data in column format
I'm looking for government datasets on a wide variety of topics concerning the population of the country. Things like the crime rate, unemployment rate, level of educational attainment by different ...
- 173
1
vote
1
answer
33
views
OS VectorMap Local Layer Definition Files
Would anybody be kind enough to share their QIGS Layer Definition Files for the following OS VectorMap Local layers. SLD file formats would work as well. Alternativly, where do you buy your OS VML ...
- 193
2
votes
1
answer
127
views
90ies Windows .exe database on CD: Extract underlying data
I would like to extract data from a register stored on a CD from the 90ies. The Windows executable on the CD allows one to browse the database with keywords and by specific variables. However, there ...
- 153
4
votes
2
answers
2k
views
Are there IMDb datasets with IMDb ID numbers and actor birthdates?
I want datasets that have the name of the movie and its link on the site or the tt-number.
E.g. for Jurassic Park (1993) it would be in the format:
> NAME ID LINK
>...
- 191
1
vote
0
answers
55
views
National Spanish soccer lotteries - La Quiniela and El Quinigol datasets
Looking for any of those National Spanish soccer lotteries in format similar to :
week, game 1, game 2 .... Chances: Home (game 1), Draw (game 1), Away (game 1) ...
1 X 2 ...
- 211
3
votes
2
answers
350
views
Elevation data by latitude and longitude for the Grand Canyon
I am looking for elevation data organized by latitude and longitude for the Grand Canyon.
I have found USGS elevation data (http://nationalmap.gov/elevation.html), which is in the form of an ESRI ...
- 39
5
votes
1
answer
181
views
How to classify EEG and ECG signals
I'm a student and a beginner on Physionet. What is the best method to classify EEG and ECG signals: KNN or SVM? And how can I do it with matlab? Should I convert the .dat files to .mat or just extract ...
6
votes
2
answers
130
views
Open data quality frameworks
I'm looking for some kind of lightweight framework for assessing the quality of datasets, as a publisher. The most widely known one is Tim Berners-Lee's "5 star open data", but it's actually not very ...
- 850
1
vote
0
answers
15
views
Merging social care expenditure data to NHS trust data
I have downloaded social care expenditure from the following website http://content.digital.nhs.uk/article/1165/Search-catalogue?topics=1/Social%20care/Social%20care%20expenditure&sort=Date&...
- 161
2
votes
1
answer
6k
views
A dataset with ~10 million rows
I am looking for a dataset with 10 millions of rows to analyze it. Actually to rework it into more usable format and come up with some interesting metrics for it. So there are two requirements:
1) ~...
- 123
4
votes
1
answer
50
views
How can I convert xy line-plots to textual data values?
I want to reverse engineer a simple XY-line graph to scalar data values.
An example of such a plot is linked below,
water temperature as a function of datetime. As far as I know, the raw data (...
- 1,227
2
votes
0
answers
24
views
Text Fields Extraction Tools Recommendation
The Problem: I have emails coming through and I want to parse few fields from this emails to save it as structured data , can use regex if I just have one or two structures but I have a lot of them so ...
- 121
3
votes
2
answers
93
views
How to extract data from web files? [closed]
Looking for some brief information on how to extract data from files on the web? If there are any tutorials or pieces that you know of, it would be great help.
- 101
1
vote
0
answers
10
views
Find relative frequency of file or MIME types
I want to use Google or some internet search service to gauge the popularity of competing file types or MIME types. Has anyone done this? Any suggestions?
- 161
2
votes
0
answers
25
views
Machine readable format to report results of randomized control trials
Results of randomized control trials are typically reported in free text contained in a PDF or HTML. Are there any proposal of machine readable format to report results of randomized control trials (...
- 7,740
2
votes
2
answers
114
views
Any libraries for SEC Forms, such as a 10Q, as an Interface?
I'd like to process some SEC data, such as a 10Q, but don't want to build a parser for the data myself. Are there any existing libraries that can parse or represent these types of forms?
- 121
3
votes
1
answer
54
views
First and last date in YYYY-MM-DD format of ISO 8061
Which is the first date of ISO 8061 format? Is it by Georgian Calander (1582-1-15) or 0001-1-1 ???
Which is the last date? I guess it must be 9999-12-31. Am I right???
The citations given in Wiki ...
- 131
2
votes
1
answer
1k
views
Corruption Perception Index (CPI) by Transparency International
I need the indeces in analyzable format, i.e. csv, xls, from the year 2005 to 2015. The results are in HTML table/PDF format on the TI website. Can anyone link a source or write a script to scrape the ...
- 123
3
votes
2
answers
363
views
How to download issues from ASF Jira
I am currently working with unstructured data, planning to mine the unstructured data present in bug reports.
For this I tried to download the issues from the ASF (Apache Software Foundation) Jira ...
- 315
3
votes
0
answers
222
views
What are the limitations of the Wikidata data model?
Wikidata data model is as follows:
The following diagram is a more summarized version of it (source):
All terms are defined here.
I wonder what the limitations Wikidata data model are.
- 7,740
7
votes
2
answers
183
views
Formats of texts from wikisource?
In what formats can I retrieve texts from wikisource?
The obvious format is the HTML they deliver for reading, but the HTML source is very layout oriented and messy.
Is there a downloadable source ...
user6083
11
votes
2
answers
166
views
A standard format for English vocabulary
Is there a standard format for English vocabulary lists and some data sources in that format? (For example a standard XML)
For example SAT vocabulary or Basic English words, including definition, ...
- 261
5
votes
1
answer
60
views
Government standards, guidelines, and practices for collecting data
By standards, guidelines, and practices for collecting data I mean the rules that facilitate:
Practical value: Collecting data with a specific goal in mind
Data integrity: Minimizing omissions and ...
- 3,641
7
votes
5
answers
468
views
Which format (CSV, JSON, Atom, RSS?) should events data be published in?
I'm developing recommendations for local councils publishing event listings. Compared to other kinds of data, events data seems very likely to be used by web and mobile apps (as opposed to downloaded ...
- 850
4
votes
0
answers
195
views
Example of credit card usage data
I want to understand the data saved when a person uses his or her credit card in a shop or online. Is there a common data set format for this? If so, what does it contain? Furthermore, can anyone ...
- 295
2
votes
1
answer
214
views
Finder API list ACA Approved Health Insurance API JSON?
Does Healthcare.gov or Finder API list ACA Approved Health Insurance in API JSON format?
- 21
2
votes
1
answer
38
views
What is your level of external data?
I'm working on an internship of Big Data, I've build a predictive model. To enrich my model, I'm searching for the open data / external (paid) data. But I could only find the data that is in type of ...
- 121
3
votes
1
answer
36
views
What data formats that can be published on the first level (1 star) of open data?
I wonder what are the possible data formats that can be published for 1-star level of open data.
The only example I have found is with the PDF format, I wonder if there are other possible formats to ...
7
votes
1
answer
129
views
Protocol/software to publish weather information online
I've got a temperature and humidity sensor that captures the data outside the house and whose data I collect every 5 minutes.
Is there a standard protocol/format that I can use to publish those data ...
- 171
1
vote
1
answer
62
views
Data repositories like UCI and mlData, for biological data
Are there any other data repositories like UCI and mlData, for biological data?? I want to know about mostly biological data set.(The format of data set would be like that of UCI)
- 113
7
votes
1
answer
98
views
Data management practices
Software has code repositories and package managers, so installation and maintenance are done in one line (or click).
What are practices for managing data, instead? Apart from manually organized ...
- 3,641
2
votes
1
answer
214
views
Working with Sample Surveys, Statistical Packages, and Fixed Format ASCII Data (.dct ,.do, .sas, .sps) and .dat
US Department of Education sent me National Household Education Surveys Program data via cd-rom and I'm looking for tips/software/best-practices here for converting/viewing/manipulating this data. ...
- 11.9k
2
votes
1
answer
47
views
What's a good file format for presidencies of countries? [closed]
I want to build a file with all the data of the different presidents of a country. Is there a defined JSON format to represent this data?
For example:
{
name: "President A",
Assumed: '01-01-...
- 129
7
votes
1
answer
227
views
What's a good file format for sharing 3D models of cities?
Some councils have 3D models of the buildings which they're considering sharing. What would be a good format to encourage them to use, if possible? I had thought 3DS would be the standard, but ...
- 850
5
votes
1
answer
55
views
Open database of filename extensions
Filename extensions like ".doc" or ".licx" are usually associated with a type of file, and are sometimes strongly associated with one or several pieces of software.
Is there an open database of these?...
- 8,376
2
votes
1
answer
106
views
HIOS Plan Year 2016 XSD Schema
Can someone provide a link to the new (plan year 2016) XSD schema for HIOS admin/plan/rate/etc. data exchange? There have been changes to the XML format for this year and we need to update our ETL ...
- 21
1
vote
1
answer
148
views
Most reusable way to publish a list as JSON
I have a list that I want to publish as JSON, so that others can easily reuse it:
product1: price1
product2: price2
product3: price3
product4: price4
What is the most reusable way to publish this ...
- 8,376
4
votes
4
answers
815
views
Applying filters to headers in a huge CSV file
I am working with a CSV file that is approximately 500 MB.
When I open this file in Excel, the wrong data is displayed under the column headers. I suspect this may be due to the large size of the CSV ...
- 141
6
votes
1
answer
83
views
Plans and documentation to tidy RAW data in Maude?
MAUDE is the Manufacturer and User Facility Device Experience database from the FDA.
The MAUDE database houses medical device reports submitted to the FDA by mandatory reporters 1 (manufacturers, ...
- 61