5 votes

A standard format for English vocabulary

XDXF is an open source "XML Dictionary Exchange Format". XDXF stands for XML Dictionary Exchange Format, and specifies a semantic format for storing dictionaries. The main distinction of ...
philshem's user avatar
  • 17.6k
4 votes

How can I work with a 4GB csv file?

I recently had to parse the 6GB NPPES file and here is how I did it: $ wget http://download.cms.gov/nppes/NPPES_Data_Dissemination_July_2017.zip $ unzip NPPES_Data_Dissemination_July_2017.zip $ split ...
Andrei Sura's user avatar
4 votes

How can I work with a 4GB csv file?

I am a big fan of tad which crunches these kind of files easily.
Steven's user avatar
  • 141
4 votes
Accepted

Formats of texts from wikisource?

For automated processing, by far the best alternative is a database dump. They might be a little bit old, but hopefully that won't be a problem. You can select database dumps by language and wiki, ...
gerrit's user avatar
  • 1,144
4 votes

Are there IMDb datasets with IMDb ID numbers and actor birthdates?

1) I would like to point you to a dataset and an API that provides IMDB information. Here are some queries to get the information from your example, and to show you what kind of data to expect from ...
marfi's user avatar
  • 583
4 votes
Accepted

OS VectorMap Local Layer Definition Files

Here is a link to the official Ordnance Survey Stylesheets hosted on Github. They also do ones for VectorMap District which is the open data version https://github.com/OrdnanceSurvey/OS-VectorMap-...
Stevetech's user avatar
  • 266
3 votes
Accepted

90ies Windows .exe database on CD: Extract underlying data

I received some help on it. Something along these lines with xor in Python did the job: with open('...dat', 'rb') as f: with open('...txt', 'w') as out: xor = 1 s = "" ...
moezelot's user avatar
  • 153
3 votes
Accepted

A dataset with ~10 million rows

City bike shares will have about that number of records, and because there will be some geospatial data (latitude/longitude) along with timestamps, it's usually a fun topic to explore GitHub list of ...
philshem's user avatar
  • 17.6k
3 votes

How to download issues from ASF Jira

you can try this Url https://issues.apache.org/jira/rest/api/2/search?jql=project=projectname it works with basic authentication.
nimesh pande's user avatar
3 votes

How to extract data from web files?

There is a good piece here: https://blog.datazar.com/mastering-the-art-of-data-preparation-fea2074232fa#.iblmav7eq that goes over all components of data preperation. There is a specific portion of it ...
Brian Back's user avatar
3 votes

What are the most useful formats in which to release geospatial data?

Geospatial Data Standardization No more KML, KMZ, SHP files! I will make the somewhat bold and possibly controversial statement that geospatial data should always be available in two single ...
Carl V. Lewis's user avatar
2 votes

What's the best way to host map tiles?

I actually no longer recommend CartoDB (which has since been renamed to CARTO), although I was once a power user and helped build the platform from its open-source days. For maptile hosting, I'd go ...
Carl V. Lewis's user avatar
2 votes

Do you know any open/standard resume format?

h-resume (formally hresume) is a simple, open format for publishing resumes and CVs on on the web. h-resume is one of several open microformat draft standards suitable for embedding data in HTML. h-...
albert's user avatar
  • 11.9k
2 votes

Do you know any open/standard resume format?

i guess this is an old question, but there is HR-XML now. http://schemas.liquid-technologies.com/hr-xml/2007-04-15/
messedup's user avatar
  • 121
2 votes

How can I work with a 4GB csv file?

You can try nitroproc. It's currently a beta version I think, but allows to sort/summarize/filter/etc. It's free.
bob's user avatar
  • 21
2 votes

Any libraries for SEC Forms, such as a 10Q, as an Interface?

I've had some luck using Quandl; specifically the Raymond database. It isn't perfect but if you know exactly what you're looking for it can come in handy. The Quandl Raymond Data Page The Quandl ...
Andrew L's user avatar
  • 121
2 votes

First and last date in YYYY-MM-DD format of ISO 8061

The practical limitation isn't in the ISO format at all but in the systems that use it. Different databases, for example, implement system specific limitations which are not even consistent across ...
matt_black's user avatar
2 votes
Accepted

Corruption Perception Index (CPI) by Transparency International

In the Github link there is a file acquire_data.r. It has the exact URLs for datafiles from 2010 to 2015. http://files.transparency.org/content/download/1950/12812/file/2015_CPI_DataMethodologyZIP....
Bulrush's user avatar
  • 667
2 votes

Formats of texts from wikisource?

If you are just interested in two dozen text I think it is easiest just to request for the raw wikitext, for instance for the 'The Metal Pig' page: https://en.wikisource.org/wiki/The_Metal_Pig?action=...
Finn Årup Nielsen's user avatar
2 votes

A standard format for English vocabulary

You could try out Merriam-Webster's Dictionary API, which has a basic XML standard for dictionary entries: http://www.dictionaryapi.com/products/api-collegiate-dictionary.htm
Hayden Schiff's user avatar
2 votes

Elevation data by latitude and longitude for the Grand Canyon

You can get digital elevation models (DEMs) from the ASTER GDEM project using the USGS Earth Explorer tool: http://earthexplorer.usgs.gov/ Select the region you want by clicking on the map. Under '...
Swier's user avatar
  • 1,453
2 votes

Open data quality frameworks

In December 2016, the Data on the Web Best Practices Working Group (Group Page, Group Charter) have published the Data Quality Vocabulary. This vocabulary is a meta-framework for frameworks that ...
Stanislav Kralin's user avatar
2 votes

Open data quality frameworks

You can benchmark data vs. Open Data Census, you can use linting tools (CSV Lint, JSON Lint, etc.), and you can make them all into Data Packages. I'm curious to why linked data is not a priority ...
albert's user avatar
  • 11.9k
2 votes
Accepted

How can I convert xy line-plots to textual data values?

Here is a blog post that compares 16 graph digitizing tools, some free, some not. The suggestion is to use WebPlotDigitizer. The blog doesn't mention if any of the tools can be used to automate the ...
philshem's user avatar
  • 17.6k
1 vote

Seeking source of curated/cleansed data for 2016 Canadian Census?

I've run into this problem as well and have opted not to use the aggregated data in some cases because of how badly it's formatted. If you have access through a Canadian university, I`d highly ...
Trevor J. Smith's user avatar
1 vote

Elevation data by latitude and longitude for the Grand Canyon

Google Elevation API has worked for me a couple of times in a pinch: https://developers.google.com/maps/documentation/elevation/start You could also check out the county for whichever part of the ...
boulder_ruby's user avatar
1 vote

How to extract data from web files?

Can you be just a tad more specific - what files are you extracting data from? What format are they? Are they data file already or are they text/pdf documents? If you simply want to programmatically ...
P. M.'s user avatar
  • 41
1 vote

Applying filters to headers in a huge CSV file

I'd suggest you look at TextQ (disclaimer - I'm its developer). It can import a big CSV file and allows you to manage its schema/structure: parse date and numbers in various formats; rename or hide ...
Geo Systems's user avatar
1 vote

How can I work with a 4GB csv file?

I've had good luck in R (without resorting to fancy packages) of reading CSVs up to and beyond that size. The nice thing about getting it in RAM, if you can swing it, is very fast manipulation.
Mike Dolan Fliss's user avatar
1 vote

Do you know any open/standard resume format?

Take a look at the EU Europass project. CVs can be saved out in a Europass XML format.
jrc's user avatar
  • 111

Only top scored, non community-wiki answers of a minimum length are eligible