Questions tagged [tool-request]
Indicates a request for tools to create or manage open data.
17 questions
24
votes
10
answers
11k
views
Wikipedia table to JSON (or other machine-readable format)
I'm interested in the data listed in the tables listed here.
Is there a good way to extract the information (as JSON, preferably) without resorting to HTML parsing?
- 491
11
votes
4
answers
5k
views
What server and technologies can I use to extract data out of Wikipedia's infoboxes (e.g., ATC code for drugs)
Wikipedia is a significant source of data. Data from Wikipedia may be available in various formats via other servers (e.g., SPARQL end point).
For a task of extracting all pairs of "ATC code" - "...
- 730
115
votes
21
answers
19k
views
Is there a Git for data?
I know you can put CSV or XML in Git already, but there are issues for those wishing to collaborate on a dataset for creation, cleaning it up, pull requests, etc. Are there alternative version control ...
- 2,371
93
votes
21
answers
174k
views
How can I work with a 4GB csv file?
What's the best way to access a 4GB csv file?
I would like get a 'cut' of this open data set: Full Replacement Monthly NPI File, available here.
Specifically, I want only the rows for hospitals; ...
- 949
38
votes
11
answers
33k
views
Good tools to parse repetitive unstructured data
I'm looking to parse a large number of lines of repetitive but unstructured data. This is a task that happens at least once every project, in my experience, so I'm looking for a tool to transform ...
- 943
26
votes
7
answers
3k
views
Extracting tables from multiple PDFs
What's the best practice of extracting tables from a large number of PDF, which may be formatted differently?
For example, I have a series of PDFs like this one, and I would like to extract the ...
- 446
25
votes
8
answers
3k
views
Tools for merging similar datasets continuously
How do I merge similar datasets, not just once but on an ongoing basis? This seems like a reasonably common problem so I'd be interested if there is a tool out there aimed at this problem, as a guided ...
- 2,371
15
votes
4
answers
487
views
How do I share Open Data with others on this SE site?
I have some data which is Open(free from copyright, patents or other control mechanisms) and I want to share it with the users here. How do I do it without having to host it on some other server and ...
- 253
12
votes
2
answers
10k
views
Is there a tool to match zip codes to cities?
I have a data set with zipcodes and would like to do a bulk upload to a tool that will give me the cities each zip is in (US only.)
- 307
39
votes
7
answers
10k
views
Are there any good libraries available for doing normalization of company names?
I've run into a number of use cases where I need to normalize company names in a database before running automated and manual matching. We've usually ended up writing a specific script with endless ...
- 903
17
votes
6
answers
532
views
Collect a list of open data systems
for a research project we are trying to collect a list of relevant open data systems. I am aware that systems is very broad so I tried to categorize them a bit.
Please help us extending this list ...
- 271
16
votes
9
answers
2k
views
What's an easy-to-use tool to manage datasets?
I am quite new to open data. I see a lot of people looking for machine-readable data, but to start, I am wondering which tool I can use to start playing with some dataset.
I am particularly looking ...
- 413
13
votes
3
answers
2k
views
How might I go about visualising historical temperature CSV data?
I've downloaded the Central England Temperature Data available from Met Office Hadley Centre. On their summary page, it is described thus (emphasis mine):
These daily and monthly temperatures are ...
- 233
8
votes
3
answers
130
views
How to use the DOI system as an individual?
Is anyone aware of a way for an individual developer to access the Digital Object Identifier (DOI) system?
I am a software developer working in biological research but independent of any single ...
- 720
5
votes
2
answers
347
views
Do you know a technique for text mining judicial decisions?
I'm trying to find a method to mine sepecific informations in judicial decisions (judge's name, court, area of law and neutral citation number[canadian way to cite decisions uniformly across the ...
- 51
5
votes
2
answers
154
views
What forums / boards do you use to answer open data questions? [closed]
In NYC, we're wondering what forums and web boards do open data professionals use to answer questions around open data?
CartoDB promotes the GIS Stack Exchange.
BetaNYC has a spreadsheet listing NYC ...
- 275
3
votes
1
answer
307
views
Open database of domain registration information?
Is there a central database of all domain registration information, or a way to access an aggregate of that data?
I know there are already tools to help you access the registration information of a ...
- 31