Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [tool-request]

Indicates a request for tools to create or manage open data.

1
vote
0answers
17 views

Distribution of number of people having money M in their bank account [closed]

Not sure whether to post this here or have my post migrated to personal finance and money SE, please recommend. I would like to know, where I can find, for each country, the graph of the following ...
1
vote
1answer
67 views

Data integration tool that supports Semantic Web

I've multiple data sources (files or API data). I want to integrate all these sources using one common ontology. I've started using Karma Information Integration Tool; however, I'm facing some ...
2
votes
1answer
20 views

Carto Help in minimizing geographic dataset

I have a file that contains location points all over the world, using lat long coordinates. I am trying to trim it down to only new York and Newark new jersey. I have a shape file that is the ...
0
votes
2answers
42 views

If Wordpress is an appropriate tool for loading open data into a system's front end, what would I use for the backend?

This question was inspired by this one. I want to load open data into the backend of my system. That is, I want the data to be accessible to my developers, but not the public. I was told by an IT ...
3
votes
1answer
50 views

How to add a claim to an existing Wikidata item, from command line?

I want to add to Wikidata this claim: Embassy of Switerland, London - is operated by - Switzerland ... using my Linux command-line. Launching a web request via curl is OK too. How to do? I have ...
4
votes
1answer
149 views

What kind of spreadsheet/application are the Socrata datasets built on?

I have yet to see another online service for viewing spreadsheets that works as seamlessly as the Socrata sets. It seems no matter how much data or how many rows there are - it is always consistently ...
2
votes
2answers
70 views

Whats the simplest way to get 1000 twitter handles of users in USA who are less than 21 years of age?

Need 1000 twitter handles of users who are below 21 years of age and residing in US
2
votes
1answer
102 views

Long-term search trends by domain

I want to know what people are searching for in a particular domain (the domain is enterprise software, if that matter). The goal is to discover new trends. I tried the Hot Trends feature which is ...
3
votes
1answer
82 views

Scientometric/bibliometric data retrieval from a list of DOI

I am a conducting bibliometric analysis on small/midsize sets of academic papers (40-400), in a longitudinal study (repeated over time on the same dataset). I am interest in retrieving data for each ...
2
votes
0answers
46 views

What you look for in a codebook

I'm putting together a few codebooks/data dictionaries for our transparency portal, http://ledger.illinoiscomptroller.gov. In doing so I have been reviewing some examples to get an idea of what civic ...
2
votes
2answers
63 views

Open data set to calculate the correlation between different brands

Is there any data sets / methods available to find correlation between different 'bands' ? Brands : Puma, Google, Microsoft, Nike, BMW etc Is there any open data set available to find this ...
7
votes
2answers
124 views

Creating data from web tables with import.io failed - other tools?

I found this site with solar system moon orbit data: Table of moons in solar system. I ran that through the http://import.io site and it only came up with Jupiter data. Is there a more comprehensive ...
2
votes
1answer
148 views

Simple, online collaborative database

I would like to launch an online collaborative database (< 100 MB, most likely < 10 MB). I'll use either MySQL, MariaDB or PostgreSQL. I need a platform that would allow people to submit pull ...
4
votes
0answers
91 views

Memex open data (Dark web)

Has any data been created by Memex that is available for open use? Is Memex even available to be used in order to create open data of the "dark web"?
6
votes
2answers
85 views

Cleaning up addresses in a large data set

I have a dataset of about half a million unique addresses. An address consists of a StreetAddress1, StreetAddress2, City, State and Zip code (all addresses are in the United States). One of my main ...
6
votes
1answer
109 views

Where to upload media not yet compatible with Wikimedia Commons licenses? (“open dark archive”)

I took many pictures of modern art paintings at a museum. I uploaded the public domain ones to Wikimedia Commons, and wonder to what website I could upload the others. Requirements: The website ...
11
votes
2answers
608 views

Time-Series data viewer

Looking for a way of visualizing public power generation data. Typical data set has 1–5 years of hourly data, and anything up to 30 columns. Needing to pan and zoom, and perhaps select sections. Needs ...
6
votes
1answer
296 views

Mapping CSV Header to RDF + SPARQL console

I would like to know your opinion about the next system: with a large CSV file convert it's header to RDF schema, in which exists only the CSV columns information and access point. This way there's ...
4
votes
1answer
57 views

What product is the Australian government Meteor made using?

METeOR is Australia’s repository for national metadata standards for health, housing and community services statistics and information. - http://meteor.aihw.gov.au/ If I want to build a open data ...
5
votes
3answers
426 views

Simulated dataset agent based gps

I am about to do a project that involves "trajectory" prediction of human gps tracks. Preferably I need data of "agents" over months. In need some sort of "routine patterns" in it (e.g. work <-> ...
4
votes
1answer
9k views

Google search by file size

How can I sort files found by Google search according to their size or show only results that are larger than x Kilobytes? For isntance using filetype:mbox to find only large .mbox files.
5
votes
2answers
68 views

API for datapackages?

Is there an API solution for datapackages which can be self-hosted? (Ideally something more lightweight than CKAN that can run on Heroku or similar.) Overall I am looking for a solution which allows ...
5
votes
2answers
147 views

What forums / boards do you use to answer open data questions? [closed]

In NYC, we're wondering what forums and web boards do open data professionals use to answer questions around open data? CartoDB promotes the GIS Stack Exchange. BetaNYC has a spreadsheet listing NYC ...
2
votes
1answer
80 views

Vocab to describe Image Data / Pictures

I've seen a page where they describe technology along with a Vocab to describe imagery data. It allows a client to zoom into very large images which are then tiled and loaded and set focal points to ...
5
votes
2answers
2k views

Looking for web scraper that works on YouTube channel video catalogs

I'm trying to find a web scraper that will help me get detailed data from several YouTube channels I'm interested in researching. I've tried the trial version of Easy Web Extractor, but the processed ...
3
votes
2answers
203 views

Sentiment search engine

Sometimes I want to know what is the mainstream sentiment about a product/service/person/anything. For instance: is the game GTA V considered by players as entertaining or boring? are selfie sticks ...
4
votes
1answer
50 views

Retrieve affiliations from research paper

I am trying to download the data of the research papers published by people in my university. What I would like to do is then to plot the geographical distribution of the authors, and see how it ...
4
votes
2answers
149 views

Open data build project examples

This post provides a good explanation why and how the data collection process should be part of the implementation of an open data project rather than just a once-executed-and-then-forgotten step. ...
2
votes
2answers
68 views

Open data & perl

Know anybody about (more or less) complex toolset like CKAN / DKAN Socrata which is mainly programmed in the Perl language?
3
votes
0answers
53 views

How can I figure out how many U.S. phonebooks contain a particular name?

I have several names (first + last in combination) that are fairly common in the US, but I want to know how widely geographically dispersed they are. So, for example, I can search at http://names....
6
votes
1answer
39 views

Search engine for graphs where we can specify the axis we are looking for

Are there some search engines where I could search for graphs by specifying the axis I am looking for? E.g. axis 1: year; axis 2: price to store 1 TB on a hard drive.
8
votes
12answers
3k views

Best way to convert Excel Files to Open Data Formats

We have plenty of data buried in a lot of Excel files (.xls, .xlsx). The data comprises mainly statistics (first row comtains colum headers, first column contains row headers, rest of data are decimal ...
11
votes
3answers
3k views

Converting Geographic Coordinates to New York City neighboorhood names

Does anyone know of a simple tool, method or dataset to enable someone to convert geographic coordinates to New York City neighborhood names? At the very least, it would be good to map a dataset to ...
4
votes
2answers
130 views

Wiki site for data tables

Recently I participated in a digital humanities hackathon where we created programs for automatic handling of texts. For example, one program involved automatic detection of Biblical phrases in modern ...
4
votes
1answer
183 views

What is the best tool for doing explorative analysis of databases?

We are looking for a tool that plugs into a database (SQL) and help us query and visualize results dynamically, building monitoring dashboards and dynamic queries. Any good tool out there?
5
votes
2answers
284 views

Do you know a technique for text mining judicial decisions?

I'm trying to find a method to mine sepecific informations in judicial decisions (judge's name, court, area of law and neutral citation number[canadian way to cite decisions uniformly across the ...
15
votes
6answers
444 views

Collect a list of open data systems

for a research project we are trying to collect a list of relevant open data systems. I am aware that systems is very broad so I tried to categorize them a bit. Please help us extending this list ...
13
votes
4answers
311 views

How do I share Open Data with others on this SE site?

I have some data which is Open(free from copyright, patents or other control mechanisms) and I want to share it with the users here. How do I do it without having to host it on some other server and ...
4
votes
2answers
328 views

Open Product Data sources and importing into SQL

I'm trying to import the .sql file from Open Product Data, the POD Database Dump. The site recommends to use BigDump, but when I try to run the php script from BigDump in my localhost, I'm getting ...
2
votes
1answer
200 views

Parsing Curriculum Vitaes

I am wondering whether any of you could help me to find a tool that could help me to parse and extract data out of Curriculum Vitaes? I know that Sovren is a very good application but I can’t help ...
13
votes
3answers
1k views

How might I go about visualising historical temperature CSV data?

I've downloaded the Central England Temperature Data available from Met Office Hadley Centre. On their summary page, it is described thus (emphasis mine): These daily and monthly temperatures are ...
6
votes
4answers
2k views

Tool to extract the main concepts/topics from web pages

I need to find the main themes or topics for each of 50,000 website urls. For example, http://austinzencenter.org/ should return topics such as zen, monastic, austin, retreat, buddha, etc. I'm ...
3
votes
3answers
160 views

Building maps using ESRI shapefile

I would like to combine together a couple of ESRI shapefile shared by the city of Toronto. After doing a quick search I found plenty of tutorials to use those file in programming language (R, php, ...
83
votes
20answers
141k views

How can I work with a 4GB csv file?

What's the best way to access a 4GB csv file? I would like get a 'cut' of this open data set: Full Replacement Monthly NPI File, available here http://nppes.viva-it.com/NPI_Files.html Specifically, ...
5
votes
1answer
83 views

Suspected dirty data in Wikipedia articles indirectly belonging to a category

I'm trying to get a list of all articles (just the names, not the contents) that are indirectly within the category Japanese people in Wikipedia. I've tried using a tool called Quick intersection. ...
4
votes
2answers
604 views

Is there a tool to convert geoRSS into geoJSON?

I have a geoRSS file that I would like to convert to geoJSON to use it with Leaflet. I found MyGeodata Converter (mentioned on What are the most useful formats in which to release geospatial data?), ...
4
votes
5answers
1k views

Stemming of long English text

I need to perform stemming in my application, but mostly for a small subset of stems. I.e. to check if a given word is of a certain stem out of a small list of stem words. Maybe a hundred stem words ...
5
votes
1answer
3k views

Shaded KML file for US Zip Codes? Doesn't have to be perfect

I was looking for a simple KML file anyone knew of that I could just easily import and overlay onto Google Earth. I know Google Earth already seems to show postal code regions under government data, ...
3
votes
3answers
6k views

Twitter crawlers for tweets, retweets and social network

I am looking for some twitter crawlers for crawling the tweets/retweets and the social graph of some thousands of users. Suggestions are most welcome.
0
votes
2answers
100 views

Weed out inaccurate information from 2 million records

I have a database with about two million entries (!), relating IP ranges to locations. Unfortunately, a lot of the data is overlapping, so that every IP produces multiple hits (about two or three. Of ...