Questions tagged [tool-request]
Indicates a request for tools to create or manage open data.
74 questions
1
vote
0
answers
18
views
Options for analyzing twitter hashtag use by various factors - date of account creation, location, username strings and even defined user lists
I am not sure if this question is better suited for data science but I'm mostly looking for an outline of what currently is or is not possible and a direction for where I should learn more.
My first ...
- 11
1
vote
1
answer
33
views
What would be the best ontology evaluation tool to use to analyse and evaluate the Computer Science Ontology (CSO)?
A tool that can assess the effectiveness of the Computer Science Ontology (CSO) in the best possible way, by assessing metrics such as accuracy, completeness, conciseness, consistency, expressiveness ...
- 11
1
vote
0
answers
26
views
Distribution of number of people having money M in their bank account [closed]
Not sure whether to post this here or have my post migrated to personal finance and money SE, please recommend.
I would like to know, where I can find, for each country, the graph of the following ...
1
vote
1
answer
93
views
Data integration tool that supports Semantic Web
I've multiple data sources (files or API data). I want to integrate all these sources using one common ontology.
I've started using Karma Information Integration Tool; however, I'm facing some ...
- 123
2
votes
1
answer
21
views
Carto Help in minimizing geographic dataset
I have a file that contains location points all over the world, using lat long coordinates. I am trying to trim it down to only new York and Newark new jersey. I have a shape file that is the ...
- 21
0
votes
2
answers
53
views
If Wordpress is an appropriate tool for loading open data into a system's front end, what would I use for the backend?
This question was inspired by this one.
I want to load open data into the backend of my system. That is, I want the data to be accessible to my developers, but not the public. I was told by an IT ...
- 541
3
votes
1
answer
64
views
How to add a claim to an existing Wikidata item, from command line?
I want to add to Wikidata this claim:
Embassy of Switerland, London - is operated by - Switzerland
... using my Linux command-line.
Launching a web request via curl is OK too.
How to do?
I have ...
- 8,486
4
votes
1
answer
161
views
What kind of spreadsheet/application are the Socrata datasets built on?
I have yet to see another online service for viewing spreadsheets that works as seamlessly as the Socrata sets. It seems no matter how much data or how many rows there are - it is always consistently ...
2
votes
2
answers
79
views
Whats the simplest way to get 1000 twitter handles of users in USA who are less than 21 years of age?
Need 1000 twitter handles of users who are below 21 years of age and residing in US
2
votes
1
answer
115
views
Long-term search trends by domain
I want to know what people are searching for in a particular domain (the domain is enterprise software, if that matter). The goal is to discover new trends.
I tried the Hot Trends feature which is ...
- 8,486
3
votes
2
answers
209
views
Scientometric/bibliometric data retrieval from a list of DOI
I am a conducting bibliometric analysis on small/midsize sets of academic papers (40-400), in a longitudinal study (repeated over time on the same dataset). I am interest in retrieving data for each ...
- 517
4
votes
0
answers
51
views
What you look for in a codebook
I'm putting together a few codebooks/data dictionaries for our transparency portal. In doing so I have been reviewing some examples to get an idea of what civic hackers look for in such a document.
My ...
- 51
2
votes
2
answers
78
views
Open data set to calculate the correlation between different brands
Is there any data sets / methods available to find correlation between different 'bands' ?
Brands : Puma, Google, Microsoft, Nike, BMW etc
Is there any open data set available to find this ...
- 153
7
votes
2
answers
127
views
Creating data from web tables with import.io failed - other tools?
I found this site with solar system moon orbit data: Table of moons in solar system.
I ran that through the http://import.io site and it only came up with Jupiter data. Is there a more comprehensive ...
- 231
2
votes
1
answer
180
views
Simple, online collaborative database
I would like to launch an online collaborative database (< 100 MB, most likely < 10 MB). I'll use either MySQL, MariaDB or PostgreSQL.
I need a platform that would allow people to submit pull ...
- 7,815
4
votes
0
answers
100
views
Memex open data (Dark web)
Has any data been created by Memex that is available for open use? Is Memex even available to be used in order to create open data of the "dark web"?
- 639
6
votes
2
answers
202
views
Cleaning up addresses in a large data set
I have a dataset of about half a million unique addresses. An address consists of a StreetAddress1, StreetAddress2, City, State and Zip code (all addresses are in the United States).
One of my main ...
- 355
6
votes
2
answers
122
views
Where to upload media not yet compatible with Wikimedia Commons licenses? ("open dark archive")
I took many pictures of modern art paintings at a museum.
I uploaded the public domain ones to Wikimedia Commons, and wonder to what website I could upload the others.
Requirements:
The website ...
- 8,486
11
votes
1
answer
779
views
Time-Series data viewer
Looking for a way of visualizing public power generation data. Typical data set has 1–5 years of hourly data, and anything up to 30 columns. Needing to pan and zoom, and perhaps select sections. Needs ...
- 555
6
votes
1
answer
369
views
Mapping CSV Header to RDF + SPARQL console
I would like to know your opinion about the next system:
with a large CSV file
convert it's header to RDF schema, in which exists only the CSV columns information and access point. This way there's ...
- 63
5
votes
1
answer
69
views
What product is the Australian government Meteor made using?
METeOR is Australia’s repository for national metadata standards for health, housing and community services statistics and information. - http://meteor.aihw.gov.au/
If I want to build a open data ...
5
votes
3
answers
507
views
Simulated dataset agent based gps
I am about to do a project that involves "trajectory" prediction of human gps tracks. Preferably I need data of "agents" over months. In need some sort of "routine patterns" in it (e.g. work <-> ...
- 53
6
votes
1
answer
18k
views
Google search by file size
How can I sort files found by Google search according to their size or show only results that are larger than x Kilobytes?
For isntance using filetype:mbox to find only large .mbox files.
- 293
5
votes
2
answers
74
views
API for datapackages?
Is there an API solution for datapackages which can be self-hosted?
(Ideally something more lightweight than CKAN that can run on Heroku or similar.)
Overall I am looking for a solution which allows ...
- 151
5
votes
2
answers
154
views
What forums / boards do you use to answer open data questions? [closed]
In NYC, we're wondering what forums and web boards do open data professionals use to answer questions around open data?
CartoDB promotes the GIS Stack Exchange.
BetaNYC has a spreadsheet listing NYC ...
- 275
2
votes
1
answer
114
views
Vocab to describe Image Data / Pictures
I've seen a page where they describe technology along with a Vocab to describe imagery data. It allows a client to zoom into very large images which are then tiled and loaded and set focal points to ...
- 409
6
votes
2
answers
3k
views
Looking for web scraper that works on YouTube channel video catalogs
I'm trying to find a web scraper that will help me get detailed data from several YouTube channels I'm interested in researching.
I've tried the trial version of Easy Web Extractor, but the processed ...
3
votes
2
answers
226
views
Sentiment search engine
Sometimes I want to know what is the mainstream sentiment about a product/service/person/anything.
For instance:
is the game GTA V considered by players as entertaining or boring?
are selfie sticks ...
- 8,486
5
votes
1
answer
60
views
Retrieve affiliations from research paper
I am trying to download the data of the research papers published by people in my university. What I would like to do is then to plot the geographical distribution of the authors, and see how it ...
user3961
4
votes
2
answers
165
views
Open data build project examples
This post provides a good explanation why and how the data collection process should be part of the implementation of an open data project rather than just a once-executed-and-then-forgotten step.
...
- 151
2
votes
2
answers
85
views
Open data & perl
Know anybody about (more or less) complex toolset like
CKAN / DKAN
Socrata
which is mainly programmed in the Perl language?
- 235
3
votes
0
answers
60
views
How can I figure out how many U.S. phonebooks contain a particular name?
I have several names (first + last in combination) that are fairly common in the US, but I want to know how widely geographically dispersed they are. So, for example, I can search at http://names....
- 155
6
votes
1
answer
42
views
Search engine for graphs where we can specify the axis we are looking for
Are there some search engines where I could search for graphs by specifying the axis I am looking for? E.g. axis 1: year; axis 2: price to store 1 TB on a hard drive.
- 7,815
8
votes
12
answers
3k
views
Best way to convert Excel Files to Open Data Formats
We have plenty of data buried in a lot of Excel files (.xls, .xlsx). The data comprises mainly statistics (first row comtains colum headers, first column contains row headers, rest of data are decimal ...
- 459
11
votes
3
answers
4k
views
Converting Geographic Coordinates to New York City neighboorhood names
Does anyone know of a simple tool, method or dataset to enable someone to convert geographic coordinates to New York City neighborhood names?
At the very least, it would be good to map a dataset to ...
4
votes
2
answers
146
views
Wiki site for data tables
Recently I participated in a digital humanities hackathon where we created programs for automatic handling of texts. For example, one program involved automatic detection of Biblical phrases in modern ...
4
votes
1
answer
190
views
What is the best tool for doing explorative analysis of databases?
We are looking for a tool that plugs into a database (SQL) and help us query and visualize results dynamically, building monitoring dashboards and dynamic queries.
Any good tool out there?
- 81
5
votes
2
answers
347
views
Do you know a technique for text mining judicial decisions?
I'm trying to find a method to mine sepecific informations in judicial decisions (judge's name, court, area of law and neutral citation number[canadian way to cite decisions uniformly across the ...
- 51
17
votes
6
answers
532
views
Collect a list of open data systems
for a research project we are trying to collect a list of relevant open data systems. I am aware that systems is very broad so I tried to categorize them a bit.
Please help us extending this list ...
- 271
15
votes
4
answers
487
views
How do I share Open Data with others on this SE site?
I have some data which is Open(free from copyright, patents or other control mechanisms) and I want to share it with the users here. How do I do it without having to host it on some other server and ...
- 253
4
votes
2
answers
392
views
Open Product Data sources and importing into SQL
I'm trying to import the .sql file from Open Product Data, the POD Database Dump. The site recommends to use BigDump, but when I try to run the php script from BigDump in my localhost, I'm getting ...
2
votes
1
answer
269
views
Parsing Curriculum Vitaes
I am wondering whether any of you could help me to find a tool that could help me to parse and extract data out of Curriculum Vitaes?
I know that Sovren is a very good application but I can’t help ...
- 4,447
13
votes
3
answers
2k
views
How might I go about visualising historical temperature CSV data?
I've downloaded the Central England Temperature Data available from Met Office Hadley Centre. On their summary page, it is described thus (emphasis mine):
These daily and monthly temperatures are ...
- 233
9
votes
4
answers
3k
views
Tool to extract the main concepts/topics from web pages
I need to find the main themes or topics for each of 50,000 website urls.
For example, http://austinzencenter.org/ should return topics such as zen, monastic, austin, retreat, buddha, etc.
I'm ...
- 289
3
votes
3
answers
175
views
Building maps using ESRI shapefile
I would like to combine together a couple of ESRI shapefile shared by the city of Toronto. After doing a quick search I found plenty of tutorials to use those file in programming language (R, php, ...
- 1,595
93
votes
21
answers
174k
views
How can I work with a 4GB csv file?
What's the best way to access a 4GB csv file?
I would like get a 'cut' of this open data set: Full Replacement Monthly NPI File, available here.
Specifically, I want only the rows for hospitals; ...
- 949
5
votes
1
answer
93
views
Suspected dirty data in Wikipedia articles indirectly belonging to a category
I'm trying to get a list of all articles (just the names, not the contents) that are indirectly within the category Japanese people in Wikipedia.
I've tried using a tool called Quick intersection. ...
- 283
5
votes
2
answers
915
views
Is there a tool to convert geoRSS into geoJSON?
I have a geoRSS file that I would like to convert to geoJSON to use it with Leaflet. I found MyGeodata Converter (mentioned on What are the most useful formats in which to release geospatial data?), ...
- 125
4
votes
6
answers
1k
views
Stemming of long English text
I need to perform stemming in my application, but mostly for a small subset of stems. I.e. to check if a given word is of a certain stem out of a small list of stem words. Maybe a hundred stem words ...
- 141
5
votes
1
answer
4k
views
Shaded KML file for US Zip Codes? Doesn't have to be perfect
I was looking for a simple KML file anyone knew of that I could just easily import and overlay onto Google Earth. I know Google Earth already seems to show postal code regions under government data, ...
- 415