Questions tagged [metadata]
Metadata is data/information that provides data/information about other data. Metadata is essentially documentation of data.
90
questions
1
vote
0
answers
7
views
Number of images being used for the annual product
I am using the v2.1 annual nighttime light (NTL) product for my analysis. My study areas are several megacities, which include:
Los Angles, Mexico City, Tehran, Paris, Cairo, Manila, Tokyo.
I would ...
- 173
1
vote
1
answer
96
views
Where can I find a large unprocessed dataset?
I am looking for a large dataset (greater than 100MB), preferably CSV, which is raw and unprocessed, with missing values. It is for a data preprocessing assignment as part of my college course on Big ...
- 61
1
vote
0
answers
121
views
(How) can I use CKAN when data needs to be kept in place and only its data dictionary should be published?
Context
I am investigating how I can set-up a data management system for a department of 100+ colleagues.
Many of our datasets are stored (scattered is a better word) on different network drives, ...
0
votes
1
answer
30
views
Web pages graph data sets
Is anyone aware of any web graph datasets, such that the nodes represent the webpages and the link represent the URLS? I am looking for a dataset which has node attributes. I have found many datasets, ...
1
vote
0
answers
20
views
Projects similar to google books?
Are there other projects similar to google books that allow (legally defensible) search, snippet view, and/or metadata exploration of non-public domain books?
- 131
1
vote
1
answer
23
views
Is there an open standard for recording pieces of media?
‘Social cataloguing’ sites like Goodreads/Letterboxd/etc. allow users to record the media they read/watch/etc., usually with dates, reviews, etc. and social elements. This can also extend beyond media ...
- 111
1
vote
0
answers
32
views
Where to find large survival dataset with at least one time dependent variable?
Looking for a large dataset for survival analysis where at least one of the variables is time-dependent.
For example, this a sample dataset:
time status sex age year thickness ulcer
1 10 ...
- 111
1
vote
0
answers
62
views
Looking for Skills Taxonomy with Industry specific
Like O*NET database which have skills categorized on based on occupations defined by BLS Standard Occupations, is there any dataset similar that can provide skills categorized based on industries as ...
- 167
1
vote
0
answers
19
views
Is there any GitHub pull-request dataset with labels information?
I also tried to get the labels for a pull-request using GitHub API, but that did not work as labels are not linked with the pull-request. Any idea? How can I get the PR comments labels for GitHub ...
- 111
1
vote
0
answers
16
views
Source for good administrative area boundary data US, MX, CA
We are using SQL Server to calculate mileage breakdowns per state. It's a simple query to find length of intersection between path (polyline) and shape.
Data for US, MX, and CA were sourced from ...
- 111
1
vote
1
answer
2k
views
Unofficial Metacritic API — Chicken Coop
My team and I are building a website about video games that has affiliate links in it.
My question is about the Chicken Coop API key provided by rapidapi (https://rapidapi.com/valkiki/api/chicken-...
- 111
1
vote
1
answer
275
views
Harvesting Bulk Metadata from ArXiv and querying by date
Recently I've found the need to query a large amount of data from ArXiv for a project I'm working on. In particular, I want to retrieve metadata according to a time query (say starting 2015 to 2016). ...
- 111
1
vote
1
answer
35
views
Adding organization metadata to RSS/Atom feed?
What is the most correct / typical / popular namespace to associate an organization name, logo, and maybe website metadata with an RSS 2 (or Atom) feed entry? Can we just use https://schema.org/...
- 113
1
vote
1
answer
35
views
Where can I find demographic data on ABC network shows?
Does anyone know where I can find data on ABC network shows (like Blackish on ABC Family)? I want to see how they're doing as a company and what their demographics numbers are.
1
vote
1
answer
58
views
Open data for software requirements
I'm looking for a plattform where I can receive machine readable requirements for an application like a cms (for example firstspirit):
Required memory
Required hard disk capacity (depending on number ...
- 111
1
vote
1
answer
212
views
College Scorecard: determining how representative data is of the overall undergraduate body
The Question
The College Scorecard Documentation Report repeatedly mentions that some data only represents undergraduates that are recipients of Title IV federal aid:
Most of the metrics of ...
- 11
1
vote
1
answer
21
views
Google Directions train timetable coverage by country
I'm trying to figure out which countries in Europe that Google Directions has full coverage for with regards to train timetables.
I found this section: https://maps.google.com/landing/transit/...
- 216
1
vote
1
answer
56
views
Looking for taxonomy for skills databases?
I am looking for taxonomy databases or datasets other than "O*Net" which can have skills (Tools and technologies). Added to the above, I am also looking for taxonomy which can have skills from pharma ...
- 167
1
vote
0
answers
17
views
Statistics about Extensible Metadata Platform (XMP) implementation by smartphone cameras
I am writing an Android photo sharing app, and pondering whether I should implement Extensible Metadata Platform reading from pictures taken by the smartphone/tablet/device's.
If almost no smartphone ...
- 8,366
2
votes
2
answers
254
views
How do I get my data indexed by Google Dataset Search?
Google now offers Dataset Search (beta)
https://toolbox.google.com/datasetsearch
Dataset Search enables users to find datasets stored across the Web through a simple keyword search. The tool ...
1
vote
2
answers
55
views
Metadata on scientific articles (economics) conditional to set of queries
I am looking for an API/software (free or open source) able to download metadata on scientific articles (economics) according to a set of queries (e.g., words in the title/abstract, keywords, JEL code,...
- 237
4
votes
1
answer
66
views
Data for all lakes on Earth?
Is there data available for all lakes on Earth? Even just a list of names would be nice; metadata is also welcome.
In this case, a lake is any enclosed body of water with a surface area between some ...
- 141
1
vote
2
answers
76
views
Product features / components / attributes data set
I am desperately looking for a way to either create or find an existing data set for products that lists the most common features / components or attributes of that product.
An example could be:
...
- 21
3
votes
3
answers
447
views
Where can I download non-malicious .EXE files for my machine learning model
I have been working on a machine learning project which detects malware. I have downloaded malicious files and tested my model and I was looking for a place which would contain about 50-60 non-...
- 31
1
vote
1
answer
50
views
Which currencies are used in IMF's / Worldbank's PA.NUS.FCRF forex data?
I need annual, historic exchange rates of currencies worldwide. The PA.NUS.FCRF seems to be a great data set for that: it's open, spans almost all countries worldwide, and for many countries it dates ...
- 161
0
votes
1
answer
69
views
Tips for finding hard-to-locate data
Say Barry, could you use this site's "answer your own question" feature to give us some tips on how to find data that may not be readily available?
user3856
1
vote
1
answer
127
views
The list of restricted second-level domains such as .co.uk and .ac.jp
Some country-code top-level domains (ccTLD) contain general-purpose second-level domains, like .co and .ac, so the end user of the domain is identified with the third-level domain, such as oxford.ac....
- 3,641
0
votes
1
answer
295
views
When I click on Data Dictionary, it brings up a blank Excel spreadsheet
When I click on Data Dictionary in the College Scorecard, it brings up a blank Excel spreadsheet. Where can I find the Data Dictionary information?
3
votes
0
answers
41
views
Clarity of Flag 124-126 in the GSOD weather dataset
The following table provides information around the Flag 124-126 of the GSOD Weather dataset the documentation of which is available here:
Flag 124-124 Char A = 1 report of 6-hour ...
1
vote
0
answers
21
views
Spatially Orienting 1,4 Dioxane Data From the EPA UCMR-3 Data Set
I am attempting to draw conclusions about the source of 1,4 Dioxane, an emerging contaminant. In the last few years, the EPA released the UCMR-3 (Unregulated Contaminant Monitoring Rule) which had ...
- 11
1
vote
1
answer
68
views
Cannot access to the OSM Boundaries website
I was using the OSM Boundaries website to download shpfiles of boundaries and using them in QGIS:
Today, when I was attempted to access this website I get this message and I get the same result from ...
- 193
4
votes
1
answer
91
views
What is the value of standardized metadata (e.g. OAI-PMH, LOM, Dublin Core) in the days of search engines?
What is the value of standardized metadata (e.g. OAI-PMH, IEEE-LOM, Dublin Core) in the days of search engines? Sites that offer open data (e.g. Open Educational Resources), want their content to be ...
- 141
4
votes
1
answer
416
views
Get metadata from all datasets on Socrata
Socrata.org gives a possibility to browse all datasets that are published by their customers with their API via Open Data Network.
I'd like to collect metadata such as:
Dataset size
Number of rows
...
- 173
3
votes
0
answers
140
views
Bacterial infectious diseases dataset
Does anyone know of a dataset relating:
bacteria (not viruses or fungi)
infectiousness
symptoms
...or something of the sort?
I'm looking to classify infectiousness (ie. infectious/not infectious) ...
- 51
2
votes
1
answer
71
views
Graph representation of NUTS-3 regions to determine adjacency
I need a graph representation of NUTS-3 regions in the European Union, which can answer the question whether a certain region is neighbor of another region.
Dataset available?
I have looked at the ...
- 123
2
votes
0
answers
68
views
Accessibility categories for social media data
What is the best way to generically categorise data in social media back-end databases within a context of level of openness?
Both academic sources and own thoughts and ideas are appreciated as I have ...
- 216
4
votes
1
answer
104
views
Availability of descriptive ship metadata
I'm creating my own ship position map by AIS (Automatic Identification System) messages from the base transceiver station (BTS).
Can I find a free database of static information about the ships by ...
- 41
2
votes
2
answers
124
views
is there a dataset of financial blogs?
I am looking for a database that contains the name of all the financial blogs out there.
Ideally each blog should be linked to the website it refers to (say, I need to be able to know that blog X is ...
- 191
3
votes
1
answer
140
views
Is there a way to ask a CKAN repository only for changed datasets after a certain time?
I am trying to harvest several CKAN repositories for their metadata, using CKAN REST API.
I wanted to only update the changed datasets (metadata only) in my repository, but I do not see a way to ...
3
votes
2
answers
93
views
How to extract data from web files? [closed]
Looking for some brief information on how to extract data from files on the web? If there are any tutorials or pieces that you know of, it would be great help.
- 101
4
votes
1
answer
55
views
Crosswalk for State Crime Statutes
I have arrest data from a number of cities across the United States and I'd like to make comparisons for the reasons of arrest. In this data, the reason for arrest is the state statute that the ...
- 5,098
4
votes
1
answer
68
views
Will open data foster a common set of "metadata" standards?
This is just one example, but I'm sure that there can be many others.
Government open data will have links to all the relevant license information, which will be found in the metadata. That ...
- 541
3
votes
0
answers
68
views
How does open data differ in quality depending on the source?
Let's talk about government data, e.g. data.gov, first. Putting aside "outliers," are most government data sets guided by e.g. "mandates" by the government? If not, how does the fact that say weather, ...
- 541
1
vote
1
answer
41
views
Is there a site that has comprehensive list of data, along with descriptions, meta data etc?
Is there a resource/website that has list of all possible datasets from around the world with links to the download page, names of columns in the individual datasets (so users can search by a ...
- 443
4
votes
1
answer
96
views
NEISS injury dataset - machine readable coding for characterizations
The National Electronic Injury Surveillance System (NEISS) database offers Excel downloads (example XLSX, ~50MB) on a year by year basis. The categorization of the injuries in the Excel files is given ...
- 17.6k
1
vote
0
answers
91
views
How to simulate stock exchange data (OHLC chart) realistically?
The stock market is described in many places (e.g. here) as a random walk. Among the various arguments against this hypothesis, nowhere is mentioned what struck me to be the most obvious one: every ...
- 151
2
votes
0
answers
19
views
Get specific metadata from a group of open databases
Use case:
I am investigating common characteristics of chosen databases. By databases I understand collections of data, possibly with relations between them.
I want to collect metadata for all ...
- 173
1
vote
0
answers
47
views
Getting metadata of all databases available on the Internet [closed]
I would like to get metadata for all (or as many as possible) databases that are available online. It does not have to be an open database. It is only the metadata that is important for me. The data I ...
- 173
5
votes
1
answer
103
views
Countries with a Census
I am looking for a list of countries that have a census. The attributes would be the last census dates or dates of censuses and the census unit. I do not want variables from a census but meta ...
3
votes
1
answer
214
views
Understanding Precipitation data
I am trying to perform an analysis on weather and car collisions data of New York city. I have downloaded weather data from NOAA. But I am not able to understand the data provided in the precipitation ...
- 217