Questions tagged [metadata]

Metadata is data/information that provides data/information about other data. Metadata is essentially documentation of data.

Filter by
Sorted by
Tagged with
1 vote
0 answers
7 views

Number of images being used for the annual product

I am using the v2.1 annual nighttime light (NTL) product for my analysis. My study areas are several megacities, which include: Los Angles, Mexico City, Tehran, Paris, Cairo, Manila, Tokyo. I would ...
Nikos's user avatar
  • 173
1 vote
1 answer
96 views

Where can I find a large unprocessed dataset?

I am looking for a large dataset (greater than 100MB), preferably CSV, which is raw and unprocessed, with missing values. It is for a data preprocessing assignment as part of my college course on Big ...
Amal K's user avatar
  • 61
1 vote
0 answers
121 views

(How) can I use CKAN when data needs to be kept in place and only its data dictionary should be published?

Context I am investigating how I can set-up a data management system for a department of 100+ colleagues. Many of our datasets are stored (scattered is a better word) on different network drives, ...
Saaru Lindestøkke's user avatar
0 votes
1 answer
30 views

Web pages graph data sets

Is anyone aware of any web graph datasets, such that the nodes represent the webpages and the link represent the URLS? I am looking for a dataset which has node attributes. I have found many datasets, ...
Apeksha Kulkarni's user avatar
1 vote
0 answers
20 views

Projects similar to google books?

Are there other projects similar to google books that allow (legally defensible) search, snippet view, and/or metadata exploration of non-public domain books?
capet's user avatar
  • 131
1 vote
1 answer
23 views

Is there an open standard for recording pieces of media?

‘Social cataloguing’ sites like Goodreads/Letterboxd/etc. allow users to record the media they read/watch/etc., usually with dates, reviews, etc. and social elements. This can also extend beyond media ...
08915bfe02's user avatar
1 vote
0 answers
32 views

Where to find large survival dataset with at least one time dependent variable?

Looking for a large dataset for survival analysis where at least one of the variables is time-dependent. For example, this a sample dataset: time status sex age year thickness ulcer 1 10 ...
Edv Beq's user avatar
  • 111
1 vote
0 answers
62 views

Looking for Skills Taxonomy with Industry specific

Like O*NET database which have skills categorized on based on occupations defined by BLS Standard Occupations, is there any dataset similar that can provide skills categorized based on industries as ...
Raady's user avatar
  • 167
1 vote
0 answers
19 views

Is there any GitHub pull-request dataset with labels information?

I also tried to get the labels for a pull-request using GitHub API, but that did not work as labels are not linked with the pull-request. Any idea? How can I get the PR comments labels for GitHub ...
joydeba's user avatar
  • 111
1 vote
0 answers
16 views

Source for good administrative area boundary data US, MX, CA

We are using SQL Server to calculate mileage breakdowns per state. It's a simple query to find length of intersection between path (polyline) and shape. Data for US, MX, and CA were sourced from ...
katit's user avatar
  • 111
1 vote
1 answer
2k views

Unofficial Metacritic API — Chicken Coop

My team and I are building a website about video games that has affiliate links in it. My question is about the Chicken Coop API key provided by rapidapi (https://rapidapi.com/valkiki/api/chicken-...
Delicious Bacon's user avatar
1 vote
1 answer
275 views

Harvesting Bulk Metadata from ArXiv and querying by date

Recently I've found the need to query a large amount of data from ArXiv for a project I'm working on. In particular, I want to retrieve metadata according to a time query (say starting 2015 to 2016). ...
kauii8's user avatar
  • 111
1 vote
1 answer
35 views

Adding organization metadata to RSS/Atom feed?

What is the most correct / typical / popular namespace to associate an organization name, logo, and maybe website metadata with an RSS 2 (or Atom) feed entry? Can we just use https://schema.org/...
Roman Susi's user avatar
1 vote
1 answer
35 views

Where can I find demographic data on ABC network shows?

Does anyone know where I can find data on ABC network shows (like Blackish on ABC Family)? I want to see how they're doing as a company and what their demographics numbers are.
PlayerUnknown_12's user avatar
1 vote
1 answer
58 views

Open data for software requirements

I'm looking for a plattform where I can receive machine readable requirements for an application like a cms (for example firstspirit): Required memory Required hard disk capacity (depending on number ...
Tobias Oberrauch's user avatar
1 vote
1 answer
212 views

College Scorecard: determining how representative data is of the overall undergraduate body

The Question The College Scorecard Documentation Report repeatedly mentions that some data only represents undergraduates that are recipients of Title IV federal aid: Most of the metrics of ...
Anton's user avatar
  • 11
1 vote
1 answer
21 views

Google Directions train timetable coverage by country

I'm trying to figure out which countries in Europe that Google Directions has full coverage for with regards to train timetables. I found this section: https://maps.google.com/landing/transit/...
user3471881's user avatar
1 vote
1 answer
56 views

Looking for taxonomy for skills databases?

I am looking for taxonomy databases or datasets other than "O*Net" which can have skills (Tools and technologies). Added to the above, I am also looking for taxonomy which can have skills from pharma ...
Raady's user avatar
  • 167
1 vote
0 answers
17 views

Statistics about Extensible Metadata Platform (XMP) implementation by smartphone cameras

I am writing an Android photo sharing app, and pondering whether I should implement Extensible Metadata Platform reading from pictures taken by the smartphone/tablet/device's. If almost no smartphone ...
Nicolas Raoul's user avatar
  • 8,366
2 votes
2 answers
254 views

How do I get my data indexed by Google Dataset Search?

Google now offers Dataset Search (beta) https://toolbox.google.com/datasetsearch Dataset Search enables users to find datasets stored across the Web through a simple keyword search. The tool ...
1 vote
2 answers
55 views

Metadata on scientific articles (economics) conditional to set of queries

I am looking for an API/software (free or open source) able to download metadata on scientific articles (economics) according to a set of queries (e.g., words in the title/abstract, keywords, JEL code,...
Caserio's user avatar
  • 237
4 votes
1 answer
66 views

Data for all lakes on Earth?

Is there data available for all lakes on Earth? Even just a list of names would be nice; metadata is also welcome. In this case, a lake is any enclosed body of water with a surface area between some ...
Zubo's user avatar
  • 141
1 vote
2 answers
76 views

Product features / components / attributes data set

I am desperately looking for a way to either create or find an existing data set for products that lists the most common features / components or attributes of that product. An example could be: ...
cwinhall's user avatar
3 votes
3 answers
447 views

Where can I download non-malicious .EXE files for my machine learning model

I have been working on a machine learning project which detects malware. I have downloaded malicious files and tested my model and I was looking for a place which would contain about 50-60 non-...
Ronith 's user avatar
1 vote
1 answer
50 views

Which currencies are used in IMF's / Worldbank's PA.NUS.FCRF forex data?

I need annual, historic exchange rates of currencies worldwide. The PA.NUS.FCRF seems to be a great data set for that: it's open, spans almost all countries worldwide, and for many countries it dates ...
Tim Tröndle's user avatar
0 votes
1 answer
69 views

Tips for finding hard-to-locate data

Say Barry, could you use this site's "answer your own question" feature to give us some tips on how to find data that may not be readily available?
user avatar
1 vote
1 answer
127 views

The list of restricted second-level domains such as .co.uk and .ac.jp

Some country-code top-level domains (ccTLD) contain general-purpose second-level domains, like .co and .ac, so the end user of the domain is identified with the third-level domain, such as oxford.ac....
Anton Tarasenko's user avatar
0 votes
1 answer
295 views

When I click on Data Dictionary, it brings up a blank Excel spreadsheet

When I click on Data Dictionary in the College Scorecard, it brings up a blank Excel spreadsheet. Where can I find the Data Dictionary information?
Mary Neuman's user avatar
3 votes
0 answers
41 views

Clarity of Flag 124-126 in the GSOD weather dataset

The following table provides information around the Flag 124-126 of the GSOD Weather dataset the documentation of which is available here: Flag 124-124 Char A = 1 report of 6-hour ...
Derek Gardiner's user avatar
1 vote
0 answers
21 views

Spatially Orienting 1,4 Dioxane Data From the EPA UCMR-3 Data Set

I am attempting to draw conclusions about the source of 1,4 Dioxane, an emerging contaminant. In the last few years, the EPA released the UCMR-3 (Unregulated Contaminant Monitoring Rule) which had ...
Joseph T's user avatar
1 vote
1 answer
68 views

Cannot access to the OSM Boundaries website

I was using the OSM Boundaries website to download shpfiles of boundaries and using them in QGIS: Today, when I was attempted to access this website I get this message and I get the same result from ...
Nitzan Matan's user avatar
4 votes
1 answer
91 views

What is the value of standardized metadata (e.g. OAI-PMH, LOM, Dublin Core) in the days of search engines?

What is the value of standardized metadata (e.g. OAI-PMH, IEEE-LOM, Dublin Core) in the days of search engines? Sites that offer open data (e.g. Open Educational Resources), want their content to be ...
Paul Gobée's user avatar
4 votes
1 answer
416 views

Get metadata from all datasets on Socrata

Socrata.org gives a possibility to browse all datasets that are published by their customers with their API via Open Data Network. I'd like to collect metadata such as: Dataset size Number of rows ...
Sayid's user avatar
  • 173
3 votes
0 answers
140 views

Bacterial infectious diseases dataset

Does anyone know of a dataset relating: bacteria (not viruses or fungi) infectiousness symptoms ...or something of the sort? I'm looking to classify infectiousness (ie. infectious/not infectious) ...
Zach Eisner's user avatar
2 votes
1 answer
71 views

Graph representation of NUTS-3 regions to determine adjacency

I need a graph representation of NUTS-3 regions in the European Union, which can answer the question whether a certain region is neighbor of another region. Dataset available? I have looked at the ...
mondano's user avatar
  • 123
2 votes
0 answers
68 views

Accessibility categories for social media data

What is the best way to generically categorise data in social media back-end databases within a context of level of openness? Both academic sources and own thoughts and ideas are appreciated as I have ...
user3471881's user avatar
4 votes
1 answer
104 views

Availability of descriptive ship metadata

I'm creating my own ship position map by AIS (Automatic Identification System) messages from the base transceiver station (BTS). Can I find a free database of static information about the ships by ...
Michał's user avatar
  • 41
2 votes
2 answers
124 views

is there a dataset of financial blogs?

I am looking for a database that contains the name of all the financial blogs out there. Ideally each blog should be linked to the website it refers to (say, I need to be able to know that blog X is ...
ℕʘʘḆḽḘ's user avatar
3 votes
1 answer
140 views

Is there a way to ask a CKAN repository only for changed datasets after a certain time?

I am trying to harvest several CKAN repositories for their metadata, using CKAN REST API. I wanted to only update the changed datasets (metadata only) in my repository, but I do not see a way to ...
Stefano Bocconi's user avatar
3 votes
2 answers
93 views

How to extract data from web files? [closed]

Looking for some brief information on how to extract data from files on the web? If there are any tutorials or pieces that you know of, it would be great help.
Tim Garber's user avatar
4 votes
1 answer
55 views

Crosswalk for State Crime Statutes

I have arrest data from a number of cities across the United States and I'd like to make comparisons for the reasons of arrest. In this data, the reason for arrest is the state statute that the ...
fgregg's user avatar
  • 5,098
4 votes
1 answer
68 views

Will open data foster a common set of "metadata" standards?

This is just one example, but I'm sure that there can be many others. Government open data will have links to all the relevant license information, which will be found in the metadata. That ...
Tom Au's user avatar
  • 541
3 votes
0 answers
68 views

How does open data differ in quality depending on the source?

Let's talk about government data, e.g. data.gov, first. Putting aside "outliers," are most government data sets guided by e.g. "mandates" by the government? If not, how does the fact that say weather, ...
Tom Au's user avatar
  • 541
1 vote
1 answer
41 views

Is there a site that has comprehensive list of data, along with descriptions, meta data etc?

Is there a resource/website that has list of all possible datasets from around the world with links to the download page, names of columns in the individual datasets (so users can search by a ...
user1336's user avatar
  • 443
4 votes
1 answer
96 views

NEISS injury dataset - machine readable coding for characterizations

The National Electronic Injury Surveillance System (NEISS) database offers Excel downloads (example XLSX, ~50MB) on a year by year basis. The categorization of the injuries in the Excel files is given ...
philshem's user avatar
  • 17.6k
1 vote
0 answers
91 views

How to simulate stock exchange data (OHLC chart) realistically?

The stock market is described in many places (e.g. here) as a random walk. Among the various arguments against this hypothesis, nowhere is mentioned what struck me to be the most obvious one: every ...
wehnsdaefflae's user avatar
2 votes
0 answers
19 views

Get specific metadata from a group of open databases

Use case: I am investigating common characteristics of chosen databases. By databases I understand collections of data, possibly with relations between them. I want to collect metadata for all ...
Sayid's user avatar
  • 173
1 vote
0 answers
47 views

Getting metadata of all databases available on the Internet [closed]

I would like to get metadata for all (or as many as possible) databases that are available online. It does not have to be an open database. It is only the metadata that is important for me. The data I ...
Sayid's user avatar
  • 173
5 votes
1 answer
103 views

Countries with a Census

I am looking for a list of countries that have a census. The attributes would be the last census dates or dates of censuses and the census unit. I do not want variables from a census but meta ...
If you do not know- just GIS's user avatar
3 votes
1 answer
214 views

Understanding Precipitation data

I am trying to perform an analysis on weather and car collisions data of New York city. I have downloaded weather data from NOAA. But I am not able to understand the data provided in the precipitation ...
maven25's user avatar
  • 217