Andrew
  • Member for 6 years, 11 months
  • Last seen this week
  • Cambridge, UK
6 answers
14 votes
4k views
Mapping all Wikipedia URLs to Wikidata entity ids
Accepted answer
8 votes

If you want to do this from the dumps, you can use the wb_items_per_site dump (current version, 625 MB; most recent dumps) For each Wikidata item, this contains rows with the corresponding page ...

View answer
4 answers
12 votes
1k views
How to get soccer players Wikipedia URL?
Accepted answer
6 votes

First of all, if you want the page content, the best way to do this isn't by scraping, but by processing one of the database dumps - you can do this locally, and it'll allow you to get the raw page ...

View answer
1 answers
8 votes
216 views
Can I put a CC BY-SA photo in a non CC BY-SA work?
4 votes

Assuming you comply with the license as regards attribution and labelling (ie, you indicate the author + the license in an appropriate way, such as an image caption) then you are free to do this. The ...

View answer
4 answers
10 votes
244 views
API to get Wikimedia Commons categories that are near a particular latitude/longitude
4 votes

Wikidata can do it! Using autolist, run the query claim[373] and around[625,40.7576,-73.9857,50] [link]. This will give you all items with a commons category property (P373) and a location (P625) up ...

View answer
6 answers
8 votes
315 views
Cases where open data has been removed?
4 votes

One you'll probably remember - Wikimedia released (CC0) search logs in 2012, realised they were insufficiently anonymised, and took them down the same day: https://blog.wikimedia.org/2012/09/19/what-...

View answer
1 answers
3 votes
151 views
Historic weather data for Germany in 1938
3 votes

@Philsheim points out the very useful weather data discussed in 1945 (spring) daily weather Germany Sadly, it looks like data for Weiden in that set only goes back to 1947, as do most nearby weather ...

View answer
1 answers
3 votes
117 views
Mapping a Wikimedia project URL to the corresponding Wikidata entity id
Accepted answer
3 votes

As a general rule, Wikidata won't know about redirects - they're not part of the model there. They only record the canonical page title (leaving aside a few rare cases where the Wikidata sitelink is a ...

View answer
1 answers
3 votes
59 views
Where can I find data on method of travel to train stations?
3 votes

In the UK, you may be able to get this through the National Travel Survey data, though I'm not sure if it's broken down on a station-by-station basis. It looks like it may simply be regional. Within ...

View answer
1 answers
1 votes
47 views
Is it legal to publish under CC-BY-SA a picture of a recent sculpture in Japan?
Accepted answer
3 votes

This is not really an "open data" question, but... The answer is "you are not allowed to do this"; Japan does not allow commercial photography of otherwise copyrighted artistic works in public places,...

View answer
1 answers
1 votes
26 views
Seeking location data for UK parliamentary constituencies
Accepted answer
2 votes

The ONS has what looks like the data you're looking for - digital vector boundaries for Westminster Parliamentary Constituencies in the UK, as at 31 December 2017.

View answer
2 answers
2 votes
77 views
Is it possible to know the number of American residents/students/tourists leaving France each year?
2 votes

It seems likely that the vast majority are tourists, so you should be able to get a good first approximation by looking at tourist arrival numbers - generally speaking, tourist arrivals & ...

View answer
2 answers
2 votes
64 views
Antebellum Newspaper Data
2 votes

The US Newspapers Directory has a substantial amount of metadata about publication locations & dates, but nothing on circulation. Some bulk data/linked data access is apparently available. It's ...

View answer
3 answers
5 votes
531 views
How can I add Wikidata properties of item a on the Wikipedia page of item b?
2 votes

To add to Patrick's answer, "arbitrary access" to Wikidata items from other Wikipedia pages is now available: https://www.wikidata.org/wiki/Wikidata:Arbitrary_access It's currently (14 May 2015) ...

View answer
1 answers
0 votes
43 views
Wikimedia: Delta-Dumps or Timestamp of Last Change
Accepted answer
1 votes

There are two ways to generate a list of last-revision data for all pages. The preferable tool is probably the second one listed here, PetScan. The first is to use the Wikimedia Quarry SQL service (...

View answer
2 answers
1 votes
178 views
Converting Wikipedia URL to Wikipedia Page ID
1 votes

The title field in that datadump appears to be the same as the page title, and thus can be used as the page URL - standard Wikipedia URLs are of the form .../wiki/Page_title { "id": &...

View answer