Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [wikipedia]

Wikipedia is a collaboratively edited, multilingual, free Internet encyclopedia supported by the non-profit Wikimedia Foundation.

1
vote
1answer
27 views

Wikimedia Commons API image by category

I'm trying to retrieve a list of urls of images in Wikimedia Commons from a particular article. I want to either search article by category and retrieve images from them, or filter images by category. ...
3
votes
0answers
22 views

Is it fair use to use figures from ArXiv preprints on Wikipedia?

Apologies if this isn't the right exchange. I'm not sure where this question should live. There are some science figures from Arxiv papers that I think would greatly enhance a Wikipedia page on the ...
3
votes
1answer
31 views

2 category intersection with PetScan not working?

I'm trying to create an intersection between two categories on Wiktionary using PetScan (http://tools.wmflabs.org/catscan2/catscan2.php), but I can't get it to work. What I've read says it should be ...
3
votes
1answer
50 views

Crosswalk between FIPS codes and Wikipedia articles about U.S. Census Places

The English Wikipedia includes an article for nearly every U.S. Census Place. Has anyone published a crosswalk from FIPS codes of these places to Wikipedia urls? Is this something that would be ...
1
vote
1answer
54 views

How can I get data about Wikipedians (e.g. language proficiency), by username?

Is there an open dataset containing information such as username, language proficiency levels (https://en.m.wikipedia.org/wiki/Wikipedia:Babel/Levels) and (possibly) academic degrees and nationality ...
1
vote
1answer
24 views

Search in wikidata with specific Q code

I've this query but I can't understand why doesn't return any result. I try different versions (with link, with only code, with wd:code) but nothing seems to work. What I need is this query but ...
2
votes
1answer
103 views

Wikidata - Search of human instance that doesn't break

Is this possible, like the wikidata autocomplete combo works, in a speedy way, with a filter of "itemlabel strings start with..." ? PREFIX xsd: <http://www.w3.org/2001/XMLSchema#> SELECT ?item ...
4
votes
1answer
142 views

Is there any open dataset for named entity linking?

Entity linking is the task of detecting mentions of entities from a knowledge base in a document. Are there any openly available datasets to train and evaluate such systems? The datasets I came ...
0
votes
0answers
32 views

Is there a comprehensive dataset of faces derived from Wikipedia/Wikimedia images?

I am looking for a comprehensive dataset of faces derived from Wikipedia/Wikimedia images associated with Wikipedia person pages. I know that images can be found via the various APIs. What I want are ...
3
votes
1answer
27 views

Wikidata differs from Wikipedia

I am trying to retrieve data for a company programmatically using the Wikidata API. However, the data retrieved from Wikidata is different from en.wikipedia.org. Is this expected? Example: Nissan ...
2
votes
2answers
109 views

Various Country Statistics

In Wikipedia articles of countries a lot of statistics are given about the country at hand. For example in the Venezuela article, demographics are described in terms of ethnic groups (e.g. 51.6% are ...
1
vote
0answers
41 views

Download clean coordinates from Wikipedia Map Module: … detailed map

I would like to know if there is a way to either download/scrape a clean CSV with coordinates and controlling group from Wikipedia conflict maps, or how to generate an ESRI shapefile from the Lua ...
4
votes
1answer
56 views

Wikipedia Article Category

The wikipedia Page View API provides information about the number of page views for a given article, including an option to view top-N articles in a given day or month: https://wikimedia.org/api/...
1
vote
0answers
36 views

wikipedia user data for a recommendation engine

So I pulled the Wikipedia Page Traffic Statistics into an AWS instance and then downloaded a file which represents one hour from several months of usage data to look at locally, but it didn't really ...
4
votes
2answers
81 views

Info based on page title?

I'm looking for a way to get info from wikipedia based on the page title. example: If i have a page called "Britney Spears" i want to be able to get a simple bio extracted from wikipedia onto the ...
3
votes
1answer
48 views

Wikipedia: How to activate email notification from watchlist?

I may have a blackout on this, so please help. I have a wikipedia account with a confirmed email. I have checked the box "Email me when a page or file on my watchlist is changed". I have two pages ...
9
votes
2answers
283 views

Is Wikidata up to date with Wikipedia?

I think that DBpedia links to Wikipedia by Wikipedia database dump, making it not up to date with on-line Wikipedia contents. I was wondering if Wikidata uses on-line Wikipedia content or if it also ...
2
votes
2answers
329 views

Get section and page title from a list of articles in Wikipedia via API

I want to get the different sections with their pages from the Wikipedia:Featured articles. By following this answer, I know I can get page titles of links as follows: https://en.wikipedia.org/w/...
5
votes
2answers
135 views

How to get urls of entries in wikipedia list articles?

I am trying to retrieve the URL of all articles listed inside wikipedia list articles. For concreteness lets consider the wikimedia list article List_of_American_scientists I know how to use the wiki ...
1
vote
1answer
50 views

Downloading wikipedia data from specific url

I want to download data from https://en.wikipedia.org/wiki/List_of_districts_of_Germany I am rookie at this and can'T find any relevant articles. Most of them are on downloading full wikipedia. I ...
2
votes
2answers
727 views

Download wikipedia dump and save in raw text form

I have been trying to use Wikipedia text data for my personal research. I know that crawling is not good for the Wikipedia server so I downloaded big xml file from https://dumps.wikimedia.org/jawiki/...
6
votes
1answer
209 views

wikidata: (when) will it be possible to query for wikipedia page links?

(When) will the following be possible: For a wikipedia page: get the list of all wikipedia links on that page with their respective wikidata IDs in a single query/API call. Receive additional ...
5
votes
2answers
155 views

wikipedia page: get the list of all links with their wikidata ids

For a Wikipedia page: is it possible to get the list of all Wikipedia links on that page with their respective wikidata IDs in a single query/API call? Optional: can additional information of the ...
4
votes
2answers
240 views

ISO 3166-1 country codes in DBpedia

How can I get a two-letter ISO 3166-1 country code in DBpedia? More specifically, I'm querying the SPARQL endpoint like this: SELECT DISTINCT ?iata ?country where { ?airport a dbo:Airport. ?...
2
votes
1answer
69 views

Wikipedia database: categories and category mapping across languages

I've imported the wikipedia database in four languages with the goal of running some machine learning algorithms on it for text classification. The import doesn't populate the "category" table though. ...
5
votes
1answer
113 views

Getting influences / influencedBy data from DBpedia

I am struggling with DBpedia. The description is unclear (to the point that for me it is hard to tell which data can be obtain, which - cannot), and (what is worst) it does not have many examples (...
2
votes
1answer
83 views

Too few results from DBpedia

I am using the following query to get Athletes data from DBpedia SELECT * WHERE { ?player a <http://dbpedia.org/ontology/Athlete> . ?player foaf:name ?firstname . ?player foaf:surname ?...
15
votes
2answers
2k views

Get Wikipedia URLs (sitelinks) in Wikidata SPARQL query

I can use the following query to list all sovereign states via the Wikidata query interface: PREFIX wikibase: <http://wikiba.se/ontology#> PREFIX wd: <http://www.wikidata.org/entity/> ...
7
votes
3answers
2k views

Get season statistics for NFL players

So as the title suggests I'm trying to retrieve NFL stats for players. I've found that Wikipedia has a quite extensive statistics panel for a lot of players (i.e Tom Brady https://en.wikipedia.org/...
1
vote
1answer
56 views

How to use multiple wikipedia categories for Quick Intersection?

I'm using http://tools.wmflabs.org/quick-intersection/index.php to get a list of articles within categories but I have a list of over 35 categories and I'd like to use Quick Intersection to get the ...
12
votes
4answers
2k views

Mapping all Wikipedia URLs to Wikidata entity ids

Is there a Wikidata dump that maps all Wikipedia URLs to their corresponding Wikidata entity ids, e.g. the Wikipedia URL https://en.wikipedia.org/wiki/Tom_Hanks to the Wikidata entity id Q2263?
11
votes
4answers
818 views

How to get soccer players Wikipedia URL?

I'd like to grab as many soccer players names and their Wikipedia URL. For example: "David Beckham": 'David_Beckham', "Wayne Rooney": 'Wayne_Rooney' The first portion is their name and the second is ...
5
votes
3answers
488 views

How can I add Wikidata properties of item a on the Wikipedia page of item b?

How would I get the eccentricity (Property:P1096) of Venus (Q313) in the article en:Mars? I have figured out that I have to write {{#property:P1096}} if I want to get a property of the page on that ...
5
votes
1answer
194 views

“DBpedia as Tables” not having all the properties

I browsed a sample for available data at http://dbpedia.org/page/Sachin_Tendulkar. I wanted these properties as columns, so I downloaded the CSV files from http://wiki.dbpedia.org/DBpediaAsTables. ...
3
votes
1answer
68 views

Where should I host/contribute a mapping from Stack Overflow tags to Wikipedia articles?

I had asked for a mapping from Stack Overflow tags to Wikipedia articles over at meta.stackoverflow, but no one seemed to find one, so I started building my own. Where is the "right" place for me to ...
5
votes
1answer
2k views

Download Wikipedia articles from a specific category

I know that I can download English Wikipedia Dump, but I was wondering if I can download only articles for a specific category-subject. For instance, can I download articles related to Mathematics or ...
5
votes
1answer
80 views

Suspected dirty data in Wikipedia articles indirectly belonging to a category

I'm trying to get a list of all articles (just the names, not the contents) that are indirectly within the category Japanese people in Wikipedia. I've tried using a tool called Quick intersection. ...
9
votes
3answers
395 views

How to get wikipedia daily updates

I installed media-wiki on ec2 machine and loaded the wikipedia page-articles dump content and other relevant data into that. I want to update the data regularly(daily) but I didn't get any resource ...
20
votes
10answers
5k views

Wikipedia table to JSON (or other machine-readable format)

I'm interested in the data listed in the tables listed here. Is there a good way to extract the information (as JSON, preferably) without resorting to HTML parsing?
6
votes
2answers
3k views

Wikipedia dump files in SQL format

I need to access to history of each wiki page. I found http://dumps.wikimedia.org/fawiki/latest/fawiki-latest-pages-meta-history.xml.7z contains such data for Persian wiki in XML format. But I want ...
11
votes
4answers
2k views

What server and technologies can I use to extract data out of Wikipedia's infoboxes (e.g., ATC code for drugs)

Wikipedia is a significant source of data. Data from Wikipedia may be available in various formats via other servers (e.g., SPARQL end point). For a task of extracting all pairs of "ATC code" - "...