Questions tagged [wikipedia]
Wikipedia is a collaboratively edited, multilingual, free Internet encyclopedia supported by the non-profit Wikimedia Foundation.
48
questions
2
votes
0answers
25 views
Torrent for Wikidata dump
I'm looking for Wikipedia (enwiki-latest-pages-articles-multistream.xml.bz2) and a Wikidata (latest-all.json.bz2 ) dumps. The files are quite large (the latter has ~47GB) and my internet connection ...
1
vote
1answer
23 views
How do I extract certain articles from Arabic Wiki Dumps?
I need to collect all articles that are about countries and continents in Arabic from Wikipedia. I was wondering how do I find these articles if I downloaded the latest wiki dump?
New to the field. ...
0
votes
1answer
41 views
Query wikipedia links
I'm using the following query to receive label and description of all Wikidata-entries with geo-location in a geo-bounding box:
SELECT DISTINCT ?place ?placeLabel ?placeDescription ?location WHERE
{
...
0
votes
0answers
16 views
How come there are missing entities in this SPARQL query?
I was interested in listing all books,
so I wrote:
SELECT ?book ?url WHERE {
?book wdt:P31 wd:Q571 .
OPTIONAL {
?url schema:about ?book .
?url schema:inLanguage "en" .
?url schema:isPartOf <...
1
vote
1answer
11 views
Non commercial use of nfl team logos from Wikipedia
I am about to publish some use cases for an open source visualization I did for hierarchical data.
One use case is sports data, e.g. visualizing the super bowl play by play. I would like to use the ...
0
votes
0answers
11 views
Wiki Sparql difference between wikibase:apiOutput and wikibase:apiOutputItem?
Reading https://www.mediawiki.org/wiki/Wikidata_Query_Service/User_Manual/MWAPI#Find_articles_in_Wikipedia and trying some queries, I have come to the question: What is the difference between "...
1
vote
1answer
58 views
What are Outlink categories of Wikipedia
I am wondering if it is possible to view outlink categories of a given article in Wikipedia? For example, consider the Wikipedia article about 'Data Mining'. What are the outlink categories of "Data ...
2
votes
1answer
44 views
Limiting a SPARQL Query to Lastest Point in Time
I'm trying to get information on Prefectures in Japan out of Wikidata. I succeeded to read the population statement, however there are occasionally several values with different point in time fields.
...
2
votes
2answers
91 views
How to get specific wikipedia data?
I only want to use the link structure and articles’ content of Wikipedia. Therefore, I want to downlaod the dump that contains only the following details.
articles content
link structure (i.e. re-...
2
votes
1answer
244 views
Wikimedia Commons API image by category
I'm trying to retrieve a list of urls of images in Wikimedia Commons from a particular article. I want to either search article by category and retrieve images from them, or filter images by category. ...
3
votes
0answers
31 views
Is it fair use to use figures from ArXiv preprints on Wikipedia?
Apologies if this isn't the right exchange. I'm not sure where this question should live.
There are some science figures from Arxiv papers that I think would greatly enhance a Wikipedia page on the ...
3
votes
1answer
40 views
2 category intersection with PetScan not working?
I'm trying to create an intersection between two categories on Wiktionary using PetScan (http://tools.wmflabs.org/catscan2/catscan2.php), but I can't get it to work. What I've read says it should be ...
3
votes
1answer
57 views
Crosswalk between FIPS codes and Wikipedia articles about U.S. Census Places
The English Wikipedia includes an article for nearly every U.S. Census Place. Has anyone published a crosswalk from FIPS codes of these places to Wikipedia urls?
Is this something that would be ...
1
vote
1answer
57 views
How can I get data about Wikipedians (e.g. language proficiency), by username?
Is there an open dataset containing information such as username, language proficiency levels (https://en.m.wikipedia.org/wiki/Wikipedia:Babel/Levels) and (possibly) academic degrees and nationality ...
1
vote
1answer
37 views
Search in wikidata with specific Q code
I've this query but I can't understand why doesn't return any result. I try different versions (with link, with only code, with wd:code) but nothing seems to work. What I need is this query but ...
2
votes
1answer
148 views
Wikidata - Search of human instance that doesn't break
Is this possible, like the wikidata autocomplete combo works, in a speedy way, with a filter of "itemlabel strings start with..." ?
PREFIX xsd: <http://www.w3.org/2001/XMLSchema#>
SELECT ?item ...
4
votes
1answer
469 views
Is there any open dataset for named entity linking?
Entity linking is the task of detecting mentions of entities from a knowledge base in a document.
Are there any openly available datasets to train and evaluate such systems? The datasets I came ...
4
votes
1answer
45 views
Wikidata differs from Wikipedia
I am trying to retrieve data for a company programmatically using the Wikidata API. However, the data retrieved from Wikidata is different from en.wikipedia.org. Is this expected?
Example: Nissan ...
2
votes
2answers
114 views
Various Country Statistics
In Wikipedia articles of countries a lot of statistics are given about the country at hand. For example in the Venezuela article, demographics are described in terms of ethnic groups (e.g. 51.6% are ...
1
vote
0answers
43 views
Download clean coordinates from Wikipedia Map Module: … detailed map
I would like to know if there is a way to either download/scrape a clean CSV with coordinates and controlling group from Wikipedia conflict maps, or how to generate an ESRI shapefile from the Lua ...
4
votes
1answer
65 views
Wikipedia Article Category
The wikipedia Page View API provides information about the number of page views for a given article, including an option to view top-N articles in a given day or month:
https://wikimedia.org/api/...
1
vote
0answers
38 views
wikipedia user data for a recommendation engine
So I pulled the Wikipedia Page Traffic Statistics into an AWS instance and then downloaded a file which represents one hour from several months of usage data to look at locally, but it didn't really ...
3
votes
2answers
105 views
Info based on page title?
I'm looking for a way to get info from wikipedia based on the page title.
example: If i have a page called "Britney Spears" i want to be able to get a simple bio extracted from wikipedia onto the ...
3
votes
1answer
61 views
Wikipedia: How to activate email notification from watchlist?
I may have a blackout on this, so please help.
I have a wikipedia account with a confirmed email. I have checked the box "Email me when a page or file on my watchlist is changed".
I have two pages ...
9
votes
2answers
312 views
Is Wikidata up to date with Wikipedia?
I think that DBpedia links to Wikipedia by Wikipedia database dump, making it not up to date with on-line Wikipedia contents.
I was wondering if Wikidata uses on-line Wikipedia content or if it also ...
2
votes
2answers
571 views
Get section and page title from a list of articles in Wikipedia via API
I want to get the different sections with their pages from the Wikipedia:Featured articles.
By following this answer, I know I can get page titles of links as follows:
https://en.wikipedia.org/w/...
6
votes
2answers
277 views
How to get urls of entries in wikipedia list articles?
I am trying to retrieve the URL of all articles listed inside wikipedia list articles. For concreteness lets consider the wikimedia list article List_of_American_scientists
I know how to use the wiki ...
1
vote
1answer
55 views
Downloading wikipedia data from specific url
I want to download data from https://en.wikipedia.org/wiki/List_of_districts_of_Germany
I am rookie at this and can'T find any relevant articles. Most of them are on downloading full wikipedia. I ...
2
votes
2answers
1k views
Download wikipedia dump and save in raw text form
I have been trying to use Wikipedia text data for my personal research.
I know that crawling is not good for the Wikipedia server so I downloaded big xml file from https://dumps.wikimedia.org/jawiki/...
7
votes
1answer
282 views
wikidata: (when) will it be possible to query for wikipedia page links?
(When) will the following be possible:
For a wikipedia page: get the list of all wikipedia links on that page with their respective wikidata IDs in a single query/API call.
Receive additional ...
4
votes
2answers
189 views
wikipedia page: get the list of all links with their wikidata ids
For a Wikipedia page: is it possible to get the list of all Wikipedia links on that page with their respective wikidata IDs in a single query/API call?
Optional: can additional information of the ...
4
votes
2answers
306 views
ISO 3166-1 country codes in DBpedia
How can I get a two-letter ISO 3166-1 country code in DBpedia? More specifically, I'm querying the SPARQL endpoint like this:
SELECT DISTINCT ?iata ?country where {
?airport a dbo:Airport.
?...
2
votes
1answer
77 views
Wikipedia database: categories and category mapping across languages
I've imported the wikipedia database in four languages with the goal of running some machine learning algorithms on it for text classification. The import doesn't populate the "category" table though. ...
5
votes
1answer
126 views
Getting influences / influencedBy data from DBpedia
I am struggling with DBpedia. The description is unclear (to the point that for me it is hard to tell which data can be obtain, which - cannot), and (what is worst) it does not have many examples (...
18
votes
2answers
4k views
Get Wikipedia URLs (sitelinks) in Wikidata SPARQL query
I can use the following query to list all sovereign states via the Wikidata query interface:
PREFIX wikibase: <http://wikiba.se/ontology#>
PREFIX wd: <http://www.wikidata.org/entity/>
...
7
votes
4answers
3k views
Get season statistics for NFL players
So as the title suggests I'm trying to retrieve NFL stats for players. I've found that Wikipedia has a quite extensive statistics panel for a lot of players (i.e Tom Brady https://en.wikipedia.org/...
1
vote
1answer
60 views
How to use multiple wikipedia categories for Quick Intersection?
I'm using http://tools.wmflabs.org/quick-intersection/index.php to get a list of articles within categories but I have a list of over 35 categories and I'd like to use Quick Intersection to get the ...
15
votes
6answers
3k views
Mapping all Wikipedia URLs to Wikidata entity ids
Is there a Wikidata dump that maps all Wikipedia URLs to their corresponding Wikidata entity ids, e.g. the Wikipedia URL https://en.wikipedia.org/wiki/Tom_Hanks to the Wikidata entity id Q2263?
11
votes
4answers
1k views
How to get soccer players Wikipedia URL?
I'd like to grab as many soccer players names and their Wikipedia URL. For example:
"David Beckham": 'David_Beckham',
"Wayne Rooney": 'Wayne_Rooney'
The first portion is their name and the second is ...
5
votes
3answers
517 views
How can I add Wikidata properties of item a on the Wikipedia page of item b?
How would I get the eccentricity (Property:P1096) of Venus (Q313) in the article en:Mars?
I have figured out that I have to write {{#property:P1096}} if I want to get a property of the page on that ...
5
votes
1answer
203 views
“DBpedia as Tables” not having all the properties
I browsed a sample for available data at http://dbpedia.org/page/Sachin_Tendulkar. I wanted these properties as columns, so I downloaded the CSV files from http://wiki.dbpedia.org/DBpediaAsTables.
...
3
votes
1answer
69 views
Where should I host/contribute a mapping from Stack Overflow tags to Wikipedia articles?
I had asked for a mapping from Stack Overflow tags to Wikipedia articles over at meta.stackoverflow, but no one seemed to find one, so I started building my own.
Where is the "right" place for me to ...
7
votes
1answer
3k views
Download Wikipedia articles from a specific category
I know that I can download English Wikipedia Dump, but I was wondering if I can download only articles for a specific category-subject.
For instance, can I download articles related to Mathematics or ...
5
votes
1answer
84 views
Suspected dirty data in Wikipedia articles indirectly belonging to a category
I'm trying to get a list of all articles (just the names, not the contents) that are indirectly within the category Japanese people in Wikipedia.
I've tried using a tool called Quick intersection. ...
9
votes
3answers
443 views
How to get wikipedia daily updates
I installed media-wiki on ec2 machine and loaded the wikipedia page-articles dump content and other relevant data into that. I want to update the data regularly(daily) but I didn't get any resource ...
21
votes
10answers
6k views
Wikipedia table to JSON (or other machine-readable format)
I'm interested in the data listed in the tables listed here.
Is there a good way to extract the information (as JSON, preferably) without resorting to HTML parsing?
6
votes
2answers
4k views
Wikipedia dump files in SQL format
I need to access to history of each wiki page. I found http://dumps.wikimedia.org/fawiki/latest/fawiki-latest-pages-meta-history.xml.7z contains such data for Persian wiki in XML format. But I want ...
11
votes
4answers
3k views
What server and technologies can I use to extract data out of Wikipedia's infoboxes (e.g., ATC code for drugs)
Wikipedia is a significant source of data. Data from Wikipedia may be available in various formats via other servers (e.g., SPARQL end point).
For a task of extracting all pairs of "ATC code" - "...
