Hot answers tagged

23 votes
Accepted

Cryptocurrency historical prices

As it turns out there are several resources one can use for all main cryptocurrencies so I will post here the most relevant and flexible I was able to gather. All Cryptocurrencies Coinmetrics https:...
user avatar
  • 992
14 votes

Downloading the Panama Papers

No leak The Panama Papers were not leaked at all. They were handed over to a German media company which probably paid a good price (translation/summary here) for that deal. This means, the panama ...
user avatar
  • 290
12 votes

Credit card metadata database

What you are looking for is the Issuer Identifier Number (IIN), which are the first 6 digits of the credit card. Like @pndfam05 mentioned, there are many commercial databases that charge for more than ...
user avatar
  • 17.2k
10 votes

Stock market historical data

There are many good resources described in the comments to your question (1 & 2). One that combines many different types of financial products and has some open access is Quandl. Data browser ...
user avatar
  • 17.2k
10 votes
Accepted

Downloading the Panama Papers

The Panama Papers database has just been published at this link https://www.occrp.org/en/panamapapers/database.html This ICIJ database contains information on almost 320,000 offshore entities that ...
user avatar
  • 332
9 votes

Credit card metadata database

I had a business need for this. A quick wikipedia read https://en.wikipedia.org/wiki/ISO/IEC_7812#cite_note-ANSI-3 showed that the American Banker's Association was the ultimate holder of the "...
user avatar
9 votes
Accepted

ATM locations in UK and/or Ireland

While the data is only as good as the community contributes, OpenStreetMap (OSM) has some ATM data. In OSM, points can be tagged with "amenity=atm". You can extract these nodes using these steps: ...
user avatar
  • 5,488
9 votes

Cryptocurrency historical prices

I work at Quandl and stumbled upon this post. I'm happy to share an update: we now have two databases which contain OHLCV (open-high-low-close-volume) data for bitcoin and other cryptocurrencies: 1....
user avatar
  • 1,026
7 votes

Open API for SEC data?

Dev.Last10K.com has a RESTful API for SEC filing data. Disclaimer: I work for Last10K.com
user avatar
  • 171
7 votes
Accepted

Where could one find financial big data

I'm an accounting major and I know that for a number of my classes I've had to use various financial databases that have just tons of information available, but they're pay-services. However, I'd ...
user avatar
  • 186
6 votes
Accepted

Looking for data on bankruptcy prediction

In the U.S., bankruptcy data is found in several places. Depending on which parameters you decide are important for your tool and algorithm, some of the following datasets should be helpful to you: ...
user avatar
  • 4,497
6 votes

Where does Allrecipes.com get its "On Sale" data?

After taking a look at the source code of the widget on a sample recipe page (selected at random by me), it appears that they are using http://corp.groceryserver.com/ as a data provider For example, ...
user avatar
6 votes
Accepted

Total cryptocurrency market cap over time

As @philshem suggested I wrote some python to gather the data import pandas as pd import requests import re from bs4 import BeautifulSoup # Create date range for historical snapshots Date = pd....
user avatar
  • 276
5 votes

Dataset with informations about donations

You can find aggregated data on charitable donations from the IRS's Statistics of Income (SOI). Here are some links to look around: http://www.irs.gov/uac/Tax-Stats-2 http://www.irs.gov/uac/SOI-Tax-...
user avatar
5 votes

How can I get a list of currencies from Wikidata?

Yes, there is. There are several ways to get this list: You can, in Wikidata website, look at every entity that has a link to currency (Q8142): https://www.wikidata.org/wiki/Special:WhatLinksHere/...
user avatar
  • 151
4 votes
Accepted

Where to find household financial data for my research

if you can use united states residents, you are looking for the survey of income and program participation. this microdata set contains monthly income about persons, families, and households. enjoy! ...
user avatar
4 votes

Open alternatives to the IMF data

The UN has several sources of datasets relating to government expenditures and trade that are free to use for commercial and non-commercial usage. Generally, the terms require attribution. Note, not ...
user avatar
4 votes
Accepted

Credit card metadata database

if you need a free bin database, you can get it here: https://getcreditcardonline.com/free-bin-database-download/ Data in CSV, JSON, SQL, TXT, Excel formats, etc.
user avatar
4 votes

Return on investment in international development projects

great question. The first thing to note is that the IEG database that you're referencing is only one of several that the World Bank provides. You might want to also check out the Bank's projects ...
user avatar
  • 51
4 votes

Why is my scraper returning inconsistent results and timing out?

You may get better answers on CodeReview, but just glancing at your code I have one suggestion that is to split the codes into a scraping and parsing steps. This will help with reproducibility and ...
user avatar
  • 17.2k
4 votes

Why is my scraper returning inconsistent results and timing out?

Some tips for scrapers: log: don't stop at "sometimes I get data and sometimes I don't" -- when you get unexpected results in the response, log it so you can learn what happened. Specifically when ...
user avatar
  • 5,488
4 votes

Where could one find financial big data

Take a look at Yahoo! Finance for daily, weekly, monthly data on S&P500 and other tickers. However, if you want microaggregated data (e.g. seconds, minutes, hours ---> real big data) you have to ...
user avatar
4 votes
Accepted

Financial text data/corpora

Your school's library might have access to databases of newspaper and magazine archives, some going back decades. If you're in a large city, your public library might also have those. The New York ...
user avatar
4 votes

Fundamentals data for European stocks

Just wanted to share that there is now fundamentals data on European stocks on Quandl. Check it out here: https://www.quandl.com/data/RB1 This database has a special focus on European and Asian stocks ...
user avatar
  • 1,026
4 votes

Cryptocurrency historical prices

http://www.CryptoDataDownload.com is newer but has 28+ exchanges, ~550 pairs, 8+ ccy pairs, and daily/hourly/minute timeframes to download via csv format for free
user avatar
  • 41
4 votes
Accepted

Machine readable list of monetary currencies, including symbol

There are at least three github repos Currency-List - many formats - "List of all currencies with names and ISO 4217 codes in all languages and all data formats." JSON (gist) - (I'll use this one for ...
user avatar
  • 17.2k
3 votes

Where can I find open data on historical forex rates for financial reporting purposes?

Several sources provide pretty nice information on exchange rates: http://data.worldbank.org/indicator/PA.NUS.FCRF http://research.stlouisfed.org/fred2/categories/15 http://stats.oecd.org/index.aspx?...
user avatar
3 votes
Accepted

Basic Financial Data for Non-Governmental Organizations (NGOs)

Selected financial information on all entities that file using form 990 with the IRS is public. A variety of datasets can be found in the IRS Statistics of Income (SOI). I would start at this page: ...
user avatar

Only top scored, non community-wiki answers of a minimum length are eligible