23
votes
Accepted
Cryptocurrency historical prices
As it turns out there are several resources one can use for all main cryptocurrencies so I will post here the most relevant and flexible I was able to gather.
All Cryptocurrencies
Coinmetrics
https:...
- 992
14
votes
Downloading the Panama Papers
No leak
The Panama Papers were not leaked at all. They were handed over to a German media company which probably paid a good price (translation/summary here) for that deal.
This means, the panama ...
- 290
12
votes
Credit card metadata database
What you are looking for is the Issuer Identifier Number (IIN), which are the first 6 digits of the credit card. Like @pndfam05 mentioned, there are many commercial databases that charge for more than ...
- 17.2k
10
votes
Stock market historical data
There are many good resources described in the comments to your question (1 & 2). One that combines many different types of financial products and has some open access is Quandl.
Data browser ...
- 17.2k
10
votes
Accepted
Downloading the Panama Papers
The Panama Papers database has just been published at this link
https://www.occrp.org/en/panamapapers/database.html
This ICIJ database contains information on almost 320,000 offshore entities that ...
- 332
9
votes
Credit card metadata database
I had a business need for this. A quick wikipedia read
https://en.wikipedia.org/wiki/ISO/IEC_7812#cite_note-ANSI-3
showed that the American Banker's Association was the ultimate holder of the "...
- 1,530
9
votes
Accepted
ATM locations in UK and/or Ireland
While the data is only as good as the community contributes, OpenStreetMap (OSM) has some ATM data.
In OSM, points can be tagged with "amenity=atm". You can extract these nodes using these steps:
...
- 5,488
9
votes
Cryptocurrency historical prices
I work at Quandl and stumbled upon this post. I'm happy to share an update: we now have two databases which contain OHLCV (open-high-low-close-volume) data for bitcoin and other cryptocurrencies:
1....
- 1,026
7
votes
Open API for SEC data?
Dev.Last10K.com has a RESTful API for SEC filing data.
Disclaimer: I work for Last10K.com
- 171
7
votes
Accepted
Where could one find financial big data
I'm an accounting major and I know that for a number of my classes I've had to use various financial databases that have just tons of information available, but they're pay-services. However, I'd ...
- 186
6
votes
Accepted
Looking for data on bankruptcy prediction
In the U.S., bankruptcy data is found in several places. Depending on which parameters you decide are important for your tool and algorithm, some of the following datasets should be helpful to you:
...
- 4,497
6
votes
Where does Allrecipes.com get its "On Sale" data?
After taking a look at the source code of the widget on a sample recipe page (selected at random by me), it appears that they are using http://corp.groceryserver.com/ as a data provider
For example, ...
- 5,153
6
votes
Accepted
Total cryptocurrency market cap over time
As @philshem suggested I wrote some python to gather the data
import pandas as pd
import requests
import re
from bs4 import BeautifulSoup
# Create date range for historical snapshots
Date = pd....
- 276
5
votes
Dataset with informations about donations
You can find aggregated data on charitable donations from the IRS's Statistics of Income (SOI). Here are some links to look around:
http://www.irs.gov/uac/Tax-Stats-2
http://www.irs.gov/uac/SOI-Tax-...
- 8,637
5
votes
How can I get a list of currencies from Wikidata?
Yes, there is.
There are several ways to get this list:
You can, in Wikidata website, look at every entity that has a link to currency (Q8142): https://www.wikidata.org/wiki/Special:WhatLinksHere/...
- 151
4
votes
Accepted
Where to find household financial data for my research
if you can use united states residents, you are looking for the survey of income and program participation. this microdata set contains monthly income about persons, families, and households. enjoy!
...
- 1,460
4
votes
Open alternatives to the IMF data
The UN has several sources of datasets relating to government expenditures and trade that are free to use for commercial and non-commercial usage. Generally, the terms require attribution.
Note, not ...
- 8,637
4
votes
Accepted
Credit card metadata database
if you need a free bin database, you can get it here:
https://getcreditcardonline.com/free-bin-database-download/
Data in CSV, JSON, SQL, TXT, Excel formats, etc.
- 56
4
votes
Return on investment in international development projects
great question.
The first thing to note is that the IEG database that you're referencing is only one of several that the World Bank provides. You might want to also check out the Bank's projects ...
- 51
4
votes
Why is my scraper returning inconsistent results and timing out?
You may get better answers on CodeReview, but just glancing at your code I have one suggestion that is to split the codes into a scraping and parsing steps. This will help with reproducibility and ...
- 17.2k
4
votes
Why is my scraper returning inconsistent results and timing out?
Some tips for scrapers:
log: don't stop at "sometimes I get data and sometimes I don't" -- when you get unexpected results in the response, log it so you can learn what happened. Specifically when ...
- 5,488
4
votes
Where could one find financial big data
Take a look at Yahoo! Finance for daily, weekly, monthly data on S&P500 and other tickers. However, if you want microaggregated data (e.g. seconds, minutes, hours ---> real big data) you have to ...
- 141
4
votes
Accepted
Financial text data/corpora
Your school's library might have access to databases of newspaper and magazine archives, some going back decades. If you're in a large city, your public library might also have those. The New York ...
- 66
4
votes
Fundamentals data for European stocks
Just wanted to share that there is now fundamentals data on European stocks on Quandl. Check it out here: https://www.quandl.com/data/RB1 This database has a special focus on European and Asian stocks ...
- 1,026
4
votes
Cryptocurrency historical prices
http://www.CryptoDataDownload.com is newer but has 28+ exchanges, ~550 pairs, 8+ ccy pairs, and daily/hourly/minute timeframes to download via csv format for free
- 41
4
votes
Accepted
Machine readable list of monetary currencies, including symbol
There are at least three github repos
Currency-List - many formats - "List of all currencies with names and ISO 4217 codes in all languages and all data formats."
JSON (gist) - (I'll use this one for ...
- 17.2k
3
votes
Where can I find open data on historical forex rates for financial reporting purposes?
Several sources provide pretty nice information on exchange rates:
http://data.worldbank.org/indicator/PA.NUS.FCRF
http://research.stlouisfed.org/fred2/categories/15
http://stats.oecd.org/index.aspx?...
- 3,631
3
votes
Accepted
Basic Financial Data for Non-Governmental Organizations (NGOs)
Selected financial information on all entities that file using form 990 with the IRS is public. A variety of datasets can be found in the IRS Statistics of Income (SOI). I would start at this page:
...
- 8,637
Only top scored, non community-wiki answers of a minimum length are eligible