6
votes
Accepted
Total cryptocurrency market cap over time
As @philshem suggested I wrote some python to gather the data
import pandas as pd
import requests
import re
from bs4 import BeautifulSoup
# Create date range for historical snapshots
Date = pd....
- 276
5
votes
Accepted
free REST API for daily end-of-day S&P 500 index
By looking into yFinance source code I've found this query:
https://query2.finance.yahoo.com/v8/finance/chart/%5EGSPC
where %5E is ^ ( ^GSPC )
- 166
4
votes
Cryptocurrency historical prices
http://www.CryptoDataDownload.com is newer but has 28+ exchanges, ~550 pairs, 8+ ccy pairs, and daily/hourly/minute timeframes to download via csv format for free
- 41
3
votes
Is there an open standard for the CAFR (Comprehensive Annual Finance Report)?
Two standards you may wish to consider are XBRL and Frictionless Data.
I have been working on a municipal XBRL taxonomy with others. You can see the current status here: https://github.com/govwiki/...
- 31
3
votes
Annual reports from UK public companies
You're probably having difficulty finding a service for this because there's no money in running one since Companies House announced and then launched the public beta of this wonderful free API
https:...
- 51
3
votes
Financial text data/corpora
For copyright issues; these datasets are no longer available.
Check out those datasets here:
8.5M titles from Reuters (2007-2016)
https://github.com/philipperemy/Reuters-full-data-set
450k + 100k ...
- 131
3
votes
Total cryptocurrency market cap over time
Scraping your link is not too difficult, because the raw data is in the source code.
First, create a list of all possible dates, from this URL
https://coinmarketcap.com/historical/
['20130428','...
- 17.6k
2
votes
Art Market data
Looking for art market data for a project I found this OKFN (Open Knowledge International) blog post in the field you specify:
Art Open data. This leads to a wiki page (not to useful IMHO but it shows ...
- 21
2
votes
Stock market historical data
The TORQ database is a database of all data related to a random sample of 144 companies from NYSE, for the dates 1990-11-01 to 1991-01-31. In contrast to other databases, it includes not only prices ...
2
votes
Art Market data
Maybe start an open database of auction results? It will never be as complete as commercial ones, but I'm sure there are many people who would use it (and possibly add content).
- 131
2
votes
Open API for SEC data?
sec-api (https://sec-api.io) provides an API to search filings on SEC EDGAR by CIK, ticker, company name, form type and filings date.
Query API
give me all form 4 filings for GE between dates X ...
- 121
2
votes
Over-the-counter prices of pharmaceutical drugs in the United States
It seems that this data has some business value and, hence is often available only at a cost. If a non-free solution is sufficient for you, you could try it here and here.
If it's important for you ...
- 592
2
votes
Fracking Cost per Barrel of Oil
Short answer:
In 2014/2015, Maybe $48/BOE (Barrel of Oil Equivalent). The $48 is the sum of the negative items in the slide below. This unit cost is currently unprofitable.
However, there is oil-...
- 1,237
2
votes
Places to find credit risk data-sets
The Lending Club dataset might be fun for you to play around with:
https://www.lendingclub.com/info/download-data.action
- 121
2
votes
Accepted
SWIFT routing codes for all global banks
There are a number of paid API services that allow such requests. Trying to advertise commercial offerings as little as possible, I can mention the original SWIFT API.
You could probably also scrape ...
- 156
2
votes
Accepted
Google Finance Error: Sorry, you may be sending automated queries
I got the same error in the browser, so I guess your URL is old. Google Finance isn't an API (the API was shut down in 2012, so in effect you are just scraping)... Checkout Yahoo Finance or others for ...
- 17.6k
2
votes
Where to get realtime stock market data legally
There is a free API service called Alpha Vantage that provides "free APIs for realtime and historical data on stocks, forex (FX), and digital/crypto currencies." However, there are some usage limits ...
- 121
2
votes
Accepted
Shanghai Stock Exchange data API
It turns out that you actually can get this data from Yahoo! Finance, but you just need to know the numeric representation of the Chinese ticker symbols of interest.
prices
# A tibble: 141,040 x 8
...
- 299
2
votes
free REST API for daily end-of-day S&P 500 index
The official website of the index is
https://www.spglobal.com/spdji/en/indices/equity/sp-500/#overview.
If you hover with your mouse over Export above the graph, then you can recover a link, with ...
- 121
2
votes
free REST API for daily end-of-day S&P 500 index
The St. Louis Fed has a very easy-to-use API for this. The format is:
https://api.stlouisfed.org/fred/series/observations?series_id=SP500&api_key=KEY_GOES_HERE&file_type=json&...
- 121
2
votes
Accepted
Whole national market volume data
Here's another secondary source of the info:
Bloomberg: https://archive.is/omvKx
It turns out the calculation was made by "Cboe Global Markets", who will have real-time market data access ($...
- 17.6k
1
vote
Total cryptocurrency market cap over time
For Bitcoin only, this page offers download links:
http://data.bitcoinity.org/markets/market_cap/all/USD?t=l
Maybe contact the site owner for more data, seems to be a single person.
- 1,237
1
vote
Micro-finance data set
Check out MIX Market (Micro-finance Information Exchange). Here's the link to the dataset page. Yes, you can also get information per country as well; check this page. The idea of MIX Market was to ...
- 133
1
vote
Is there any public database for financial transactions
IFF - Illicit Financial Flows (PDF) - Report of the High Level Panel
on Illicit Financial Flows from Africa has money laundering data, though you'll have to pull it out of the PDF.
Search FinCen ...
- 11.9k
1
vote
Open API for currency conversion / exchange rates to EUR/USD/GBP (daily settlements)
1Forge (http://1forge.com) provides what you're looking for.
To get rates for specific currency pairs try this:
https://forex.1forge.com/1.0.1/quotes?pairs=EURUSD,GBPJPY,AUDUSD
If you just want to ...
- 11
1
vote
Cryptocurrency historical prices
There are many services that provide OHLC aggregated data for crypto markets both free and paid and in many cases exchanges themselves provide APIs to access that kind of aggregated data (like BitMEX ...
- 31
1
vote
Places to find credit risk data-sets
Have you tried https://www.kaggle.com/datasets? There is a credit card fraud detection databse available on this site.
- 41
1
vote
Data with Revision/Version (Versioning) History?
The Open-APC data consists of datasets
[...] on fees paid for Open Access journal articles by Universities and Research Society Funds [...]
Source
The data is freely available and has the GitHub ...
- 221
1
vote
Over-the-counter prices of pharmaceutical drugs in the United States
GoodRX has an API that you can use, easier than scraping. GoodRX Developer API
- 11
1
vote
A sample historical online trading data to download?
Individual trades will come anonymized from a broker directly, and aren't available unless you use that broker, or pay for a terminal (like Bloomberg).
Consider using cryptocurrency transactions, ...
- 17.6k
Only top scored, non community-wiki answers of a minimum length are eligible