Timeline for How do I get historical data from coinmarketcap.com?
Current License: CC BY-SA 4.0
6 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Dec 10, 2019 at 12:30 | comment | added | philshem | Yes, scraping is an art. | |
| Dec 10, 2019 at 2:01 | comment | added | user23089 | Well I appreciate your effort, but the code seems to get killed after 3-4 requests saying "too many requests" or something like that. Anyways thanks for your help. | |
| Dec 9, 2019 at 14:15 | comment | added | philshem | one would get the individual csvs and the concatenate them, adding a column for the date from the filename. yes, I can do it, but this is a forum about open data, and not for hiring people. I had written the answer to show people how to start, not deliver a final product. Also, I wanted to highlight pandas.read_html(), which works quite nicely | |
| Dec 9, 2019 at 2:28 | comment | added | user23089 | Also, the request times out after only a few produced csv's. I would ideally just get a single csv, just with date and total market cap. Again, I know this might take some work, so I can leave you a tip | |
| Dec 9, 2019 at 2:24 | comment | added | user23089 | I appreciate the help, but I think you misunderstood what I was asking. Near the bottom of each page, there is something that says Total Market Cap: @philshem This is the only thing I care about. Can you get this to produce a csv that has date and market cap? I just care about the total market cap on each date, not the individual coins. So ultimately the code would loop through each page and just get the single "Total Market Cap" value. Then I would have a single csv instead of thousands. | |
| Dec 8, 2019 at 12:37 | history | answered | philshem | CC BY-SA 4.0 |