2

I am looking for a dataset with 10 millions of rows to analyze it. Actually to rework it into more usable format and come up with some interesting metrics for it. So there are two requirements:

1) ~10 million rows

2) "Interesting" data to build some metrics on it (like users per country, average temperature in month, average check and so on).

So the question is: where can I find such dataset? I found awesome-public-datasets repo on Github but looks like there is no any classification by data size/format there. If you have any ideas about relevant datasets and where I can find it it would be great.

3

City bike shares will have about that number of records, and because there will be some geospatial data (latitude/longitude) along with timestamps, it's usually a fun topic to explore

Duration - Duration of trip

Start date – Includes start date and time

End date – Includes end date and time

Start station – Includes starting station name and number

End station – Includes ending station name and number

Bike # - Includes ID number of bike used for the trip

Member Type – Lists whether user was a Registered (annual or monthly) or Casual (1 to 5 day) member.

enter image description here

(photo source Wikipedia)

  • Thank you! Datasets looks great. But I can't find description for fields from these files: s3.amazonaws.com/capitalbikeshare-data/index.html Maybe you have an idea where I can find it? – Paul Oct 26 '16 at 16:52
  • I added a link and the text with the column descriptions. – philshem Oct 26 '16 at 20:23
  • But looks like this description doesn't matches with actual data. Here is a sample from "2016-Q3-Trips-History-Data-1.csv": 115008,8/31/2016 23:40,8/31/2016 23:42,32000,Norfolk Ave & Fairmont St,32028,Norfolk & Rugby Ave,W20299,Registered Am I missing something? – Paul Oct 26 '16 at 21:28
  • Sorry, my mistake. Forgot to take a look on the header. Thanks a lot! – Paul Oct 27 '16 at 10:00

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.