2

I am looking for a dataset with 10 millions of rows to analyze it. Actually to rework it into more usable format and come up with some interesting metrics for it. So there are two requirements:

1) ~10 million rows

2) "Interesting" data to build some metrics on it (like users per country, average temperature in month, average check and so on).

So the question is: where can I find such dataset? I found awesome-public-datasets repo on Github but looks like there is no any classification by data size/format there. If you have any ideas about relevant datasets and where I can find it it would be great.

1 Answer 1

3

City bike shares will have about that number of records, and because there will be some geospatial data (latitude/longitude) along with timestamps, it's usually a fun topic to explore

Duration - Duration of trip

Start date – Includes start date and time

End date – Includes end date and time

Start station – Includes starting station name and number

End station – Includes ending station name and number

Bike # - Includes ID number of bike used for the trip

Member Type – Lists whether user was a Registered (annual or monthly) or Casual (1 to 5 day) member.

enter image description here

(photo source Wikipedia)

4
  • Thank you! Datasets looks great. But I can't find description for fields from these files: s3.amazonaws.com/capitalbikeshare-data/index.html Maybe you have an idea where I can find it?
    – Paul
    Commented Oct 26, 2016 at 16:52
  • I added a link and the text with the column descriptions.
    – philshem
    Commented Oct 26, 2016 at 20:23
  • But looks like this description doesn't matches with actual data. Here is a sample from "2016-Q3-Trips-History-Data-1.csv": 115008,8/31/2016 23:40,8/31/2016 23:42,32000,Norfolk Ave & Fairmont St,32028,Norfolk & Rugby Ave,W20299,Registered Am I missing something?
    – Paul
    Commented Oct 26, 2016 at 21:28
  • Sorry, my mistake. Forgot to take a look on the header. Thanks a lot!
    – Paul
    Commented Oct 27, 2016 at 10:00

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.