I'm working on a project of predicting the bus arrival time for each stops based on the historical data. I checked the database for Boston and New York, but the result is not very perfect.
For Boston, I only found the GTFS schedule data and the real-time data API.
For New York, I did find the historical database. But the trip id in the corresponding data is not in the same format to the trip id from the GTFS schedule data of New York, which makes it hard to connect the historical data to the scheduled data.
Can someone provide some suggestions or some other database which I could use?
What I plan to use are two types of data: GTFS data and historical data.
The GTFS data is downloaded from here: http://web.mta.info/developers/developer-data-terms.html#data
The historical data is downloaded from here: http://data.mytransit.nyc/bus_time/
The first one is used to represent the scheduled arrival time of buses at different stops and the second one is the record of the location of each bus at different time points at a specific day.
The connection between these two types of data is the
trip_id, which represent a specific trip for a bus. Theoretically, they should have the same
trip_id, but they don't. In other words, there are many trips in the historical data with the
trip_id which I cannot find from the GTFS scheduled data. As a result, I cannot confirm the specific route and the stop list for these trips.
Thus, I wondered whether you could provide some suggestions.