↑ Return to Listserv

Transit Developers ListServ

Transit Developers Google Group

This group is for software developers both inside and outside transit agencies who want to discuss reuse of transit software, open transit data, and interesting things that they've built.

Re: Assessing accuracy of real-time arrival estimate systems

Just a quick plug this would be a very good question for
[link]
Still need more commitment.

Posted: May 20, 2013, 4:00 pm

Re: [transit-developers] Re: Assessing accuracy of real-time arrival estimate systems

Agreed. It affects everything about the AVL system, including many things
not mentioned in this thread.

But the update interval of the system is something that is known more or
less a priori. You don't need to think deeply and gather lots of ground
truth data or do lots of fancy post processing to evaluate it. Or even if


Posted: May 20, 2013, 12:34 am

Re: [transit-developers] Re: Assessing accuracy of real-time arrival estimate systems

Exactly. Communication technology strongly affects the AVL reporting rate which in turn strongly affects both prediction accuracy and the ability to measure the accuracy.

Mike


Posted: May 20, 2013, 12:24 am

Re: [transit-developers] Re: Assessing accuracy of real-time arrival estimate systems

Sean Barbeau noted that he could not check predictions against location
fixes at stops, due to the low frequency of those fixes, and that the
low frequency was a constraint of the radio network. Joachim Pfeiffer
repeated the first sentence of Sean's message and guessed the same
constraint.

Posted: May 19, 2013, 9:23 pm

Re: [transit-developers] Re: Assessing accuracy of real-time arrival estimate systems

Fascinating as the debate over commercial cellular vs private radio is (and
recognizing that the "right" answer of course varies depending on the many
context-specific objectives and constraints), I wonder what any of it has
to do with methodologies for validating and evaluating the performance of

Posted: May 19, 2013, 5:04 am

Re: Assessing accuracy of real-time arrival estimate systems

(Shrugs) - since you brought up San Francisco.

Everybody's situation is different, see above ("the concept of getting
on public safety networks for voice and using commercial carriers for
data."). Generally, the FCC mandated spectral efficiency requirements
in the UHF and 700MHz spectrum will tend to push more agencies into


Posted: May 19, 2013, 4:28 am

Re: [transit-developers] Re: Assessing accuracy of real-time arrival estimate systems

Joa,

You have clearly stated the arguments that agencies use to support not
using a commercial cellular system. But in working with many transit
agencies I have found that those arguments simply do not hold up. The
non-cellular based systems simply don't meet the specs. It doesn't matter
what the requirements are if the vendor simply cannot meet them. With the


Posted: May 18, 2013, 5:54 pm

Re: Assessing accuracy of real-time arrival estimate systems

Today, things are more nuanced than you paint it. I figure you refer
to MTA's radio system replacement project. Here, transit uses its own,
dedicated spectrum that exclusively runs data for transit, purpose
built to meet the agency's needs, using radio equipment that is built
for this use. With "tack-on" I was referring to cases where efforts

Posted: May 18, 2013, 3:30 pm

Re: [transit-developers] Re: Assessing accuracy of real-time arrival estimate systems

Joa,

You are correct that using public safety/voice channels has not proven to be the best solution. But it should be noted that a large number of AVL systems still use this unfortunate technology and some agencies are still pursuing it (i.e. San Francisco Muni). Therefore it still often needs to be dealt with.


Posted: May 17, 2013, 6:00 pm

Re: Assessing accuracy of real-time arrival estimate systems

Correction: 2/min, that is.

Posted: May 17, 2013, 5:08 pm

Re: Assessing accuracy of real-time arrival estimate systems

The reality of real-time next bus and train times being provided as a
"by-product" of CAD/AVL systems does not support this claim. Assuming
decent poll rates (2/s or better), they just fine without "looking at
historical arrival predictions".

"HART's OrbCAD system only logs GPS data at timepoints, only logs GPS


Posted: May 17, 2013, 5:01 pm

Re: [transit-developers] Re: Assessing accuracy of real-time arrival estimate systems

I highly recommend measuring the update rate. We have found that for systems from particular vendors that the update rate is far worse than it is supposed to be.

Mike


Posted: May 17, 2013, 3:53 pm

RE: [transit-developers] Re: Assessing accuracy of real-time arrival estimate systems

Ken,
HART has told us that their update rate is also around 2 minutes, or when a bus passes a timepoint. For HART, the bigger issue is the capacity of their radio system in terms of data bandwidth. They are using a proprietary Motorola radio that was designed primarily for voice, with data as an add-on. HART has told us that they are concerned with system reliability when increasing the update rate to any more frequently than it is now, because of the radio channel.

Posted: May 17, 2013, 2:45 pm

RE: [transit-developers] Re: Assessing accuracy of real-time arrival estimate systems

What is the current polling rate for Hart for the ACS system? DC Metro has the same system and their rate is about every 2 mins, but they're in the process of switching over to another vendor to improve the predictions. They are targeting a 30 second polling rate vs the current 2 minute rate.

Posted: May 17, 2013, 2:24 pm

Re: [transit-developers] Re: Assessing accuracy of real-time arrival estimate systems

We have found that several components are needed for prediction
verification. An automated system for looking at historic arrival
predictions is key because only such a system can thoroughly show how well
a system is truly working. It is the only way you can cover all the stops,
day and night, weekdays and weekends, etc. A separate system for examining

Posted: May 16, 2013, 10:45 pm