Your GPS is lying to you

At the very least, you’re probably misinterpreting what it’s saying.

People’s attitudes toward GPS devices are very interesting. Since 2000, when selective availability was turned off, GPS has become ubiquitous  to the point where most people have one and interact with it on a daily basis, whether they know it or not. To make things even more confusing, the general case of global positioning, whether satellite based or not, is completely pervasive. You may not know this, but this web site knows where you are (to some level of detail) right now.

Your approximate location:

At the same time, the general understanding of how GPS works and it’s level of accuracy has gotten worse. This is a natural consequence of ubiquity; as more people use these devices, the average level of expertise diminishes.

However, we should expect outdoor professionals to have a much clearer and nuanced understanding of GPS and it’s accuracy, shouldn’t we?

How accurate are they?

How accurate do you think your GPS unit is?

I asked this basic question in a survey which I started on October 18th, 2012. In the survey, which I distributed to readers of this blog and through contacts on Twitter, Facebook and Google+, and members of the local Search and Rescue community, I asked 4 questions;

  1. Do you own or regularly use a GPS?
  2. What kind of GPS do you own?
  3. Do you know how to read the accuracy of your GPS?
  4. To your understanding, what does it mean when your GPS unit displays an accuracy reading of 5m?

This is a very unscientific survey due to the limited size of the sample and the nature of the distribution. There is certainly a self-selection process at work. Tellingly however, the self selection should have been toward those more more knowledge of GPS, and not less. However, I suspected that even expert users didn’t know how accurate their GPS was, and this survey was designed to test that knowledge.

I present the results here to illustrate that a small sample of expert GPS users don’t know what the accuracy displayed on the GPS means, but with the intent to show that those displays are it’s actually quite misleading.

Survey Results

7 respondents didn’t own or regularly use a GPS so their results were thrown out; I wanted to survey regular users or owners.

GPS type was as follows:

Surveyed GPS type for users.

GPS for wilderness use 77 79%
Cell Phone / Smart Phone 59 60%
Tablet / Laptop 15 15%
Car GPS 40 41%
Marine GPS 3 3%
Other 9 9%
People may select more than one checkbox, so percentages may add up to more than 100%.

88% of respondents knew how to display the accuracy of the GPS.  Very good.

Percent of users who know how to read or display the current accuracy of their GPS unit.

Of those that knew how to display the accuracy, I asked the final question; what does the accuracy number mean? I used an example of 5m; a screen shot of my Garmin GPSMap 62st is displaying 4m accuracy here:

Garmin GPSMap 62st displaying 4m accuracy

Note that it just says “GPS” and “4m” below that. On most GPS units that’s all you’re going to get. This level of accuracy is pretty standard for a purpose-built wilderness GPS unit on any given day that you’re in the open.

To the question “To your understanding, what does it mean when your GPS unit displays an accuracy reading of 5m?” I presented the following multiple choice answers:

  • The GPS is accurate to within 5 meters of the actual position.
    This answer seems right and makes the implicit assumption that the GPS is 100% certain that the actual position is within 5 meters of it’s calculated position. This is wrong.
  • The GPS is accurate to within 5 meters of the actual position 95% of the time
    This answers explicitly states a 95% confidence interval, and is also wrong.
  • The actual position is about 5 meters away from you.
    This is either a re-statement of the first one, or a “general sense” that the GPS is “close” or “within 5 meters”
  • The RMS (root mean square) of the error is 5 meters
    This is an valid measure of error and is no correct
  • The GPS is accurate to within 5 meters of the actual position 50% of the time
    This is the correct answer and I will explain more about why later.

The results are presented below. I interpreted responses to mean a 100% confidence interval (that the GPS is displaying a value that it is 100% confident that the displayed position is within 5 m of the real positions), a 95% confidence interval (the displayed position is within 5m of the real position 95% of the time), a “do not know” and a “not answered” category, and finally the correct answer; 50% confidence interval.

Attitudes toward GPS accuracy

Only 6.3% of respondents, or 5 people, knew the correct answer.

GPS Accuracy Explained

The first thing to understand is that a GPS is solving some very complex equations. It really and truly does not know where on the surface of the planet it is, so the expression of how far it is from an actual position is derived from known errors in various parts of its derivation. We can call each “solution” to the position problem a measurement.

As a result of the error present in various parts of the equations used in the measurement, a GPS can never say with 100% confidence that measurement is accurate, it can only express a confidence interval.  The interval is usually expressed as a percent, meaning the proportion of measurements that are within a certain distance of the actual value.

The accuracy of most GPS units, unless specified explicitly, are expressed using Circular Error Probable, or CEP. If the number displayed is N, then the interpretation of the number is as follows:

  • 50% of measurements with be within N of actual
  • 43% of measurements will be within N and 2N of actual
  • 7% of measurements will be between 2N and 3N
  • less than 0.3% of measurements will be further than 3N

If you put a GPS in one place and record the measurements over a period of 24 hours you will get a plot of the position offsets from the mean value that looks like this.

The “CEP” ring encompasses 50% of measurements, representing a 50% confidence interval. The 96% ring is the 2DRMS (Root Mean Square in 2D), and 96% of the measurements are in that ring.

50% of measurements will be larger than the CEP ring. and 7% will be 2-3 times larger.

What does the survey tell us?

The results of the survey indicate to me that even expert users, such as SAR volunteers and outdoor professionals, enthusiasts, helicopter pilots, etc, do not know what the number displayed as the accuracy of their GPS means.

Further, while attempting to read the manual for the GPS that I own, I did not find a good explanation for GPS accuracy, other than some “statements of conformity” that declare that a device meets certain standards. My feeling is that the device manufacturers benefit from displaying a lower number, leading people to believe a higher level of accuracy.

What does this mean to me?

I’ll be writing more about this in the future, but here’s what you can take home right now.

  • The GPS is expressing its accuracy as a 50% confidence interval
  • Most users who know how to read the GPS accuracy think it’s displaying a 95% confidence interval
  • You can safely take the accuracy of a GPS and double it to make your assumptions match with reality.

References

van Diggelen, F. (2007). GNSS accuracy – lies, damn lies and statisticsGPS World, 18(1).

Circular Error Probable, Wikipedia

Earth Measurement Consulting, GPS Accuracy and Limitations (for CEP image)

Posted in Blog Entry Tagged with: , , , ,
3 comments on “Your GPS is lying to you
  1. AwkwardMoment says:

    I am not sure I get it… Isn’t the graph “GPS positions over 24 hours” show that the GPS was accurate within 4.06m 98% of the time? How do you equate that with the correct answer being within 5m 50% of the time??

    • I see I’ve managed to confuse the issue quite a bit.

      The chart I presented and the “5m” example are both hypothetical situations from different examples. I didn’t make the chart, it’s from here: http://earthmeasurement.com/GPS_accuracy.html

      The GPS that the chart represents would be displaying 1.67m as the accuracy measure. It’s probably a survey GPS and is more accurate than a commercial wilderness GPS.

      The 5m example was from a common accuracy measure I see on my Garmin GPSMap 62st when I am using it.

      There’s also the screen shot of that GPS which shows 4m accuracy.

      It’s still correct to say that if the GPS is showing “N” as accuracy, you should double it to give you the 98% confidence interval.

    • I wrote a new post where I analyzed the data I gathered from my own GPS. The chart and data in that post should be consistent and make sense

6 Pings/Trackbacks for "Your GPS is lying to you"
  1. […] my post on GPS accuracy I made some claims about the accuracy of GPS devices and used a graphic that was created by a third […]

  2. […] On Oct 31st 2012 I took the results of the survey and compiled them into the following post. If you still want to take the survey, please do, but please don’t “cheat” by […]

  3. […] Do you know how to read the accuracy of your GPS or is your GPS is lying to you? […]

  4. […] you’re interested in my analysis of GPS error, read “Your GPS is Lying to you” and “How to calculate your own GPS accuracy” and note that during this period […]

  5. […] the unit to “smooth out” errors, so for the purposes of this article we will assume (as many people do) that the GPS is […]

  6. […] the capabilities of all devices. From the declarations of GPS accuracy (which I dealt with here http://blog.oplopanax.ca/2012/11/your-gps-is-lying/ ) to either over stating, under specifying or otherwise not managing people's expectations on how a […]

Leave a Reply


Buy a T-Shirt
BlueToque Software
BlueToque Software
Software Design, Architecture and Consulting

TrueNorth Geospatial
TrueNorth Geospatial
Mapping Software for Backcountry Professionals

YourLo.ca/tion
YourLo.ca/tion
Locate people using their SmartPhones

Older stuff

Twitter