Your GPS is lying to you

Your GPS is lying to you

At the very least, you’re probably misinterpreting what it’s saying.

People’s attitudes toward GPS devices are very interesting. Since 2000, when selective availability was turned off, GPS has become ubiquitous  to the point where most people have one and interact with it on a daily basis, whether they know it or not. To make things even more confusing, the general case of global positioning, whether satellite based or not, is completely pervasive. You may not know this, but this web site knows where you are (to some level of detail) right now.

Your approximate location: [geoip_detect2 property=”location.latitude”] [geoip_detect2 property=”location.longitude”]

At the same time, the general understanding of how GPS works and it’s level of accuracy has gotten worse. This is a natural consequence of ubiquity; as more people use these devices, the average level of expertise diminishes.

However, we should expect outdoor professionals to have a much clearer and nuanced understanding of GPS and it’s accuracy, shouldn’t we?

How accurate are they?

How accurate do you think your GPS unit is?

I asked this basic question in a survey which I started on October 18th, 2012. In the survey, which I distributed to readers of this blog and through contacts on Twitter, Facebook and Google+, and members of the local Search and Rescue community, I asked 4 questions;

  1. Do you own or regularly use a GPS?
  2. What kind of GPS do you own?
  3. Do you know how to read the accuracy of your GPS?
  4. To your understanding, what does it mean when your GPS unit displays an accuracy reading of 5m?

This is a very unscientific survey due to the limited size of the sample and the nature of the distribution. There is certainly a self-selection process at work. Tellingly however, the self selection should have been toward those more more knowledge of GPS, and not less. However, I suspected that even expert users didn’t know how accurate their GPS was, and this survey was designed to test that knowledge.

I present the results here to illustrate that a small sample of expert GPS users don’t know what the accuracy displayed on the GPS means, but with the intent to show that those displays are actually quite misleading.

Survey Results

7 respondents didn’t own or regularly use a GPS so their results were thrown out; I wanted to survey regular users or owners.

GPS type was as follows:

Surveyed GPS type for users.
GPS for wilderness use 77 79%
Cell Phone / Smart Phone 59 60%
Tablet / Laptop 15 15%
Car GPS 40 41%
Marine GPS 3 3%
Other 9 9%
People may select more than one checkbox, so percentages may add up to more than 100%.

88% of respondents knew how to display the accuracy of the GPS.  Very good.

Percent of users who know how to read or display the current accuracy of their GPS unit.

Of those that knew how to display the accuracy, I asked the final question; what does the accuracy number mean? I used an example of 5m; a screen shot of my Garmin GPSMap 62st is displaying 4m accuracy here:

Garmin GPSMap 62st displaying 4m accuracy

Note that it just says “GPS” and “4m” below that. On most GPS units that’s all you’re going to get. This level of accuracy is pretty standard for a purpose-built wilderness GPS unit on any given day that you’re in the open.

To the question “To your understanding, what does it mean when your GPS unit displays an accuracy reading of 5m?” I presented the following multiple choice answers:

  • The GPS is accurate to within 5 meters of the actual position.
    This answer seems right and makes the implicit assumption that the GPS is 100% certain that the actual position is within 5 meters of it’s calculated position. This is wrong.
  • The GPS is accurate to within 5 meters of the actual position 95% of the time
    This answers explicitly states a 95% confidence interval, and is also wrong.
  • The actual position is about 5 meters away from you.
    This is either a re-statement of the first one, or a “general sense” that the GPS is “close” or “within 5 meters”
  • The RMS (root mean square) of the error is 5 meters
    This is an valid measure of error and is no correct
  • The GPS is accurate to within 5 meters of the actual position 50% of the time
    This is the correct answer and I will explain more about why later.

The results are presented below. I interpreted responses to mean a 100% confidence interval (that the GPS is displaying a value that it is 100% confident that the displayed position is within 5 m of the real positions), a 95% confidence interval (the displayed position is within 5m of the real position 95% of the time), a “do not know” and a “not answered” category, and finally the correct answer; 50% confidence interval.

Attitudes toward GPS accuracy

Only 6.3% of respondents, or 5 people, knew the correct answer.

GPS Accuracy Explained

The first thing to understand is that a GPS is solving some very complex equations. It really and truly does not know where on the surface of the planet it is, so the expression of how far it is from an actual position is derived from known errors in various parts of its derivation. We can call each “solution” to the position problem a measurement.

As a result of the error present in various parts of the equations used in the measurement, a GPS can never say with 100% confidence that measurement is accurate, it can only express a confidence interval.  The interval is usually expressed as a percent, meaning the proportion of measurements that are within a certain distance of the actual value.

The accuracy of most GPS units, unless specified explicitly, are expressed using Circular Error Probable, or CEP. If the number displayed is N, then the interpretation of the number is as follows:

  • 50% of measurements with be within N of actual
  • 43% of measurements will be within N and 2N of actual
  • 7% of measurements will be between 2N and 3N
  • less than 0.3% of measurements will be further than 3N

If you put a GPS in one place and record the measurements over a period of 24 hours you will get a plot of the position offsets from the mean value that looks like this.

The “CEP” ring encompasses 50% of measurements, representing a 50% confidence interval. The 96% ring is the 2DRMS (Root Mean Square in 2D), and 96% of the measurements are in that ring.

50% of measurements will be larger than the CEP ring. and 7% will be 2-3 times larger.

What does the survey tell us?

The results of the survey indicate to me that even expert users, such as SAR volunteers and outdoor professionals, enthusiasts, helicopter pilots, etc, do not know what the number displayed as the accuracy of their GPS means.

Further, while attempting to read the manual for the GPS that I own, I did not find a good explanation for GPS accuracy, other than some “statements of conformity” that declare that a device meets certain standards. My feeling is that the device manufacturers benefit from displaying a lower number, leading people to believe a higher level of accuracy.

What does this mean to me?

I’ll be writing more about this in the future, but here’s what you can take home right now.

  • The GPS is expressing its accuracy as a 50% confidence interval
  • Most users who know how to read the GPS accuracy think it’s displaying a 95% confidence interval
  • You can safely take the accuracy of a GPS and double it to make your assumptions match with reality.

References

van Diggelen, F. (2007). GNSS accuracy – lies, damn lies and statisticsGPS World, 18(1).

Circular Error Probable, Wikipedia

Earth Measurement Consulting, GPS Accuracy and Limitations (for CEP image)

5 Comments on “Your GPS is lying to you

  1. I am not sure I get it… Isn’t the graph “GPS positions over 24 hours” show that the GPS was accurate within 4.06m 98% of the time? How do you equate that with the correct answer being within 5m 50% of the time??

    • I see I’ve managed to confuse the issue quite a bit.

      The chart I presented and the “5m” example are both hypothetical situations from different examples. I didn’t make the chart, it’s from here: http://earthmeasurement.com/GPS_accuracy.html

      The GPS that the chart represents would be displaying 1.67m as the accuracy measure. It’s probably a survey GPS and is more accurate than a commercial wilderness GPS.

      The 5m example was from a common accuracy measure I see on my Garmin GPSMap 62st when I am using it.

      There’s also the screen shot of that GPS which shows 4m accuracy.

      It’s still correct to say that if the GPS is showing “N” as accuracy, you should double it to give you the 98% confidence interval.

  2. I know this s an post but I’m pretty sure the figure above relates to precision not accuracy – which i understand is what the “error” measure is.

    • Thanks for the comment.

      Good point, I was being very loose with the terminology. I was attempting to describe how things appear to a layperson.

      From the point of view of someone using a GPS, they are interested in how the position displayed relates to the real position in the world. The only information they have is the coordinate, and the confidence interval. Using that, most people create a mental model where they draw a circle of that radius around the coordinate. A layperson would call that difference between the real position and the displayed coordinate, accuracy.

      Of course we know that the confidence interval is in fact a measure of precision, but only because we have a more sophisticated understanding of the math and definitions of those terms.

      https://en.wikipedia.org/wiki/File:Accuracy_and_precision.svg

Leave a Reply

Your email address will not be published. Required fields are marked *

*