Difference between revisions of "Range Statistics"

From ShotStat
Jump to: navigation, search
m (Example: NRA's Test Protocol)
(Efficient Estimators)
Line 33: Line 33:
 
== Efficient Estimators ==
 
== Efficient Estimators ==
 
If our goal is to characterize a range statistic using the least number of shots then we should pick our group size carefully.  [[Prior_Art#Kolbe.2C_2010.2C_Group_Statistics|Kolbe]] et. al. noted that for any desired error and confidence level it looked like 7-shot groups produced a significant estimate using the lowest number of total shots fired.  [[Media:RangeStatisticEstimation.xls|Using our more extensive simulations of the coefficient of variation we can see now]] that '''6-shot groups are actually the most efficient''', and that '''5-shot groups are practically as efficient''' (and for many scenarios identical).
 
If our goal is to characterize a range statistic using the least number of shots then we should pick our group size carefully.  [[Prior_Art#Kolbe.2C_2010.2C_Group_Statistics|Kolbe]] et. al. noted that for any desired error and confidence level it looked like 7-shot groups produced a significant estimate using the lowest number of total shots fired.  [[Media:RangeStatisticEstimation.xls|Using our more extensive simulations of the coefficient of variation we can see now]] that '''6-shot groups are actually the most efficient''', and that '''5-shot groups are practically as efficient''' (and for many scenarios identical).
 +
 +
4- and 8-shot groups are almost as efficient, but if you're shooting groups of 3 or more than 8 you are wasting bullets.
  
 
== Small Samples ==
 
== Small Samples ==

Revision as of 10:52, 27 April 2014

Previous: Measuring Precision

Range Statistics

Median values for size statistics when σ = 1. Bands cover 50% of samples around each median.

The three measures that vary with n (Extreme Spread, Diagonal, and Figure of Merit) are range statistics that lack convenient functional forms. However both the mean and standard deviation of their expected value, as well as quantiles, scale directly with σ, so it is sufficient to calculate those statistics once for σ = 1 and multiply the resulting values by the desired σ. Media:Sigma1RangeStatistics.xls contains quantiles and moments for n up to 100.

Example 1

What extreme spread should I expect for 5-shot groups from my rifle? The extreme spread median from the table for 5 shots is 3.0 σ. I've determined my rifle has precision σ = ½MOA. If I take five shots at 100 yards we would expect half my groups to be less than 3.0/2 = 1.5MOA \(\approx\) 1.6".

Multiplying the rest of the distribution data for that row by my 0.5MOA we can also say that the extreme spread of my 5-shot groups should exhibit the following distributions:

  • 50% between (1.2, 1.8)MOA
  • 80% between (1.0, 2.1)MOA
  • 95% between (0.8, 2.4)MOA

Example 2

Over many tests I have found my rifle produces 5-shot groups with an average extreme spread of 1MOA. What extreme spread should I expect if I instead start shooting 10-shot groups? The table shows that the ratio of expected extreme spreads on 10-shot groups is 1.24 times the value on 5-shot groups. So my a priori expectation would be for 10-shot groups to average 1.24MOA.

Estimation

Following the Central Limit Theorem we can use the sampling distribution of the mean to make statistical inferences. The methods for this are detailed well by Kolbe. Suppose we want to estimate a gun's extreme spread. We need to specify three values:

  1. Shots per group, n – because range statistics increase with the number of shots taken
  2. Sampling Error, E – the distance (above and below, as a fraction of the estimated value) you allow your estimate to vary from the "true" value you would discover if you could average an infinite number of samples
  3. Confidence Level K – the likelihood your estimate will be within E of the true value

The number of groups g we need to shoot and measure in order to estimate the extreme spread ±E with confidence K is given by

  \(g = (\frac{Z V}{E})^2\)

where:

  • V is the Coefficient of Variation, which is equal to the standard deviation divided by the mean for the given group size n in Media:Sigma1RangeStatistics.xls
  • Z is the Critical Value associated with K, which is the inverse of the standard normal. The spreadsheet function for Z is =NORMSINV(K + (1-K)/2)

The required data and formulas for this calculation can be found in Media:RangeStatisticEstimation.xls.

Efficient Estimators

If our goal is to characterize a range statistic using the least number of shots then we should pick our group size carefully. Kolbe et. al. noted that for any desired error and confidence level it looked like 7-shot groups produced a significant estimate using the lowest number of total shots fired. Using our more extensive simulations of the coefficient of variation we can see now that 6-shot groups are actually the most efficient, and that 5-shot groups are practically as efficient (and for many scenarios identical).

4- and 8-shot groups are almost as efficient, but if you're shooting groups of 3 or more than 8 you are wasting bullets.

Small Samples

In practice we are usually limited to shooting small numbers of groups, which will have significant positive skewness. In order to more accurately characterize the distribution of small samples we fall back on direct simulation to produce quantile functions. Media:ES_Quantiles.c runs 2 million iterations per scenario, with a number of small scenarios shown in Media:Extreme Spread Quantiles.xlsx.

We can see that the skewness disappears quite rapidly as we average samples: The following table shows the 90% confidence bounds on averages of 5-shot groups, with the mean normalized to 1:

Total Shots Groups 5% Level 95% Level
5 1 0.59 1.47
10 2 0.70 1.33
15 3 0.75 1.27
20 4 0.79 1.23
25 5 0.81 1.20

By the time we're looking at the average of five 5-shot groups our distribution has almost no skew.

Example: NRA's Test Protocol

As noted previously, the NRA's standard for testing precision is to shoot five consecutive 5-shot groups and report the average extreme spread.

As we saw in the preceding section, the 90% confidence interval for five 5-shot groups is (0.81, 1.20). This means, for example: if we measure an average 5x5 extreme spread of 1.0MOA then, nine times out of ten, we would expect that same shooter, gun, and ammunition to produce five 5-shot groups measuring between (0.8MOA, 1.2MOA).

How efficient is this test protocol? From Closed Form Precision we know that the best precision estimator for a symmetric bivariate process is the Rayleigh estimator, so using Media:RayleighEstimatorQuantile.c we simulated quantile curves for that as well: Media:RayleighEstimatorQuantiles.xls provides quantiles for groups ranging from 2 to 50 shots. From these data we can see that the 5% and 95% quantiles of the Rayleigh estimator reach the confidence range (0.81, 1.20) – the range the NRA protocol achieves with 25 shots – after just 19 shots. I.e.,

  • Following the best estimation methodology you can measure precision as effectively as the NRA protocol does but use only 3/4 as many bullets.
  • Following the NRA protocol you’re spending 32% more ammo than necessary to get the same precision estimates.

(Granted, unless you have an electronic target, it’s easier to measure and average 5 extreme spreads in the field than to measure the radius of each shot and compute the corrected sum of squares, so that trade-off may be worthwhile.)