Significance and Use
ASTM regulations require precision statements in all test methods in terms of repeatability and reproducibility. This practice may be used in obtaining the needed information as simply as possible. This information may then be used to prepare a precision statement in accordance with Practice E 177
Test Method and Protocol—In this practice, the term “test method” is used both for the actual measurement process and for the written description of the process, while the term “protocol” is used for the directions given to the laboratories for conducting the ILS.
Observations, Test Determinations and Test Results:
5.3.1 A test method often has three distinct stages, the direct observation of dimensions or properties, the arithmetic combination of the observed values to obtain a test determination, and the arithmetic combination of a number of test determinations to obtain the test result of the test method. In the simplest of test methods a single direct observation is both the test determination and the test result. For example, the test method may require the measurement of the mass of a test specimen prepared in a prescribed way. Another test method may require the measurement of the area of the test specimen as well as the mass, and then direct that the mass be divided by the area to obtain the mass per unit area of the specimen. The whole process of measuring the mass and the area and calculating the mass per unit area is a test determination. If the test method specifies that only one test determination is to be made, then the test determination value is the test result of the test method. Some test methods require that several determinations be made and the values obtained be averaged or otherwise combined to obtain the test result of the test method. Averaging of several determinations is often used to reduce the effect of local variations of the property within the material.
In this practice, the term “test determination” is used both for the process and for the value obtained by the process, except when “test determination value” is needed for clarity.
The number of test determinations required for a test result should be specified in each individual test method. The number of test results required for an interlaboratory study of a test method is specified in the protocol of that study.
Test Specimens and Test Units—In this practice a test unit is the total quantity of material needed for obtaining a test result as specified by the test method. The portion of the test unit needed for obtaining a single test determination is called a test specimen. Usually a separate test specimen is required for each test determination.
Precision, Bias, and Accuracy of a Test Method:
5.5.1 When a test method is applied to a large number of portions of a material, that are as nearly alike as possible, the test results obtained nevertheless will not all have the same value. A measure of the degree of agreement among these test results describes the precision of the test method for that material.
Numerical measures of the variability between such test results provide inverse measures of the precision of the test method. Greater variability implies smaller (that is, poorer) precision and larger imprecision.
This practice is designed only to estimate the precision of a test method. However, when accepted reference values are available for the property levels, the test result data obtained according to this practice may be used in estimating the bias of the test method. For a discussion of bias estimation and the relationships between precision, bias, and accuracy, see Practice E 177
Repeatability and Reproducibility—These terms deal with the variability of test results obtained under specified laboratory conditions. Repeatability concerns the variability between independent test results obtained within a single laboratory in the shortest practical period of time by a single operator with a specific set of test apparatus using test specimens (or test units) taken at random from a single quantity of homogeneous material obtained or prepared for the ILS. Reproducibility deals with the variability between single test results obtained in different laboratories, each of which has applied the test method to test specimens (or test units) taken at random from a single quantity of homogeneous material obtained or prepared for the ILS.
Repeatability Conditions—The within-laboratory conditions specified above for repeatability. The single-operator, single-set-of-apparatus requirement means that for a particular step in the measurement process the same combination of operator and apparatus is used for every test result and on every material. Thus, one operator may prepare the test specimens, a second measure the dimensions and a third measure the breaking force. “Shortest practical period of time” means that the test results, at least for one material, are obtained in a time not less than in normal testing and not so long as to permit significant changes in test material, equipment or environment.
Scope
1.1 This practice describes the techniques for planning, conducting, analyzing, and treating the results of an interlaboratory study (ILS) of a test method. The statistical techniques described in this practice provide adequate information for formulating the precision statement of a test method.
1.2 This practice does not concern itself with the development of test methods but rather with gathering the information needed for a test method precision statement after the development stage has been successfully completed. The data obtained in the interlaboratory study may indicate, however, that further effort is needed to improve the test method.
1.3 Since the primary purpose of this practice is the development of the information needed for a precision statement, the experimental design in this practice may not be optimum for evaluating materials, apparatus, or individual laboratories.
1.4 Field of Application—This practice is concerned exclusively with test methods which yield a single numerical figure as the test result, although the single figure may be the outcome of a calculation from a set of measurements.
1.4.1 This practice does not cover methods in which the measurement is a categorization, such as a go-no-go allocation (two categories) or a sorting scheme into two or more categories. For practical purposes, the discontinuous nature of measurements of these types may be ignored when a test result is defined as an average of several individual measurements. Then, this practice may be applicable, but caution is required and a statistician should be consulted.
1.5 The information in this practice is arranged as follows:
| Section | |
| Scope | 1 |
| Referenced Documents | 2 |
| Terminology | 3 |
| Summary of Practice | 4 |
| Significance and Use | 5 |
| Planning the Interlaboratory Study (ILS) | |
| ILS Membership | 6 |
| Basic Design | 7 |
| Test Method | 8 |
| Laboratories | 9 |
| Section | |
| Materials | 10 |
| Number of Test Results per Material | 11 |
| Protocol | 12 |
| Conducting the Testing Phase of the ILS | |
| Pilot Run | 13 |
| Full Scale Run | 14 |
| Section | |
| Calculation and Display of Statistics | |
| Calculation of the Statistics | 15 |
| Tabular and Graphical Display of Statistics | 16 |
| Data Consistency | |
| Flagging Inconsistent Results | 17 |
| Investigation | 18 |
| Task Group Actions | 19 |
| Examples of Interlaboratory Studies | 20 |
| Precision Statement Information | |
| Repeatability and Reproducibility | 21 |
| Appendixes | |
| Theoretical Considerations | A1 |
| Index to Selected Terms | A2 |
| References | |
| Tables and Figures | |
| Tables | Table |
| Glucose in Serum Example | 1–4 & 6–7 |
| Pentosans in Pulp Example | 8–11 |
| Critical Values of Consistency Statistics, h and k | 5 |
| Figures | Fig. |
| Glucose in Serum Example | 1–5 |
| Pentosans in Pulp Example | 6–10 |
1.6 This standard may involve hazardous materials, operations, and equipment. This standard does not purport to address all of the safety problems associated with its use. It is the responsibility of the user of this standard to establish appropriate safety and health practices and determine the applicability of regulatory limitations prior to use.
