|
|
||||||||
Proteomics and Protein Markers |
1 Laboratorio Analisi Chimico Cliniche 1, Azienda Ospedaliera Spedali Civili, 25125 Brescia, Italy.
2 Department of Pathology, Dartmouth-Hitchcock Medical Center and Dartmouth Medical School, Lebanon, NH 03756.
3 Department of Laboratory Medicine and Pathology, Clinical Laboratories, Hennepin County Medical Center and the University of Minnesota School of Medicine, Minneapolis, MN 55415.
4 Department of Pathology, University of Maryland Medical School of Medicine, Baltimore, MD 21201.
5 IVD Consulting, D-35041 Marburg, Germany.
6 Department of Internal Medicine, Division of Cardiology, University of Innsbruck School of Medicine, 6020 Innsbruck, Austria.
7 Department of Cardiology, Aalborg University Hospital, DK-9100 Aalborg, Denmark.
8 Clinical Chemistry Laboratory, Hartford Hospital, Hartford, CT 06102.
aAuthor for correspondence. Fax 39-030-3995369; e-mail panteghi{at}bshosp.osp.unibs.it.
| Abstract |
|---|
|
|
|---|
10% is recommended. However, peer-reviewed data on assay imprecision are lacking. The purpose of this study was to construct the clinically relevant imprecision profiles for each of the commercially available cardiac troponin assays. Pools of human sera containing cardiac troponin concentrations around the MI decision limit were assessed to identify the lowest concentration associated with a 10% CV. Methods: Eight serum pools targeting different concentrations of cardiac troponin (I and T) were prepared and stored at -70 °C until usage. The cardiac troponin measurement protocol consisted of two replicates per specimen per run, and one run per day for 20 days, using two reagent lots and three calibrations. Manufacturers of each cardiac troponin assay directly performed the measurements. Data analysis for each assay was centralized and performed according to the NCCLS EP5-A guideline.
Results: The lowest concentrations (µg/L) providing a 10% CV were as follows: AxSYM, 1.22; ACS:180, 0.37; Centaur, 0.33; Immuno 1, 0.34; Access, 0.06; Vidas, 0.36; Liaison, 0.065; Dimension, 0.26; Opus, 0.90; Stratus CS, 0.10; Immulite, 0.32; Vitros ECi, 0.44; Elecsys, 0.04; AIA 21, 0.09.
Conclusion: No cardiac troponin assay was able to achieve the 10% CV recommendation at the 99th percentile reference limit defined by the manufacturer.
| Introduction |
|---|
|
|
|---|
Consistent data on cardiac troponin assay imprecision are often lacking in the peer-reviewed literature. Many reports state the imprecision only for increased concentrations of cardiac troponins and do not address the low range, which is of greatest importance for clinical decision making. Furthermore, the imprecision frequently mentioned in published studies usually reflects assay performance under ideal, nonroutine laboratory conditions. No study has simultaneously determined the total imprecision for a large number of cardiac troponin assays based on the same samples and the same experimental protocol. The aims of the present study were (a) to construct clinically relevant imprecision profiles for commercially available cardiac troponin assays by assessing samples containing cardiac troponin concentrations covering the range around the assay-dependent MI decision limit; (b) to determine the lowest concentrations giving a 10% CV (total imprecision) in the various assays; and (c) to determine whether the concentration associated with a 10% CV corresponds to the manufacturers stated 99th percentile reference limit.
| Materials and Methods |
|---|
|
|
|---|
participants
All companies manufacturing platforms/assays for cTnI and/or cTnT were invited to participate. The imprecision experiments were performed directly by the manufacturers. A total of 13 companies agreed to participate, but 2 of these companies did not return their results: Innotrac Diagnostics did not explain why the data were not sent, and Biosite Diagnostics specified that their system (Triage) was designed only for plasma and whole-blood samples. Eleven manufacturers submitted results; 4 of them used two or three different analytical systems (Table 1
).
|
study design
On receipt, the eight pools were stored at -70 °C until measurement, which occurred within 30 days. Vials of each aliquot were thawed, allowed to equilibrate to room temperature, and centrifuged to eliminate possible fibrin strands. Manufacturers were directed to analyze two replicates of each specimen in each run and to perform one run per day for 20 working days with their respective analytical systems. Two reagent lots (10 working days per lot) and at least three calibrations were to be used. Participants were instructed to randomly analyze pools to reflect any carryover effect. The manufacturers recommended controls, assayed at the beginning and at the end of each run, were used to validate measurements.
data analysis
Measurements were reported on a special electronic form prepared by the IFCC Committee and sent to the Committees chairman (M.P.). The original instrument printouts with raw data were also submitted. The total imprecision of troponin assays at different concentrations was estimated using the ANOVA method described in NCCLS EP5-A guideline (13). The CV values reported for the pools were used to construct imprecision profiles for each method. The troponin concentration associated with a 10% CV was determined from the intercept of the total CV (y axis) equal to 10% on the imprecision profile curve.
| Results |
|---|
|
|
|---|
|
The imprecision profiles (total CV vs pools AH, which had increasing cTnI concentrations) obtained for each cTnI method are shown in Fig. 1
. Because it was impossible to directly compare cTnT with cTnI concentrations in the evaluated pools, the CV data for the two Roche platforms are reported in Fig. 2
. Differences in imprecision were clear, which allowed us to categorize assays according to performance as good, moderate, and less than ideal.
|
|
The 10% CV concentrations together with the corresponding upper reference limits for each evaluated assay are reported in Table 3
. There were no cardiac troponin assays that can achieve an imprecision (CV) of 10% at the 99th percentile reference limit. Six systems achieved a 10% CV at concentrations that were approximately twofold higher than the concentration corresponding to the 99th percentile of the value distribution in a reference population. A second group of nine platforms achieved a 10% CV at concentrations approximately fourfold higher than the 99th percentile cutoff. In two cases, the concentration was very high (ninefold higher than the 99th percentile cutoff; Opus) or even impossible to calculate (Alpha Dx).
|
| Discussion |
|---|
|
|
|---|
10% (4)(9)(10). A recent study showed that only use of cardiac troponin concentrations that meet the goal of 10% CV as an MI cutoff provide a misclassification rate <1% in a population of patients with suspected acute coronary syndrome (18). With regard to this point, many cardiac troponin assays have not been appropriately validated, and the absolute performance of some commercially available assays is not easily discerned (19). To date, clinical users have frequently had to rely on the manufacturers claims and package inserts, even if data provided by manufacturers often portray better precision than is achieved in clinical practice (9). The current study is unique in that it demonstrates the imprecision at the low concentration ranges of the commercially available assays for cTnI and cTnT based on the use of the same experimental protocol performed over a clinically relevant timespan (4 weeks), use of the same human sera analyzed randomly with more than one lot of reagents and calibrations, and direct comparisons among assays independent of the commercial information provided with each assay. Pools of human sera were used. Because the imprecision for cardiac troponin measurements in modified protein matrices may be significantly different from that for measurements in human serum pools, a clinically realistic precision estimate is obtained only when unmodified human sera are tested.
Our data confirm the large diversity among cardiac troponin assays with respect to total imprecision and underscore the need for introduction of improved cardiac troponin assays that comply with the redefined MI definition and imprecision requirements. There currently are no commercial assays that can achieve a 10% CV at the 99th percentile reference limit, which would allow accurate differentiation between "minor" myocardial injury and analytical noise. The demand for very precise cardiac troponin assays undoubtedly presents a difficult challenge, but results obtained with more recently released next-generation assays show that there has been substantial improvement in the precision and sensitivity offered by the newer assays. This type of low-end improvement is considered by manufacturers as the main goal in the design of new assays (14).
According to previous suggestions (9)(20)(21), in the context of clinical practice a predetermined cardiac troponin concentration that meets the imprecision goal should be used as the cutoff for MI until the assays are improved. The results from the present study may help laboratories by identifying the lowest cardiac troponin concentrations that give the 10% CV required for implementation of the recommended clinical strategies in acute coronary syndrome patients. The use of the actual 10% CV concentration instead of the 99th percentile reference limit as a decision cutoff could slightly decrease the clinical sensitivity of the biochemical criterion used for the MI diagnosis, but should permit physicians to reduce the occasional increase in serum cardiac troponin in the absence of myocardial damage. Although higher precision at lower cardiac troponin concentrations does not automatically equate with higher clinical sensitivity, it has been shown that the use of a high-sensitivity cardiac troponin assay would allow identification of a substantial and additional proportion of patients with MI compared with a less sensitive cardiac troponin assay (22)(23). Use of the new diagnostic criteria for MI could lead to a mean increase in the number of infarcts in patients with acute coronary syndrome from 20% to 30%, but the percentage of patients recategorized from angina to MI may also be critically dependent on the performance of the cardiac troponin assay used.
Decision limits other than the 99th percentile and 10% CV have been clinically defined for some of the evaluated methods and used for risk stratification of patients with acute coronary syndrome (15)(16)(17). Although the data from these clinical trials are compelling, the use of cardiac troponin for MI diagnosis is different from its use for risk stratification. As discussed previously (24), it is important to consider differences in the prevalence of acute coronary syndrome in different populations. If the purpose of measuring cardiac troponin is only to risk-stratify patients with acute coronary syndrome for adverse events, consideration should be given to lowering the cardiac troponin cutoff below the 10% CV value. However, these low cardiac troponin cutoffs are not likely appropriate for the diagnosis of MI in a cohort of patients with chest pain and a low prevalence of disease, where false-positive results produced by a cardiac troponin assay as a result of analytical imprecision could have a much larger negative impact (18).
The limitations in our study should be noted. One limitation is that because each method was assessed in only one (manufacturer) site, it was not possible to definitively determine the effect, if any, on the imprecision of an assay by type of clinical laboratory (emergency or centralized) or by type of healthcare worker (laboratory technician or ward nurse) performing measurements. Furthermore, although human serum pools are better than artificial protein matrices, pooling may mask problems related to the performance for individual samples because interfering compounds in individual sera, e.g., heterophilic antibodies, are diluted and their effects may escape attention. Another limitation is that it could be difficult to accurately estimate the 10% CV concentration based on an interpolation between relatively few points. However, there was no alternative way to derive this information from our findings. Furthermore, looking at the peer-reviewed literature, imprecision studies on individual assays using robust experimental approaches have obtained results very similar to ours (18)(25). Finally, use of the 99th percentile limits information obtained from the manufacturers for calculation of the ratio of the 10% CV and 99th percentile concentrations, and the ranking of tests could influence the results, if aspects such as statistical data analysis, sample sizes, or criteria for individual selection were not correctly considered in the production of data by each company. However, for fairness to all manufacturers, we decided to use only what their claim.
| Acknowledgments |
|---|
| Footnotes |
|---|
1 Nonstandard abbreviations: MI, myocardial infarction; and cTnI and cTnT, cardiac troponin I and T, respectively. ![]()
| References |
|---|
|
|
|---|
The following articles in journals at HighWire Press have cited this article:
![]() |
M. S. Sabatine, D. A. Morrow, J. A. de Lemos, P. Jarolim, and E. Braunwald Detection of acute changes in circulating troponin in the setting of transient stress test-induced myocardial ischaemia using an ultrasensitive assay: results from TIMI 35 Eur. Heart J., November 8, 2008; (2008) ehn504v1. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. M. Eggers, T. Kempf, T. Allhoff, B. Lindahl, L. Wallentin, and K. C. Wollert Growth-differentiation factor-15 for early risk stratification in patients with acute chest pain Eur. Heart J., October 1, 2008; 29(19): 2327 - 2335. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. D White Evolution of the definition of myocardial infarction: what are the implications of a new universal definition? Heart, June 1, 2008; 94(6): 679 - 684. [Full Text] [PDF] |
||||
![]() |
J. R Tate, W. Ferguson, R. Bais, K. Kostner, T. Marwick, and A. Carter The determination of the 99th centile level for troponin assays in an Australian reference population Ann Clin Biochem, May 1, 2008; 45(3): 275 - 288. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. v. d. Kerkhof, B. Peters, and V. Scharnhorst Performance of the Advia Centaur second-generation troponin assay TnI-Ultra compared with the first-generation cTnI assay Ann Clin Biochem, May 1, 2008; 45(3): 316 - 317. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Thygesen, J. S. Alpert, H. D. White, and on behalf of the Joint ESC/ACCF/AHA/WHF Task Force Universal Definition of Myocardial Infarction J. Am. Coll. Cardiol., November 27, 2007; 50(22): 2173 - 2195. [Full Text] [PDF] |
||||
![]() |
K. Thygesen, J. S. Alpert, H. D. White, on behalf of the Joint ESC/ACCF/AHA/WHF Task Force, TASK FORCE MEMBERS: Chairpersons: Kristian Thygese, Biomarker Group: Allan S. Jaffe, Coordinator (USA), ECG Group: Bernard Chaitman, Co-ordinator (USA), P, Imaging Group: Richard Underwood, Coordinator (UK), Intervention Group: Jean-Pierre Bassand, Co-ordina, Clinical Investigation Group: Paul W. Armstrong, C, et al. Universal Definition of Myocardial Infarction Circulation, November 27, 2007; 116(22): 2634 - 2653. [Full Text] [PDF] |
||||
![]() |
Task Force Members, K. Thygesen, J. S. Alpert, H. D. White, Biomarker Group, A. S. Jaffe, F. S. Apple, M. Galvani, H. A. Katus, L. K. Newby, et al. Universal definition of myocardial infarction: Kristian Thygesen, Joseph S. Alpert and Harvey D. White on behalf of the Joint ESC/ACCF/AHA/WHF Task Force for the Redefinition of Myocardial Infarction Eur. Heart J., October 2, 2007; 28(20): 2525 - 2538. [Full Text] [PDF] |
||||
![]() |
C. Prontera, A. Fortunato, S. Storti, A. Mercuri, G. Longombardo, G. C. Zucchelli, M. Emdin, and A. Clerico Evaluation of Analytical Performance of the Siemens ADVIA TnI Ultra Immunoassay Clin. Chem., September 1, 2007; 53(9): 1722 - 1723. [Full Text] [PDF] |
||||
![]() |
J. L. Anderson, C. D. Adams, E. M. Antman, C. R. Bridges, R. M. Califf, D. E. Casey Jr, W. E. Chavey II, F. M. Fesmire, J. S. Hochman, T. N. Levin, et al. ACC/AHA 2007 Guidelines for the Management of Patients With Unstable Angina/Non-ST-Elevation Myocardial Infarction: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Writing Committee to Revise the 2002 Guidelines for the Management of Patients With Unstable Angina/Non-ST-Elevation Myocardial Infarction) Developed in Collaboration with the American College of Emergency Physicians, the Society for Cardiovascular Angiography and Interventions, and the Society of Thoracic Surgeons Endorsed by the American Association of Cardiovascular and Pulmonary Rehabilitation and the Society for Academic Emergency Medicine J. Am. Coll. Cardiol., August 14, 2007; 50(7): e1 - e157. [Full Text] [PDF] |
||||
![]() |
J. L. Anderson, C. D. Adams, E. M. Antman, C. R. Bridges, R. M. Califf, D. E. Casey Jr, W. E. Chavey II, F. M. Fesmire, J. S. Hochman, T. N. Levin, et al. ACC/AHA 2007 Guidelines for the Management of Patients With Unstable Angina/Non ST-Elevation Myocardial Infarction Executive Summary: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Writing Committee to Revise the 2002 Guidelines for the Management of Patients With Unstable Angina/Non ST-Elevation Myocardial Infarction) Developed in Collaboration with the American College of Emergency Physicians, the Society for Cardiovascular Angiography and Interventions, and the Society of Thoracic Surgeons Endorsed by the American Association of Cardiovascular and Pulmonary Rehabilitation and the Society for Academic Emergency Medicine J. Am. Coll. Cardiol., August 14, 2007; 50(7): 652 - 726. [Full Text] [PDF] |
||||
![]() |
B. H. Cuthbertson, A. R. Amiri, B. L. Croal, S. Rajagopalan, O. Alozairi, J. Brittenden, and G. S. Hillis Utility of B-type natriuretic peptide in predicting perioperative cardiac events in patients undergoing major non-cardiac surgery Br. J. Anaesth., August 1, 2007; 99(2): 170 - 176. [Abstract] [Full Text] [PDF] |
||||
![]() |
NACB Writing Group Members, F. S. Apple, R. L. Jesse, L. K. Newby, A. H.B. Wu, and R. H. Christenson National Academy of Clinical Biochemistry and IFCC Committee for Standardization of Markers of Cardiac Damage Laboratory Medicine Practice Guidelines: Analytical Issues for Biochemical Markers of Acute Coronary Syndromes Circulation, April 3, 2007; 115(13): e352 - e355. [Full Text] [PDF] |
||||
![]() |
C L Hu, Y B Li, Y G Zou, J M Zhang, J B Chen, J Liu, Y H Tang, Q Z Tang, and C X Huang Troponin T measurement can predict persistent left ventricular dysfunction in peripartum cardiomyopathy Heart, April 1, 2007; 93(4): 488 - 490. [Abstract] [Full Text] [PDF] |
||||
![]() |
NACB WRITING GROUP MEMBERS, F. S. Apple, R. L. Jesse, L. K. Newby, A. H.B. Wu, R. H. Christenson, NACB COMMITTEE MEMBERS, R. H. Christenson, F. S. Apple, C. P. Cannon, et al. National Academy of Clinical Biochemistry and IFCC Committee for Standardization of Markers of Cardiac Damage Laboratory Medicine Practice Guidelines: Analytical Issues for Biochemical Markers of Acute Coronary Syndromes Clin. Chem., April 1, 2007; 53(4): 547 - 551. [Full Text] [PDF] |
||||
![]() |
L. T. Cooper Jr, G. A. Mensah, L. M. Baddour, S. B. Dunbar, E. L. Kaplan, W. R. Wilson, and P. K. Shah Task Force III: Prevention and Control of Cardiovascular Complications of Emerging Infectious Diseases and Potential Biological Terrorism Agents and Diseases J. Am. Coll. Cardiol., March 27, 2007; 49(12): 1398 - 1406. [Full Text] [PDF] |
||||
![]() |
R. Sakhuja, S. Green, E. M. Oestreicher, P. M. Sluss, E. Lee-Lewandrowski, K. B. Lewandrowski, and J. L. Januzzi Jr. Amino-Terminal Pro-Brain Natriuretic Peptide, Brain Natriuretic Peptide, and Troponin T for Prediction of Mortality in Acute Heart Failure Clin. Chem., March 1, 2007; 53(3): 412 - 420. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. A. Kavsak, A. M. Newman, V. Lustig, A. R. MacRae, G. E. Palomaki, D. T. Ko, J. V. Tu, and A. S. Jaffe Long-Term Health Outcomes Associated with Detectable Troponin I Concentrations Clin. Chem., February 1, 2007; 53(2): 220 - 227. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. S. Willis, J. A. Snyder, R. H. Poppenga, and D. G. Grenache Bovine cardiac troponin T is not accurately quantified with a common human clinical immunoassay J Vet Diagn Invest, January 1, 2007; 19(1): 106 - 108. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. A. Waxman, S. Hecht, J. Schappert, and G. Husk A Model for Troponin I as a Quantitative Predictor of In-Hospital Mortality J. Am. Coll. Cardiol., November 7, 2006; 48(9): 1755 - 1762. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. H.B. Wu, N. Fukushima, R. Puskas, J. Todd, and P. Goix Development and preliminary clinical validation of a high sensitivity assay for cardiac troponin using a capillary flow (single molecule) fluorescence detector. Clin. Chem., November 1, 2006; 52(11): 2157 - 2159. [Full Text] [PDF] |
||||
![]() |
P. A. Kavsak, A. R. MacRae, G. E. Palomaki, A. M. Newman, D. T. Ko, V. Lustig, J. V. Tu, and A. S. Jaffe Health Outcomes Categorized by Current and Previous Definitions of Acute Myocardial Infarction in an Unselected Cohort of Troponin-Naive Emergency Department Patients Clin. Chem., November 1, 2006; 52(11): 2028 - 2035. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. H. Christenson, S. H. Duh, F. S. Apple, G. S. Bodor, D. M. Bunk, M. Panteghini, M. J. Welch, A. H.B. Wu, S. E. Kahn, and for the American Association for Clinical Chemistr Toward Standardization of Cardiac Troponin I Measurements Part II: Assessing Commutability of Candidate Reference Materials and Harmonization of Cardiac Troponin I Assays Clin. Chem., September 1, 2006; 52(9): 1685 - 1692. [Abstract] [Full Text] [PDF] |
||||
![]() |
V. L. Roger, J. M. Killian, S. A. Weston, A. S. Jaffe, J. Kors, P. J. Santrach, H. Tunstall-Pedoe, and S. J. Jacobsen Redefinition of Myocardial Infarction: Prospective Evaluation in the Community Circulation, August 22, 2006; 114(8): 790 - 797. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. T. Holmes and K. Buhr Mathematical Modeling: Assumptions Affect Results. Clin. Chem., August 1, 2006; 52(8): 1606 - 1608. [Full Text] [PDF] |
||||
![]() |
O. Schulz, K. Kirpal, J. Stein, R. Bensch, G. Berghofer, I. Schimke, and A. S. Jaffe Importance of low concentrations of cardiac troponins. Clin. Chem., August 1, 2006; 52(8): 1614 - 1615. [Full Text] [PDF] |
||||
![]() |
A. S. Jaffe, L. Babuin, and F. S. Apple Biomarkers in Acute Cardiac Disease: The Present and the Future J. Am. Coll. Cardiol., July 4, 2006; 48(1): 1 - 11. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. A. Khan, B. R. Hemmelgarn, M. Tonelli, C. R. Thompson, and A. Levin Response to Letter Regarding Article by Khan et al, "Prognostic Value of Troponin T and I Among Asymptomatic Patients With End-Stage Renal Disease: A Meta-Analysis" Circulation, May 23, 2006; 113(20): e776 - e776. [Full Text] [PDF] |
||||
![]() |
W. Lim, D. J. Cook, L. E. Griffith, M. A. Crowther, and P. J. Devereaux Elevated Cardiac Troponin Levels in Critically Ill Patients: Prevalence, Incidence, and Outcomes Am. J. Crit. Care., May 1, 2006; 15(3): 280 - 288. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. R. MacRae, P. A. Kavsak, V. Lustig, R. Bhargava, R. Vandersluis, G. E. Palomaki, M.-J. Yerna, and A. S. Jaffe Assessing the Requirement for the 6-Hour Interval between Specimens in the American Heart Association Classification of Myocardial Infarction in Epidemiology and Clinical Research Studies Clin. Chem., May 1, 2006; 52(5): 812 - 818. [Abstract] [Full Text] [PDF] |
||||
![]() |