|
|
||||||||
1 Department of Internal Medicine I, University of Bonn, Sigmund-Freud-Strasse 25, 53105 Bonn, Germany
aAuthor for correspondence. Fax 49-228287-5034; e-mail j-c.wasmuth{at}uni-bonn.de.
| Abstract |
|---|
|
|
|---|
Methods: In 144 patients with suspected APS, anti-cardiolipin (aCL) and anti-ß2-glycoprotein I (aß2GPI) antibodies were measured with 23 different ELISAs from three manufacturers. Data were analyzed by ROC curves. In the absence of an accepted criterion standard, the endpoint "diagnosis of APS" was varied according to the number (two through five) of signs and symptoms of APS.
Results: Although the presence of lupus anticoagulant was associated significantly with APL-Ab in 10 of 23 assays (P = 0.0110-4) and recurrent arterial or venous occlusions were significantly associated with APL-Ab of IgM isotype in 5 of 6 assays (P = 0.0210-4), sensitivity for detection of APS did not exceed 67%. With the exception of IgA APL-Ab, the diagnostic accuracy of the assays improved when the diagnosis of APS was based on an increasing number of simultaneous features of APS. For most methods, areas under the ROC curves were >0.8 irrespective of the methods subclass specificity and antigen preparation (aCL or aß2GPI), if the clinical diagnosis of APS was based on four or more signs and symptoms of APS.
Conclusion: Despite considerable heterogeneity in the individual test results, a single test of IgG or IgM isotype targeted at either aCL or aß2GPI antibodies has excellent diagnostic accuracy when the criterion for diagnosis requires four or more typical manifestations of APS.
| Introduction |
|---|
|
|
|---|
Among the antiphospholipid antibodies (APL-Abs), the appearance of anticardiolipin (aCL) antibodies is particularly associated with the APS (1), although antibodies can also interfere with the function of other pro- or anticoagulatory proteins, such as prothrombin, (activated) protein C, protein S, annexin V, factor XII, thrombomodulin, and tissue-type plasminogen activator (4)(5)(6)(7). aCL antibodies react with cardiolipin in the presence of a 50-kDa serum cofactor, which was identified as ß2-glycoprotein I (ß2GPI) by sequencing of the N-terminal amino acids (8). ß2GPI enhances the binding of aCL antibodies to cardiolipin in systemic lupus erythematosus (SLE) (9).
Accumulating evidence suggests that antibodies to ß2GPI (aß2GPI antibodies) are the actual pathogenic principle that leads to APS (10)(11). This has produced controversy regarding which antigen preparation should be used for the detection of APL-Abs in clinical practice. A recent consensus conference suggested that correct identification of APS-associated autoantibodies is of outmost importance to make a correct diagnosis (12), but it is still unclear whether certain isotypes of aCL antibodies are linked to the presence of distinct clinical manifestations (13). For example, IgA isotypes have been proposed to be particularly linked with an increased risk of thrombocytopenia, skin manifestations, and thrombotic events (14)(15). However, others did not find such associations (16)(17). Moreover, the prevalence of IgA-aCL antibodies may show significant heterogeneity with respect to different ethnic backgrounds (18).
To clarify the clinical importance of different APL-Abs in the diagnosis of APS, we measured aCL and aß2GPI antibodies with 23 reagent sets targeted either at different immunoglobulin isotypes or antigenic preparations, respectively, in 144 Caucasoid patients with the clinical suspicion of APS. In these patients, clinical manifestations of APS were validated by a standardized questionnaire, and test accuracy was studied by ROC analysis with "diagnosis of APS" as endpoint. To study the relationship between the clinical heterogeneity in the presentation of APS and the presence and heterogeneity of APL-Abs, the endpoint, diagnosis of APS, was varied according to the numbers (two through five) of APS-related features that were present simultaneously.
| Materials and Methods |
|---|
|
|
|---|
To take into account differences in diagnostic standards, the patient records were reevaluated by the study personnel, using standardized criteria and a unified protocol (19) to identify clinical manifestations of APS: (a) recurrent venous thrombosis (verified by either ultrasound or phlebography); (b) thrombocytopenia (<100 g/L in both EDTA and citrate blood to exclude pseudothrombocytopenia); (c) recurrent spontaneous abortions (more than two); (d) neurologic symptoms (such as transient ischemic attacks and hemiplegia) and signs of arterial or venous occlusion verified by Doppler ultrasound, angiography, or magnetic resonance imaging angiography; (e) peripheral arterial occlusion (verified by angiography or operative thrombectomy); (f) amaurosis fugax; (g) livedo reticularis; (h) ulceration of the legs; (i) SLE or other autoimmune processes; and (j) presence of a prolonged activated partial thromboplastin time as a marker of lupus anticoagulant (LAC), confirmed according to the guidelines of the International Society on Thrombosis and Hemostasis (20) (unexplained prolongation of the activated partial thromboplastin time that was not reversed after mixing and dilution of the patients plasma with normal platelet-free plasma; confirmatory tests were dilute Russells viper venom time and kaolin clotting time).
For 16 patients, the records were incomplete and did not allow a definite decision on the presence of APS-associated manifestations. These 16 patients were excluded from the analysis, and 144 well-characterized patients were entered into the analysis (50 males and 94 females; mean age ± SD, 44 ± 12 years). We studied clinical features and APL-Abs at a second time point in 53 of these 144 patients. Blood samples from 10 healthy, symptom-free controls without any known underlying disease (3 males and 7 females; mean age ± SD, 42 ± 14 years of age) were included as negative controls. All study procedures were done in accordance with the current revision of the Helsinki Declaration of 1975. Finally, the study design was oriented on the 2000 guidelines for evaluation of diagnostic accuracy (21), and samples were deidentified.
laboratory procedures
Serum samples were collected and frozen at -80 °C. For quantitative determination of aCL and aß2GPI antibodies, ELISAs from three different manufacturers were used (summarized in Table 1
). All assays were used according to the manufacturers instructions according to standard ELISA procedures. In-house calibrators were used for standardization. Negative controls were included in the assays to ensure negative test results and were included in the statistical analysis. Absorbances were determined with a photometer at 450 nm (Spectra Mini; Tecan). The cutoff values predefined by the manufacturers and the analytical precisions of the ELISAs are given in Table 1
. The laboratory staff was blinded with respect to the clinical presentation of the patients.
|
statistical analysis
To characterize each ELISA with respect to its accuracy to detect patients with an APS, sensitivity and specificity were calculated from 2 x 2 contingency tables for each possible cutoff value and plotted as ROC curves. The area under the ROC curve (AUC), W, and its standard error, SEW, were calculated according to the methods of Hanley and McNeil (22) and Beck and Schultz (23). The significance of the AUC for each ROC curve analyzed with the standard critical ratio test:
![]() |
For statistical comparison of the AUCs for two ROC curves, A and B, the critical ratio z was calculated as:
![]() |
= 0.05. A clear-cut external criterion standard not involving APL-Ab testing does not exist for the diagnosis of APS. Therefore, we took the presence of typical manifestations of APS as a substitute for such a gold standard, and ROC analysis was performed repeatedly with different definitions of APS diagnosis, depending on the number of simultaneous signs and symptoms. Patients were arbitrarily divided into four subgroups, based on the signs and symptoms. In group I, the diagnosis of APS was assumed if two or more of the above-mentioned 10 clinical criteria were met. Similarly, patients in group II fulfilled three or more of the above criteria; in group III, four or more of the above criteria were fulfilled, and in group IV, at least five criteria were fulfilled. In each of these analyses, patients with less than the required number of features were allocated to the "disease-free" group in the 2 x 2 contingency tables.
Statistical analysis was performed with SPSS software (Ver. 6.1.3; SPSS Inc.), and ROC analysis was performed on an electronic spreadsheet (Microsoft Excel 7.0; Microsoft Corp.).
| Results |
|---|
|
|
|---|
In our primary ROC analysis, the presence of LAC was associated significantly with the presence of APL-Abs for 10 of 23 ELISAs (aCL antibodies, IgG and IgM by ELISAs from companies A and B, IgA by ELISAs from companies B and C; aß2GPI antibodies, IgG by ELISAs from all three companies, IgA by ELISAs from company B; range of AUCs, 0.750.93; range of SE, 0.0800.109; range for P, 0.0110-4). Antibodies of the IgM isotype were significantly associated with recurrent venous thromboembolism or arterial occlusion in five of six ELISAs (aCL antibodies, ELISAs from all three companies; aß2GPI antibodies, ELISAs from companies A and B; range of AUCs, 0.640.76; range of SE, 0.0490.075; range of P, 0.0210-4), and with ulceration of the legs in two IgM ELISAs [IgM aCL antibodies by the ELISA from company B (AUC = 0.67; SE = 0.075; P <0.05); and IgM aß2GPI antibodies by the ELISA from company A (AUC = 0.70; SE = 0.091; P <0.05)]. The best diagnostic accuracy for the association of a positive antiphospholipid test result and any of the other APS-associated phenomena was found with the IgG aß2GPI ELISA from company C and the presence of LAC (AUC = 0.93; SE = 0.102; P <10-4). However, even this association had only 67% sensitivity and 91% specificity with the cutoff provided by the manufacturer. Therefore, our further analysis was focused on assay performance to detect patients who had several APS-associated features simultaneously.
roc analysis by stratification based on number of aps criteria
The ROC characteristics (AUCs) improved in parallel to the number of required criteria to make a positive diagnosis of APS for all assays except the aCL antibody tests from company C [Fig. 1
; also see the data supplement that accompanies the online version of this article on the Clinical Chemistry Online web site (http://www.clinchem.org/content/vol48/issue7/)]. Areas under the ROC curves >0.8 were obtained when four or more typical manifestations (group III) were set as the definition of APS (Fig. 2
).
|
|
When we used the cutoff values provided by the manufacturers, sensitivities were
67% in groups I and II for any of the assays (range, 467%), whereas in groups III and IV, sensitivities reached 100% for the IgG, IgM, and screen assays (33100%), indicating that stricter criteria for the definition of APS produced fewer false-negative results. The analyzed tests to detect IgA antibodies were inferior to the other test types regardless of aCL or aß2GPI antibody specificity or manufacturer. Sensitivities did not exceed 25% in the best IgA tests (data not shown). Therefore, IgA tests were excluded from further statistical analysis, as were all aCL antibody tests from company C because their diagnostic accuracy remained poor when the number of clinical criteria for the diagnosis of APS was varied. Considering the relatively small numbers of patients in subgroups III and IV, it was not possible to analyze whether any of the tests significantly outperformed the other tests.
| Discussion |
|---|
|
|
|---|
In this study, we searched for APL-Abs in 144 patients, using 23 different ELISAs based on antibodies of different isotypes and specificities. To account for differences attributable to the antigen preparations, we chose assays from three different manufacturers. To compare the diagnostic accuracy of these test methods, we used ROC analysis with surrogate definitions of APS, which varied in the numbers of APS-related features, and we assumed that the AUCs for the ROC curves would increase with the progressive allocation of patients to the disease-free group. This approach was chosen to circumvent the problem that current consensus definitions of APS could not be used as a gold standard for such an analysis because APL-Abs themselves are an integral part of the definition.
A further consideration in our approach was that the use of a fixed criterion is particularly prone to spectrum bias in a disease, such as APS, with highly variable manifestations, i.e., only patients with severe manifestations are diagnosed correctly. In contrast, our concept of a variation of ROC curves with the number of clinical manifestations also takes into account variable disease expression. Choosing an incremental number of diagnostic criteria as the endpoint in our ROC analysis produced higher apparent diagnostic accuracies for the tests (except for the aCL antibody ELISAs manufactured by company C). This finding together with the reliable exclusion of the negative controls is expected for any reasonable tests and, thus, strengthens the internal validity of our analysis.
Our analysis indicated that an almost-perfect ROC plot was obtained if the clinical diagnosis of APS was based on four or more features. This almost-perfect match was obtained with tests targeted at different antigen specificities (cardiolipin and ß2GPI) and from different manufacturers. In general, tests for IgG, IgM, or IgG + IgM (screen) produced equivalent results, similar to those reported previously by Bertolaccini et al. (27). However, the numbers of patients in groups III and IV were rather low; therefore, our ability to detect statistically significant differences among tests was rather limited.
It was unexpected that the aCL assays manufactured by company C failed to correctly identify patients with APS when stricter criteria were required for the diagnosis of APS. This company had added abundant ß2GPI in the dilution buffers of their aCL reagent sets to exclude false-positive reactivities attributable to ß2GPI contamination in the cardiolipin antigen preparation in the solid phase, whereas such measures were not taken by the other manufacturers. There is accumulating evidence that aß2GPI may be a more relevant antibody than aCL with respect to clinical manifestations of APS (10)(11)(28).
The failure of the aCL assay manufactured by company C in our analysis supports the concept that aß2GPI antibodies are better correlated to clinical symptoms and that the diagnostic power of so-called cardiolipin tests is actually based on the cross-reaction of antibodies with contaminating ß2GPI. This interpretation is in line with recent data reported by Day et al. (29) and Gomez Pacheco et al. (30). Cross-reactivity with contaminating ß2GPI probably also explains why ß2GPI tests achieved areas under the ROC curves similar to those of the aCL tests (excluding the aCL ELISAs from company C).
Tests targeted at IgA isotypes performed less well than tests targeted at antibodies of the other isotypes. This finding is in line with the data from Wilson et al. (16) and Selva-OCallaghan et al. (17), who reported that IgA antibodies do not play an important role in the diagnosis of APS. However, these studies, as well as our present analysis, were done in a Caucasoid population, and considerably higher prevalences of IgA-isotype APL-Abs have been reported in populations with different ethnic backgrounds (18)(31)(32). Therefore, our study does not exclude that IgA-aCL testing is of use in such populations.
No relevant association of distinct antibodies or immunoglobulin classes with single clinical symptoms was found. Although ROC analysis revealed significant AUC values for the detection of recurrent venous thromboembolism, arterial occlusion, or ulceration of the legs by IgM antibodies, sensitivities always were <50% when we used the cutoffs provided by the manufacturers. Likewise, sensitivities were
44% for the associations between IgG and IgM aCL antibodies or IgG aß2GPI antibodies and the presence of LAC.
The activated partial thromboplastin time used to detect the presence of LAC in our study can be normal in a substantial proportion of LAC-positive plasmas. Thus, we cannot exclude that our approach to identifying LAC has underestimated the prevalence of LAC-positive samples. Nevertheless, our data are in contrast to some studies, which had demonstrated an association between venous or arterial thrombosis and recurrent fetal loss with the presence of APL-Abs (33); other studies, however, did not find associations between immunoglobulin isotypes and clinical manifestations of APS (34)(35) or between APL-Abs and SLE (36). This obvious paradox reflects the great variability of the APS itself, the variability of different assay methods (37), and the difficulty in comparing results from different investigators (38). Accordingly, we can not exclude a heterogeneity of our own study population, thereby hampering comparison with other groups.
In conclusion, our analysis confirms that aCL and aß2GPI antibodies are suitable diagnostic markers for APS despite considerable variability in the diagnostic accuracy of commercially available tests. Current guidelines recommend repeated testing of phospholipid autoantibodies to make a reliable diagnosis of APS (12), whereas our analysis was based on a single test result to meet statistical requirements. However, it was reassuring that none of our 53 patients who were evaluated at a second time point had to be allocated to a different group based on clinical features or APL-Ab results. Our analysis of diagnostic accuracy suggests that a single test targeted at IgG or IgM aCL or aß2GPI antibodies has satisfactory accuracy to detect the clinical presence of APS. Therefore, we recommend that further studies with rigorous statistical procedures to be done in different ethnic populations and on a broader clinical basis to clarify whether incremental testing with different tests is really necessary in the diagnostic routine.
| Footnotes |
|---|
| References |
|---|
|
|
|---|
The following articles in journals at HighWire Press have cited this article:
![]() |
J.-C. Wasmuth, B. Grun, B. Terjung, A. Homrighausen, and U. Spengler ROC Analysis Comparison of Three Assays for the Detection of Antibodies against Double-Stranded DNA in Serum for the Diagnosis of Systemic Lupus Erythematosus Clin. Chem., November 1, 2004; 50(11): 2169 - 2171. [Full Text] [PDF] |
||||
![]() |
M. A. Ozturk, I. C. Haznedaroglu, M. Turgut, and H. Goker Current Debates in Antiphospholipid Syndrome: The Acquired Antibody-Mediated Thrombophilia Clinical and Applied Thrombosis/Hemostasis, April 1, 2004; 10(2): 89 - 126. [Abstract] [PDF] |
||||
![]() |
B. Lumbreras-Lacarra, J. M. Ramos-Rincon, and I. Hernandez-Aguado Methodology in Diagnostic Laboratory Test Research in Clinical Chemistry and Clinical Chemistry and Laboratory Medicine Clin. Chem., March 1, 2004; 50(3): 530 - 536. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |