Clinical Chemistry Email Content Delivery
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


Clinical Chemistry 45: 189-198, 1999;
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Submit an electronic Letter to
the Editor about this paper
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (37)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Hølleland, G.
Right arrow Articles by Sandberg, S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Hølleland, G.
Right arrow Articles by Sandberg, S.
Related Collections
Right arrow Nutrition
Right arrow Evidence Based Laboratory Medicine and Test Utilization
Right arrow Hematology
(Clinical Chemistry. 1999;45:189-198.)
© 1999 American Association for Clinical Chemistry, Inc.


Articles

Cobalamin Deficiency in General Practice. Assessment of the Diagnostic Utility and Cost-Benefit Analysis of Methylmalonic Acid Determination in Relation to Current Diagnostic Strategies

Geir Hølleland1, Jørn Schneede2, Per Magne Ueland2, Per Kristian Lund3, Helga Refsum2 and Sverre Sandberg1,a

1 Laboratory of Clinical Biochemistry, Haukeland University Hospital, N-5021 Bergen, Norway, and Division for General Practice, University of Bergen, Norway.

2 Department of Pharmacology, University of Bergen, Armauer Hansens Hus, N-5021 Bergen, Norway.

3 Fürst Medical Laboratory, Soeren Bulls vei 25, N-1051 Oslo 10, Norway.
a Author for correspondence. Fax 0047 55 97 3115; e-mail sverre.sandberg{at}haukeland.no.


   Abstract
Top
Abstract
Introduction
Patients and Methods
Results and Discussion
Conclusions
References
 
Diagnosing cobalamin deficiency is often difficult. We investigated the diagnostic strategies that 224 general practitioners used to assess cobalamin status and the criteria on which they based their decisions to supplement patients. From all serum cobalamin analyses carried out at a single laboratory during 1993, individuals with serum cobalamin concentrations <300 pmol/L were identified, and one patient per general practitioner was included. When serum methylmalonic acid (s-MMA) values >0.376 µmol/L were used as the "reference standard" for cobalamin deficiency, the serum cobalamin assay had a diagnostic sensitivity of 0.40 and a specificity of 0.98. With the same reference standard, the diagnostic accuracy of the physicians' decision to supplement patients had the same specificity but a higher sensitivity (0.51). Cost-benefit analysis indicated that measurement of s-MMA can be recommended in patients with serum cobalamin >60–90 pmol/L and <200–220 pmol/L, depending on its diagnostic accuracy.


   Introduction
Top
Abstract
Introduction
Patients and Methods
Results and Discussion
Conclusions
References
 
The diagnosis of cobalamin deficiency is traditionally based on medical history and the finding of megaloblastic anemia combined with a low serum cobalamin (s-cobalamin)1 concentration. Development of cobalamin deficiency is usually a slow process that often starts with subtle symptoms such as asthenia, memory impairment, or polyneuropathy (1)(2)(3)(4)(5)(6). Moreover, severe neurologic deficits may occur in the absence of anemia in a considerable portion of patients (7). The often diffuse and nonspecific symptoms in the early phase of cobalamin deficiency, the possible absence of anemia, and the irreversible damage to the central nervous system that may result from delayed diagnosis (8)(9) are strong incentives to establish accurate diagnostic tests. A poor diagnostic test for cobalamin deficiency can also lead to overdiagnosis, which may in turn lead to people being treated their entire lives for a disease they do not have and which may also mask other diseases.

Among laboratory tests for the diagnosis of cobalamin deficiency, determination of s-cobalamin is most commonly used. However, the diagnostic efficiency of s-cobalamin is too low . This can partly be explained by the fact that the major fraction of cobalamin in serum is bound to haptocorrin, which is not available for uptake in most cells (10)(11). Approximately 20% is bound to transcobalamin II. Only the transcobalamin II-cobalamin complex can be utilized by peripheral cells through receptor-mediated uptake (12)(13). In addition, s-cobalamin may be influenced by changes in the binding protein concentration. Thus, total s-cobalamin is a relatively poor indicator of bioavailable cobalamin (14). Therefore, tests for other cobalamin markers have been developed, such as the holo-transcobalamin II concentration in serum (15), the deoxyuridine suppression test, or the functional markers methylmalonic acid (MMA) and total homocysteine (tHcy) (16).

Among the functional tests, determination of serum MMA (s-MMA) has received particular attention. This is because of the stability of MMA in blood (17) and the small sample volume requirements and high diagnostic accuracy of the test. s-MMA is assumed to be a better indicator of intracellular cobalamin status than s-cobalamin, and s-MMA has been proposed as a complement or replacement for s-cobalamin measurements (17). However, methods for MMA measurement are costly and cumbersome, and commercial assays are not available. This hampers its widespread routine use.

Here, we report on the diagnostic strategies used to assess cobalamin deficiency in general practice, especially the influence of s-cobalamin assay results on final diagnosis and the decision to supplement patients. We also estimated the increase in diagnostic accuracy obtained by additional determination of s-MMA, and indicate the s-cobalamin range, where this may be justified, based on cost-benefit analyses.


   Patients and Methods
Top
Abstract
Introduction
Patients and Methods
Results and Discussion
Conclusions
References
 
patients and study design
The study was performed as a retrospective cohort study. Patients were recruited through the Fürst Medical Laboratory (FML) in Oslo, Norway in 1993. During that year, a total of 76 840 cobalamin analyses were performed, and only patients with s-cobalamin concentrations <300 pmol/L (30%) were eligible for the present study. The lower reference limit for s-cobalamin was 170 pmol/L. Approximately 75 patients in each of the following s-cobalamin concentrations were included: 0–139, 140–169, 170–189, 190–219, and 220–299 pmol/L. The limits of the intervals were chosen in this way to ensure that there were enough patients representing definitely low, borderline, and health-related values of s-cobalamin because we were especially interested in the physicians' decision when they received results in these concentrations. Only one patient per general practitioner was included.

Approximately 6 weeks after FML had sent the results of cobalamin analysis, the general practitioners received a questionnaire to obtain information on why they had requested s-cobalamin measurement. The categories provided in the questionnaire were anemia; macrocytosis; psychiatric symptoms (specified as depression, dementia, or psychosis); neurologic symptoms (unspecified); and diffuse symptoms, screening, and others. Other questions asked whether additional analyses were requested, whether the general practitioner believed that the patient was cobalamin deficient, and whether the patient had received any treatment. General practitioners who did not respond to the first questionnaire received a new questionnaire after 6 weeks.

A total of 316 (84%) out of 376 questionnaires were returned. Five were excluded from all further analyses because the doctors were not general practitioners. Nine patients were excluded because the questionnaires were incompletely filled out. In addition, we did not ask for clinical data in 78 cases where s-cobalamin was ordered as a confirmation test of either an earlier s-cobalamin determination or as therapy control in patients on cobalamin supplementation. Thus, 224 patients were qualified for additional data analysis. In addition, 15 patients had to be excluded from parts of the study because there was not enough serum left for measurement of serum concentrations of creatinine and MMA. Likewise, 12 women and 7 men with serum creatinine >115 and 125 µmol/L, respectively, were excluded from parts of the study where s-MMA was used (18)(19)(20). Table 1 shows the demographic characteristics of the study population.


View this table:
[in this window]
[in a new window]
 
Table 1. Demographic representation of the study population as percentages of the total number of samples included.

sample handling and biochemical analyses
In this study, the blood was collected and the serum prepared at the general practitioners' offices. The serum samples were then mailed to FML. After FML had performed the requested blood analyses, the serum samples were stored at -20 °C. s-Creatinine, s-tHcy, and s-folate were later measured at the Laboratory of Clinical Biochemistry, Haukeland Hospital, Bergen, Norway, whereas s-MMA was analyzed at the Department of Pharmacology, University of Bergen.

s-Cobalamin and s-folate were measured by RIA (Diagnostic Product Corp.). The reference range of s-cobalamin was 170–700 pmol/L, and the between-day CV was 3–7%, depending on the s-cobalamin concentration. The reference limit of s-folate was >5.0 nmol/L, and the between-day CV was 3–7%, depending on the s-folate concentration.

Serum creatinine was measured by the Jaffe method on an Axon® (Bayer Instruments Corp.). The reference ranges for serum creatinine were 55–115 and 60–125 µmol/L for women and men, respectively. The between-day CV was 2.5–3.5%. In 15 patients, there was not sufficient serum for creatinine determination, and these were excluded from part of the analyses.

Serum tHcy, which includes free and protein-bound Hcy forms, was determined by a modification of an automated procedure based on derivatization with monobromobimane, followed by HPLC and fluorescence detection (21)(22). The between-day CV was ~3%. The reference range for serum tHcy is 0–15 µmol/L, and results above 15.0 µmol/L are considered increased (23).

s-MMA was measured by capillary electrophoresis (24). The between-day CV was 5–10% for MMA concentrations within a range of 0.12–0.57 µmol/L. The reference range for s-MMA is 0.05–0.26 µmol/L. The cutoff point for diagnosing functional cobalamin deficiency was set to 0.376 µmol/L, which corresponded to 3 SD above the mean of healthy controls (22)(25)(26)(27)(28). Lower values were referred to as "normal".

statistics and data analyses
Data analyses were performed using multivariate stepwise logistic regression analyses (SPSS, Ver. 4.0 for Macintosh). From this we obtain the log odds and could remodel the equation to give the posttest probability of an event. In the logistic regression analyses, different dependent and independent variables were used.


   Results and Discussion
Top
Abstract
Introduction
Patients and Methods
Results and Discussion
Conclusions
References
 
Cobalamin deficiency presenting with classical clinical manifestations is not difficult to diagnose. However, such a clinical picture is seen only rarely, even in a selected group of patients with s-cobalamin in the lower range. Conceivably, the indications for requesting such a test will differ with the cobalamin concentration found. Likewise, because there is no independent "gold standard" for cobalamin deficiency, the certainty with which the general practitioner sets a diagnosis, and the probability that the patient will be supplemented, will be directly related to the serum cobalamin assay result. When comparing s-cobalamin with s-MMA, we therefore must consider whether the additional information obtained by measuring MMA will assist the general practitioner in reaching the correct diagnosis and thereby the correct therapy.

In the present study, we investigated the diagnostic strategies among 224 general practitioners, each contributing one patient with a serum cobalamin <300 pmol/L. The patients belonged to five different categories defined according to their cobalamin concentration. This allowed us to investigate the different diagnostic approaches as a function of the cobalamin concentration. We first registered the indications that the general practitioner listed for requesting the serum cobalamin assay. We then investigated how the general practitioner responded to the serum cobalamin assay result as judged by (a) the subsequent request of additional biochemical tests; (b) their ability to set a definite diagnosis; and (c) the initiation of cobalamin therapy.

We performed a retrospective comparison of the s-MMA as the reference standard with the initial serum cobalamin assay result, the ability of the general practitioner to set a definite diagnosis, and the initiation of cobalamin supplementation. On the basis of these results, we were able to evaluate the diagnostic benefit of including MMA as an additional marker of cobalamin deficiency.

indications for requesting s-cobalamin
The indications for requesting s-cobalamin are summarized in Table 2 . Two or more indications were frequently reported. Anemia was an indication for requesting s-cobalamin in ~30% of patients with s-cobalamin values <170 pmol/L. This percentage decreased at higher s-cobalamin concentrations. Macrocytosis was an uncommon reason for cobalamin testing, even at low cobalamin concentrations. In almost 50% of the patients with s-cobalamin <190 pmol/L, the general practitioners did not report hematological, neurologic, or psychiatric findings or symptoms.


View this table:
[in this window]
[in a new window]
 
Table 2. Indications for requesting cobalamin.

primary and ancillary tests
Hemoglobin was requested together with s-cobalamin for 70–90% of the patients. s-Iron, s-total iron binding capacity, or s-ferritin was requested for 60–80%, thyroid function tests were requested for 30–50%, and serum or red cell folate was requested for ~30% of the patients. s-Lactate dehydrogenase, s-bilirubin, or the Schilling test were seldom ordered as initial or ancillary tests (data not shown).

Cobalamin retesting was the most frequently used follow-up test in these patients (Table 3 ). With s-cobalamin in the range of 170–189 pmol/L, 66% of the general practitioners ordered a new test within 6 weeks. Examination of blood smears, gastroscopy, or measurement of s-antibodies against intrinsic factors or parietal cells were only performed in a few patients.


View this table:
[in this window]
[in a new window]
 
Table 3. Follow-up tests for investigating suspected cobalamin deficiency.

influence of s-cobalamin concentrations on the clinical diagnosis
We investigated whether the physicians had made a definite diagnosis regarding the cobalamin status of their patients. The alternatives given were "deficient", "not deficient", and "uncertain". As shown in Table 4 , the category uncertain was the diagnosis for >50% of the patients with s-cobalamin between 140 and 219 pmol/L and 41% of the patients with s-cobalamin <140 µmol/L. In contrast, the majority of general practitioners were able to make a definite diagnosis of not deficient or deficient in patients belonging to the highest and lowest cobalamin intervals. Only 2–9% of the patients with s-cobalamin between 170 and 299 pmol/L were regarded as deficient, and <10% of the patients with s-cobalamin <170 pmol/L were diagnosed as not deficient (Table 4 ).


View this table:
[in this window]
[in a new window]
 
Table 4. Relationship between the general practitioner's clinical diagnosis and the cobalamin concentration.

In a logistic regression analysis, we used the physician's diagnosis as the response variable (deficient = 1, not deficient = 0) and indications for requesting s-cobalamin (Table 2Up ), s-cobalamin, and the patient's age and sex as independent variables. In this model, s-cobalamin (decreasing values in intervals of 10 pmol/L) and anemia (no = 0; yes = 1) significantly predicted the clinical diagnosis deficient, with odds ratios of 1.34 [95% confidence interval (CI), 1.21–1.48] and 3.95 (95% CI, 1.08–14.5), respectively. Patients classified as uncertain were not included in this model.

evaluation of the diagnostic strategies
By definition, 2.5% of healthy people have values below the lower reference limit of a quantitative laboratory test (25). If there is prior clinical selection of the subjects to be tested, the percentage is expected to be higher. However, we found that only 2.8% of routinely measured s-cobalamin values were <170 pmol/L (Table 1Up ). This may be explained by the indications for ordering s-cobalamin in our survey (Table 2Up ). Patients with anemia and/or macrocytosis have a relatively high pretest probability of cobalamin deficiency (26)(29)(30)(31); however, these indications represent a minority in our survey results. An additional explanation might be the use of s-cobalamin as a control test during cobalamin supplementation. Furthermore, in the majority of cases, s-cobalamin was requested for screening purposes or for examination of diffuse symptoms, which is also indicated by the frequent request of other biochemical tests together with s-cobalamin. Thus, s-cobalamin is most likely used as a case-finding test for cobalamin deficiency in general practice (32).

The high portion of subjects categorized as uncertain diagnosis (Table 4Up ) may indicate that general practitioners are aware of the low predictive value of s-cobalamin. However, there could be a bias towards this category because general practitioners may prefer to categorize their patients as uncertain diagnosis to avoid making a false-negative diagnosis. The number of patients with uncertain diagnoses increased around the lower reference limit of s-cobalamin. This observation is corroborated by the frequent cobalamin retesting in patients with low and low-normal values (Table 3Up ). In spite of this considerable diagnostic uncertainty, ancillary tests such as the mean corpuscular volume, a blood smear, or the intrinsic factor antibody are seldom used.

serum concentrations of vitamins and metabolic markers
Different reference standards for functional cobalamin deficiency have been presented. The deoxyuridine suppression test (dUST) is theoretically sound (27)(33), but is expensive and labor-intensive, and therefore impractical for large-scale use. Moelby et al. (32) used an abnormal Schilling test and/or megaloblastic bone marrow morphology, which could not be explained by folate deficiency, as the reference standard. Increased s-MMA and/or s-tHcy or a substantial decrease in these metabolites after cobalamin injections have been used by other investigators (19)(28)(34).

In 1993, s-MMA was not available as a routine analysis in Norway, and tHcy was little known and not available at FML. The physicians, therefore, made their diagnoses without knowledge of the s-MMA or tHcy values for their patients.

The distributions of increased s-MMA, tHcy, and low s-folate at different s-cobalamin concentrations are shown in Table 5 . As expected, tHcy was higher at low s-cobalamin concentrations and decreased as a function of the cobalamin concentration. In contrast, s-folate showed no relationship with s-cobalamin, and <11.5% of the patients had s-folate <5 nmol/L throughout the s-cobalamin strata (Table 5 ).


View this table:
[in this window]
[in a new window]
 
Table 5. Concentrations of MMA, t-Hcy, and folate in serum in different cobalamin intervals.

The relationship between s-MMA and tHcy is depicted in Fig. 1 . tHcy was increased in a substantial number of patients with s-MMA values within the reference range, whereas only six patients with reference values of tHcy (<15 µmol/L) had increased s-MMA (Fig. 1 ). This may reflect the lower specificity of s-tHcy as an indicator of cobalamin deficiency (35). In accordance with these data and with procedures advocated by others (19)(20)(34)(36)(37), we therefore used s-MMA >0.376 µmol/L (3 SD above the mean of the reference range) as the reference standard in this study.



View larger version (19K):
[in this window]
[in a new window]
 
Figure 1. Correlation between s-tHcy and s-MMA.

{blacksquare}, patients with increased s-creatinine; {blacktriangleup}, patients with low s-folate; {circ}, patients with s-creatinine and s-folate within the reference range.

assessment of diagnostic accuracy of s-cobalamin
The s-cobalamin concentration was the basis for patient selection in this study. We therefore had to correct for the frequency distribution of s-cobalamin values when calculating the sensitivities and specificities of s-cobalamin. This correction was done on the basis of the frequency distribution of the total s-cobalamin analyses at FML in 1993 (Table 1Up ).

We then evaluated the diagnostic sensitivity and specificity of s-cobalamin <=170 pmol/L, using s-MMA >0.376 µmol/L as the reference standard. The sensitivity of s-cobalamin was 0.40 (95% CI, 0.22–0.58), and the specificity was 0.98 (95% CI, 0.976–0.983). In these calculations, we have assumed that there are no cobalamin-deficient patients with s-cobalamin >300 pmol/L.

These results, which showed low sensitivity for s-cobalamin, are in line with other studies. Norman et al. (38) discovered that 51% (18 of 35) of elderly people with increased urinary MMA had s-cobalamin below the lower reference limit. Pennypacker et al. (28) found that 7 (37%) of 19 geriatric outpatients with s-MMA >0.376 µmol/L had s-cobalamin <148 pmol/L, and Nilsson et al. (39) estimated the sensitivity of s-cobalamin <150 pmol/L to be 41% in a psychogeriatric population. In surviving members of the original Framingham elderly population, only 12 (20%) of 59 patients with increased s-MMA and a s-creatinine value within the reference range had s-cobalamin <148 pmol/L (20).

The estimated diagnostic accuracy of a test is always influenced by the selection of the study population. The specificity will usually be lowest in populations with high prevalence of other/similar diseases, and the sensitivity will be highest in populations with advanced disease (38). Accordingly, we would expect our estimate of specificity to be high and our sensitivity to be low compared with a group of inpatients.

The overall prevalence of cobalamin deficiency in the patients having their s-cobalamin tested at FML was estimated to 2.96%, when increased s-MMA (>0.376 µmol/L) was used as the reference.

predictors of high s-mma
In multiple logistic regression analyses, we used indications for requesting s-cobalamin (Table 2Up ), s-cobalamin, s-creatinine, and patient age and sex as independent variables. In this model, increased s-MMA was significantly predicted by low s-cobalamin (decreasing values in intervals of 10 pmol/L), high age, and female sex (coded = 1), with odds ratios of 1.34 (95% CI, 1.22–1.63), 1.12 (95% CI, 1.08–1.17), and 3.12 (95% CI, 1.09–9.1), respectively.

A similar relationship between s-MMA, s-cobalamin, age, and sex was found by Pennypacker et al. (28). Norman et al. (38) found increased urinary MMA in 5.3% of women compared with 1.9% of men. They found no statistically significant association between age and urinary MMA concentrations. However, their study population consisted only of persons >65 years of age.

An independent effect of age and sex on the probability of functional cobalamin deficiency at the same concentration of s-cobalamin requires substantiation.

clinical diagnosis and therapeutic conclusion in relation to concentrations of mma and cobalamin
The relationship between the general practitioners' clinical diagnoses and the s-MMA and s-cobalamin concentrations is illustrated in Fig. 2 . There is a considerable discrepancy between the general practitioners' diagnosis of "cobalamin-deficient" and the number of patients with increased MMA (Fig. 2A ). This is especially true for higher cobalamin concentrations. On the other hand, the agreement between the clinical diagnosis not deficient and s-MMA values within the reference range is very good (Fig. 2C ). Only one patient with s-MMA >0.376 µmol/L was diagnosed as not deficient. Nine percent of patients, whom the general practitioners had classified as uncertain, had increased s-MMA (Fig. 2B ).



View larger version (25K):
[in this window]
[in a new window]
 
Figure 2. Relationship between s-MMA and the general practitioners' diagnoses.

Diagnoses: A, cobalamin-deficient; B, uncertain; C, not deficient. Patients with increased s-creatinine have been excluded.

The decision by a general practitioner to start cobalamin supplementation was also made when the diagnosis was uncertain. In this case, low s-cobalamin seemed particularly influential because cobalamin supplementation was given to patients in the uncertain category almost exclusively when they had s-cobalamin <170 pmol/L (Table 6 ).


View this table:
[in this window]
[in a new window]
 
Table 6. Relationship between the general practitioner's decision to supplement and the clinical diagnosis and cobalamin concentration.

In the group classified as deficient by the general practitioners, two patients were advised to change their diets, two were followed up by other general practitioners, one refused any treatment, and one died before therapy was started. The rest of the patients received supplementation with cobalamin. For the estimates below, all patients classified as deficient by the general practitioners were included in the group of patients receiving cobalamin supplements. When supplementation was used as the response indicator and given the assumption that no patients with s-cobalamin >300 pmol/L were supplemented, the clinical decision to supplement the patient had a sensitivity of 0.51 (95% CI, 0.32–0.69) and a specificity of 0.98 (95% CI, 0.976–0.983).

To compare the diagnostic efficiency of clinical judgement (supplementation or not) with the s-cobalamin assay, again using s-MMA as the reference standard, we performed a logistic regression analysis and calculated "posttest" probabilities. We first used supplementation as the response variable in an analysis with s-cobalamin as the independent variable (Fig. 3 , inset). As expected, as s-cobalamin values decreased, the probability that a patient would receive a supplement gradually increased. We next used high s-MMA as the response variable and then analyzed the following three groups separately: patients receiving cobalamin supplementation, patients not receiving supplementation, and all patients. The probability of true cobalamin deficiency (defined by increased MMA) is shown separately for the three groups in Fig. 3 .



View larger version (32K):
[in this window]
[in a new window]
 
Figure 3. Relationship between the decision by general practitioners to give cobalamin supplementation and the probability of cobalamin deficiency.

The inset shows the probability of cobalamin supplementation at various s-cobalamin concentrations. The main panel illustrates the relationship between s-cobalamin and the probability of cobalamin deficiency, using s-MMA as reference standard. Data for supplemented patients ({bullet}), all patients (——–), and nonsupplemented patients ({circ}) are shown.

The importance of clinical judgement can be estimated by the difference in the probability of cobalamin deficiency in the supplemented and nonsupplemented groups. For example, in patients with a s-cobalamin value of 100 pmol/L, the probability that the patient had a cobalamin deficiency was ~0.59. In the supplemented and nonsupplemented groups, the corresponding numbers were 0.73 and 0.31, respectively (Fig. 3Up ).

diagnostic benefit of s-mma determination
Our findings indicate that the clinical judgment of general practitioners has a higher diagnostic accuracy than s-cobalamin used without clinical information. However, the clinical diagnostic efficiency is still not high. Therefore, we wanted to estimate the diagnostic benefit of using s-MMA determination. The gain in diagnostic accuracy can be expressed as the discrepancy between the clinical diagnosis and the result of the s-MMA determination.

As an example, we can study a case where the s-cobalamin is 100 pmol/L. For this example, we will consider s-MMA >0.376 nmol/L (and s-creatinine within the health-related reference range) as synonymous with cobalamin deficiency. The probability that the patient will receive a supplement is 0.72 (Fig. 3Up , inset). Among the subjects receiving supplements , the probability of having increased s-MMA is 0.73 (Fig. 3Up , main panel). Thus, the fraction correctly supplemented (of all patients with an s-cobalamin value of 100 pmol/L) is 0.52 (0.72 x 0.73). The fraction supplemented without having a deficiency is 0.20 (0.72 - 0.52). The fraction not supplemented is 0.28 (1 - 0.72; Fig. 3Up , inset), with a fraction of 0.69 (1 - 0.31; Fig. 3Up , main panel) having s-MMA within the reference interval. Thus, the fraction of patients correctly not supplemented is 0.19 (0.28 x 0.69), and the fraction wrongly not supplemented, i.e., subjects who should have been supplemented, is 0.09 (0.28 - 0.19). Of all patients with an s-cobalamin value of 100 pmol/L, a fraction of 0.60 had increased s-MMA and a fraction of 0.40 had s-MMA within the reference range. The use of s-MMA as the reference standard therefore implies a fractional increase in true-positive diagnoses of 0.08 (0.60 - 0.52) and a fractional increase in true-negative diagnoses of 0.21 (0.40 - 0.19). This fractional increase in "true" diagnoses is shown in Fig. 4 A.



View larger version (17K):
[in this window]
[in a new window]
 
Figure 4. Changes in the fraction of true-positive and true-negative diagnoses when the decision by general practitioners to give patients supplements is replaced by s-MMA as the reference standard.

(A), the fractional increase when s-MMA is used as reference standard; (B), the corresponding results when s-MMA has a sensitivity of 0.95 and a specificity of 0.97 (see text). (———–), the difference between the true-negative rate when s-MMA is used as reference standard and the true-negative rate when the general practitioners' clinical diagnostic conclusions (supplementation or not) are used as the reference; (– – – –), the corresponding difference in the true-positive diagnoses.

In our model, we know the fraction of patients with s-MMA >0.376 nmol/L (A) for different cobalamin concentrations. If s-MMA is not used as the reference standard, but as a test with a certain sensitivity (se) and specificity (sp) for diagnosing cobalamin deficiency, samples with s-MMA >0.376 will include samples from patients with true-positive (TP) and false-positive (FP) diagnoses. Similarly, s-MMA <=0.376 nmol/L (B) will include patients with true-negative (TN) and false-negative (FN) diagnoses. If we use the following (40) formulas:


(1)

by calculations and rearrangements, we find that:


(2)

These equations were used to calculate the fractions of true-positive, false-negative, true-negative, and false-positive diagnoses for different sensitivities and specificities for s-MMA. Fig. 4BUp shows the calculated fractional diagnostic difference in true-negative and true-positive diagnoses between s-MMA and the "clinical diagnosis" (supplementation or not) with the MMA test sensitivity set at 0.95 and the specificity set at 0.97.

The diagnostic performance of metabolite assays (s-MMA and s-tHcy) was reviewed extensively in a recent monograph (41). The sensitivity and specificity of s-MMA are >0.90 in most studies.

cost-benefit estimates of s-mma measurements
A simple cost-benefit analysis was made to find the s-cobalamin interval where s-MMA should be determined. In this analysis, we compared the costs and benefits of the additional use of s-MMA in diagnosing cobalamin deficiency:

(3)

(4)

We defined in absolute values the benefit of giving supplements or not giving supplements to a deficient patient as equal (a). In comparison, the cost of treating and the benefit of not treating nondeficient patients are also defined as equal (b). The values for w in Eqs. 3Up , and 4Up are the different ratios of a to b. The relative benefit between the conventional diagnostic procedures and the use of s-MMA for the diagnosis of cobalamin deficiency is obtained by plotting the ratio of Eq. 3Up to Eq. 4Up . When this ratio is <1, s-MMA should be requested. When the ratio is >1, s-MMA should not be requested. The ratio when the costs of the analysis are set to 5% of b and the sensitivity and specificity for s-MMA as the test are 100% is shown in Fig. 5 A. We can see that the test should be requested in most cases up to s-cobalamin values of 250 pmol/L. By using the Eqs. 1Up , and 2Up , we can simulate the changes of relative benefit of the MMA-test giving the assay different sensitivities and specificities. With a sensitivity of 95% and a specificity of 97% for s-MMA, which is presumably a realistic assumption (35), s-MMA should be requested if a patient has s-cobalamin values between 60 and 220 pmol/L. The conclusion is more or less independent of w (Fig. 5B ). With a sensitivity of 90% and a specificity of 95%, s-MMA should be requested for s-cobalamin values between 90 and 200 pmol/L (Fig. 5C ). Even if the costs of the s-MMA-assay are changed to 20% of the false positives (b), the effects on the conclusions of our model are minor (data not shown), and s-MMA should be requested at s-cobalamin values between 90 and 190 pmol/L. Thus, the model is rather robust for small changes in the diagnostic accuracy of s-MMA, as well as for alterations in the cost-benefit weights and different estimates of the costs of the MMA analysis.



View larger version (22K):
[in this window]
[in a new window]
 
Figure 5. Relative benefits of using the conventional diagnostic procedures and using s-MMA for the diagnosis of cobalamin deficiency.

Benefit ratio <1 indicates that s-MMA should be requested. (A), s-MMA is considered the reference standard with a sensitivity of 100% and a specificity of 100%. (B), s-MMA is a test with a sensitivity of 0.95 and a specificity of 0.97. (C), s-MMA is a test with a sensitivity of 0.90 and a specificity of 0.95. The calculations as well as the weights used are explained in the text.


   Conclusions
Top
Abstract
Introduction
Patients and Methods
Results and Discussion
Conclusions
References
 
In general practice, s-cobalamin is usually requested on the basis of nonspecific indications or vague symptoms. When general practitioners decide to supplement patients, they primarily take into consideration the cobalamin value and whether the patient is anemic. General practitioners often postpone making a definitive diagnosis when s-cobalamin is in the lower reference range.

Our data emphasize the poor diagnostic utility of low and low-normal s-cobalamin assay results and call for more sensitive and specific markers of cobalamin deficiency. s-MMA meets these criteria, and if used, our data suggest routine measurement in patients when s-cobalamin is >60–90 pmol/L and <200–220 pmol/L, depending on the diagnostic accuracy of s-MMA.


   Acknowledgments
 
This study was supported by grants from the Norwegian Research Council and the Norwegian Medical Association Quality Assurance Foundation. We thank Pål Rustad (Fürst Medical Laboratory, Oslo, Norway) for expert statistical assistance.


   Footnotes
 
1 Nonstandard abbreviations: s, serum; MMA, methylmalonic acid; tHcy, total homocysteine; FML, Fürst Medical Laboratory; and CI, confidence interval.


   References
Top
Abstract
Introduction
Patients and Methods
Results and Discussion
Conclusions
References
 

  1. Long ER. Thomas Addison and his discovery of idiopathic anemia. Ann Med 1935;7:130-132.
  2. Lindenbaum J, Pezzimenti JF, Shea N. Small-intestinal function in vitamin B12 deficiency. Ann Intern Med 1974;80:326-331.
  3. Hector M, Burton JR. What are the psychiatric manifestations of vitamin B12 deficiency?. J Am Geriatr Soc 1988;36:1105-1112. [ISI][Medline] [Order article via Infotrieve]
  4. Beck WS. Neuropsychiatric consequences of cobalamin deficiency. Adv Intern Med 1991;36:33-56. [Medline] [Order article via Infotrieve]
  5. Levitt AJ, Karlinsky H. Folate, vitamin B12 and cognitive impairment in patients with Alzheimer's disease. Acta Psychiatr Scand 1992;86:301-305. [ISI][Medline] [Order article via Infotrieve]
  6. Regland B, Gottfries C. Vitamin B12-brist – inte minst ett neuropsykiatrisk problem. Läkartidningen 1992;89:2736-2740. [Medline] [Order article via Infotrieve]
  7. Lindenbaum J, Healton EB, Savage DG, Brust JCM, Garrett TJ, Podell ER. Neuropsychiatric disorders caused by cobalamin deficiency in the absence of anemia or macrocytosis. N Engl J Med 1988;318:1720-1728. [Abstract]
  8. Healton EB, Savage DG, Brust JCM, Garrett TJ, Lindenbaum J. Neurologic aspects of cobalamin deficiency. Medicine 1991;70:229-245. [Medline] [Order article via Infotrieve]
  9. Martin DC, Francis J, Protetch J, Jacob Huff F. Time dependency of cognitive recovery with cobalamin replacement: report of a pilot study. J Am Geriatr Soc 1992;40:168-172. [ISI][Medline] [Order article via Infotrieve]
  10. Carmel R, Herbert V. Deficiency of vitamin B12-binding alpha globulin in two brothers. Blood 1969;33:1-12. [Abstract/Free Full Text]
  11. Carmel R. R-Binder deficiency. A clinically benign cause of cobalamin pseudodeficiency. JAMA 1983;250:1886-1890. [Abstract]
  12. Herzlich B, Herbert V. Depletion of serum holotranscobalamin II. An early sign of negative vitamin B12 balance. Lab Investig 1988;58:332-337. [ISI][Medline] [Order article via Infotrieve]
  13. Gimsing P, Nexø E. Cobalamin-binding capacity of haptocorrin and transcobalamin: age-correlated reference intervals and values from patients. Clin Chem 1989;35:1447-1451. [Abstract/Free Full Text]
  14. Wickramasinghe SN, Fida S. Correlations between holo-transcobalamin II, holo-haptocorrin, and total B12 in serum samples from healthy subjects and patients. J Clin Pathol 1993;46:537-539. [Abstract/Free Full Text]
  15. Herbert V, Fong W, Gulle V, Stopler T. Low holotranscobalamin II is the earliest serum marker for subnormal vitamin B12 (cobalamin) absorption in patients with AIDS. Am J Hematol 1990;34:132-139. [ISI][Medline] [Order article via Infotrieve]
  16. Carmel R, Rasmussen K, Jacobsen DW, Green R. Comparison of the deoxyuridine suppression test with serum levels of methylmalonic acid and homocysteine in mild cobalamin deficiency. Br J Haematol 1996;93:311-318. [ISI][Medline] [Order article via Infotrieve]
  17. Nexø E, Hansen M, Rasmussen K, Lindgren A, Grasbeck R. How to diagnose cobalamin deficiency. Scand J Clin Lab Investig 1994;54(Suppl 219):61-76. [ISI][Medline] [Order article via Infotrieve]
  18. Rasmussen K, Vyberg B, Pedersen KO, Brøchner-Mortensen J. Methylmalonic acid in renal insufficiency: evidence of accumulation and implications for diagnosis of cobalamin deficiency. Clin Chem 1990;36:1523-1524. [Free Full Text]
  19. Savage DG, Lindenbaum J, Stabler SP, Allen RH. Sensitivity of serum methylmalonic acid and total homocysteine determinations for diagnosing cobalamin and folate deficiencies. Am J Med 1994;96:239-246. [ISI][Medline] [Order article via Infotrieve]
  20. Lindenbaum J, Rosenberg IH, Wilson PWF, Stabler SP, Allen RH. Prevalence of cobalamin deficiency in the Framingham elderly population. Am J Clin Nutr 1994;60:2-11. [Abstract/Free Full Text]
  21. Fiskerstrand T, Refsum H, Kvalheim G, Ueland PM. Homocysteine and other thiols in plasma and urine: automated determination and sample stability. Clin Chem 1993;39:263-271. [Abstract]
  22. Refsum H, Ueland PM, Svardal AM. Fully automated fluorescence assay for determining total homocysteine in plasma. Clin Chem 1989;35:1921-1927. [Abstract/Free Full Text]
  23. Ueland PM, Refsum H, Stabler SP, Malinow MR, Andersson A, Allen RH. Total homocysteine in plasma or serum. Methods and clinical applications. Clin Chem 1993;39:1764-1779. [Abstract]
  24. Schneede J, Ueland PM. Application of capillary electrophoresis with laser-induced fluorescence detection for routine determination of methylmalonic acid in human serum. Anal Chem 1995;67:812-819. [Medline] [Order article via Infotrieve]
  25. Sox HC Blatt MA Higgins MC Marton KI eds. Medical decision making 1988:103-106 Butterworth-Heinemann Boston, MA. .
  26. Davidson RJ, Hamilton PJ. High mean red cell volume: its incidence and significance in routine haematology. J Clin Pathol 1978;31:493-498. [Abstract/Free Full Text]
  27. Carmel R, Karnaze DS. The deoxyuridine suppression test identifies subtle cobalamin deficiency in patients without typical megaloblastic anemia. JAMA 1985;253:1284-1287. [Abstract]
  28. Pennypacker LC, Allen RH, Kelly JP, Matthews M, Grigsby J, Kaye K, et al. High prevalence of cobalamin deficiency in elderly outpatients. J Am Geriatr Soc 1992;40:1197-1204. [ISI][Medline] [Order article via Infotrieve]
  29. Carmel R. Macrocytosis, mild anemia, and delay in the diagnosis of pernicious anemia. Arch Intern Med 1979;139:47-50. [Abstract]
  30. Breedveld FC, Bieger R, van Wermeskerken RKA. The clinical significance of macrocytosis. Acta Med Scand 1981;209:319-322. [ISI][Medline] [Order article via Infotrieve]
  31. Van der Weyden MB, Campbell L. Clinching the diagnosis: macrocytic anemia. Pathology 1988;20:353-357. [ISI][Medline] [Order article via Infotrieve]
  32. Moelby L, Rasmussen K, Jensen MK, Pedersen KO. The relationship between clinically confirmed cobalamin deficiency and serum methylmalonic acid. J Intern Med 1990;228:373-378. [ISI][Medline] [Order article via Infotrieve]
  33. Killmann SA. Effect of deoxyuridine on incorporation of tritiated thymidine: difference between normoblasts and megaloblasts. Acta Med Scand 1964;175:483-488.
  34. Rasmussen K, Møller J, Østergaard K, Østergaard Kristensen M, Jensen J. Methylmalonic acid concentrations in serum of normal subjects: biological variability and effect of oral L-isoleucine loads before and after intramuscular administration of cobalamin. Clin Chem 1990;36:1295-1299. [Abstract/Free Full Text]
  35. Lindenbaum J, Savage DG, Stabler SP, Allen RH. Diagnosis of cobalamin deficiency II: Relative sensitivities of serum cobalamin, methylmalonic acid, and total homocysteine concentrations. Am J Hematol 1990;34:99-107. [ISI][Medline] [Order article via Infotrieve]
  36. Rasmussen K, Pedersen KO, Mortensen ES, Mølby L. Krogh Jensen M. Laboratory diagnosis of cobalamin deficiency. A comparative study of 2 serum cobalamin methods and serum methylmalonic acid. Ugeskr Læger 1992;154:326-330.
  37. Carmel R, Gott PS, Waters CH, Cairo K, Green R, Bondareff W, et al. The frequently low cobalamin levels in dementia usually signify treatable metabolic, neurologic and electrophysiologic abnormalities. Eur J Haematol 1995;54:245-253. [ISI][Medline] [Order article via Infotrieve]
  38. Norman EJ, Morrison JA. Screening elderly populations for cobalamin (vitamin B12) deficiency using the urinary methylmalonic acid assay by gas chromatography mass spectrometry. Am J Med 1993;94:589-594. [ISI][Medline] [Order article via Infotrieve]
  39. Nilsson K, Gustafson L, Faldt R, Andersson A, Hultberg B. Plasma homocysteine in relation to serum cobalamin and blood folate in a psychogeriatric population. Eur J Clin Investig 1994;24:600-606. [ISI][Medline] [Order article via Infotrieve]
  40. Valenstein PN. Evaluating diagnostic tests with imperfect standards. Am J Clin Pathol 1990;93:252-258. [ISI][Medline] [Order article via Infotrieve]
  41. Green R. Metabolite assays in cobalamin and folate deficiency. Baillieres Clin Haemotol 1995;8:533-566. [ISI][Medline] [Order article via Infotrieve]



The following articles in journals at HighWire Press have cited this article:


Home page
Clin. Chem.Home page
H.-A. Lakso, P. Appelblad, and J. Schneede
Quantification of Methylmalonic Acid in Human Plasma with Hydrophilic Interaction Liquid Chromatography Separation and Mass Spectrometric Detection
Clin. Chem., December 1, 2008; 54(12): 2028 - 2035.
[Abstract] [Full Text] [PDF]


Home page
Clin. Chem.Home page
A. Schmedes and I. Brandslund
Analysis of methylmalonic Acid in plasma by liquid chromatography-tandem mass spectrometry.
Clin. Chem., April 1, 2006; 52(4): 754 - 757.
[Abstract] [Full Text] [PDF]


Home page
CMAJHome page
B. M. Gilfix
Vitamin B12 and homocysteine
Can. Med. Assoc. J., November 22, 2005; 173(11): 1360 - 1360.
[Full Text] [PDF]


Home page
BloodHome page
L. R. Solomon
Cobalamin-responsive disorders in the ambulatory care setting: unreliability of cobalamin, methylmalonic acid, and homocysteine testing
Blood, February 1, 2005; 105(3): 978 - 985.
[Abstract] [Full Text] [PDF]


Home page
Clin. Chem.Home page
H. Refsum, A. D. Smith, P. M. Ueland, E. Nexo, R. Clarke, J. McPartlin, C. Johnston, F. Engbaek, J. Schneede, C. McPartlin, et al.
Facts and Recommendations about Total Homocysteine Determinations: An Expert Opinion
Clin. Chem., January 1, 2004; 50(1): 3 - 32.
[Abstract] [Full Text] [PDF]


Home page
QJMHome page
J.G. Ray and H.J. Blom
Vitamin B12 insufficiency and the risk of fetal neural tube defects
QJM, April 1, 2003; 96(4): 289 - 295.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
M. S. Morris, P. F. Jacques, I. H. Rosenberg, and J. Selhub
Elevated Serum Methylmalonic Acid Concentrations Are Common among Elderly Americans ,
J. Nutr., September 1, 2002; 132(9): 2799 - 2803.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
D. Matern and M. J. Magera
Mass Spectrometry Methods for Metabolic and Health Assessment
J. Nutr., May 1, 2001; 131(5): 1615S - 1620.
[Abstract] [Full Text]


Home page
Clin. Chem.Home page
B. J. Bolann, J. D. Solli, J. Schneede, K. A. Grottum, A. Loraas, M. Stokkeland, A. Stallemo, A. Schjoth, R. B. Bie, H. Refsum, et al.
Evaluation of Indicators of Cobalamin Deficiency Defined as Cobalamin-induced Reduction in Increased Serum Methylmalonic Acid
Clin. Chem., November 1, 2000; 46(11): 1744 - 1750.
[Abstract] [Full Text] [PDF]


Home page
Clin. Chem.Home page
M. J. Magera, J. K. Helgeson, D. Matern, and P. Rinaldo
Methylmalonic Acid Measured in Plasma and Urine by Stable-Isotope Dilution and Electrospray Tandem Mass Spectrometry
Clin. Chem., November 1, 2000; 46(11): 1804 - 1810.
[Abstract] [Full Text] [PDF]


Home page
Clin. Chem.Home page
G. G. Klee
Cobalamin and Folate Evaluation: Measurement of Methylmalonic Acid and Homocysteine vs Vitamin B12 and Folate
Clin. Chem., August 1, 2000; 46(8): 1277 - 1283.
[Abstract] [Full Text] [PDF]


Home page
Clin. Chem.Home page
C. M. Pfeiffer, S. J. Smith, D. T. Miller, and E. W. Gunter
Comparison of Serum and Plasma Methylmalonic Acid Measurements in 13 Laboratories: An International Study
Clin. Chem., December 1, 1999; 45(12): 2236 - 2242.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Submit an electronic Letter to
the Editor about this paper
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted