|
|
||||||||
Molecular Diagnostics and Genetics |
1 Department of Pathology, University of Utah School of Medicine, Salt Lake City, UT.
aAddress correspondence to this author at: Department of Pathology, University of Utah School of Medicine, Salt Lake City, UT 84132. Fax 801-581-4517; e-mail carl.wittwer{at}path.utah.edu.
| Abstract |
|---|
|
|
|---|
Methods: A 3'-blocked, unlabeled oligonucleotide probe and the saturating dye, LCGreen I, were added to standard PCR reagents before amplification. After PCR, the samples were melted at 0.10.3 °C/s in high-resolution (HR-1TM), high-throughput (LightTyperTM), and rapid-cycle, real-time (LightCycler®) instruments, and fluorescence melting curves were recorded.
Results: Derivative melting curves of the probetarget duplexes were characteristic of the genotype under the probe. With synthetic plasmid templates, all SNP base combinations could be genotyped. For human genomic DNA, the technique was demonstrated with mutations associated with cystic fibrosis, including SNPs (G542X, I506V, and F508C) and 3-bp deletions (F508del and I507del).
Conclusions: Genotyping of SNPs and small deletions by melting analysis of an unlabeled probe in the presence of LCGreen I is simple and rapid. Only three unlabeled oligonucleotides (two primers and one probe), a saturating DNA dye, PCR, and a melting instrument are required. The method is closed-tube, does not require fluorescently labeled probes or real-time PCR, and can be completed in <10 min on any instrument capable of monitoring melting curves by fluorescence.
| Introduction |
|---|
|
|
|---|
Homogeneous melting of PCR products in the presence of the DNA dye LCGreenTM I can detect heterozygotes and genotype SNPs (7). Heterozygotes are identified by a change in melting curve shape, and different homozygotes are distinguished by a change in melting temperature (Tm). Unlike other commonly used dyes in real-time PCR, LCGreen I can be used at high concentrations that saturate PCR products without inhibiting amplification. Multiple products with different Tms are easily detected with LCGreen I, whereas higher Tm products are preferentially detected with SYBR® Green I. The bias of SYBR Green I toward higher Tm products has been attributed to redistribution of dye during melting (8) and bias toward GC-rich sequences (9).
A recent study of SNP genotyping with LCGreen I used small amplicons to increase the Tm difference between homozygous genotypes (10). Heterozygotes were easy to identify in all cases. In SNPs in which a G::C base pair was interchanged with an A::T base pair (84% of human SNPs), the Tm difference between homozygous genotypes (
1 °C) could be distinguished on standard melting instruments. However, in the remaining cases, in which only the base pair orientation changed (A::T to T::A or G::C to C::G), high-resolution melting was necessary to differentiate homozygotes. Furthermore, in one fourth of these cases (4% of human SNPs), addition of a known genotype was necessary.
Genotyping by amplicon melting depends on the specificity of the PCR primers. At least in clinical assays, it is commonly believed that the extra specificity of a probe is necessary. To provide probe specificity without the cost of a fluorescently labeled oligonucleotide, we investigated the feasibility of genotyping with unlabeled oligonucleotide probes with use of asymmetric PCR and LCGreen I. The result is a closed-tube, homogeneous method for genotyping without fluorescently labeled probes or allele-specific PCR (11)(12). Either conventional real-time PCR instruments or more economic, dedicated melting instruments can be used. High-resolution analysis is not necessary, and any SNP can be genotyped by use of three unlabeled oligonucleotides in one reaction.
| Materials and Methods |
|---|
|
|
|---|
TM calculations
Duplex Tms were calculated by use of previously described nearest-neighbor thermodynamic models (15)(16)(17)(18)(19)(20)(21)(22) and custom software. The best fit for the Mg2+ equivalence (74-fold that of Na+) was obtained by use of a data set of 475 duplexes (23). The amplicon concentration at the end of PCR was set at the limiting primer concentration. The effective concentration of Mg2+ was decreased by the total deoxynucleotide triphosphate concentration, assuming stoichiometric chelation. The effect of Tris+ was assumed equal to Na+, and the Tris+ concentration (20 mmol/L) was calculated from the buffer concentration and pH. Oligonucleotides were obtained from the University of Utah Core facility.
asymmetric pcr
PCR of the engineered plasmids and the genomic samples was performed in 10-µL reaction volumes with 50 mM Tris (pH 8.3), 500 µg/mL bovine serum albumin, 3 mM MgCl2, 200 µM of each deoxynucleotide triphosphate, 0.4 U of Taq Polymerase (Roche Applied Science), 1x LCGreen I (Idaho Technology), 0.5 µM excess primer, 0.5 µM probe, and 0.05 µM limiting primer, unless otherwise stated. In some experiments, SYBR® Green I at a final concentration of 1x (Molecular Probes) replaced LCGreen I. The plasmids were used at 106 copies, and PCR was performed in a LightCycler® for 45 cycles with denaturation at 95 °C (0 s hold), annealing at 55 °C (0 s hold), and extension at 72 °C (10 s hold). Transition rates between temperatures were programmed at 20 °C/s, and fluorescence was acquired at the end of extension. When a plasmid "heterozygote" was amplified, equal amounts of each template (25 ng) were used. The primers (13) were 5'-GATATTTGAAGTCTTTCGGG-3' (0.05 µM) and 5'-TAAGAGCAACACTATCATAA-3' (0.5 µM) and amplified a 300-bp product. The variable site was in the center of the PCR product. The longest probe was 30 bases long (5'-GGGGGATTCAATGAATATTTATGACGATTC-P-3'), in which the variable site is underlined and "-P" indicates a 3' phosphate. Shorter probes from 28 to 14 bases were also used with 18 bases removed from each end, all with 3' phosphates.
For amplification of the cystic fibrosis sequence variants, 50 ng of genomic DNA was initially denatured at 95 °C for 10 s, followed by 45 cycles of 95 °C with a 0 s hold, 52 °C with a 0 s hold, and 72 °C with a 10 s hold. The exon 10 target (201 bp) was amplified with primers 5'-ACTTCTAATGATGATTATGGG-3' (0.05 µM) and 5'-ACATAGTTTCTTACCTCTTC-3' (0.5 µM) with probe 5'-TAAAGAAAATATCATCTTTGGTGTTTCCTA-P-3'. The exon 11 target (198 bp) was amplified with primers 5'-TGTGCCTTTCAAATTCAGATTG-3' (0.05 µM) and 5'-CAGCAAATGCTTGCTAGACC-3' (0.5 µM). For exon 11, one of two probes was used, 5'-CAATATAGTTCTTXGAGAAGGTGGAATC-P-3', with X being either G or T.
melting curve acquisition and analysis
Melting analysis was performed on three different instruments. Melting analysis on the LightCycler immediately followed amplification with an additional denaturation at 95 °C with a 0 s hold, cooling at a programmed rate of 20 °C/s to 40 °C with a 0 s hold, and continuous melting curve acquisition during a 0.2 °C/s ramp to 90 °C. A derivative melting curve plot was obtained with use of default settings of the LightCycler software.
For melting analysis on the high-resolution melting instrument (HR-1TM; Idaho Technology), the amplified samples were first denatured (95 °C with no hold) and rapidly cooled to 40 °C at 20 °C/s in the LightCycler. The capillary samples were then removed from the LightCycler, placed in the HR-1 instrument, and melted at 0.3 °C/s. The data were then displayed as derivative melting curve plots by the HR-1 analysis software.
Melting analysis on the LightTyperTM (Roche) was performed after modification of the standard instrument to match the optics to the LCGreen I dye. The standard 470 nm excitation light-emitting diodes were replaced with 450 nm light-emitting diodes (Bright-LED Optoelectronics). In addition, the optical filters were changed to a 425475 excitation filter and a 485 nm long-pass filter (both from Omega Optical). Amplified samples were denatured and cooled in the LightCycler as described above for the HR-1 instrument. The samples were then removed from the LightCycler capillaries by centrifugation, placed in a 384-well microtiter tray, overlaid with 10 µL of mineral oil, and melted at 0.1 °C/s. Data were exported into HR-1 analysis software through a custom interface, and derivative melting curve plots were displayed.
| Results |
|---|
|
|
|---|
|
The peak height of the probe-target signal depended on the concentrations of (a) the probe, (b) the complementary PCR product strand, and (c) the opposite competing PCR strand. The concentrations of the two PCR product strands depended on the degree of asymmetry and the number of temperature cycles after the PCR plateau. We found that 10-fold primer asymmetry with 10 cycles after the plateau was optimal (data not shown), and these conditions were used in the experiments that follow. The peak heights of the PCR product and probetarget signals also depended on their lengths. Long PCR products tended to obscure the probetarget peak, and asymmetric PCR was absolutely necessary. The relative magnitude of the probetarget transition increased as the amplicon length decreased, and PCR products <100 bp did not always require asymmetric amplification.
The effect of probe length on detecting the probetarget duplex is shown in Fig. 2
. Oligonucleotide probes were added before PCR, and melting curves were obtained after amplification. Probes 2230 bases long (GC content, 2737%) with no mismatch to the template melted between 60 and 70 °C with distinct peaks on derivative plots. Nearest-neighbor Tm predictions (22) underestimated these Tms by
4 °C (range, 56.266.6 °C). Although matched probes of 1420 bases were detectable, the peak heights decreased with probe length. When the probe was mismatched to the template at 1 base near the center, the lowest detectable length was 22 bp (data not shown).
|
In additional experiments, we assessed the usefulness of probes with extreme GC content (0% and 100%) by use of synthetic oligonucleotide targets. With probes 40 bases long, both 100% AT and 100% GC sequences were detected with Tms of 55 and 91 °C, respectively (derivative plots not shown). The peak height of the 100% GC probe was lower than that of the 100% AT probe, which is at least partly explained by the expected decrease in fluorescence with increasing temperature. When the GC content was 100%, probes as small as 10 bases were easily detected (Tm, 48 °C; derivative plots not shown). Probes 2730 bases long with 4060% GC content were routinely used in the remaining experiments, giving Tms between 55 and 70 °C.
Engineered plasmids (14) were used to study all possible SNP base combinations. Four plasmids (identical except for an A, a C, a G, or a T at one position) were either used alone to simulate homozygous genotypes or in binary combinations to construct simulated heterozygotes. When we used an A in a 28mer probe at the variable position, we obtained the derivative melting curves shown in Fig. 3
for all homozygotes and heterozygotes after PCR amplification. All homozygotes melted in a single transition (Fig. 3
, top curve set). The A::T match was most stable, with a Tm of 66.1 °C (predicted, 64.0 °C), with the mismatches A::G (Tm of 63.0 °C; predicted, 62.4 °C), A::A (Tm of 61.9 °C; predicted, 60.7 °C), and A::C (Tm of 61.4 °C; predicted, 60.8 °C) decreasing in order of stability. Heterozygous templates with one allele matched to the probe clearly displayed two peaks (Fig. 3
, middle curve set). The higher temperature peak corresponded to the perfectly matched duplex and the lower temperature peak to a duplex with a 1-base mismatch. Heterozygous templates with neither of the alleles matched to the probe usually produced an apparent broad single transition (Fig. 3
, bottom curve set) with the peaks generally positioned between the relevant two mismatch peaks shown in the middle curve set of Fig. 3
. Probes with a C, G, or T in the probe at the variable position gave similar results (data not shown). When SYBR Green I was used instead of LCGreen I, heterozygotes could not be distinguished from homozygotes (data not shown).
|
SNP genotyping with unlabeled probes and LCGreen I from genomic DNA is shown in Fig. 4
. After PCR amplification, three different instruments were used to genotype the cystic fibrosis mutation G542X (a G-to-T transversion) with two different probes. The top row in Fig. 4
displays derivative melting curves using a probe matched to the wild type, whereas the bottom row shows the curves obtained with a probe matched to the mutation. In all cases, genotyping was clear, although the resolution decreased in the following order: HR-1 > LightTyper > LightCycler. The predicted Tms (G::C = 65.9 °C, G::A = 61.5 °C, T::A = 64.6 °C, and T::C = 60.1 °C) were 23 °C lower than the observed Tms.
|
Genotyping of mutations around the F508 region of cystic fibrosis is shown in Fig. 5
. In the top row of Fig. 5
, two different SNP heterozygotes (A1648G and T1655G) are compared with the wild type. Although it was easy to distinguish the heterozygotes from the wild type, it was not easy to differentiate the two heterozygotes. The predicted Tms (wild type = 63.2 °C, A1648G = 60.7 °C, and T1655G = 59.6 °C) were 34 °C below the observed transitions. Similarly, heterozygous 3-bp deletions (I507del and F508del) were easy to distinguish from homozygous samples but harder to differentiate from each other when a single wild-type probe was used (bottom row).
|
| Discussion |
|---|
|
|
|---|
High-resolution melting analysis of double-stranded PCR products can be used to detect and differentiate heterozygotes (7)(8). Most, but not all, SNPs can be fully genotyped by melting analysis of small amplicons (10). This method, requiring only two primers and a generic DNA dye, is the simplest method of SNP genotyping available. However, in
4% of human SNPs, the two different homozygotes cannot be differentiated without addition of a known genotype. In addition, the method is more reliable with high-resolution melting instruments that have only become available recently.
In this report, we present a robust method for genotyping all SNPs and small deletions that does not require high-resolution melting. The ability of unlabeled probes to genotype all possible SNP base combinations was demonstrated by use of engineered plasmids to simulate homozygous and heterozygous genotypes. In addition to the amplicons and sequence variants reported here, we have also genotyped an additional 16 human genomic SNPs in 14 different amplicons with a 100% success rate. For each SNP, only three oligonucleotides are required, two PCR primers and one internal probe that is not covalently labeled with a fluorescent dye or other special functional groups. Melting transitions are monitored in the presence of LCGreen I, a dye originally designed to detect heteroduplexes (7). Multiple genotypes can be identified with a single unlabeled probe, similar to genotyping methods that monitor the melting of fluorescently labeled oligonucleotides (1)(2)(3) and in contrast to allele-specific methods, in which one probe is required for each allele (4).
The robustness of asymmetric PCR has recently been questioned (25). The decreased concentration of the limiting primer lowers its Tm compared with the excess primer, a fact that may be overlooked. Indeed, with concentration taken into account, the predicted Tms of the limiting primers used in this study were 2.34.9 °C below the Tms of the excess primers. However, when the 5' ends of the limiting primers were extended so that their Tms were 0.71.9 °C above the excess primers and the results from parallel experiments were compared, the probe signal (peak height on derivative plots) did not increase (data not shown). Furthermore, we experienced no difficulties in optimizing asymmetric PCR, perhaps because the asymmetry ratio used was modest (1:10).
Although there are many elegant methods for closed-tube genotyping, the oligonucleotides used are often complex, with multiple fluorescent dyes and/or functional groups (26)(27). For example, in one popular approach, a fluorescent dye, a minor groove binder, and a quencher are all covalently attached to an allele-specific probe (27). In addition, two probes are required to genotype one SNP. In contrast, SNP genotyping with an unlabeled oligonucleotide requires only one probe with no covalent modifications.
If the unlabeled probe is included in the PCR, the 3' end is blocked to prevent polymerase extension during amplification. We used 3' phosphorylation, although a 2',3'-dideoxynucleotide, a 3'-deoxynucleotide, a 3'-3' linkage, or other nonextendable terminations, such as a 3'-spacer C3 (Glen Research) could be used. Mismatching the last two 3' bases of the probe can also be used to prevent extension.
The length and Tm of the unlabeled probe can be varied over a wide range. In the present study, melting transitions of oligonucleotides from 10 to 40 bases ranged from 48 to 91 °C. However, the most useful duplex transitions are between 55 and 70 °C. Duplexes with Tms below this range need to be distinguished from increasing background fluorescence. Probe melting above this range may be confused, with primer-dimers often observed around 7580 °C. The probes used for genotyping in this report were usually 2730 bases in length. Longer probes interrogate a greater sequence region and have sharper melting transitions than shorter probes. If short probes are desired, locked nucleic acids (28) or minor groove binders (27) could likely be used. Another interesting possibility is to use multiple unlabeled probes in the same PCR, using Tm multiplexing as an alternative to color multiplexing (5).
Predicted probe Tms were lower than actual Tms, consistent with dye stabilization of the duplex. In general, relative stabilities were predicted by nearest-neighbor analysis. Apparent exceptions included the A::A and A::C mismatches in Fig. 3
and the A::C and T::C mismatches in Fig. 5
. Nearest-neighbor parameters may be altered in the presence of DNA-binding dyes and should be applied cautiously. The ability of melting analysis to distinguish multiple sequence alterations is well known, for example, cystic fibrosis F508C and F508del (29). However, all variants may not always be differentiated with a single wild-type probe (30).
SNP genotyping with unlabeled probes and LCGreen I does not require allele-specific PCR or real-time PCR. Only two primers, an unlabeled oligonucleotide probe, and a melting instrument are needed. Reagent costs for genotyping are low because only standard oligonucleotides and a generic dye are needed. Real-time instruments can be used for amplification and melting analysis, although there is no need for monitoring during amplification. For example, amplification and genotyping could be performed on the LightCycler (Figs. 4
and 5
), although the spectrum of LCGreen I is shifted 2030 nm to the blue away from standard fluorescein/SYBR Green I optics. Alternatively, any temperature-cycling instrument can be used for PCR with subsequent analysis on a separate instrument dedicated to melting. For example, the LightTyper can be used for high-throughput melting applications using standard 96- or 384-well plates. To better match the spectrum of LCGreen I, we modified the excitation and optics of the LightTyper. High-resolution melting on the HR-1 instrument produced the best melting curve resolution. However, unlike amplicon melting, in which resolution is paramount (7)(8), genotyping with unlabeled probes can be performed without high-resolution melting.
Homogeneous, closed-tube methods for genotyping without separation steps are attractive for their simplicity and containment of amplified products. Genotyping with unlabeled probes is robust and eliminates the need for covalently labeled fluorescent oligonucleotide probes. Combined with rapid cycle amplification (31)(32)(33)(34), unlabeled probes provide a rapid, low-complexity method for genotyping.
| Acknowledgments |
|---|
| References |
|---|
|
|
|---|
The following articles in journals at HighWire Press have cited this article:
![]() |
L. Zhou, R. J. Errigo, H. Lu, M. A. Poritz, M. T. Seipp, and C. T. Wittwer Snapback Primer Genotyping with Saturating DNA Dye and Melting Analysis Clin. Chem., October 1, 2008; 54(10): 1648 - 1656. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. S. Laughlin, M. W. Becker, J. L. Liesveld, D. A. Mulford, C. N. Abboud, P. Brown, and P. G. Rothberg Rapid Method for Detection of Mutations in the Nucleophosmin Gene in Acute Myeloid Leukemia J. Mol. Diagn., July 1, 2008; 10(4): 338 - 345. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. N. Gundry, S. F. Dobrowolski, Y. R. Martin, T. C. Robbins, L. M. Nay, N. Boyd, T. Coyne, M. D. Wall, C. T. Wittwer, and D. H.-F. Teng Base-pair neutral homozygotes can be discriminated by calibrated high-resolution melting of small amplicons Nucleic Acids Res., June 1, 2008; 36(10): 3401 - 3408. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Pont-Kingdon, R. L. Margraf, K. Sumner, A. Millson, E. Lyon, and E. Schutz Design and Application of Noncontinuously Binding Probes Used for Haplotyping and Genotyping Clin. Chem., June 1, 2008; 54(6): 990 - 999. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. L. Margraf, R. Mao, and C. T. Wittwer Rapid Diagnosis of MEN2B Using Unlabeled Probe Melting Analysis and the LightCycler 480 Instrument J. Mol. Diagn., March 1, 2008; 10(2): 123 - 128. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. T. Seipp, D. Pattison, J. D. Durtschi, M. Jama, K. V. Voelkerding, and C. T. Wittwer Quadruplex Genotyping of F5, F2, and MTHFR Variants in a Single Closed Tube by High-Resolution Amplicon Melting Clin. Chem., January 1, 2008; 54(1): 108 - 115. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Montgomery, C. T. Wittwer, J. O. Kent, and L. Zhou Scanning the Cystic Fibrosis Transmembrane Conductance Regulator Gene Using High-Resolution DNA Melting Analysis Clin. Chem., November 1, 2007; 53(11): 1891 - 1898. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Dames, D. C. Pattison, L. K. Bromley, C. T. Wittwer, and K. V. Voelkerding Unlabeled Probes for the Detection and Typing of Herpes Simplex Virus Clin. Chem., October 1, 2007; 53(10): 1847 - 1854. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Dames, R. L. Margraf, D. C. Pattison, C. T. Wittwer, and K. V. Voelkerding Characterization of Aberrant Melting Peaks in Unlabeled Probe Assays J. Mol. Diagn., July 1, 2007; 9(3): 290 - 296. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. T. Seipp, J. D. Durtschi, M. A. Liew, J. Williams, K. Damjanovich, G. Pont-Kingdon, E. Lyon, K. V. Voelkerding, and C. T. Wittwer Unlabeled Oligonucleotides as Internal Temperature Controls for Genotyping by Amplicon Melting J. Mol. Diagn., July 1, 2007; 9(3): 284 - 289. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. G. Vandersteen, P. Bayrak-Toydemir, R. A. Palais, and C. T. Wittwer Identifying Common Genetic Variants by High-Resolution Melting Clin. Chem., July 1, 2007; 53(7): 1191 - 1198. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. L. Margraf, R. Mao, W. E. Highsmith, L. M. Holtegaard, and C. T. Wittwer RET Proto-Oncogene Genotyping Using Unlabeled Probes, the Masking Technique, and Amplicon High-Resolution Melting Analysis J. Mol. Diagn., April 1, 2007; 9(2): 184 - 196. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. G. Herrmann, J. D. Durtschi, L. K. Bromley, C. T. Wittwer, and K. V. Voelkerding Amplicon DNA Melting Analysis for Mutation Scanning and Genotyping: Cross-Platform Comparison of Instruments and Dyes Clin. Chem., March 1, 2006; 52(3): 494 - 503. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Liew, L. Nelson, R. Margraf, S. Mitchell, M. Erali, R. Mao, E. Lyon, and C. Wittwer Genotyping of Human Platelet Antigens 1 to 6 and 15 by High-Resolution Amplicon Melting and Conventional Hybridization Probes J. Mol. Diagn., February 1, 2006; 8(1): 97 - 104. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Zhou, L. Wang, R. Palais, R. Pryor, and C. T. Wittwer High-Resolution DNA Melting Analysis for Simultaneous Mutation Scanning and Genotyping in Solution Clin. Chem., October 1, 2005; 51(10): 1770 - 1777. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. Lyon Discovering Rare Variants by Use of Melting Temperature Shifts Seen in Melting Curve Analysis Clin. Chem., August 1, 2005; 51(8): 1331 - 1332. [Full Text] [PDF] |
||||
![]() |
R. Graham, M. Liew, C. Meadows, E. Lyon, and C. T. Wittwer Distinguishing Different DNA Heterozygotes by High-Resolution Melting Clin. Chem., July 1, 2005; 51(7): 1295 - 1298. [Full Text] [PDF] |
||||
![]() |
T. R. Gingeras, R. Higuchi, L. J. Kricka, Y.M. D. Lo, and C. T. Wittwer Fifty Years of Molecular (DNA/RNA) Diagnostics Clin. Chem., March 1, 2005; 51(3): 661 - 671. [Full Text] [PDF] |
||||
![]() |
G. H. Reed and C. T. Wittwer Sensitivity and Specificity of Single-Nucleotide Polymorphism Scanning by High-Resolution Melting Analysis Clin. Chem., October 1, 2004; 50(10): 1748 - 1754. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. E. Highsmith Jr SNPs for Sale. Cheap! Clin. Chem., August 1, 2004; 50(8): 1296 - 1298. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||