Genotypic tropism testing by massively parallel sequencing: qualitative and quantitative analysis
© Däumer et al; licensee BioMed Central Ltd. 2011
Received: 24 November 2010
Accepted: 13 May 2011
Published: 13 May 2011
Inferring viral tropism from genotype is a fast and inexpensive alternative to phenotypic testing. While being highly predictive when performed on clonal samples, sensitivity of predicting CXCR4-using (X4) variants drops substantially in clinical isolates. This is mainly attributed to minor variants not detected by standard bulk-sequencing. Massively parallel sequencing (MPS) detects single clones thereby being much more sensitive. Using this technology we wanted to improve genotypic prediction of coreceptor usage.
Plasma samples from 55 antiretroviral-treated patients tested for coreceptor usage with the Monogram Trofile Assay were sequenced with standard population-based approaches. Fourteen of these samples were selected for further analysis with MPS. Tropism was predicted from each sequence with geno2pheno[coreceptor].
Prediction based on bulk-sequencing yielded 59.1% sensitivity and 90.9% specificity compared to the trofile assay. With MPS, 7600 reads were generated on average per isolate. Minorities of sequences with high confidence in CXCR4-usage were found in all samples, irrespective of phenotype. When using the default false-positive-rate of geno2pheno[coreceptor] (10%), and defining a minority cutoff of 5%, the results were concordant in all but one isolate.
The combination of MPS and coreceptor usage prediction results in a fast and accurate alternative to phenotypic assays. The detection of X4-viruses in all isolates suggests that coreceptor usage as well as fitness of minorities is important for therapy outcome. The high sensitivity of this technology in combination with a quantitative description of the viral population may allow implementing meaningful cutoffs for predicting response to CCR5-antagonists in the presence of X4-minorities.
Treatment of HIV infection has progressed significantly in the last decade. Amongst other factors this improvement is also based on the development of new drugs which are becoming more and more potent and which nowadays are given in combination . This so-called highly active antiretroviral therapy (HAART) aims at inhibiting the viral replication as strongly as possible by using antiretroviral drugs from usually two different drug classes. While mortality and morbidity decreased substantially, long-term side effects and suboptimal drug potency are still major obstacles . Moreover, the emergence of drug-resistant variants from minor populations may lead to early therapy-failures despite apparently effective treatment regimes .
With the approval of maraviroc (MVC, Celsentry/Selzentry, Pfizer)  in 2007, a further new class of antiretrovirals was introduced into anti-HIV treatment. In contrast to previously approved drugs, drugs from this class do not bind to viral proteins but to a specific coreceptor which is expressed by the host cell [5, 6]. Two coreceptors CCR5 and CXCR4 have been shown to be relevant in vivo. The mode of action of coreceptor antagonists led to the assumption that administration of such drugs would impede the adaptation of the virus and consequently lower the risk of developing resistance. However, the major problem of coreceptor antagonists is that there are two types of viruses: 1) so-called R5-viruses which use the CCR5 coreceptor for cell entry and which are usually dominant in the beginning of infection, and 2) dual-tropic and X4-viruses, which can also use another coreceptor (CXCR4) to gain entry into cells. Due to the fact, that maraviroc binds to CCR5, viruses which are capable of using CXCR4 are not harmed by the drug. Therefore, coreceptor usage, also known as viral tropism, has to be determined before administration of a regimen containing maraviroc. Currently such tests are performed with a phenotypic assay, usually the trofile assay (nowadays the enhanced sensitivity version) from Monogram Biosciences (San Francisco, CA, USA) . In this assay a recombinant replication-defective virus carrying the tropism-determining gp120 V3 region of a clinical isolate, is analyzed for entry on either CCR5- or CXCR4 expressing cells. The assay has been used in all maraviroc and vicriviroc (another coreceptor antagonist which is not in development anymore, Merck) clinical trials and has therefore become the de facto gold standard for measuring coreceptor-tropism. The main disadvantages of phenotypic assays are that they are very time-consuming and cost-intensive . Additionally, samples with viral loads below 1,000 copies/ml or certain non-B subtypes exhibited an extraordinarily high failure rate in the original Trofile assay.
Here the genotypic approach poses an alternative. It is characterized by the experimental determination and computational interpretation of the viral genome. Genotypic prediction of HIV-1 tropism is an inexpensive and fast alternative to phenotypic assays [8, 9]. However, standard sequencing approaches afford only a low sensitivity of X4-detection, especially in clinical isolates [10–12]. They generally work well when applied to clonal data [10, 12] which led to the conclusion that "false" predictions are mainly attributed to the lack of detection of minor populations of CXCR-using variants. To overcome this disadvantage, a new approach to genotypic tropism testing, the so-called massively parallel sequencing  was introduced. This technology enables generating an unprecedented number of sequences on the basis of single molecule sequencing, thus increasing the probability of identifying minority variants in heterogeneous gene families or virus populations. Therefore, coreceptor usage prediction from genotype is generally regarded as a promising application of ultra-deep sequencing, which detects single clones, thereby being much more sensitive than classical population-based Sanger sequencing.
In this study we address the question whether massively parallel sequencing can be successfully combined with bioinformatic approaches in order to afford improved qualitative and a quantitative prediction of coreceptor usage from the V3-loop.
Samples from 55 heavily pre-treated patients with limited therapy options were screened for potential administration of maraviroc. 3 ml plasma from each patient was shipped on dry ice for phenotypic tropism testing (original trofile tropism assay, Monogram Biosciences, South San Francisco). Plasma viral load was determined using the M2000 system (Abbott Molecular). Results were documented as either CCR5-tropic (R5), CXCR4-tropic (X4) or dual-/mixed-tropic (D/M). X4- and D/M isolates are pooled together and called X4 from here on. The investigation was performed within the German RESINA-study for which the patients signed an informed consent (BMG 310/4476/02/3).
RNA extraction, cDNA synthesis and V3-PCR
RNA extraction was performed by using the Viral RNA mini kit (Qiagen, Hilden, Germany) according to the manufacturer's instructions. cDNA-synthesis was performed using 10 μl of RNA, specific primers V3-1 (5'TACAATGTACACATGGAATT, position 6958 → 6977 in HXB2), V3-2 (ATTACAGTAGAAAAATTCCCC, position 7362 → 7382 in HXB2)  and Superscript II (Invitrogen) according to the manufacturer's instructions in a total volume of 20 μl.
Amplification of the V3 region was carried out using the FastStart HiFi PCR system, (Roche, Mannheim) and primers V3-for (TGGCAGTCTAGCAGAAGAAG, position 7010 → 7029 in HXB2) and V3-rev (CTGGGTCCCCTCCTGAGG, position 7315 → 7332 in HXB2)  in a Primus 96 plus thermal cycler (MWG-Biotech).
Products to be massively parallel sequenced were generated with fusion primers V3FusA: GCCTCCCTCGCGCCATCAG-V3-for and V3FusB: GCCTTGCCAGCCCGCTCAG-V3-rev.
Standard DNA sequencing and massively parallel pyrosequencing
Clean-up of the PCR products prior to standard sequencing was performed by incubation with FastAP™ in conjunction with Exonuclease I (Fermentas, Burlington, Canada) for 10 min at 37°C followed by heat inactivation for 5 min at 75°C.
Population-based sequencing of the V3 region was carried out using the Big Dye® Terminator v3.1 cycle sequencing kit (Applied Biosystems, Foster City, CA, USA) with primers (3pmol) V3-for and V3-rev. Extension products were purified using the Biomek NXp automated sequencing reaction cleanup system (Beckman Coulter, Fullerton, CA, USA) and were run on an ABI 3130 capillary sequencer (Applied Biosystems, Foster City, CA, USA).
Out of the 55 samples, 14 (7 R5, 7 X4) were randomly selected for further analysis with massively parallel sequencing. All 14 amplicons were purified with AMPure magnetic beads (Agencourt, Beckman Coulter) and quantified using an Agilent 2100 Bioanalyser (Agilent Life Sciences). Since bidirectional sequencing using primers A and B might result in unbalanced read composition, unidirectional sequencing with primer A (kit II; Roche-454 Life Sciences) was chosen to ensure precise quantification. After beads recovery and enrichment, approximately forty thousand beads were loaded on each region of a GS FLX PicoTiter plate subdivided with a 16-lane gasket. Sequencing was performed on a Genome Sequencer FLX (Roche-454 Life Sciences).
Determination of HIV-coreceptor phenotype
The trofile assay is a single-cycle recombinant virus assay developed by Monogram Biosciences. A 2.5kb long part of the patient-derived env gene is amplified by PCR and inserted into an envelope expression vector. Together with a replication-defective retroviral vector carrying a luciferase reporter gene, this vector is used to co-transfect human embryonic kidney 293 cells (HEK293). Pseudo-viruses produced by these cells are then given to engineered U87 target cell lines expressing either CCR5 or CXCR4.
Upon successful infection of these cells, the reporter gene is expressed and a light signal emitted. This can be quantitated in relative light units (RLU) and is additionally controlled by the presence of coreceptor antagonists. The original tropism assay is reported to be reproducible and effective at detecting minority populations of CXCR4-using virus at levels as low as 5% .
Preprocessing of 454-data
Massively parallel sequencing data was processed directly from the Standard Flowgram Files (.sff) containing the sequence trace data. The system's methods for post-processing (GS De Novo Assembler, GS Reference Mapper, GS Amplicon Variant Analyzer) have not been used due to previous problems with this software
Two main filtering steps were applied to minimize possible errors and to sort out non-V3 sequences arising from PCR- or sequencing errors. These worked as follows: First, sequences were translated into all three reading frames. Each frame was then screened for typical start and end-motifs of the V3-loop (e.g. CTR, CIR, AHC, AYC). Only sequences where both ends of the loop were recognized in the same reading frame were further processed. The potential V3-loop was cut out and its length analyzed. While the usual V3-loop has a length of about 35 amino acids, loops containing a number of insertions and deletions have been observed previously, as well . To allow for such indels but limit the number of deviations from the standard loop which could occur due to sequencing problems, we introduced the criteria that V3-loops had to have a length of at least 30 and at most 45 residues. If several V3-start- or V3-end motifs were found in a specific read, only the one with the length closest to 35 was selected for coreceptor usage prediction.
Tropism prediction from genotype
Genotypes resulting from both sequencing methods were input to a development version of geno2pheno[coreceptor] for coreceptor usage prediction (version from June 2009) . This version of the freely available web system produces exactly the same predictions as the public version but differs in two respects: First, it can process a number of sequences in batch allowing to handle the vast amount of data generated with the Genome Sequencer FLX system and second it returns the internal scores of the prediction method which are currently not displayed on the website (the displayed FPR-scores are a transformation of these scores ).
Prediction results were used in two fashions: On the one hand, cutoffs corresponding to the false-positive rates available on the website (1%, 2.5%, 5%, 10%, 15%, 20%) were used in order to classify the samples into R5- and X4-viruses. On the other hand, the raw values were used for detailed quantitative analysis as described below.
For performance comparison, the Monogram Trofile assay was used as reference. Performance was measured in terms of accuracy, true positive rate and false positive rate. The true positive rate is the relative number of X4 viruses correctly predicted as X4 while the false positive rate is the relative number of R5 viruses falsely classified as X4. Accuracy represents the total agreement between genotype and phenotype. For all evaluations, the statistical programming language R  was used.
Analysis of the error rate
The 454 GS-20 system is reported to have an overall error rate of 0.4%  to 0.49%  whereas the error rate of the FLX system is supposed be about 0.12% . For the GS-20 system, only about 11%  to 16%  of all errors turned out to be substitution errors whereas the remaining errors are insertion and deletion errors. Thus, the per-base substitution error rate is approximately 0.042%  to 0.078% . A nucleotide error might not necessarily change the amino acid of the respective codon and thus the prediction score. When checking the number of possible synonymous and non-synonymous mutations, we found 460 of 576 possible codon mutations to be non-synonymous. Therefore, the probability of a problematic substitution error in these reports is reduced to 0.03354% and 0.0623%, respectively. Given a V3-loop of 105 nucleotides, the probability of having no error is therefore (1-0.0335%)105 = 96.54% and (1-0.0623%)105 = 93.66% and consequently the probability of an erroneous V3 amino acid sequence only 3.4% to 6.3%. Considering the fact that not every amino acid change will change the coreceptor prediction we assume that such errors do not affect our results substantially.
Insertion and deletion errors can also be considered to be unproblematic because they induce frame shifts. These are detected by our filtering approach testing for valid V3-ends at both sides of the loops. Last but not least, it might happen that within a V3-loop an insertion and a deletion error occur together so that the V3-ends are in the same frame. However, reads with more than one sequence error occurred only in 7% of the reads in . Taken into account that both errors have to be located within the V3-loop which is much smaller than the whole read and one of them has to be an insertion and one a deletion error the probability of such a case is negligibly small, too.
Based on these considerations we can assume that our results should not be affected too much by problems with the sequencing technology.
Comparison of genotype and phenotype
Properties of analyzed patient isolates
viral load, copies/ml
#reads with v3 loop
After translation and adjusting for the V3-loop we found 280 different amino acid variants of the V3-loop on average (range: 57-584). The squared correlation coefficient between the number of different V3-variants and the number of reads was r2 = 0.584 (p = 0.001). When comparing R5- and X4 isolates, we did not find any significant difference between the two groups neither for the number of reads generated (p = 0.29, 8821 vs. 6341), nor for the viral load (p = 0.26, 19515 vs. 52106) or the number of found V3-loops (p = 0.29, 6808 vs. 4687) and their variants (p = 0.97, 281.7 vs. 279.1).
Quantitative analysis of coreceptor usage
Comparison between genotypic prediction and phenotypic results
In order to obtain a qualitative prediction from the ultra-deep data, two cutoffs have to be defined. The first is a cutoff for the prediction score has to be selected - reflecting the affinity of the virus to the CXCR4-coreceptor. For this purpose and in order to be comparable to the bulk-sequenced isolates, we chose the cutoff resulting in the standard 10% false-positive rate of geno2pheno[coreceptor]. Second, we have to set a minority threshold because in every sample individual clones very predictive for CXCR4-usage had been found. Three reasons might be responsible for this: (i) not every minority is clinically relevant, (ii) the phenotypic assay also has a sensitivity limit which has to be taken into account and which is most probably higher than the limit for massively parallel sequencing, and (iii) in some cases the 454-machine also produces erroneous sequences that are not recognized during preprocessing and prediction and which should not have an impact on the overall prediction outcome. Hence, we decided to select a minority cutoff of 5%, i.e. only samples in which more than 5% of the sequences were predicted to be CXCR4-using were assigned to be X4. This value is identical with the proposed sensitivity limit of the standard trofile assay used in this analysis.
Tropism results from different assays
prediction from bulk-sequence, predicted as X4 at FPR a of:
MPS, proportion. predicted as X4 b
In this work, we analyzed the usefulness of next-generation sequencing technologies in the realm of coreceptor usage prediction. Our results show that the approach affords precise classification as well as the possibility of quantitatively assessing the tropism of the viral quasispecies. With respect to the classification, our results are concordant with the phenotype in all cases but one. It should be noted that the cutoffs selected in this work were not optimized. Instead we selected cutoffs which are plausible (default cutoff of the geno2pheno method and the proposed sensitivity limit of the phenotypic assay). On the other hand, due to the limited amount of data, it was not possible to infer the cutoffs automatically in a statistically sound way. Future work on larger datasets should focus on optimizing the cutoffs. The data set on which we base this study is too small for this purpose. However, when comparing the results to the predictions obtained with conventional bulk-sequencing approaches it could clearly be shown that combining genotypic prediction with ultra-deep sequencing provides a fast and accurate alternative to phenotypic assays.
In addition to simple classification of the isolates into R5- and X4-samples, we could also provide a quantitative output with this approach. This may be of minor interest when comparing against a phenotype as done in this work but can be more important in the context of administration of coreceptor antagonists. A patient with a very small minority of X4-viruses might respond differently to a regimen containing coreceptor antagonist than a patient with a majority of X4-viruses despite the fact that both might have an X4-phenotype. However, this has to be addressed in the future when larger datasets with therapy outcome become widely available.
The main advantage of the massively parallel sequencing technology implemented in the GS FLX-system is that it can reliably detect minor variants and generate clonal sequences. In the context of coreceptor usage, especially the first property seems to be of special interest because minor variants have been shown to be much more important in tropism determination than in HIV resistance testing.
The main disadvantage of the 454-technology is that currently it is rather expensive with costs for a run ranging around 10,000€. However, several samples can be sequenced in parallel in a single run so that it is possible to lower the per/sample price dramatically (e.g. by sequencing 48 patients in parallel the price will decrease to about 200€). The drawback is that usually not that many patients have to be screened at the same time. Nevertheless, sequencing prices will further decrease so that we believe that this technology will be standard in the future.
In the course of this work, some publications have become available dealing with coreceptor usage and massively parallel sequencing. Tsibris et al.  have used the 454-technology to monitor the evolution and escape of HIV-1 during CCR5 antagonist therapy in four patients but not to predict the tropism of these viruses. In a related work, Archer et al.  used the 454 Genome Sequencer 20 to find minorities of CXCR4-using variants emerging in a patient treated with maraviroc monotherapy. In contrast to our work, however, these two works did not focus on the prediction of viral tropism but on the observation of shifts within the viral quasispecies under selective drug pressure. More recently, approaches similar to the one discussed here have been presented by Abbate et al.  and Vandekerckhove et al. . Swenson et al. used such a method to rescreen the patients enrolled in the MOTIVATE studies and compared the results with the ones generated by the original trofile assay [25, 26]. In a related study it was also found that genotypic interpretation of data from population-based sequencing works much better than anticipated despite substantial discordant rates to the original trofile assay .
The original trofile assay used in this work has been replaced by an enhanced version (ESTA) able to detect minor variants circulating in quantities as low as 0.3%. This might imply that more differences with the new assay would have been seen than with the old assay. However, we believe that this is not the case for two reasons: First of all, we have set the minority cutoff to 5% to mirror the one of the original trofile assay which was reported to be 100% sensitive at detecting 10% minor variants and 85% sensitive at detecting 5% minor variants in a mixed virus population. We could easily lower this cutoff to any other value. Second, we have presented data at the 7th European HIV Drug Resistance Workshop  on how to adjust the FPR cutoff of geno2pheno[coreceptor] in order to obtain prediction results comparable in terms of sensitivity and specificity of X4-detection on samples generated with the original and the enhanced sensitivity trofile assays. The same adjustment could be applied in this case as well.
Additional data would definitively strengthen the results. However, we cannot afford the high costs to screen further samples with the Trofile assay and with the 454-technology. Moreover, we would now get the results from the enhanced sensitivity Trofile and not the original Trofile used in this study. Thus, we would also have to rescreen the 14 samples used in this analysis again.
There is room for improvements. First, as already discussed above one has to decide if the goal is to recreate the results of Trofile-assay or rather to reliably predict coreceptor antagonist admissibility. In our opinion the latter is more important. Therefore the 5%-minority cutoff chosen in this project is probably not the best solution and should be adjusted when more treatment data become available. In fact, the 5% cutoff appears high with respect to the possibilities of ultradeep sequencing. We chose it since we compare the 454 technology against an assay for which a minority threshold of about 5% is suitable. If we used a cutoff of 1%, the samples 8 and 12-14 would also be predicted as X4 by massively parallel sequencing but not by the Trofile assay. We could then claim that the 454 assay is more sensitive than the Trofile assay. Others might say, however, that these samples are erroneously classified as X4 on the basis of the 454 measurements. Thus, we feel that a fair comparison is only possible if we use the same sensitivity limits for both assays compared.
Furthermore, one might think about changing the dogma to exclude all patients from a therapy with coreceptor antagonists who harbor a dual-tropic or X4-virus. We found at least one sequence predicted as X4 in every isolate which means that if we do not use a minority cutoff none of our patients would be administered a coreceptor antagonist. This does not make therapeutic sense. Instead of trying to further increase the sensitivity of detecting minority populations we suggest to search for clinically relevant cutoffs. These cutoffs might not only be based on the number of minor X4-viruses but also depend on the fitness of these variants. McGovern et al.  determined and proposed a clinical cutoff at FPR of 5.75%. However, this cutoff was based on triplicate sequencing in which the lowest predicted FPR was used. Consequently, these FPRs were lower in general than those for single sequencing making a direct comparison difficult. We feel that with respect to the phenotype, the standard 10% g2p cutoff is more appropriate.
Another point one to be addressed in the future is that we used a standard coreceptor prediction tool which was originally developed for bulk-sequenced isolates and not for ultra-deep data. This might imply problems because e.g. the prediction system also uses features like the number of ambiguous positions which are usually not or only rarely existent in massively parallel sequencing data. Thus, a tool trained specifically on the latter kind of sequence data should show enhanced prediction outcomes.
Finally, coreceptor antagonists are administered together with other antiretroviral compounds. We do not know if minorities of X4-viruses accumulate the same resistance mutations to other drugs as the predominant R5-viruses. There might be the possibility that these variants have quite different polymerase-genes and therefore are resistant against a coreceptor antagonist but not against the other drugs in the backbone. Hence, a future goal is to sequence the whole virus with the ultra-deep sequencing technology in order to address this problem.
Massively parallel sequencing can be successfully combined with prediction of HIV-1 coreceptor usage from V3 genotype. Such an approach results in a fast and accurate alternative to phenotypic assays which not only gives a qualitative tropism result but also allows for generating a quantitative picture of the whole viral quasispecies.
The authors would like to thank André Altmann for critical discussions throughout the study. This work was partly supported by the German Ministry of Health under grant number BMG 310/4476/02/3. Parts of this work have been presented in a talk at the XVII International HIV Drug Resistance Workshop: Basic Principles and Clinical Implications.
- Yeni PG, Hammer SM, Carpenter CC, Cooper DA, Fischl MA, Gatell JM, Gazzard BG, Hirsch MS, Jacobsen DM, Katzenstein DA: Antiretroviral treatment for adult HIV infection in 2002: updated recommendations of the International AIDS Society-USA Panel. JAMA. 2002, 288 (2): 222-235. 10.1001/jama.288.2.222.View ArticlePubMedGoogle Scholar
- Vandamme AM, Van Laethem K, De Clercq E: Managing resistance to anti-HIV drugs: an important consideration for effective disease management. Drugs. 1999, 57 (3): 337-361. 10.2165/00003495-199957030-00006.View ArticlePubMedGoogle Scholar
- Simen BB, Simons JF, Hullsiek KH, Novak RM, Macarthur RD, Baxter JD, Huang C, Lubeski C, Turenchalk GS, Braverman MS: Low-abundance drug-resistant viral variants in chronically HIV-infected, antiretroviral treatment-naive patients significantly impact treatment outcomes. J Infect Dis. 2009, 199 (5): 693-701. 10.1086/596736.View ArticlePubMedGoogle Scholar
- Dorr P, Westby M, Dobbs S, Griffin P, Irvine B, Macartney M, Mori J, Rickett G, Smith-Burchnell C, Napier C: Maraviroc (UK-427,857), a potent, orally bioavailable, and selective small-molecule inhibitor of chemokine receptor CCR5 with broad-spectrum anti-human immunodeficiency virus type 1 activity. Antimicrob Agents Chemother. 2005, 49 (11): 4721-4732. 10.1128/AAC.49.11.4721-4732.2005.View ArticlePubMedPubMed CentralGoogle Scholar
- Berger EA, Murphy PM, Farber JM: Chemokine receptors as HIV-1 coreceptors: roles in viral entry, tropism, and disease. Annu Rev Immunol. 1999, 17: 657-700. 10.1146/annurev.immunol.17.1.657.View ArticlePubMedGoogle Scholar
- Westby M, van der Ryst E: CCR5 antagonists: host-targeted antivirals for the treatment of HIV infection. Antivir Chem Chemother. 2005, 16 (6): 339-354.View ArticlePubMedGoogle Scholar
- Whitcomb JM, Huang W, Fransen S, Limoli K, Toma J, Wrin T, Chappey C, Kiss LD, Paxinos EE, Petropoulos CJ: Development and characterization of a novel single-cycle recombinant-virus assay to determine human immunodeficiency virus type 1 coreceptor tropism. Antimicrob Agents Chemother. 2007, 51 (2): 566-575. 10.1128/AAC.00853-06.View ArticlePubMedGoogle Scholar
- Lengauer T, Sander O, Sierra S, Thielen A, Kaiser R: Bioinformatics prediction of HIV coreceptor usage. Nat Biotechnol. 2007, 25 (12): 1407-1410. 10.1038/nbt1371.View ArticlePubMedGoogle Scholar
- Sierra S, Kaiser R, Thielen A, Lengauer T: Genotypic coreceptor analysis. Eur J Med Res. 2007, 12 (9): 453-462.PubMedGoogle Scholar
- Low AJ, Swenson LC, Harrigan PR: HIV coreceptor phenotyping in the clinical setting. AIDS Rev. 2008, 10 (3): 143-151.PubMedGoogle Scholar
- Sing T, Low AJ, Beerenwinkel N, Sander O, Cheung PK, Domingues FS, Buch J, Daumer M, Kaiser R, Lengauer T: Predicting HIV coreceptor usage on the basis of genetic and clinical covariates. Antivir Ther. 2007, 12 (7): 1097-1106.PubMedGoogle Scholar
- Low AJ, Dong W, Chan D, Sing T, Swanstrom R, Jensen M, Pillai S, Good B, Harrigan PR: Current V3 genotyping algorithms are inadequate for predicting X4 co-receptor usage in clinical isolates. AIDS. 2007, 21 (14): F17-24. 10.1097/QAD.0b013e3282ef81ea.View ArticlePubMedGoogle Scholar
- Margulies M, Egholm M, Altman WE, Attiya S, Bader JS, Bemben LA, Berka J, Braverman MS, Chen YJ, Chen Z: Genome sequencing in microfabricated high-density picolitre reactors. Nature. 2005, 437 (7057): 376-380.PubMedPubMed CentralGoogle Scholar
- Simmonds P, Balfe P, Ludlam CA, Bishop JO, Brown AJ: Analysis of sequence diversity in hypervariable regions of the external glycoprotein of human immunodeficiency virus type 1. J Virol. 1990, 64 (12): 5840-5850.PubMedPubMed CentralGoogle Scholar
- R Development Core Team: R: A Language and Environment for Statistical Computing. 2005, Vienna: Foundation for Statistical ComputingGoogle Scholar
- Quinlan AR, Stewart DA, Stromberg MP, Marth GT: Pyrobayes: an improved base caller for SNP discovery in pyrosequences. Nat Methods. 2008, 5 (2): 179-181. 10.1038/nmeth.1172.View ArticlePubMedGoogle Scholar
- Huse SM, Huber JA, Morrison HG, Sogin ML, Welch DM: Accuracy and quality of massively parallel DNA pyrosequencing. Genome Biol. 2007, 8 (7): R143-10.1186/gb-2007-8-7-r143.View ArticlePubMedPubMed CentralGoogle Scholar
- de Mendoza C, Van Baelen K, Poveda E, Rondelez E, Zahonero N, Stuyver L, Garrido C, Villacian J, Soriano V: Performance of a population-based HIV-1 tropism phenotypic assay and correlation with V3 genotypic prediction tools in recent HIV-1 seroconverters. J Acquir Immune Defic Syndr. 2008, 48 (3): 241-244. 10.1097/QAI.0b013e3181734f0e.View ArticlePubMedGoogle Scholar
- Garrido C, Roulet V, Chueca N, Poveda E, Aguilera A, Skrabal K, Zahonero N, Carlos S, Garcia F, Faudon JL: Evaluation of eight different bioinformatics tools to predict viral tropism in different human immunodeficiency virus type 1 subtypes. J Clin Microbiol. 2008, 46 (3): 887-891. 10.1128/JCM.01611-07.View ArticlePubMedPubMed CentralGoogle Scholar
- Skrabal K, Low AJ, Dong W, Sing T, Cheung PK, Mammano F, Harrigan PR: Determining human immunodeficiency virus coreceptor use in a clinical setting: degree of correlation between two phenotypic assays and a bioinformatic model. J Clin Microbiol. 2007, 45 (2): 279-284. 10.1128/JCM.01118-06.View ArticlePubMedGoogle Scholar
- Tsibris AM, Korber B, Arnaout R, Russ C, Lo CC, Leitner T, Gaschen B, Theiler J, Paredes R, Su Z: Quantitative deep sequencing reveals dynamic HIV-1 escape and large population shifts during CCR5 antagonist therapy in vivo. PLoS One. 2009, 4 (5): e5683-10.1371/journal.pone.0005683.View ArticlePubMedPubMed CentralGoogle Scholar
- Archer J, Braverman MS, Taillon BE, Desany B, James I, Harrigan PR, Lewis M, Robertson DL: Detection of low-frequency pretherapy chemokine (CXC motif) receptor 4 (CXCR4)-using HIV-1 with ultra-deep pyrosequencing. AIDS. 2009, 23 (10): 1209-1218. 10.1097/QAD.0b013e32832b4399.View ArticlePubMedPubMed CentralGoogle Scholar
- Abbate I, Rozera G, Tommasi C, Bruselles A, Bartolini B, Chillemi G, Nicastri E, Narciso P, Ippolito G, Capobianchi MR: Analysis of co-receptor usage of circulating viral and proviral HIV genome quasispecies by ultra-deep pyrosequencing in patients who are candidates for CCR5 antagonist treatment. Clin Microbiol Infect. 2010Google Scholar
- Vandekerckhove L, Verhofstede C, Demecheleer E, De Wit S, Florence E, Fransen K, Moutschen M, Mostmans W, Kabeya K, Mackie N: Comparison of phenotypic and genotypic tropism determination in triple-class-experienced HIV patients eligible for maraviroc treatment. J Antimicrob Chemother. 2011, 66 (2): 265--272. 10.1093/jac/dkq458.View ArticlePubMedGoogle Scholar
- Swenson LC, Mo T, Dong WW, Zhong X, Woods CK, Jensen MA, Thielen A, Chapman D, Lewis M, James I: Deep Sequencing to Infer HIV-1 Co-Receptor Usage: Application to Three Clinical Trials of Maraviroc in Treatment-Experienced Patients. J Infect Dis. 203 (2): 237-245.
- Swenson LC, Moores A, Low AJ, Thielen A, Dong W, Woods C, Jensen MA, Wynhoven B, Chan D, Glascock C: Improved detection of CXCR4-using HIV by V3 genotyping: application of population-based and "deep" sequencing to plasma RNA and proviral DNA. J Acquir Immune Defic Syndr. 2010, 54 (5): 506-510. 10.1097/QAI.0b013e3181d0558f.View ArticlePubMedGoogle Scholar
- McGovern RA, Thielen A, Mo T, Dong W, Woods CK, Chapman D, Lewis M, James I, Heera J, Valdez H: Population-based V3 genotypic tropism assay: a retrospective analysis using screening samples from the A4001029 and MOTIVATE studies. AIDS. 2010, 24 (16): 2517-2525. 10.1097/QAD.0b013e32833e6cfb.View ArticlePubMedGoogle Scholar
- Thielen AaS, Nadine , Braun Patrick, Daeumer Martin, Walter Hauke, Noah Christian, Wolf Eva, Mueller Harm, Stuermer Martin, Lengauer Thomas, Kaiser Rolf, Obermeier Martin: Performance of genotypic coreceptor measurement using geno2pheno[coreceptor] in B- and non-B HIV subtypes in a large cohort of therapy-experienced patients in Germany. Reviews in Antiviral Therapy. 2009, 2009 (1): 1-Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6947/11/30/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.