PerspectiveRegulatory Science

Unmet needs: Research helps regulators do their jobs

See allHide authors and affiliations

Science Translational Medicine  25 Nov 2015:
Vol. 7, Issue 315, pp. 315ps22
DOI: 10.1126/scitranslmed.aac4369

Figures

  • Fig. 1 From laboratory to patient to the cloud.

    Shown is a test architecture for whole-genome sequencing. The flow chart represents a proposed sequential roadmap for using DNA sequencing data in a clinical setting, from sample collection to the determination of genome sequence to the interpretation of data and patient reporting. Regulation of diagnostic tests requires the development of standards and methods for the use of next-generation sequence data in clinical decision-making.

    CREDIT: P. HUEY/SCIENCE TRANSLATIONAL MEDICINE

Tables

  • Table 1 Strategic areas of regulatory sciences research.

    Information in the table is from www.fda.gov/downloads/scienceresearch/specialtopics/regulatoryscience/ucm268225.pdf.

    Strategic research areaExamples of research
    Modernize toxicology • Develop better preclinical models of human adverse events
    • Use and develop computational methods for predicting drug toxicities
    Stimulate innovation in clinical evaluations and personalized medicine • Develop a virtual physiological patient
    • Identify and qualify safety and efficacy biomarkers
    Support new approaches to improve product manufacturing • Enable development of improved manufacturing methods (for example, continuous manufacturing versus batch)
    • Develop and implement modern analytical methods for evaluating product quality (for example, nuclear magnetic resonance imaging)
    Ensure FDA readiness to evaluate innovative emerging technologies • Develop assessment tools for novel diagnostics and therapies
    • Enhance readiness for new applications of information technology
    Harness diverse data through information sciences • Enhance information technology infrastructure
    • Develop simulation models for product life cycles, risk assessment, and other regulatory sciences uses
    Implement a new prevention-focused food safety system • Improve information sharing internally and externally through improved IT systems
    • Develop methods for rapid detection of pathogens that contaminate foods
    Facilitate development of medical countermeasures • Develop, characterize, and qualify animal models for medical countermeasures
    • Develop high-throughput methods to detect threat agents
    Strengthen research in social and behavioral sciences • Develop methods for aggregating patient preference information with clinical data
    • Develop best practices for patient preference elicitation studies
  • Table 2 NGS: Diagnostic enterprise from clinical sample through diagnosis, reporting, and data archival.

    Shown is (i) suggested evidence appropriate for the development of validation standards, which could then be used to establish that evidence, and (ii) critical stakeholders who can be convened to identify existing standards, create new standards, or establish the research agenda that would underpin the needed standards. VCF, variant call format; SOP, standard operating procedures; SDOs, study delivery operations specialists; HHS, health and human services.

    PhaseEvidence neededStandards and evidence-developing practices (examples)Stakeholders for standards developmentKnowledge gaps (examples)
    Preanalytical:from tissue to DNA • Representative sampling
    • Accurate (unbiased) extraction
    • Integrity of DNA
    • Documentary standard to establish SOPs for sampling
    • Reference samples and interlaboratory studies to evaluate extraction and DNA integrity
    • Clinical laboratories
    • Professional societies
    • Clinical SDOs
    • Artifacts associated with extraction from archival tissue samples
    Sequencing: from DNA to raw sequence data “Wet bench” • Accurate (unbiased) sequencing
    • Fit-for-purpose characteristics
    • Well-characterized genomic DNA reference materials
    • Documentary standard describing sequencing characteristics appropriate for different clinical indications
    • Standards laboratories
    • Clinical laboratories
    • Sequencing technology developers
    • Academic laboratories developing methods
    • Genome centers
    • Sequencing of “difficult” regions of the genome
    • Platform artifacts
    • High-quality benchmark genomes
    • Performance expectations (sensitivity, specificity thresholds)
    Sequence bioinformatics: from raw sequence data to VCF “Dry bench” • Unbiased processing of sequence data (mapping and assembly)
    • Accurate variant calling
    • Accurate and unambiguous variant representation
    • Interoperability of data representation
    • Documentary standards describing protocols to critically evaluate processes, coupled to knowledge of technical platform idiosyncrasies
    • Data representation standards
    • Reference data, implementation: benchmark VCF files
    • Reference software to evaluate VCF files
    • Standards laboratories
    • Clinical laboratories
    • Sequencing technology developers
    • Academic laboratories developing methods
    • Genome centers
    • Assembly and mapping in “difficult” regions of the genome
    • Platform and algorithm artifacts
    • High-quality benchmark genomes
    • Performance expectations (sensitivity, specificity thresholds)
    Functional variant annotation• Accuracy of variant annotation, including establishing confidence in genomic landscape of the call • Documentary standards for critical evaluation of processes, coupled to knowledge of technical platform idiosyncrasies
    • Data representation standards
    • Interlaboratory comparisons of annotation
    • Gold standard annotation of benchmark samples
    • Clinical laboratories
    • Academic laboratories developing methods
    • Genome centers
    • Development of genome-wide “gold standard” annotations
    Clinical variant knowledge base (PharmGKB, ClinVar)• Clinical scope, reliability, relevance, strength, applicability of data in knowledge base • Documentary standards of evidence for inclusion in knowledge base
    • Documentary standards for critical evaluation of knowledge base contents, formatting, transaction accuracy
    • Knowledge base intercomparisons
    • Clinicians
    • Professional societies
    • Academic laboratories
    • Quantitative frameworks to assess knowledge of the strengths of associations of variants and disease
    • Quantitative framework to assess knowledge base curation/accuracy
    Clinical interpretation • Accurate interpretation of variants, including incidental findings and classification of pathogenicity
    • Accurate clinical findings
    • Documentary standards describing best practices and methods of critical evaluation
    • Adjudicated benchmark case studies for interlaboratory comparisons of clinical interpretation
    • Clinicians
    • Professional societies
    • Academic laboratories
    • Payers
    • Quantitative framework to predict performance of clinical interpretation
    Reporting• Accurate and clear reporting of results to clinician in a standard format • Documentary standards describing reporting guidelines
    • Interlaboratory comparisons and evaluations of reporting
    • Professional societies
    • Clinicians
    • Genetic counselors
    • Clinical laboratories
    • Payers
    • Communicate confidence in findings
    EHR archival• Accurate and interoperable representation of WGS, WES test results • Data representation standards
    • Documentary standards describing data representation
    • Compliance test software to evaluate EHR formatting
    • Reference implementations
    • Payers
    • Professional societies
    • HHS
    • Standards bodies
    • No interoperable EHR standards in common practice

Navigate This Article