Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This page will be used to track the different projects that need to be moved from the Oracle Exadata environment to another environment.

Database Schema List

The list of affected projects are below:

...


Exadata

...

  • ACT_I2B2_DATA

  • ACT_I2B2_HIVE

  • ACT_I2B2_IMDATA

  • ACT_I2B2_METADATA

  • ACT_I2B2_PM

  • ACT_I2B2_SHRINE_ONT

  • ACT_I2B2_WORKDATA

  • NOTE: There are some other schemas starting with ACT_TEST that can be deleted as they are no longer being used for ACT testing and development.

...

  • CODI

...

  • HSC_I2B2_DATA

  • HSC_I2B2_HIVE

  • HSC_I2B2_IMDATA

  • HSC_I2B2_METADATA

  • HSC_I2B2_PM

  • HSC_I2B2_SHRINE_ONT

  • HSC_I2B2_WORKDATA

...

  • HSC_PCOR

...

  • RXNORM
  • RXNORM_2017 - Actually used for N3C project. These tables should be moved somewhere else that makes more sense.

...

Airflow Process List

  • CDRNLabReload    
  • CDRNStaticIdDAG    
  • CODI_DAG    
  • CVD19GetPatKeys
  • STAR_CopyPcornetTables
  • STAR_ETL_Master    
  • STAR_ETL_PostOp    
  • STAR_Inc_Load    
  • STAR_N3C_Hash_Tokens    
  • STAR_Recover    
Exadata
Schema NameProject NameProcess TypeProcess NameProcess LocationOwnerNotes

ACT_I2B2_DATA

ACTN/AN/AN/ADaniel Popham




Decommissioned project as of May 2023. However, there is data in the following schemas that should be archived somewhere before Exadata is decommissioned.







ACT_I2B2_HIVE

ACTN/AN/AN/ADaniel Popham

ACT_I2B2_IMDATA

ACTN/AN/AN/ADaniel Popham

ACT_I2B2_METADATA

ACTN/AN/AN/ADaniel Popham

ACT_I2B2_PM

ACTN/AN/AN/ADaniel Popham

ACT_I2B2_SHRINE_ONT

ACTN/AN/AN/ADaniel Popham

ACT_I2B2_WORKDATA

ACTN/AN/AN/ADaniel Popham
ACT_TEST_DATAACTN/AN/AN/ADaniel Popham




Decommissioned project as of May 2023. All of these schemas can be removed.







ACT_TEST_HIVEACTN/AN/AN/ADaniel Popham
ACT_TEST_IMDATAACTN/AN/AN/ADaniel Popham
ACT_TEST_METADATAACTN/AN/AN/ADaniel Popham
ACT_TEST_PMACTN/AN/AN/ADaniel Popham
ACT_TEST_SHRINE_ONTACTN/AN/AN/ADaniel Popham
ACT_TEST_WORKDATAACTN/AN/AN/ADaniel Popham
CODICODIAirflow DAG

DEV: plt-nosql01.dhe.duke.edu

PRD: plp-nosql01.dhe.duke.edu

Daniel PophamContains data used for the CODI project, supported by the PCORNet CDM data. Project has been decommissioned and the associated DAG has been disabled.

HSC_I2B2_DATA

Carolinas Collaborative (CC)N/AN/AN/ADaniel Popham







Decommissioned project some time before 2020. However, required to keep data until end of year 2025 for archival/historical purposes. Data in the following schemas should be archived somewhere before Exadata is decommissioned







HSC_I2B2_HIVECarolinas Collaborative (CC)N/AN/AN/ADaniel Popham
HSC_I2B2_IMDATACarolinas Collaborative (CC)N/AN/AN/ADaniel Popham
HSC_I2B2_METADATACarolinas Collaborative (CC)N/AN/AN/ADaniel Popham
HSC_I2B2_PMCarolinas Collaborative (CC)N/AN/AN/ADaniel Popham
HSC_I2B2_SHRINE_ONTCarolinas Collaborative (CC)N/AN/AN/ADaniel Popham
HSC_I2B2_WORKDATACarolinas Collaborative (CC)N/AN/AN/ADaniel Popham





HSC_PCOR

PCORNet/STAR


N3C






Airflow

DAGs
  • CDRNLabReload    
  • CDRNStaticIdDAG    
  • CVD19GetPatKeys
  • STAR_CopyPcornetTables
  • STAR_ETL_Master    
  • STAR_ETL_PostOp    
  • STAR_Inc_Load    
  • STAR_

    DAG

       STAR_Recover    





    DEV: plt-nosql01.dhe.duke.edu

    PRD: plp-nosql01.dhe.duke.edu

    N3C Only: vwp-pmndmc.dhe.duke.edu


    Daniel PophamProject that runs monthly to generate data for N3C project from monthly refresh.
    PCORNet/STARDaniel Popham

    Project that contains the PCORNet CDM data that is refreshed both quarterly and monthly.

    RECOVERDaniel Popham

    Project that runs quarterly to generate data for RECOVER project based on available PCORNet refresh data .

    BayerPython ScriptBayerExtract.py

    vwp-pmndmc.dhe.duke.edu

    Daniel Popham

    Data extract from external database into HSC_PCOR schema. Script is located on shared drive, \\duhs-clin-nc1\duhs_pmn_dmc_fs\Bayer\

    BayerExtract.py

    . Mapped to H: on vwp-pmndmc.dhe.duke.edu

    Daniel PophamData extract from external database. Not affected by migration

    .

    RXNORMPCORNet/STARUnix Shell Script
    /dwhome/airflow_ci/master/dags/CDRN_ETL/
    RxNormLoad
    /RxNormLoad
    .sh

    DEV: plt-nosql01.dhe.duke.edu

    PRD: plp-nosql01.dhe.duke.edu

    Daniel PophamProcess related to the PCORNet/STAR project that refreshes RxNorm data on a quarterly basis, before the STAR quarterly refresh. Manually run.
    RXNORM_2017PCORNet/STARWindows Batch File
    \\duhs-clin-nc1\duhs_pmn_dmc_fs\N3C\Project\
    N3C_Main.batvwp-pmndmc.dhe.duke.eduDaniel PophamActually used for N3C project. These tables should be moved somewhere else that makes more sense.