Introduction
This page contains details on the PCORNet CDM refresh processes for both the quarterly main extract and weekly mini-CDM extract. The data from both of these extracts is used by queries submitted by the PCORNet Coordinating Center.
Background
Details
Use Cases
The PCORNet CDM data is being used for multiple projects. These projects include:
- Ad-hoc queries
- CODI
- N3C
- RECOVER
Technical Information
Programming Languages
The majority of the code being used is in Python, being run under the Airflow scheduling platform.
Server Information
- Development -
- Production -
Database Information
- Development -
- Production -
Processes
- STAR_ETL_Master
- Git Location:
- STAR_Inc_Load
- Git Location:
- STAR_Post_ETL
- Git Location:
- Static ID Update
- Git Location:
- COVID19 Keys Update
- Git Location:
- RxNormLoad
- Git Location:
- search_for_tables.ksh - Will be moved to a Python program to be used for both CDRN and Data Engineering group.
References
- Airflow - https://airflow.apache.org/
- Service Now Application Record - Application Record CDRN