Legacy Pipeline Atlas worker-1snapshot 2026-07-15

sub-job

OneGI · Flow-ECW-Transform

EWC Transformation Layer

called by Flow-ECW-Processing

sub-job OneGI/Flow-ECW-Transform · db OneGI_ProdMirror · updated 2026-07-14

task tree

What the sub-job runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

sub-job

Flow-ECW-Transform

8 tasks · OneGI
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. TruncateVisitDeltasqlflow_ecw_transform__truncatevisitdelta.sql
    Clears the visit delta table to prepare for a fresh set of changed records in the current pipeline run.
    writes VisitDelta
  2. TransformPatientTransformPatient
    writes TransformPatient · reads SourceECWFlowPatients
    merge data source type=ThisDatabasetable name=TransformPatientmerge mode=InsertUpdateSoftDeletebulk copy timeout seconds=300bulk copy use table lock
  3. TransformPatientInsurance PatientDeltasqlflow_ecw_transform__transformpatientinsurance_patientdelta.sql
    Identifies patients with updated insurance information since the last processing time and loads them into the patient delta table.
    writes FlowPatientDelta · reads FlowLogLastProcessingTimeSourceECWFlowPatientInsurance
  4. Merge TransformPatientInsuranceMergeSql
    writes TransformPatientInsurance
    merge data source type=ThisDatabasetable name=TransformPatientInsurancemerge mode=InsertUpdateHardDeletebulk copy timeout seconds=300bulk copy use table lock
  5. TransformPatientInsurance VisitDeltasqlflow_ecw_transform__transformpatientinsurance_visitdelta.sql
    Adds future visits to the visit delta table for patients who have had recent insurance updates.
    writes VisitDelta · reads FlowPatientDeltaTransformVisit
    ↳ feeds from MergeTransformVisit, TransformPatientInsurance PatientDelta
  6. VisitDeltasqlflow_ecw_transform__visitdelta.sql
    Identifies new or updated encounters from source data and adds them to the visit delta table for processing.
    writes VisitDelta · reads FlowLogLastProcessingTimeSourceECWEncounterTransformVisitVisitDelta
    ↳ feeds from MergeTransformVisit, TransformPatientInsurance VisitDelta, TruncateVisitDelta
  7. MergeTransformVisitsqlflow_ecw_transform__mergetransformvisit.sql
    Transforms and loads encounter details like status, time, and provider into the transformed visit table for identified delta records.
    writes TransformVisit · reads FacilitySourceECWAscProcEncSourceECWColonoscopyTypeSourceECWEncounterSourceECWPatientsSourceECWReferralSourceECWVisitCodesSourceECWVisitStatus
    ↳ feeds from TransformPatientInsurance VisitDelta, TruncateVisitDelta, VisitDelta
  8. MergeTransformVisitInsurancesqlflow_ecw_transform__mergetransformvisitinsurance.sql
    Maps and loads patient insurance information into the transformed visit insurance table for visits identified in the delta set.
    writes TransformVisitInsurance · reads TransformPatientInsuranceTransformVisitVisitDelta
    ↳ feeds from Merge TransformPatientInsurance, MergeTransformVisit, TransformPatientInsurance VisitDelta, TruncateVisitDelta, VisitDelta