Legacy Pipeline Atlas worker-1snapshot 2026-07-15

sub-job

OneGI · Flow-Source-Load-ECW-PriorDiagnosis

called by Flow-ECW-Source-LoadData

sub-job OneGI/Flow-Source-Load-ECW-PriorDiagnosis · db OneGI_ProdMirror · updated 2026-02-21

task tree

What the sub-job runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

sub-job

Flow-Source-Load-ECW-PriorDiagnosis

4 tasks · OneGI
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. ProcessDataFileProcessDataFiledisabled
    Import delimited files by automatically detecting their structure and merging the data into source tables.
    writes ImportECWPriorDiagnosisSourceECWPriorDiagnosis
    file path={FilePath}archive directory={SourceDataArchiveECW}base table name=ECWPriorDiagnosisrow terminator=NewlineDISABLED
  2. ExecuteProcessExecuteProcess
  3. LoadDataFileLoadDataFile
    Imports delimited data files into database tables using predefined specifications for validation, loading, and optional file archiving.
    writes ImportECWPriorDiagnosis
    data file spec=ImportECWPriorDiagnosisfile path={FilePath}import mode=Replacearchive file path={SourceDataArchiveECW}
  4. ExecuteMergeSqlExecuteMergeSql
    Synchronizes data from external sources into target tables by performing batched insert, update, and delete operations based on keys.
    writes SourceECWPriorDiagnosis · reads ImportECWPriorDiagnosis
    ↳ feeds from LoadDataFile
    merge data source type=ThisDatabasetable name=SourceECWPriorDiagnosismerge mode=InsertUpdatebulk copy timeout seconds=300bulk copy use table lock