Legacy Pipeline Atlas worker-1snapshot 2026-07-15

sub-job

OneGI · Flow-Source-Load-ECW-HistoryPresentIllness

called by Flow-ECW-Source-LoadData

sub-job OneGI/Flow-Source-Load-ECW-HistoryPresentIllness · db OneGI_ProdMirror · updated 2026-02-20

task tree

What the sub-job runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

sub-job

Flow-Source-Load-ECW-HistoryPresentIllness

3 tasks · OneGI
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. ProcessDataFileProcessDataFiledisabled
    Import delimited files by automatically detecting their structure and merging the data into source tables.
    writes ImportECWHistoryPresentIllnessSourceECWHistoryPresentIllness
    file path={FilePath}archive directory={SourceDataArchiveECW}base table name=ECWHistoryPresentIllnessrow terminator=NewlineDISABLED
  2. LoadDataFileLoadDataFile
    Imports delimited data files into database tables using predefined specifications for validation, loading, and optional file archiving.
    writes ImportECWHistoryPresentIllness
    data file spec=ImportECWHistoryPresentIllnessfile path={FilePath}import mode=Replacearchive file path={SourceDataArchiveECW}
  3. ExecuteMergeSqlExecuteMergeSql
    Synchronizes data from external sources into target tables by performing batched insert, update, and delete operations based on keys.
    writes SourceECWHistoryPresentIllness · reads ImportECWHistoryPresentIllness
    ↳ feeds from LoadDataFile
    merge data source type=ThisDatabasetable name=SourceECWHistoryPresentIllnessmerge mode=InsertUpdatebulk copy timeout seconds=300bulk copy use table lock