Legacy Pipeline Atlas worker-1snapshot 2026-07-15

sub-job

Wildflower · Flow-Source-ImportFiles

called by Flow-Processing

sub-job Wildflower/Flow-Source-ImportFiles · db Wildflower_ProdMirror · updated 2025-09-17

task tree

What the sub-job runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

sub-job

Flow-Source-ImportFiles

4 tasks · Wildflower
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. DownloadDownload
    Downloads files from remote FTP or SFTP servers to local directories with support for archiving and parallel transfers.
    server=Wildflower_ProdMirror-mdcssh-sftpremote directory=/local directory={SourceDataFolder}
  2. Flow-Source-ProcessDataFilePatientsub-job · 1
    1. Process Patient FilesProcessFile
      writes ImportPatientSourcePatient
      file path={FilePath}archive directory={SourceDataArchive}base table name=Patientrow terminator=Linefeedcolumn separator=Comma
  3. Flow-Source-ProcessDataFileVisitsub-job · 1
    1. Process Visit FileProcessFile
      writes ImportVisitSourceVisit
      file path={FilePath}archive directory={SourceDataArchive}base table name=Visitrow terminator=Linefeedcolumn separator=Comma
  4. Flow-Source-ProcessDataFileVisitInsurancesub-job · 1
    1. Process VisitInsurance FileProcessFile
      writes ImportVisitInsuranceSourceVisitInsurance
      file path={FilePath}archive directory={SourceDataArchive}base table name=VisitInsurancerow terminator=Linefeedcolumn separator=Comma