Legacy Pipeline Atlas worker-1snapshot 2026-07-15

sub-job

RIA · Process-MSN-Files-RevFind

Download and Process MSN files

called by Daily-Processing-RevFind

sub-job RIA/Process-MSN-Files-RevFind · db RIA_ProdMirror · updated 2025-11-12

task tree

What the sub-job runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

sub-job

Process-MSN-Files-RevFind

3 tasks · RIA
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. Download (old)Downloaddisabled
    Downloads files from remote FTP or SFTP servers to local directories with support for archiving and parallel transfers.
    server=RIA_ProdMirror-mdcssh-sftpremote directory=/MSN Files/local directory={SourceDataFolderRevFind}DISABLED
  2. DownloadDownload
    Downloads files from remote FTP or SFTP servers to local directories with support for archiving and parallel transfers.
    server=RIA_ProdMirror-msnftp-sftpremote directory=/local directory={SourceDataFolderRevFind}
  3. Load-MSN-ProcessDataFile-RevFindsub-job · 1Load MSN Files
    1. Process MSNProcessFile
      writes ImportMSNFilesSourceMSNFiles
      file path={FilePath}archive directory={SourceDataArchiveRevFind}base table name=MSNFilesrow terminator=Newlinecolumn separator=Comma