Legacy Pipeline Atlas worker-1snapshot 2026-07-15

sub-job

TheOregonClinic · RevFind-EDI-Source-Processing

called by RevFind-EDI-Daily-Processing

sub-job TheOregonClinic/RevFind-EDI-Source-Processing · db TheOregonClinic_ProdMirror · updated 2026-06-16

task tree

What the sub-job runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

sub-job

RevFind-EDI-Source-Processing

4 tasks · TheOregonClinic
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. Download EDI & Archive 835sDownloaddisabled
    Downloads files from remote FTP or SFTP servers to local directories with support for archiving and parallel transfers.
    remote directory=/local directory={SourceDataFolder}DISABLED
  2. Clean up unsupported filesExecuteProcess
  3. ▶RevFind-EDI-Source-LoadFilessub-job · 2↗
    1. Bulk Insert into DatabaseExecuteProcess
      command=powershell.exe
    2. Archive EDI FilesExecuteProcess
      command=cmd.exe
  4. ▶RevFind-EDI-Source-ParseEDIsub-job · 5↗
    1. EDITransformsqlrevfind_edi_source_parseedi__editransform.sql
      ✨ Loads unique EDI messages from staging into the transformation table while preventing duplicate records.
      writes EDITransform · reads EDIFileStagingEDITransform
    2. EDIBatchsqlrevfind_edi_source_parseedi__edibatch.sql
      ✨ Builds a batch of unprocessed EDI messages, excluding empty records, for subsequent parsing and transformation.
      writes EDIBatch
    3. Clean EDIBatch (for bug w EDIFabric)sqlrevfind_edi_source_parseedi__clean_edibatch_for_bug_w_edifabric.sqldisabled
      ✨ Updates EDI message formatting by replacing specific delimiters to ensure compatibility with the parsing engine.
      · reads EDIBatch
    4. EDIParserEDIParser
      writes EDIBatch
      table name=EDIBatch
    5. ▶RevFind-EDI-Source-LoadMetadatasub-job · 4↗
      1. Load EDIFacilityMapsqlrevfind_edi_source_loadmetadata__load_edifacilitymap.sql
        ✨ Loads the facility map with unique billing and service facility details extracted from electronic claim transactions.
        writes EDIFacilityMap · reads EDIFacilityMapTxn837P
      2. Load EDIProviderMapsqlrevfind_edi_source_loadmetadata__load_ediprovidermap.sqldisabled
        ✨ Builds the provider map by combining rendering provider information from claim transactions with national provider registry data.
        writes EDIProviderMap · reads EDIProviderMapNPIDataTxn837P
      3. Load EDIPayerMapsqlrevfind_edi_source_loadmetadata__load_edipayermap.sql
        ✨ Builds a mapping table of payer names and filing indicators from electronic remittance transactions to standardize payer metadata.
        writes EDIPayerMap · reads Txn835Txn835ClaimPayment
      4. ExecuteMergeSql-EDIProviderMapExecuteMergeSql-EDIProviderMap
        writes EDIProviderMap · reads EDIProviderMapTxn837ITxn837P
        merge data source type=ThisDatabasetable name=EDIProviderMapmerge mode=InsertUpdatebulk copy timeout seconds=300bulk copy use table lock