Legacy Pipeline Atlas worker-1snapshot 2026-07-15

sub-job

ISpine · RevFind-EDI-Processing

called by RevFind-Daily-Processing

sub-job ISpine/RevFind-EDI-Processing · db ISpine_ProdMirror · updated 2026-03-20

task tree

What the sub-job runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

sub-job

RevFind-EDI-Processing

5 tasks · ISpine
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. Download EDI & Archive 835sDownload
    Downloads files from remote FTP or SFTP servers to local directories with support for archiving and parallel transfers.
    server=ISpine_ProdMirror-mdcssh-sftpremote directory=/835/local directory={SourceDataFolder}
  2. Download EDI & Archive 837sDownload
    Downloads files from remote FTP or SFTP servers to local directories with support for archiving and parallel transfers.
    server=ISpine_ProdMirror-mdcssh-sftpremote directory=/local directory={SourceDataFolder}
  3. ▶RevFind-EDI-LoadFilessub-job · 2↗
    1. Bulk Insert into DatabaseExecuteProcess
      command=powershell.exe
    2. Archive EDI FilesExecuteProcess
      command=cmd.exe
  4. ▶RevFind-EDI-TransformAndParseEDIsub-job · 5↗
    1. EDITransformsqlrevfind_edi_transformandparseedi__editransform.sql
      ✨ Loads unique EDI messages from staging into the transformation table while preventing duplicate records.
      writes EDITransform · reads EDIFileStagingEDITransform
    2. EDIBatchsqlrevfind_edi_transformandparseedi__edibatch.sql
      ✨ Builds a batch of unprocessed EDI messages, excluding empty records, for subsequent parsing and transformation.
      writes EDIBatch
    3. Clean EDIBatch (for bug w EDIFabric)sqlrevfind_edi_transformandparseedi__clean_edibatch_for_bug_w_edifabric.sqldisabled
      ✨ Updates EDI message formatting by replacing specific delimiters to ensure compatibility with the parsing engine.
      · reads EDIBatch
    4. EDIParserEDIParser
      writes EDIBatch
      table name=EDIBatch
    5. ▶RevFind-EDI-LoadMetadatasub-job · 4↗
      1. Load EDIFacilityMapsqlrevfind_edi_loadmetadata__load_edifacilitymap.sql
        ✨ Loads the facility map with unique billing and service facility details extracted from electronic claim transactions.
        writes EDIFacilityMap · reads EDIFacilityMapTxn837P
      2. Load EDIProviderMapsqlrevfind_edi_loadmetadata__load_ediprovidermap.sqldisabled
        ✨ Builds the provider map by combining rendering provider information from claim transactions with national provider registry data.
        writes EDIProviderMap · reads EDIProviderMapNPIDataTxn837P
      3. Load EDIPayerMapsqlrevfind_edi_loadmetadata__load_edipayermap.sql
        ✨ Builds a mapping table of payer names and filing indicators from electronic remittance transactions to standardize payer metadata.
        writes EDIPayerMap · reads Txn835Txn835ClaimPayment
      4. ExecuteMergeSql-EDIProviderMapExecuteMergeSql-EDIProviderMap
        writes EDIProviderMap · reads EDIProviderMapTxn837ITxn837P
        merge data source type=ThisDatabasetable name=EDIProviderMapmerge mode=InsertUpdatebulk copy timeout seconds=300bulk copy use table lock
  5. ▶RevFind-Load-Transform-EDIDatasub-job · 18↗
    1. Load RemitDeltasqlrevfind_load_transform_edidata__load_remitdelta.sql
      ✨ Identifies recently processed or updated electronic remittance claims to determine which records require incremental transformation and loading.
      writes RemitDelta · reads EDIFilesProcessedRemitDeltaTransformRemitTxn835Txn835ClaimPayment
      ↳ feeds from Load TempRemitCOB, Load TransformRemit
    2. Load TransformRemitsqlrevfind_load_transform_edidata__load_transformremit.sql
      ✨ Extracts and transforms electronic remittance advice data from raw transaction files into a structured format for processing.
      writes TransformRemit · reads Txn835Txn835ClaimPaymentTxn835ClaimPaymentLineTxn835ClaimPaymentOtherClaimAmount
    3. Load TransformRemitEncounterMapsqlrevfind_load_transform_edidata__load_transformremitencountermap.sqldisabled
      ✨ Maps remittance claim identifiers to internal account records to link insurance payments with specific patient encounters.
      writes TransformRemitEncounterMap · reads TransformRemitEncounterMap
    4. Update TransformRemitEncounterMapsqlrevfind_load_transform_edidata__update_transformremitencountermap.sqldisabled
      ✨ Updates remittance mapping records with patient account identifiers by matching service dates and charge IDs at the line level.
      · reads TransformChargeTransformRemitEncounterMapTransformRemitLinerem
    5. Load TempRemitCOB (old)sqlrevfind_load_transform_edidata__load_tempremitcob_old.sqldisabled
      ✨ Builds a temporary table to determine claim status, member IDs, and coordination of benefits order for remittance data.
    6. Load TempRemitCOBsqlrevfind_load_transform_edidata__load_tempremitcob.sql
      ✨ Determines the coordination of benefits order and current claim status by analyzing historical remittance and adjustment data.
      writes TempRemitCOBTransformRemit · reads TempRemitCOBTransformRemitTransformRemitAdjustment
      ↳ feeds from Load TransformRemit, Load TransformRemitAdjustment
    7. Load TransformRemitAdjustmentsqlrevfind_load_transform_edidata__load_transformremitadjustment.sql
      ✨ Loads claim and line-level adjustments by unpivoting reason codes and amounts from electronic remittance advice transactions.
      writes TransformRemitAdjustment · reads TransformRemitTxn835ClaimAdjustment
      ↳ feeds from Load TempRemitCOB, Load TransformRemit
    8. Load TransformRemitLinesqlrevfind_load_transform_edidata__load_transformremitline.sql
      ✨ Loads detailed remittance line items, mapping procedure codes, service dates, and payment amounts from electronic remittance advice.
      writes TransformRemitLine · reads TransformRemitTxn835ClaimPaymentLine
      ↳ feeds from Load TempRemitCOB, Load TransformRemit
    9. Load TransformTxn837sqlrevfind_load_transform_edidata__load_transformtxn837.sql
      ✨ Consolidates and transforms professional and institutional claim submission data into a unified format for billing tracking.
      writes TransformTxn837 · reads Txn837ITxn837IServiceLineTxn837PTxn837PServiceLine
    10. Load TransformTxn837Linesqlrevfind_load_transform_edidata__load_transformtxn837line.sql
      ✨ Builds a unified table of professional and institutional claim service lines, extracting procedure codes, charges, and provider details.
      writes TransformTxn837Line · reads TransformTxn837Txn837ITxn837IServiceLineTxn837PServiceLine
      ↳ feeds from Load TransformTxn837
    11. Load TransformAccountsqlrevfind_load_transform_edidata__load_transformaccount.sql
      ✨ Loads account-level records by mapping claim data to patients, providers, and insurance payers using the latest claim versions.
      writes TransformAccount · reads EDIFacilityMapTransformTxn837
      ↳ feeds from Load TransformTxn837
    12. Load TransformChargesqlrevfind_load_transform_edidata__load_transformcharge.sql
      ✨ Transforms claim service lines into individual charge records linked to accounts, capturing procedure codes, units, and financial amounts.
      writes TransformCharge · reads TransformAccountTransformTxn837TransformTxn837Line
      ↳ feeds from Load TransformAccount, Load TransformTxn837, Load TransformTxn837Line
    13. Load TransformChargeFamilyPoolsqlrevfind_load_transform_edidata__load_transformchargefamilypool.sql
      ✨ Maps historical claim service lines to their latest charge versions to establish a consistent charge family for longitudinal tracking.
      writes TransformChargeFamilyPool · reads TransformChargeTransformChargeFamilyPoolTransformTxn837TransformTxn837Line
      ↳ feeds from Load TransformCharge, Load TransformTxn837, Load TransformTxn837Line
    14. Load TransformPatientMergeSql
      writes TransformPatient · reads TransformAccountTransformTxn837
      ↳ feeds from Load TransformAccount, Load TransformTxn837
      merge data source type=ThisDatabasetable name=TransformPatientmerge mode=InsertUpdatebulk copy timeout seconds=300bulk copy use table lock
    15. Load TransformRemitAccountMapsqlrevfind_load_transform_edidata__load_transformremitaccountmap.sql
      ✨ Matches remittance advice records to patient accounts using tiered logic based on identifiers like Tax ID and service dates.
      writes TransformRemitAccountMap · reads TransformAccountTransformRemit
      ↳ feeds from Load TempRemitCOB, Load TransformAccount, Load TransformRemit
    16. Load TransformRemitTransactionssqlrevfind_load_transform_edidata__load_transformremittransactions.sql
      ✨ Consolidates remittance payments and adjustments into a single transaction table, categorizing reason codes for financial reporting and analysis.
      writes TransformRemitTransactions · reads AdjustmentCodeRollupTransformRemitTransformRemitAdjustmentTransformRemitLine
      ↳ feeds from Load TempRemitCOB, Load TransformRemit, Load TransformRemitAdjustment, Load TransformRemitLine
    17. Load TransformChargeRemitMatchsqlrevfind_load_transform_edidata__load_transformchargeremitmatch.sql
      ✨ Matches normalized remittance service lines to specific charges within the charge family pool using tiered logic and procedure codes.
      writes TransformChargeRemitMatch · reads TransformChargeFamilyPoolTransformChargeRemitMatchTransformRemitTransformRemitAccountMapTransformRemitLine
      ↳ feeds from Load TempRemitCOB, Load TransformChargeFamilyPool, Load TransformRemit, Load TransformRemitAccountMap, Load TransformRemitLine
    18. Load TransformAccountRemitsqlrevfind_load_transform_edidata__load_transformaccountremit.sql
      ✨ Links remittance transactions to specific charges or accounts, providing a detailed view of payments and adjustments at the charge level.
      writes TransformAccountRemit · reads TransformAccountRemitTransformChargeRemitMatchTransformRemitAccountMapTransformRemitTransactions
      ↳ feeds from Load TransformChargeRemitMatch, Load TransformRemitAccountMap, Load TransformRemitTransactions