Legacy Pipeline Atlas worker-1snapshot 2026-07-15

sub-job

ECP · TransformAndParseEDI

called by Process-EDI

sub-job ECP/TransformAndParseEDI · db ECP_ProdMirror · updated 2025-09-17

task tree

What the sub-job runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

sub-job

TransformAndParseEDI

5 tasks · ECP
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. EDITransformsqltransformandparseedi__editransform.sql
    ✨ Loads unique EDI messages from staging into the transformation table while preventing duplicate records.
    writes EDITransform · reads EDIFileStagingEDITransform
  2. EDIBatchsqltransformandparseedi__edibatch.sql
    ✨ Builds a batch of unprocessed EDI messages, excluding empty records, for subsequent parsing and transformation.
    writes EDIBatch
  3. Clean EDIBatch (for bug w EDIFabric)sqltransformandparseedi__clean_edibatch_for_bug_w_edifabric.sqldisabled
    ✨ Updates EDI message formatting by replacing specific delimiters to ensure compatibility with the parsing engine.
    · reads EDIBatch
  4. EDIParserEDIParser
    writes EDIBatch
    table name=EDIBatch
  5. ▶Load-EDI-Metadatasub-job · 3↗
    1. Load EDIFacilityMapsqlload_edi_metadata__load_edifacilitymap.sql
      ✨ Loads the facility map with unique billing and service facility details extracted from electronic claim transactions.
      writes EDIFacilityMap · reads EDIFacilityMapTxn837P
    2. Load EDIProviderMapsqlload_edi_metadata__load_ediprovidermap.sql
      ✨ Builds the provider map by combining rendering provider information from claim transactions with national provider registry data.
      writes EDIProviderMap · reads EDIProviderMapNPIDataTxn837P
    3. Load EDIPayerMapsqlload_edi_metadata__load_edipayermap.sql
      ✨ Builds a mapping table of payer names and filing indicators from electronic remittance transactions to standardize payer metadata.
      writes EDIPayerMap · reads Txn835Txn835ClaimPayment