Legacy Pipeline Atlas worker-1snapshot 2026-07-15

HL7 real-time feed · ClarityFlow pipeline

OrthoAlliance · Flow-34792-Processing

Overall Processing job for HL7 pipeline

pipeline OrthoAlliance/Flow-34792-Processing · db OrthoAlliance_ProdMirror · updated 2026-06-02
classification: flow · 8 Flow markers

trigger

How it's scheduled

Real-time loop — every 5 min (~228×/day)

New appointments land continuously on the HL7 real-time feed. Front-of-house work is time-boxed — the estimate and letter have to reach the patient before the visit — so the pipeline polls every 5 minutes to check eligibility and price the good-faith estimate within minutes of an appointment being booked, rather than waiting for an overnight batch.

Scheduled taskCadenceServerStateCoordination
\MDC\HL7 - Processing - OrthoAllianceevery 5 min (from 00:01)prod-db-1enabledstandalone

shape

Against the canonical Flow spine

Every Flow pipeline is a variation on one shape. Lit stages are the ones this pipeline runs; the labels match the capability lens.

Ingest
HL7 real-time feed
→
Eligibility & benefits
EligibilityBenefitsDiscovery
→
Estimate
BundlesEstimate
→
Letters
→
Work queue & sync
Work queueDashboardsSync

computed concepts · from the SQL

What it computes

Business concepts mined from this pipeline's SQL text — the meaning behind the typed steps. Each links to the concept lens (who else computes it).

Coverage status

task tree

What the pipeline runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

flow

Flow-34792-Processing

8 tasks · OrthoAlliance
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. LoadHL7FilesLoadHL7Files
    Parses and imports patient demographics, visits, and charges from HL7 message files located in a specified directory.
    message folder path={HL7Directory}message processed folder path={HL7Archive}add timestamp to file name
  2. HL7ProcessLog + HL7Deltasqlflow_34792_processing__hl7processlog_hl7delta.sql
    ✨ Identifies new scheduling messages from the archive and stages the most recent updates for processing in the delta table.
    writes HL7ADTBatchHL7DeltaHL7ProcessLogHL7ProcessLogArchiveKeysHL7SIUBatch · reads HL7ADTBatchHL7ArchiveHL7SIUBatchTransformPatientTransformVisit
  3. ▶Flow-34792-Transformsub-job · 9↗HL7 Transformation Layer
    1. TruncateOrthosVisitDeltasqlflow_34792_transform__truncateorthosvisitdelta.sql
      ✨ Clears the visit delta table to prepare for a fresh set of changed records in the current pipeline run.
      writes VisitDelta
    2. ImportHL7ADTCombinedsqlflow_34792_transform__importhl7adtcombined.sql
      ✨ Consolidates patient demographics and insurance details from HL7 messages into a unified table for further data transformation.
      writes ImportHL7ADTCombined
    3. TransformPatientsqlflow_34792_transform__transformpatient.sql
      ✨ Updates or inserts patient demographic records into the transformed patient table using the most recent HL7 message data.
      writes TransformPatient · reads HL7ArchiveHL7DeltaHL7VisitImportHL7ADTCombined
      ↳ feeds from ImportHL7ADTCombined
    4. ImportTransformPatientInsurancesqlflow_34792_transform__importtransformpatientinsurance.sql
      ✨ Loads patient insurance coverage details into a staging table, mapping source insurance identifiers to standardized insurance records.
      writes ImportTransformPatientInsurance · reads ImportHL7ADTCombinedInsuranceMap
      ↳ feeds from ImportHL7ADTCombined
    5. TransformPatientInsurance+VisitDeltasqlflow_34792_transform__transformpatientinsurance_visitdelta.sql
      ✨ Synchronizes patient insurance records and flags upcoming visits for reprocessing when insurance information changes.
      writes TransformPatientInsuranceVisitDelta · reads InsuranceChangesTransformVisitimporttransformpatientinsurance
      ↳ feeds from ImportTransformPatientInsurance, MergeTransformVisit+VisitDelta
    6. ImportTransformVisitsqlflow_34792_transform__importtransformvisit.sql
      ✨ Extracts and stages appointment data from HL7 messages, resolving provider identifiers and facility locations for visit transformation.
      writes ImportTransformVisit · reads HL7DeltaHL7VisitSourceProvider_34792
    7. MergeTransformVisit+VisitDeltasqlflow_34792_transform__mergetransformvisit_visitdelta.sql
      ✨ Updates the transformed visit table with staged appointment data and records new or modified visits in the delta tracking table.
      writes TransformVisitVisitDelta · reads ImportTransformVisitVisitDelta
      ↳ feeds from ImportTransformVisit, TransformPatientInsurance+VisitDelta, TruncateOrthosVisitDelta
    8. ImportTransformVisitInsurancesqlflow_34792_transform__importtransformvisitinsurance.sql
      ✨ Stages insurance information for specific visits by linking patient insurance records to visits flagged for update or creation.
      writes ImportTransformVisitInsurance · reads TransformPatientInsuranceTransformVisitVisitDelta
      ↳ feeds from MergeTransformVisit+VisitDelta, TransformPatientInsurance+VisitDelta, TruncateOrthosVisitDelta
    9. MergeTransformVisitInsurancesqlflow_34792_transform__mergetransformvisitinsurance.sql
      ✨ Refreshes the visit insurance table by replacing existing records with updated insurance details from the staging table.
      writes TransformVisitInsurance · reads ImportTransformVisitInsurance
      ↳ feeds from ImportTransformVisitInsurance
  4. LoadPatientsLoadPatients
    Upsert patient records into the patient dimension.
    · reads PatientTransformPatient
    custom patient query
  5. ▶Flow-34792-Transform-LoadDimensionMemberssub-job · 3↗
    1. Load Time Dimensionssqlflow_34792_transform_loaddimensionmembers__load_time_dimensions.sql
      ✨ Builds and updates time-based dimension members for days, months, and years based on the range of scheduled appointment dates.
      writes DimensionMember · reads TransformVisit
    2. Load VisitStatus Dimensionsqlflow_34792_transform_loaddimensionmembers__load_visitstatus_dimension.sql
      ✨ Loads appointment status values into the visit status dimension to track patient encounter progress.
      writes DimensionMember · reads TransformVisit
    3. Load VisitType Dimensionssqlflow_34792_transform_loaddimensionmembers__load_visittype_dimensions.sql
      ✨ Builds and updates visit type dimension members using the most recent appointment data from HL7 visit messages.
      writes DimensionMember · reads HL7Visit
  6. ▶Flow-34792-Processing-LoadVisitssub-job · 17↗
    1. ReprocessChangedConfigurationsReprocessChangedConfigurations
      Identify and queue visits or accounts affected by configuration changes to ensure historical data reflects updated pricing or insurance rules.
      reprocess visits
    2. ReprocessChangedConfigs Updatessqlflow_34792_processing_loadvisits__reprocesschangedconfigs_updates.sql
      ✨ Builds a lookup for visits requiring reprocessing and adds them to the change tracking table following configuration updates.
      writes VisitDeltaVisitKeyLookup · reads TransformVisitVisitDeltaVisitKeyLookup
    3. LoadVisitBatchLoadVisitBatch
      Load scheduled visits and associated charges into the processing pipeline using custom SQL queries for pricing estimation and quote generation.
      writes QuoteBatchVisitBatch · reads FacilityInsuranceMapPatientTransformVisitTransformVisitInsuranceVisitVisitDelta
      ↳ feeds from ReprocessChangedConfigs Updates, Sync Visits and Quotes
      custom visit queryauto charge querycustom service type querycustom coverage queryadd zero charge
    4. AutoApplyBundlesToVisitBatchAutoApplyBundlesToVisitBatchdisabled
      Applies matching charge bundles to batch visits based on facility and insurance to ensure consistent pricing across service types.
      DISABLED
    5. CheckBenefitsflow
      Verifies insurance eligibility and retrieves detailed benefits information for visits by making real-time API calls to insurance providers.
      auto query
    6. Re-Check Benefitsflowdisabled
      Verifies insurance eligibility and retrieves detailed benefits information for visits by making real-time API calls to insurance providers.
      · reads EligibilityStatusMapEligibilityTxnTempBatchVisitVisitBatch
      custom queryDISABLED
    7. AutoApplyBenefitsAutoApplyBenefits
      Populates insurance benefits like copays and deductibles on batch visits using data from eligibility verification transactions.
    8. CalculateVisitsflow
      Compute the good-faith estimate (CalculateVisits).
      · reads DimensionMemberVisitBatch
      ↳ feeds from LoadVisitBatch
      custom querycalculate chargesbatch mode
    9. LogVisitChangeEventsBatchLogVisitChangeEventsBatch
      Compare batch visits against production records to detect and log specific property changes for auditing and compliance tracking.
    10. Load TransformVisitInsuranceCoverageStatussqlflow_34792_processing_loadvisits__load_transformvisitinsurancecoveragestatus.sql
      ✨ Loads insurance coverage status by calculating the latest eligibility transaction results for visits in the current batch.
      writes TempEligibilityStatsTransformVisitInsuranceCoverageStatus · reads TempEligibilityStatsTransformVisitInsuranceVisitBatch
      ↳ feeds from LoadVisitBatch
    11. ▶Flow-34792-Processing-CustPropCoverageStatussub-job · 3↗
      1. Load Primary Coverage StatusUpdateCustomPropertyFromQuery
        · reads TransformVisitInsuranceCoverageStatusVisitBatch
        entity=Visitcustom property key=PrimaryCoverageStatuscustom querybatch mode
      2. Load Secondary Coverage StatusUpdateCustomPropertyFromQuery
        · reads TransformVisitInsuranceCoverageStatusVisitBatch
        entity=Visitcustom property key=SecondaryCoverageStatuscustom querybatch mode
      3. Load Tertiary Coverage StatusUpdateCustomPropertyFromQuery
        · reads TransformVisitInsuranceCoverageStatusVisitBatch
        entity=Visitcustom property key=TertiaryCoverageStatuscustom querybatch mode
    12. Sync Visits and QuotesSyncBatch
      Synchronizes processed data from batch staging tables to production tables, updating visits, quotes, and custom property mappings.
      writes CustomPropertyMapQuoteVisitVisitChangeEvent · reads CustomPropertyMapBatchQuoteBatchVisitBatchVisitChangeEventBatch
      ↳ feeds from LoadVisitBatch
      sync quotesync visitsync custom property mapsync visit change event
    13. ExportBatchVisitEligibilityflowdisabled
      Push the batch to the app / export results.
      · reads EligibilityTxnVisitBatch
      custom querytable name=BatchEligibility_Resultsarchive table name=BatchEligibility_ResultsArchiveDISABLED
    14. SearchForInsuranceflowdisabled
      Find coverage for visits missing insurance.
      · reads EligibilityTxnBatch
      custom querytable name=InsuranceSearch_Resultbatch modeDISABLED
    15. Generate-Reportsub-jobdisabled
    16. ▶Load-Visit-Factsub-job · 1↗
      1. Load VisitFactsqlload_visit_fact__load_visitfact.sql
        ✨ Refreshes the visit fact table by recalculating metrics for encounters with recent updates, payments, eligibility checks, or patient communications.
        writes VisitFact · reads EligibilityStatusMapEligibilityTxnPatientLetterPaymentTxnVisit
    17. ▶Update-Dashboard-Tablessub-job · 2↗
      1. ▶Load-Visit-Factsub-job · 1↗
        1. Load VisitFactsqlload_visit_fact__load_visitfact.sql
          ✨ Refreshes the visit fact table by recalculating metrics for encounters with recent updates, payments, eligibility checks, or patient communications.
          writes VisitFact · reads EligibilityStatusMapEligibilityTxnPatientLetterPaymentTxnVisit
      2. UpdateDashboardTablesUpdateDashboardTables
        Regenerates optimized aggregate tables for all dashboard reports and updates their definitions to reflect the latest source data.
  7. UpdateHL7ProcessLogsqlflow_34792_processing__updatehl7processlog.sql
    ✨ Updates the process log to completed status and records the last processed archive key for future incremental runs.
    writes HL7ProcessLogLastArchiveKey · reads HL7DeltaHL7ProcessLogHL7ProcessLogLastArchiveKey
    ↳ feeds from HL7ProcessLog + HL7Delta
  8. WorkqueueAssignmentWorkqueueAssignment
    Assigns accounts or visits to workqueue stacks by evaluating matching criteria and updating item lists based on search terms.

markers

Why it classified as flow

Front-of-house actions found anywhere in the tree (including nested sub-jobs).

CalculateVisits
Compute the good-faith estimate
CheckBenefits
Real-time eligibility (270/271) benefit lookup
ExportBatchVisitEligibility
Export eligibility results
Load TransformVisitInsuranceCoverageStatus
ClarityFlow front-of-house step
LoadVisitBatch
ClarityFlow front-of-house step
SearchForInsurance
Insurance discovery for visits missing coverage
auto_apply_bundles
Apply procedure bundles for the estimate
auto_benefits
Auto-apply parsed benefits to visits