Legacy Pipeline Atlas worker-1snapshot 2026-07-15

HL7 real-time feed · ClarityFlow pipeline

StrideCare · Flow-HL7-Processing

Overall Processing job for HL7 pipeline

pipeline StrideCare/Flow-HL7-Processing · db StrideCare_ProdMirror · updated 2026-04-20
classification: flow · 8 Flow markers

trigger

How it's scheduled

Real-time loop — every 10 min (~144×/day)

New appointments land continuously on the HL7 real-time feed. Front-of-house work is time-boxed — the estimate and letter have to reach the patient before the visit — so the pipeline polls every 10 minutes to check eligibility and price the good-faith estimate within minutes of an appointment being booked, rather than waiting for an overnight batch. It stands down while Daily - Processing - StrideCare runs (the heavier nightly pass).

Scheduled taskCadenceServerStateCoordination
\MDC\HL7 - Processing - StrideCareevery 10 min (from 00:03)prod-db-1enabledyields to Daily - Processing - StrideCare

shape

Against the canonical Flow spine

Every Flow pipeline is a variation on one shape. Lit stages are the ones this pipeline runs; the labels match the capability lens.

Ingest
HL7 real-time feed
→
Eligibility & benefits
EligibilityBenefitsDiscovery
→
Estimate
BundlesEstimate
→
Letters
→
Work queue & sync
Work queueDashboardsSync

computed concepts · from the SQL

What it computes

Business concepts mined from this pipeline's SQL text — the meaning behind the typed steps. Each links to the concept lens (who else computes it).

Coverage status

task tree

What the pipeline runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

flow

Flow-HL7-Processing

10 tasks · StrideCare
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. LoadHL7FilesLoadHL7Files
    Parses and imports patient demographics, visits, and charges from HL7 message files located in a specified directory.
    message folder path={HL7Directory}message processed folder path={HL7Archive}add timestamp to file name
  2. HL7ProcessLog + HL7Deltasqlflow_hl7_processing__hl7processlog_hl7delta.sql
    ✨ Initializes the HL7 process log and identifies the latest scheduling and patient messages from the archive for delta processing.
    writes HL7ADTBatchHL7DeltaHL7ProcessLogHL7ProcessLogArchiveKeysHL7SIUBatch · reads HL7ADTBatchHL7ArchiveHL7ProcessLogHL7SIUBatchTransformPatientTransformVisit
  3. ▶Flow-HL7-Transformsub-job · 9↗HL7 Transformation Layer
    1. TruncateVisitDeltasqlflow_hl7_transform__truncatevisitdelta.sql
      ✨ Clears the visit delta table to prepare for a fresh set of changed records in the current pipeline run.
      writes VisitDelta
    2. ImportHL7ADTCombinedsqlflow_hl7_transform__importhl7adtcombined.sql
      ✨ Consolidates patient demographics and insurance information from HL7 ADT messages into a unified staging table for further processing.
      writes ImportHL7ADTCombined
    3. TransformPatientsqlflow_hl7_transform__transformpatient.sql
      ✨ Synchronizes the patient transformation table by merging the latest demographic updates from both ADT and visit-based HL7 messages.
      writes TransformPatient · reads HL7ArchiveHL7DeltaHL7VisitImportHL7ADTCombined
      ↳ feeds from ImportHL7ADTCombined
    4. ImportTransformPatientInsurancesqlflow_hl7_transform__importtransformpatientinsurance.sql
      ✨ Extracts and maps the most recent primary, secondary, and tertiary insurance details from consolidated HL7 messages for each patient.
      writes ImportTransformPatientInsurance · reads ImportHL7ADTCombinedInsuranceMap
      ↳ feeds from ImportHL7ADTCombined
    5. TransformPatientInsurance+VisitDeltasqlflow_hl7_transform__transformpatientinsurance_visitdelta.sql
      ✨ Synchronizes patient insurance records and flags upcoming visits for reprocessing when insurance information changes.
      writes TransformPatientInsuranceVisitDelta · reads InsuranceChangesTransformVisitimporttransformpatientinsurance
      ↳ feeds from ImportTransformPatientInsurance, MergeTransformVisit+VisitDelta
    6. ImportTransformVisitsqlflow_hl7_transform__importtransformvisit.sql
      ✨ Builds the visit transformation table by mapping appointment details, facilities, and resolving provider identifiers from HL7 scheduling messages.
      writes ImportTransformVisit · reads HL7DeltaHL7VisitSourceProvider_33143
    7. MergeTransformVisit+VisitDeltasqlflow_hl7_transform__mergetransformvisit_visitdelta.sql
      ✨ Updates the transformed visit table with staged appointment data and records new or modified visits in the delta tracking table.
      writes TransformVisitVisitDelta · reads ImportTransformVisitVisitDelta
      ↳ feeds from ImportTransformVisit, TransformPatientInsurance+VisitDelta, TruncateVisitDelta
    8. ImportTransformVisitInsurancesqlflow_hl7_transform__importtransformvisitinsurance.sql
      ✨ Builds the visit insurance import table by mapping patient insurance records to specific visits based on coordination of benefits.
      writes ImportTransformVisitInsurance · reads TransformPatientInsuranceTransformVisitVisitDelta
      ↳ feeds from MergeTransformVisit+VisitDelta, TransformPatientInsurance+VisitDelta, TruncateVisitDelta
    9. MergeTransformVisitInsurancesqlflow_hl7_transform__mergetransformvisitinsurance.sql
      ✨ Refreshes the visit insurance table by replacing existing records with updated insurance details from the staging table.
      writes TransformVisitInsurance · reads ImportTransformVisitInsurance
      ↳ feeds from ImportTransformVisitInsurance
  4. LoadPatientsLoadPatients
    Upsert patient records into the patient dimension.
    · reads PatientTransformPatient
    custom patient query
  5. ▶Load-Entitiessub-job · 2↗Load Facility, Provider
    1. Load FacilityLoadEntities
      writes Facility · reads SourceDepartmentfacilitysourcefacilitymapping
      entity type=Facilitycustom query
    2. Load Providersqlload_entities__load_provider.sql
      ✨ Updates the provider registry with names, NPI numbers, and taxonomy codes from source system data.
      writes Provider · reads SourceProvider
  6. ▶Flow-HL7-Transform-LoadDimensionMemberssub-job · 9↗
    1. LoadInsuranceDimensionMembersLoadInsuranceDimensionMembersdisabled
      Synchronize insurance-specific dimension members from the insurance table to update contract and eligibility filtering options across the application.
      writes DimensionMember
      load insuranceload quote insuranceload eligibility insuranceDISABLED
    2. Load Time Dimensionssqlflow_hl7_transform_loaddimensionmembers__load_time_dimensions.sql
      ✨ Builds and updates time-based dimension members for days, months, and years based on the range of scheduled appointment dates.
      writes DimensionMember · reads TransformVisit
    3. Load VisitStatus Dimensionsqlflow_hl7_transform_loaddimensionmembers__load_visitstatus_dimension.sql
      ✨ Loads visit status dimension members from appointment data to ensure all scheduling statuses are available for reporting and filtering.
      writes DimensionMember · reads TransformVisit
    4. Load Provider Dimensionsqlflow_hl7_transform_loaddimensionmembers__load_provider_dimension.sql
      ✨ Updates provider and provider type dimensions to maintain a hierarchical relationship between individual clinicians and their professional categories.
      writes DimensionMember · reads Provider
    5. Load Facility Dimensionssqlflow_hl7_transform_loaddimensionmembers__load_facility_dimensions.sqldisabled
      ✨ Loads facility dimension members and their parent groups to organize service locations for consistent reporting across the organization.
      writes DimensionMember · reads Facility
    6. Load VisitType Dimensionssqlflow_hl7_transform_loaddimensionmembers__load_visittype_dimensions.sql
      ✨ Loads visit type dimension members by consolidating appointment codes and descriptions from multiple source systems for standardized visit categorization.
      writes DimensionMember · reads SourceAppointmentTypeSourceAppointmentType_33143TransformVisit
    7. Load VisitTypeCategory Dimensionssqlflow_hl7_transform_loaddimensionmembers__load_visittypecategory_dimensions.sql
      ✨ Builds the visit type category dimension by extracting unique parent classifications from existing visit type records.
      writes DimensionMember · reads DimensionMember
      ↳ feeds from Load Provider Dimension, Load SourceInsurance Dimensions, Load Time Dimensions, Load VisitStatus Dimension, Load VisitType Dimensions
    8. Load SourceInsurance Dimensionssqlflow_hl7_transform_loaddimensionmembers__load_sourceinsurance_dimensions.sql
      ✨ Loads source insurance and insurance parent dimensions to map specific insurance packages to their broader reporting categories.
      writes DimensionMember · reads AccountInsuranceDimensionMemberInsuranceMapSourcePayer
      ↳ feeds from Load Provider Dimension, Load Time Dimensions, Load VisitStatus Dimension, Load VisitType Dimensions, Load VisitTypeCategory Dimensions
    9. Load State Dimensionssqlflow_hl7_transform_loaddimensionmembers__load_state_dimensions.sqldisabled
      ✨ Updates state dimensions using facility location data to allow for geographic segmentation of healthcare services and revenue.
      writes DimensionMember · reads Facility
  7. ▶Flow-HL7-Processing-LoadVisitssub-job · 20↗
    1. Load TempBatchVisitsqlflow_hl7_processing_loadvisits__load_tempbatchvisit.sqldisabled
      ✨ Builds a temporary batch table to identify upcoming visits requiring initial or follow-up insurance eligibility and benefit verification.
      writes TempBatchVisitVisitEligServiceTypesVisitServiceTypes · reads DimensionMemberTempBatchVisitTransformVisitTransformVisitInsuranceTransformVisitInsuranceCoverageStatusVisitEligServiceTypesVisitServiceTypes
    2. Augment Visit Deltasqlflow_hl7_processing_loadvisits__augment_visit_delta.sqldisabled
      ✨ Updates the visit delta table by adding records flagged as requiring new insurance eligibility lookups from the batch process.
      writes VisitDelta · reads TempBatchVisitVisitDelta
    3. ReprocessChangedConfigurationsReprocessChangedConfigurations
      Identify and queue visits or accounts affected by configuration changes to ensure historical data reflects updated pricing or insurance rules.
      reprocess visits
    4. Augment VisitDelta - ReprocessChangedConfigssqlflow_hl7_processing_loadvisits__augment_visitdelta_reprocesschangedconfigs.sql
      ✨ Builds a lookup for visits requiring reprocessing and adds them to the change tracking table following configuration updates.
      writes VisitDeltaVisitKeyLookup · reads TransformVisitVisitDeltaVisitKeyLookup
    5. LoadVisitBatchLoadVisitBatch
      Load scheduled visits and associated charges into the processing pipeline using custom SQL queries for pricing estimation and quote generation.
      writes QuoteBatchVisitBatch · reads FacilityInsuranceMapPatientTransformVisitTransformVisitInsuranceVisitVisitDelta
      ↳ feeds from Augment VisitDelta - ReprocessChangedConfigs, Sync Visits and Quotes
      custom visit queryauto charge querycustom service type querycustom coverage queryadd zero charge
    6. ▶Flow-HL7-Processing-LoadCustomPropertiessub-job · 2↗Load custom properties from Load-Visits
      1. UpdateVisitCustomPropertyFromQueryUpdateVisitCustomPropertyFromQuerydisabled
        · reads InsuranceSearch_ResultTransformVisitInsuranceCoverageStatusVisitBatch
        custom visit update custom property queryDISABLED
      2. LoadCustomNotesCustomPropertyLoadCustomNotesCustomPropertydisabled
        · reads BundleNotesMappingHL7DeltaHL7VisitVisitBatch
        entity=Visitcustom property key=CustomNotescustom querybatch modeDISABLED
    7. AutoApplyBundlesToVisitBatchAutoApplyBundlesToVisitBatch
      Applies matching charge bundles to batch visits based on facility and insurance to ensure consistent pricing across service types.
    8. CheckBenefitsflow
      Verifies insurance eligibility and retrieves detailed benefits information for visits by making real-time API calls to insurance providers.
      auto query
    9. Re-Check Benefitsflowdisabled
      Verifies insurance eligibility and retrieves detailed benefits information for visits by making real-time API calls to insurance providers.
      · reads EligibilityStatusMapEligibilityTxnTempBatchVisitVisitBatch
      custom queryDISABLED
    10. AutoApplyBenefitsAutoApplyBenefits
      Populates insurance benefits like copays and deductibles on batch visits using data from eligibility verification transactions.
    11. CalculateVisitsflow
      Compute the good-faith estimate (CalculateVisits).
      · reads DimensionMemberVisitBatch
      ↳ feeds from LoadVisitBatch
      custom querycalculate chargesbatch mode
    12. LogVisitChangeEventsBatchLogVisitChangeEventsBatch
      Compare batch visits against production records to detect and log specific property changes for auditing and compliance tracking.
    13. Load TransformVisitInsuranceCoverageStatussqlflow_hl7_processing_loadvisits__load_transformvisitinsurancecoveragestatus.sql
      ✨ Loads insurance coverage status by calculating the latest eligibility transaction results for visits in the current batch.
      writes TempEligibilityStatsTransformVisitInsuranceCoverageStatus · reads TempEligibilityStatsTransformVisitInsuranceVisitBatch
      ↳ feeds from LoadVisitBatch
    14. ▶Flow-HL7-Processing-CustomPropertyCoverageStatussub-job · 3↗
      1. Load Primary Coverage StatusUpdateCustomPropertyFromQuery
        · reads CustomPropertyMapEligibilityTxnVisitBatchVisitCoverageBatch
        entity=Visitcustom property key=PrimaryCoverageStatuscustom querybatch mode
      2. Load Secondary Coverage StatusUpdateCustomPropertyFromQuery
        · reads CustomPropertyMapEligibilityTxnVisitBatchVisitCoverageBatch
        entity=Visitcustom property key=SecondaryCoverageStatuscustom querybatch mode
      3. Load Tertiary Coverage StatusUpdateCustomPropertyFromQuerydisabled
        · reads TransformVisitInsuranceCoverageStatusVisitBatch
        entity=Visitcustom property key=TertiaryCoverageStatuscustom querybatch modeDISABLED
    15. Sync Visits and QuotesSyncBatch
      Synchronizes processed data from batch staging tables to production tables, updating visits, quotes, and custom property mappings.
      writes CustomPropertyMapQuoteVisitVisitChangeEvent · reads CustomPropertyMapBatchQuoteBatchVisitBatchVisitChangeEventBatch
      ↳ feeds from LoadVisitBatch
      sync quotesync visitsync custom property mapsync visit change event
    16. ExportBatchVisitEligibilityflowdisabled
      Push the batch to the app / export results.
      · reads EligibilityTxnVisitBatch
      custom querytable name=BatchEligibility_Resultsarchive table name=BatchEligibility_ResultsArchiveDISABLED
    17. SearchForInsuranceflowdisabled
      Find coverage for visits missing insurance.
      · reads EligibilityTxnBatch
      custom querytable name=InsuranceSearch_Resultbatch modeDISABLED
    18. Generate-Reportsub-jobdisabled
    19. Load-Visit-Factsub-jobdisabled
    20. Update-Dashboard-Tablessub-jobdisabled
  8. UpdateHL7ProcessLogsqlflow_hl7_processing__updatehl7processlog.sql
    ✨ Updates the HL7 process log to mark the most recent active processing task as completed.
    · reads HL7ProcessLog
    ↳ feeds from HL7ProcessLog + HL7Delta
  9. WorkqueueAssignmentWorkqueueAssignment
    Assigns accounts or visits to workqueue stacks by evaluating matching criteria and updating item lists based on search terms.
  10. UpdateDashboardTablesUpdateDashboardTablesdisabled
    Regenerates optimized aggregate tables for all dashboard reports and updates their definitions to reflect the latest source data.
    DISABLED

markers

Why it classified as flow

Front-of-house actions found anywhere in the tree (including nested sub-jobs).

CalculateVisits
Compute the good-faith estimate
CheckBenefits
Real-time eligibility (270/271) benefit lookup
ExportBatchVisitEligibility
Export eligibility results
Load TransformVisitInsuranceCoverageStatus
ClarityFlow front-of-house step
LoadVisitBatch
ClarityFlow front-of-house step
SearchForInsurance
Insurance discovery for visits missing coverage
auto_apply_bundles
Apply procedure bundles for the estimate
auto_benefits
Auto-apply parsed benefits to visits