Legacy Pipeline Atlas worker-1snapshot 2026-07-15

Batch / file feed · ClarityFlow pipeline

MNEye · Daily-Processing-Visits

pipeline MNEye/Daily-Processing-Visits · db MNEye_ProdMirror · updated 2025-10-15
classification: flow · 9 Flow markers

trigger

How it's scheduled

Chained — no clock of its own

This runs after its source-data load completes, as a follow-on stage rather than on an independent schedule.

Scheduled taskCadenceServerStateCoordination
\MDC\Daily - Processing - MNEye - Visitson demand / chainedprod-db-3enabledstandalone

shape

Against the canonical Flow spine

Every Flow pipeline is a variation on one shape. Lit stages are the ones this pipeline runs; the labels match the capability lens.

Ingest
Batch / file feed
→
Eligibility & benefits
EligibilityBenefits
→
Estimate
BundlesEstimate
→
Letters
LettersFutureReminders
→
Work queue & sync
Sync

computed concepts · from the SQL

What it computes

Business concepts mined from this pipeline's SQL text — the meaning behind the typed steps. Each links to the concept lens (who else computes it).

Payers in SQLAetnaAnthemBCBSCignaHumanaMedicaidMedicareTricare

task tree

What the pipeline runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

flow

Daily-Processing-Visits

4 tasks · MNEye
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. ▶Load-Visit-Transform-Tables-Flowsub-job · 5↗Loads transform tables for Visits
    1. Load VisitDeltasqlload_visit_transform_tables_flow__load_visitdelta.sql
      ✨ Identifies appointments and insurance records requiring updates by comparing source timestamps against existing transformed visit data.
      writes VisitDelta · reads SourceAppointmentSourcePatientInsuranceTransformVisitVisitDelta
      ↳ feeds from Merge TransformVisit
    2. ▶Load-SourceAppointmentChain-Flowsub-job · 1↗
      1. Load SourceAppointmentChainsqlload_sourceappointmentchain_flow__load_sourceappointmentchain.sql
        ✨ Builds a chain of rescheduled appointments to identify the most recent record for each original appointment number.
        writes SourceAppointmentChain · reads SourceAppointmentVisitDelta
    3. Merge TransformVisitMergeSql
      writes TransformVisit · reads SourceAppointmentSourceAppointmentChainVisitDelta
      ↳ feeds from Load VisitDelta
      merge data source type=ThisDatabasetable name=TransformVisitmerge mode=InsertUpdatebulk copy timeout seconds=300bulk copy use table lock
    4. Load TransformVisitInsurancesqlload_visit_transform_tables_flow__load_transformvisitinsurance.sqldisabled
      ✨ Loads insurance coverage details for visits, determining coordination of benefits and mapping source payers to standardized insurance categories.
      writes TransformVisitInsurance · reads InsuranceMapSourcePatientSourcePatientInsuranceTransformPatientTransformVisitVisitDelta
    5. Merge TransformVisitInsuranceMergeSql
      writes TransformVisitInsurance · reads SourcePatientSourcePatientInsuranceTransformVisitVisitDelta
      ↳ feeds from Load VisitDelta, Merge TransformVisit
      merge data source type=ThisDatabasetable name=TransformVisitInsurancemerge mode=InsertUpdateHardDeletebulk copy timeout seconds=300bulk copy use table lock
  2. ▶Load-Visits-Flowsub-job · 18↗Removing references to TempVisitBundleCharge, which is loaded by ad-hoc tables, to transition MNEye to fully using the Bundle entity instead -CW [date]
    1. ReprocessChangedConfigurationsReprocessChangedConfigurations
      Identify and queue visits or accounts affected by configuration changes to ensure historical data reflects updated pricing or insurance rules.
      reprocess visits
    2. Augment VisitDelta from Change Configssqlload_visits_flow__augment_visitdelta_from_change_configs.sql
      ✨ Adds visits from the reprocess queue to the delta table to ensure they are included in the next processing cycle.
      writes VisitDelta · reads VisitVisitDeltaVisitReprocessQueueItem
      ↳ feeds from Sync Quotes, Visits, and CustomProperties
    3. LoadVisitsLoadVisits
      Load scheduled visits and associated charges into the processing pipeline using custom SQL queries for pricing estimation and quote generation.
      writes QuoteBatchVisitBatch · reads FacilityInsuranceMapPatientSourceEventCategoryMapSourceEventTypeMapTransformVisitTransformVisitInsuranceVisit
      ↳ feeds from Augment VisitDelta from Change Configs, Sync Quotes, Visits, and CustomProperties
      custom visit queryauto charge querycustom service type querycustom coverage queryadd zero charge
    4. AutoApplyBundlesToVisitBatchAutoApplyBundlesToVisitBatch
      Applies matching charge bundles to batch visits based on facility and insurance to ensure consistent pricing across service types.
    5. Load TempBatchVisitssqlload_visits_flow__load_tempbatchvisits.sqldisabled
      ✨ Loads a temporary table with visits eligible for batch insurance verification based on scheduling, service type, and prior transaction history.
      writes TempBatchVisit
    6. CheckBenefitsflow
      Verifies insurance eligibility and retrieves detailed benefits information for visits by making real-time API calls to insurance providers.
      auto query
    7. Auto BenefitsAutoBenefits
      Populates insurance benefits like copays and deductibles on batch visits using data from eligibility verification transactions.
    8. Calculate Visitsflow
      Compute the good-faith estimate (CalculateVisits).
      · reads ContractMapDimensionMemberVisitBatch
      ↳ feeds from Load Visits
      custom querycalculate chargesupdate dimensionsbatch mode
    9. AutoSendLettersAutoSendLetters
      Generates and sends patient cost estimate letters for visits in the batch table based on configured qualification and communication rules.
    10. AutoSendLettersForFutureVisitsAutoSendLettersForFutureVisits
      Generates and sends cost estimate letters for upcoming scheduled visits based on patient preferences and configured qualification criteria.
    11. AutoSendReminderAutoSendReminder
      Resends patient cost estimate letters via email or SMS if they remain unviewed after a specified time interval.
    12. LogVisitChangeEventsBatchLogVisitChangeEventsBatch
      Compare batch visits against production records to detect and log specific property changes for auditing and compliance tracking.
    13. VisitAfterDate1.1.26VisitAfterDate1.1.26
      · reads CustomPropertyMapVisitBatch
      ↳ feeds from Load Visits, Sync Quotes, Visits, and CustomProperties
      entity=Visitcustom property key=VisitAfterDate1.1.26custom querybatch mode
    14. PrimaryCoverageStatus (CustomProp)UpdateCustomPropertyFromQuery
      · reads CustomPropertyMapEligibilityTxnVisitBatchVisitCoverageBatch
      ↳ feeds from Load Visits, Sync Quotes, Visits, and CustomProperties
      entity=Visitcustom property key=PrimaryCoverageStatuscustom querybatch mode
    15. SecondaryCoverageStatus (CustomProp)UpdateCustomPropertyFromQuery
      · reads CustomPropertyMapEligibilityTxnVisitBatchVisitCoverageBatch
      ↳ feeds from Load Visits, Sync Quotes, Visits, and CustomProperties
      entity=Visitcustom property key=SecondaryCoverageStatuscustom querybatch mode
    16. MedicarePartC Custom Prop (need to refine)UpdateCustomPropertyFromQuery
      · reads CustomPropertyMapEligibilityTxnVisitBatch
      ↳ feeds from Load Visits, Sync Quotes, Visits, and CustomProperties
      entity=Visitcustom property key=HasMedicarePartCCoverageauto querybatch mode
    17. Sync Quotes, Visits, and CustomPropertiesSyncBatch
      Synchronizes processed data from batch staging tables to production tables, updating visits, quotes, and custom property mappings.
      writes CustomPropertyMapQuoteVisitVisitChangeEvent · reads CustomPropertyMapBatchQuoteBatchVisitBatchVisitChangeEventBatch
      ↳ feeds from Load Visits
      sync quotesync visitsync custom property mapsync visit change event
    18. ▶Load-Visit-Factsub-job · 1↗
      1. Load VisitFactsqlload_visit_fact__load_visitfact.sql
        ✨ Updates the visit fact table by refreshing records with recent activity, including insurance, eligibility, and payment status.
        writes VisitFactVisitFactDelta · reads EligibilityStatusMapEligibilityTxnFacilityPatientLetterPaymentTxnVisitVisitFactDelta
  3. Load Eligibility Status Dimensionsqldaily_processing_visits__load_eligibility_status_dimension.sql
    ✨ Refreshes the eligibility status dimension with unique values from appointment benefit details to support insurance verification reporting.
    writes DimensionMember · reads vAppointmentBenefitDetailAll
  4. ▶Load-Default-CustomPropertiessub-job · 1↗See ZD Ticket #9685
    1. Update PriorAuth Custom PropertyUpdateVisitCustomPropertyFromQuery
      · reads CustomPropertyMapDimensionMemberPriorAuthDefaultVisitvPriorAuthReport
      custom visit update custom property query

markers

Why it classified as flow

Front-of-house actions found anywhere in the tree (including nested sub-jobs).

CalculateVisits
Compute the good-faith estimate
CheckBenefits
Real-time eligibility (270/271) benefit lookup
PrimaryCoverageStatus (CustomProp)
ClarityFlow front-of-house step
SecondaryCoverageStatus (CustomProp)
ClarityFlow front-of-house step
auto_apply_bundles
Apply procedure bundles for the estimate
auto_benefits
Auto-apply parsed benefits to visits
auto_send_letters
Send GFE / patient letters
auto_send_letters_for_future_visits
Pre-send letters for upcoming visits
auto_send_reminder
Send letter reminders