Legacy Pipeline Atlas worker-1snapshot 2026-07-15

FHIR feed · ClarityFlow pipeline

NWDerm · FHIR-Processing

Overall Processing job for FHIR pipeline

pipeline NWDerm/FHIR-Processing · db NWDerm_ProdMirror · updated 2025-09-17
classification: flow · 8 Flow markers

trigger

How it's scheduled

Real-time loop — every 2 min (~720×/day)

New appointments land continuously on the FHIR feed. Front-of-house work is time-boxed — the estimate and letter have to reach the patient before the visit — so the pipeline polls every 2 minutes to check eligibility and price the good-faith estimate within minutes of an appointment being booked, rather than waiting for an overnight batch.

Scheduled taskCadenceServerStateCoordination
\MDC\FHIR - Processing - NWDermevery 2 min (from 00:01)prod-db-3enabledstandalone

shape

Against the canonical Flow spine

Every Flow pipeline is a variation on one shape. Lit stages are the ones this pipeline runs; the labels match the capability lens.

Ingest
FHIR feed
→
Eligibility & benefits
EligibilityBenefitsDiscovery
→
Estimate
BundlesEstimate
→
Letters
→
Work queue & sync
Work queueDashboardsSync

computed concepts · from the SQL

What it computes

Business concepts mined from this pipeline's SQL text — the meaning behind the typed steps. Each links to the concept lens (who else computes it).

Coverage status

task tree

What the pipeline runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

flow

FHIR-Processing

8 tasks · NWDerm
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. NexTechFHIRIntegrationNexTechFHIRIntegration
  2. FHIRProcessBatchsqlfhir_processing__fhirprocessbatch.sql
    ✨ Identifies new FHIR batches and populates the visit delta table with records matching predefined surgical visit types.
    writes FHIRProcessBatchVisitDelta · reads FHIRIncomingSourceAppointmentFHIRProcessBatchProcessLogSurgicalVisitTypes
  3. ▶FHIR-Transformsub-job · 5↗FHIR Transformation Layer
    1. ImportTransformVisitsqlfhir_transform__importtransformvisit.sql
      ✨ Loads incremental appointment changes from FHIR sources into staging, including reason codes and updated service type definitions.
      writes ImportTransformVisit · reads FHIRIncomingSourceAppointmentFHIRProcessBatchVisitDelta
    2. MergeTransformVisitsqlfhir_transform__mergetransformvisit.sql
      ✨ Updates the visit transformation table by replacing existing records with the latest imported appointment, facility, and provider details.
      writes TransformVisit · reads ImportTransformVisit
      ↳ feeds from ImportTransformVisit
    3. ImportTransformVisitInsurancesqlfhir_transform__importtransformvisitinsurance.sql
      ✨ Loads primary, secondary, and tertiary insurance details into the staging table while mapping source payers to standardized insurance records.
      writes ImportTransformVisitInsurance · reads FHIRIncomingSourceAppointmentFHIRProcessBatchInsuranceMapVisitDelta
    4. MergeTransformVisitInsurancesqlfhir_transform__mergetransformvisitinsurance.sql
      ✨ Updates the main insurance transformation table by replacing existing records with newly imported and mapped insurance information.
      writes TransformVisitInsurance · reads ImportTransformVisitInsurance
      ↳ feeds from ImportTransformVisitInsurance
    5. AugmentTransformVisitsqlfhir_transform__augmenttransformvisit.sqldisabled
      ✨ Refines visit service types by mapping insurance-specific codes to standardized eligibility categories for more accurate coverage verification.
      writes TransformVisit · reads EligibilityMapping2024ImportTransformVisitTransformVisitInsurance
  4. ▶Load-Entitiessub-job · 2↗Load Facility, Provider
    1. Load FacilityLoadEntities
      writes Facility · reads FHIRActorFHIRProcessBatchFacility
      entity type=Facilitycustom query
    2. Load Providersqlload_entities__load_provider.sqldisabled
      ✨ Loads provider details into the master provider table using the latest physician information from HL7 visit messages.
      writes Provider · reads HL7Visit
  5. ▶Load-Dimension-Memberssub-job · 9↗
    1. Load Insurance Dimensionsqlload_dimension_members__load_insurance_dimension.sqldisabled
      ✨ Populates the insurance dimension with unique carrier keys to enable filtering and analysis by payer.
      writes DimensionMember · reads Insurance
    2. Load EligibilityInsurance Dimensionsqlload_dimension_members__load_eligibilityinsurance_dimension.sqldisabled
      ✨ Loads insurance members that support electronic eligibility and benefits verification via API integration.
      writes DimensionMember · reads DimensionMemberInsurance
    3. Load QuoteInsurance Dimensionsqlload_dimension_members__load_quoteinsurance_dimension.sqldisabled
      ✨ Builds a dimension of insurance providers associated with active contracts to facilitate accurate patient cost estimates.
      writes DimensionMember · reads ContractMapInsurance
    4. LoadInsuranceDimensionMembersLoadInsuranceDimensionMembers
      Synchronize insurance-specific dimension members from the insurance table to update contract and eligibility filtering options across the application.
      writes DimensionMember
      load insuranceload quote insuranceload eligibility insurance
    5. Load Time Dimensionssqlload_dimension_members__load_time_dimensions.sql
      ✨ Builds and updates time-based dimension hierarchies for days, months, and years based on the range of scheduled appointment dates.
      writes DimensionMember · reads FHIRIncomingSourceAppointment
    6. Load VisitStatus Dimensionsqlload_dimension_members__load_visitstatus_dimension.sql
      ✨ Loads unique appointment status values into the dimension table to enable standardized reporting on visit states.
      writes DimensionMember · reads TransformVisit
    7. Load Provider Dimensionsqlload_dimension_members__load_provider_dimension.sql
      ✨ Updates the provider dimension with unique practitioner identifiers and display names extracted from incoming appointment data.
      writes DimensionMember · reads FHIRIncomingSourceAppointment
    8. Load Facility Dimensionssqlload_dimension_members__load_facility_dimensions.sql
      ✨ Loads facility names and identifiers from the facility configuration into the clinic dimension for organizational reporting.
      writes DimensionMember · reads Facility
    9. Load VisitType Dimensionssqlload_dimension_members__load_visittype_dimensions.sql
      ✨ Builds the visit type dimension using the most recent appointment types found in incoming scheduling data.
      writes DimensionMember · reads FHIRIncomingSourceAppointment
  6. ▶Load-Visitssub-job · 22↗
    1. Load TempBatchVisitsqlload_visits__load_tempbatchvisit.sqldisabled
      ✨ Flags upcoming visits for insurance eligibility checks based on service types, coverage status, and appointment lead times.
      writes TempBatchVisitVisitEligServiceTypesVisitServiceTypes · reads DimensionMemberTempBatchVisitTransformVisitTransformVisitInsTransformVisitInsuranceTransformVisitInsuranceCoverageStatusVisitEligServiceTypesVisitServiceTypes
    2. Augment Visit Deltasqlload_visits__augment_visit_delta.sqldisabled
      ✨ Updates the visit delta table by adding records flagged as requiring new insurance eligibility lookups from the batch process.
      writes VisitDelta · reads TempBatchVisitVisitDelta
    3. ReprocessChangedConfigurationsReprocessChangedConfigurations
      Identify and queue visits or accounts affected by configuration changes to ensure historical data reflects updated pricing or insurance rules.
      reprocess visits
    4. Augment VisitDeltasqlload_visits__augment_visitdelta.sql
      ✨ Updates insurance mappings for reprocessed visits and adds them to the delta table for downstream processing.
      writes VisitDeltaVisitKeyLookup · reads VisitDeltaVisitKeyLookup
    5. LoadVisitBatchLoadVisitBatch
      Load scheduled visits and associated charges into the processing pipeline using custom SQL queries for pricing estimation and quote generation.
      writes QuoteBatchVisitBatch · reads PatientTransformVisitTransformVisitInsuranceVisitVisitDelta
      ↳ feeds from Augment VisitDelta, Sync Visits and Quotes
      custom visit queryauto charge querycustom service type querycustom coverage queryadd zero charge
    6. load-custom-propertiessub-job
    7. AutoApplyBundlesToVisitBatchAutoApplyBundlesToVisitBatchdisabled
      Applies matching charge bundles to batch visits based on facility and insurance to ensure consistent pricing across service types.
      DISABLED
    8. Augment TempBatchVisitsqlload_visits__augment_tempbatchvisit.sqldisabled
      ✨ Flags visits for eligibility rechecks based on appointment lead time and previous transaction status to ensure coverage is verified.
      writes TempBatchVisit · reads DimensionMemberEligibilityTxnTempBatchVisitTransformVisitTransformVisitInsuranceTransformVisitInsuranceCoverageStatusVisitVisitBatch
    9. CheckBenefitsflowdisabled
      Verifies insurance eligibility and retrieves detailed benefits information for visits by making real-time API calls to insurance providers.
      · reads TempBatchVisitVisitBatch
      custom queryDISABLED
    10. CheckBenefitsflow
      Verifies insurance eligibility and retrieves detailed benefits information for visits by making real-time API calls to insurance providers.
      auto query
    11. Re-Check Benefitsflowdisabled
      Verifies insurance eligibility and retrieves detailed benefits information for visits by making real-time API calls to insurance providers.
      · reads EligibilityStatusMapEligibilityTxnTempBatchVisitVisitBatch
      custom queryDISABLED
    12. AutoApplyBenefitsAutoApplyBenefits
      Populates insurance benefits like copays and deductibles on batch visits using data from eligibility verification transactions.
    13. CalculateVisitsflow
      Compute the good-faith estimate (CalculateVisits).
      · reads DimensionMemberVisitBatch
      ↳ feeds from LoadVisitBatch
      custom querycalculate chargesbatch mode
    14. LogVisitChangeEventsBatchLogVisitChangeEventsBatch
      Compare batch visits against production records to detect and log specific property changes for auditing and compliance tracking.
    15. Load TransformVisitInsuranceCoverageStatussqlload_visits__load_transformvisitinsurancecoveragestatus.sql
      ✨ Updates insurance coverage statuses by analyzing recent eligibility transactions and mapping results to standardized active or inactive states.
      writes TempEligibilityStatsTransformVisitInsuranceCoverageStatus · reads TempEligibilityStatsTransformVisitInsuranceVisitBatch
      ↳ feeds from LoadVisitBatch
    16. ▶Load-CustomProperty-CoverageStatussub-job · 3↗
      1. Load Primary Coverage StatusUpdateCustomPropertyFromQuery
        · reads TransformVisitInsuranceCoverageStatusVisitBatch
        entity=Visitcustom property key=PrimaryCoverageStatuscustom querybatch mode
      2. Load Secondary Coverage StatusUpdateCustomPropertyFromQuery
        · reads TransformVisitInsuranceCoverageStatusVisitBatch
        entity=Visitcustom property key=SecondaryCoverageStatuscustom querybatch mode
      3. Load Tertiary Coverage StatusUpdateCustomPropertyFromQuery
        · reads TransformVisitInsuranceCoverageStatusVisitBatch
        entity=Visitcustom property key=TertiaryCoverageStatuscustom querybatch mode
    17. Sync Visits and QuotesSyncBatch
      Synchronizes processed data from batch staging tables to production tables, updating visits, quotes, and custom property mappings.
      writes CustomPropertyMapQuoteVisitVisitChangeEvent · reads CustomPropertyMapBatchQuoteBatchVisitBatchVisitChangeEventBatch
      ↳ feeds from LoadVisitBatch
      sync quotesync visitsync custom property mapsync visit change event
    18. ExportBatchVisitEligibilityflowdisabled
      Push the batch to the app / export results.
      · reads EligibilityTxnVisitBatch
      custom querytable name=BatchEligibility_Resultsarchive table name=BatchEligibility_ResultsArchiveDISABLED
    19. SearchForInsuranceflowdisabled
      Find coverage for visits missing insurance.
      · reads EligibilityTxnBatch
      custom querytable name=InsuranceSearch_Resultbatch modeDISABLED
    20. Generate-Reportsub-jobdisabled
    21. ▶Load-Visit-Factsub-job · 1↗
      1. Load VisitFactsqlload_visit_fact__load_visitfact.sql
        ✨ Updates the visit fact table by refreshing records that have recent activity in payments, eligibility checks, or patient communications.
        writes VisitFact · reads EligibilityStatusMapEligibilityTxnPatientLetterPaymentTxnVisit
    22. Update-Dashboard-Tablessub-jobdisabled
  7. WorkqueueAssignmentWorkqueueAssignment
    Assigns accounts or visits to workqueue stacks by evaluating matching criteria and updating item lists based on search terms.
  8. UpdateDashboardTablesUpdateDashboardTables
    Regenerates optimized aggregate tables for all dashboard reports and updates their definitions to reflect the latest source data.

markers

Why it classified as flow

Front-of-house actions found anywhere in the tree (including nested sub-jobs).

CalculateVisits
Compute the good-faith estimate
CheckBenefits
Real-time eligibility (270/271) benefit lookup
ExportBatchVisitEligibility
Export eligibility results
Load TransformVisitInsuranceCoverageStatus
ClarityFlow front-of-house step
LoadVisitBatch
ClarityFlow front-of-house step
SearchForInsurance
Insurance discovery for visits missing coverage
auto_apply_bundles
Apply procedure bundles for the estimate
auto_benefits
Auto-apply parsed benefits to visits