FHIR feed · ClarityFlow pipeline
MannEye · Flow-FHIR-Processing
Overall Processing job for FHIR pipeline
trigger
How it's scheduled
New appointments land continuously on the FHIR feed. Front-of-house work is time-boxed — the estimate and letter have to reach the patient before the visit — so the pipeline polls every 10 minutes to check eligibility, price the good-faith estimate, and send the patient letter within minutes of an appointment being booked, rather than waiting for an overnight batch.
| Scheduled task | Cadence | Server | State | Coordination |
|---|---|---|---|---|
\MDC\FHIR - Processing - MannEye | every 10 min (from 00:01) | prod-db-1 | disabled | standalone |
shape
Against the canonical Flow spine
Every Flow pipeline is a variation on one shape. Lit stages are the ones this pipeline runs; the labels match the capability lens.
computed concepts · from the SQL
What it computes
Business concepts mined from this pipeline's SQL text — the meaning behind the typed steps. Each links to the concept lens (who else computes it).
task tree
What the pipeline runs
Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).
Flow-FHIR-Processing
- unnamed stepunknown
- FHIRProcessBatchsql
flow_fhir_processing__fhirprocessbatch.sql✨ Identifies new FHIR data batches and flags specific appointment types for incremental processing in the visit delta table.writesFHIRProcessBatchVisitDelta· readsFHIRIncomingSourceAppointmentFHIRProcessBatchProcessLog ▶Flow-Transform-Visitssub-job · 5↗FHIR Transformation Layer
- ImportTransformVisitsql
flow_transform_visits__importtransformvisit.sql✨ Loads incoming appointment data from source FHIR records into a staging table for further processing and transformation.writesImportTransformVisit· readsFHIRIncomingSourceAppointmentFHIRProcessBatch - MergeTransformVisitsql
flow_transform_visits__mergetransformvisit.sql✨ Merges staged appointment data into the main transformation table by replacing existing records with the most recent source information.writesTransformVisit· readsImportTransformVisit↳ feeds from ImportTransformVisit - ImportTransformVisitInsurancesql
flow_transform_visits__importtransformvisitinsurance.sql✨ Extracts and maps primary, secondary, and tertiary insurance details from incoming appointment records into a staging table.writesImportTransformVisitInsurance· readsFHIRIncomingSourceAppointmentFHIRProcessBatchInsuranceMap - MergeTransformVisitInsurancesql
flow_transform_visits__mergetransformvisitinsurance.sql✨ Updates the main insurance transformation table by replacing existing records with newly imported and mapped insurance information.writesTransformVisitInsurance· readsImportTransformVisitInsurance↳ feeds from ImportTransformVisitInsurance - AugmentTransformVisitsql
flow_transform_visits__augmenttransformvisit.sqldisabled✨ Refines visit service types by mapping insurance-specific codes to standardized eligibility categories for more accurate coverage verification.writesTransformVisit· readsEligibilityMapping2024ImportTransformVisitTransformVisitInsurance
▶Flow-Process-LoadEntitiessub-job · 3↗Load Facility, Provider
- Load Facility Mapping fileProcessFiledisabledwrites
ImportFacilityMapSourceFacilityMapfile path={SourceDataFolder}\Facility Mapping.csvbase table name=FacilityMaprow terminator=Newlinecolumn separator=CommaDISABLED - Load FacilityLoadEntitieswrites
Facility· readsFHIRActorFHIRProcessBatchFacilitySourceFacilityMapentity type=Facilitycustom query - Load Providersql
flow_process_loadentities__load_provider.sqldisabled✨ Loads provider details into the master provider table using the latest physician information from HL7 visit messages.writesProvider· readsHL7Visit
▶Flow-Process-LoadDimensionMemberssub-job · 12↗
- Load Insurance Dimensionsql
flow_process_loaddimensionmembers__load_insurance_dimension.sqldisabled✨ Populates the insurance dimension with unique carrier keys to enable filtering and analysis by payer.writesDimensionMember· readsInsurance - Load EligibilityInsurance Dimensionsql
flow_process_loaddimensionmembers__load_eligibilityinsurance_dimension.sqldisabled✨ Loads insurance members that support electronic eligibility and benefits verification via API integration.writesDimensionMember· readsDimensionMemberInsurance - Load QuoteInsurance Dimensionsql
flow_process_loaddimensionmembers__load_quoteinsurance_dimension.sqldisabled✨ Builds a dimension of insurance providers associated with active contracts to facilitate accurate patient cost estimates.writesDimensionMember· readsContractMapInsurance - LoadInsuranceDimensionMembersLoadInsuranceDimensionMembersSynchronize insurance-specific dimension members from the insurance table to update contract and eligibility filtering options across the application.writes
DimensionMemberload insuranceload quote insuranceload eligibility insurance - Load Time Dimensionssql
flow_process_loaddimensionmembers__load_time_dimensions.sql✨ Builds and updates time-based dimensions including days, months, and years derived from appointment schedule dates.writesDimensionMember· readsFHIRIncomingSourceAppointment - Load VisitStatus Dimensionsql
flow_process_loaddimensionmembers__load_visitstatus_dimension.sql✨ Builds the visit status dimension by extracting unique appointment statuses from transformed visit data.writesDimensionMember· readsTransformVisit - Load Provider Dimensionsql
flow_process_loaddimensionmembers__load_provider_dimension.sql✨ Updates the provider dimension with the latest provider names and IDs from incoming appointment records.writesDimensionMember· readsFHIRIncomingSourceAppointment - Load Facility Dimensionssql
flow_process_loaddimensionmembers__load_facility_dimensions.sql✨ Loads facility dimension members and their parent groups from the facility configuration data.writesDimensionMember· readsFacility - Load FacilityType Dimensionssql
flow_process_loaddimensionmembers__load_facilitytype_dimensions.sql✨ Loads facility type dimension members from facility records to enable standardized categorization across the revenue cycle pipeline.writesDimensionMember· readsFacility - Load FacilityGroup Dimensionssql
flow_process_loaddimensionmembers__load_facilitygroup_dimensions.sql✨ Builds the facility group dimension by identifying unique parent groups from facility dimension records.writesDimensionMember· readsDimensionMember↳ feeds from Load Facility Dimensions, Load FacilityType Dimensions, Load Provider Dimension, Load State Dimensions, Load Time Dimensions, Load VisitStatus Dimension, Load VisitType Dimensions, LoadInsuranceDimensionMembers - Load VisitType Dimensionssql
flow_process_loaddimensionmembers__load_visittype_dimensions.sql✨ Builds the visit type dimension using the most recent appointment types found in incoming scheduling data.writesDimensionMember· readsFHIRIncomingSourceAppointment - Load State Dimensionssql
flow_process_loaddimensionmembers__load_state_dimensions.sql✨ Loads unique state codes from facility records into the state dimension for geographic reporting.writesDimensionMember· readsFacility
▶Flow-Process-LoadVisitssub-job · 23↗
- Load TempBatchVisitsql
flow_process_loadvisits__load_tempbatchvisit.sqldisabled✨ Flags upcoming visits for insurance eligibility checks based on service types, coverage status, and appointment lead times.writesTempBatchVisitVisitEligServiceTypesVisitServiceTypes· readsDimensionMemberTempBatchVisitTransformVisitTransformVisitInsTransformVisitInsuranceTransformVisitInsuranceCoverageStatusVisitEligServiceTypesVisitServiceTypes - Augment Visit Deltasql
flow_process_loadvisits__augment_visit_delta.sqldisabled✨ Updates the visit delta table by adding records flagged as requiring new insurance eligibility lookups from the batch process.writesVisitDelta· readsTempBatchVisitVisitDelta - ReprocessChangedConfigurationsReprocessChangedConfigurationsIdentify and queue visits or accounts affected by configuration changes to ensure historical data reflects updated pricing or insurance rules.reprocess visits
- Augment VisitDeltasql
flow_process_loadvisits__augment_visitdelta.sql✨ Updates insurance mappings for reprocessed visits and adds them to the delta table for downstream processing.writesVisitDeltaVisitKeyLookup· readsVisitDeltaVisitKeyLookup - LoadVisitBatchLoadVisitBatchLoad scheduled visits and associated charges into the processing pipeline using custom SQL queries for pricing estimation and quote generation.writes
QuoteBatchVisitBatch· readsPatientTransformVisitTransformVisitInsuranceVisitVisitDelta↳ feeds from Augment VisitDelta, Sync Visits and Quotescustom visit queryauto charge querycustom service type querycustom coverage queryadd zero charge - AutoApplyBundlesToVisitBatchAutoApplyBundlesToVisitBatchApplies matching charge bundles to batch visits based on facility and insurance to ensure consistent pricing across service types.
- Augment TempBatchVisitsql
flow_process_loadvisits__augment_tempbatchvisit.sqldisabled✨ Flags visits for eligibility rechecks based on appointment lead time and previous transaction status to ensure coverage is verified.writesTempBatchVisit· readsDimensionMemberEligibilityTxnTempBatchVisitTransformVisitTransformVisitInsuranceTransformVisitInsuranceCoverageStatusVisitVisitBatch - CheckBenefitsflowVerifies insurance eligibility and retrieves detailed benefits information for visits by making real-time API calls to insurance providers.auto query
- Verifies insurance eligibility and retrieves detailed benefits information for visits by making real-time API calls to insurance providers.· reads
TempBatchVisitVisitBatchcustom queryDISABLED - Verifies insurance eligibility and retrieves detailed benefits information for visits by making real-time API calls to insurance providers.· reads
EligibilityStatusMapEligibilityTxnTempBatchVisitVisitBatchcustom queryDISABLED - AutoApplyBenefitsAutoApplyBenefitsPopulates insurance benefits like copays and deductibles on batch visits using data from eligibility verification transactions.
- CalculateVisitsflowCompute the good-faith estimate (CalculateVisits).· reads
DimensionMemberVisitBatch↳ feeds from LoadVisitBatchcustom querycalculate chargesbatch mode - AutoSendLettersAutoSendLettersGenerates and sends patient cost estimate letters for visits in the batch table based on configured qualification and communication rules.
- LogVisitChangeEventsBatchLogVisitChangeEventsBatchCompare batch visits against production records to detect and log specific property changes for auditing and compliance tracking.
- Load TransformVisitInsuranceCoverageStatussql
flow_process_loadvisits__load_transformvisitinsurancecoveragestatus.sql✨ Updates insurance coverage statuses by analyzing recent eligibility transactions and mapping results to standardized active or inactive states.writesTempEligibilityStatsTransformVisitInsuranceCoverageStatus· readsTempEligibilityStatsTransformVisitInsuranceVisitBatch↳ feeds from LoadVisitBatch ▶Flow-Process-CustomPropertysub-job · 3↗
- Load Primary Coverage StatusUpdateCustomPropertyFromQuery· reads
TransformVisitInsuranceCoverageStatusVisitBatchentity=Visitcustom property key=PrimaryCoverageStatuscustom querybatch mode - Load Secondary Coverage StatusUpdateCustomPropertyFromQuery· reads
TransformVisitInsuranceCoverageStatusVisitBatchentity=Visitcustom property key=SecondaryCoverageStatuscustom querybatch mode - Load Tertiary Coverage StatusUpdateCustomPropertyFromQuery· reads
TransformVisitInsuranceCoverageStatusVisitBatchentity=Visitcustom property key=TertiaryCoverageStatuscustom querybatch mode
- Sync Visits and QuotesSyncBatchSynchronizes processed data from batch staging tables to production tables, updating visits, quotes, and custom property mappings.writes
CustomPropertyMapQuoteVisitVisitChangeEvent· readsCustomPropertyMapBatchQuoteBatchVisitBatchVisitChangeEventBatch↳ feeds from LoadVisitBatchsync quotesync visitsync custom property mapsync visit change event - ExportBatchVisitEligibilityflowdisabledPush the batch to the app / export results.· reads
EligibilityTxnVisitBatchcustom querytable name=BatchEligibility_Resultsarchive table name=BatchEligibility_ResultsArchiveDISABLED - SearchForInsuranceflowdisabledFind coverage for visits missing insurance.· reads
EligibilityTxnBatchcustom querytable name=InsuranceSearch_Resultbatch modeDISABLED ▶Flow-Process-LoadVisitFactsub-job · 1↗
- Load VisitFactsql
flow_process_loadvisitfact__load_visitfact.sql✨ Updates visit-level facts and metrics by refreshing data for visits with recent activity in payments, eligibility, or communications.writesVisitFactVisitFactDelta· readsEligibilityStatusMapEligibilityTxnPatientLetterPaymentTxnVisitVisitFactDelta
- WorkqueueAssignmentWorkqueueAssignmentAssigns accounts or visits to workqueue stacks by evaluating matching criteria and updating item lists based on search terms.
- UpdateDashboardTablesUpdateDashboardTablesRegenerates optimized aggregate tables for all dashboard reports and updates their definitions to reflect the latest source data.
markers
Why it classified as flow
Front-of-house actions found anywhere in the tree (including nested sub-jobs).