Legacy Pipeline Atlas worker-1snapshot 2026-07-15

Batch / file feed · RevFind pipeline

CCP · Daily-Accounts-Processing

Overall daily batch accounts processing job

pipeline CCP/Daily-Accounts-Processing · db CCP_ProdMirror · updated 2025-09-17
classification: revfind · loads 2 visit tables

Loads visit tables
Besides its back-office work, this RevFind pipeline also loads a visit dimension/fact table (Load VisitStatus Dimension, Load VisitType Dimensions) — the shared rows Flow builds on. It runs no front-of-house work (no eligibility, estimate, or letters), so it stays RevFind.

trigger

How it's scheduled

Daily batch — once at 04:30

The Batch / file feed arrives as a scheduled drop, so one overnight pass is enough: it ingests the day's file and works the whole batch to process the visits. A tighter loop would just re-scan the same file.

Scheduled taskCadenceServerStateCoordination
\MDC\Daily - Processing - CCPdaily at 04:30prod-db-3enabledstandalone

shape

The RevFind back-office spine

RevFind pipelines share a back-office shape: ingest → load accounts → reconcile remits → model contracts → surface underpayments. Lit stages are the ones this pipeline runs.

Ingest
Batch / file feed
Accounts / AR
ACCT
Remit (835)
Contract model
Payer rules
Work queue & sync
Work queueDashboards

computed concepts · from the SQL

What it computes

Business concepts mined from this pipeline's SQL text — the meaning behind the typed steps. Each links to the concept lens (who else computes it).

task tree

What the pipeline runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

revfind

Daily-Accounts-Processing

9 tasks · CCP
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. Process-Experity-Datasub-job · 18
    1. Download-Experity-Filessub-job · 1
      1. DownloadDownload
        Downloads files from remote FTP or SFTP servers to local directories with support for archiving and parallel transfers.
        server=CCP_ProdMirror-mdcssh-sftpremote directory=/local directory={SourceDataFolder}
    2. Process ExportLogBookTableProcessFile
      writes ImportLogBookSourceLogBook
      archive directory={SourceDataArchive}base table name=LogBookrow terminator=Newlinecolumn separator=Pipe
    3. Process ExportLogDetailTableProcessFile
      writes ImportLogDetailSourceLogDetail
      archive directory={SourceDataArchive}base table name=LogDetailrow terminator=Newlinecolumn separator=Pipe
    4. Process ExportChargeHeaderTableProcessFile
      writes ImportChargeHeaderSourceChargeHeader
      archive directory={SourceDataArchive}base table name=ChargeHeaderrow terminator=Newlinecolumn separator=Pipe
    5. Process ExportChargeDetailTableProcessFile
      writes ImportChargeDetailSourceChargeDetail
      archive directory={SourceDataArchive}base table name=ChargeDetailrow terminator=Newlinecolumn separator=Pipe
    6. Process ExportARHeaderTableProcessFile
      writes ImportARHeaderSourceARHeader
      archive directory={SourceDataArchive}base table name=ARHeaderrow terminator=Newlinecolumn separator=Pipe
    7. Process ExportARDetailTableProcessFile
      writes ImportARDetailSourceARDetail
      archive directory={SourceDataArchive}base table name=ARDetailrow terminator=Newlinecolumn separator=Pipe
    8. Process ExportERAAdjustmentTableProcessFile
      writes ImportERAAdjustmentSourceERAAdjustment
      archive directory={SourceDataArchive}base table name=ERAAdjustmentrow terminator=Newlinecolumn separator=Pipe
    9. Process ExportERAClaimTableProcessFile
      writes ImportERAClaimSourceERAClaim
      archive directory={SourceDataArchive}base table name=ERAClaimrow terminator=Newlinecolumn separator=Pipe
    10. Process ExportERAServiceTableProcessFile
      writes ImportERAServiceSourceERAService
      archive directory={SourceDataArchive}base table name=ERAServicerow terminator=Newlinecolumn separator=Pipe
    11. Process ExportPatientTableProcessFile
      writes ImportPatientSourcePatient
      archive directory={SourceDataArchive}base table name=Patientrow terminator=Newlinecolumn separator=Pipe
    12. Process ExportPatBillingTableProcessFile
      writes ImportPatBillingSourcePatBilling
      archive directory={SourceDataArchive}base table name=PatBillingrow terminator=Newlinecolumn separator=Pipe
    13. Process ExportInsuranceTableProcessFile
      writes ImportInsuranceSourceInsurance
      archive directory={SourceDataArchive}base table name=Insurancerow terminator=Newlinecolumn separator=Pipe
    14. Process ExportPayerTableProcessFile
      writes ImportPayerSourcePayer
      file path={SourceDataFolder}\ExportPayerTable.txtarchive directory={SourceDataArchive}base table name=Payerrow terminator=Newlinecolumn separator=Pipe
    15. Process ExportProviderTableProcessFile
      writes ImportProviderSourceProvider
      archive directory={SourceDataArchive}base table name=Providerrow terminator=Newlinecolumn separator=Pipe
    16. Process ExportLocationTableProcessFile
      writes ImportLocationSourceLocation
      archive directory={SourceDataArchive}base table name=Locationrow terminator=Newlinecolumn separator=Pipe
    17. Process ExportFeeScheduleTableProcessFile
      writes ImportFeeScheduleSourceFeeSchedule
      archive directory={SourceDataArchive}base table name=FeeSchedulerow terminator=Newlinecolumn separator=Pipe
    18. Process ExportUtilGroupTableProcessFile
      writes ImportUtilGroupSourceUtilGroup
      archive directory={SourceDataArchive}base table name=UtilGrouprow terminator=Newlinecolumn separator=Pipe
  2. Load-Entitiessub-job · 2Load Facility, Provider
    1. Load FacilityLoadEntities
      writes Facility · reads SourceLocation
      entity type=Facilitycustom query
    2. Load Providersqlload_entities__load_provider.sql
      Builds and updates the provider master list by merging source provider details, taxonomy codes, and NPI information.
      writes Provider · reads ProviderTaxonomySourceLogDetailSourceProvider
  3. Load-InsuranceMapsub-job · 2
    1. Load InsuranceMap rawProcessFiledisabled
      writes ImportInsuranceMapSourceInsuranceMap
      file path=D:\ClientData\CCP\InsuranceMap.csvbase table name=InsuranceMaprow terminator=Newlinecolumn separator=CommaDISABLED
    2. Load InsuranceMapLoadEntities
      writes InsuranceMap · reads InsuranceMapSourceARHeaderSourceInsuranceSourcePatBilling
      entity type=InsuranceMapauto querykey prefix=IM
  4. Load-Charge-Dimensionsub-job · 9
    1. Load TempChargeSchedulessqlload_charge_dimension__load_tempchargeschedules.sql
      Builds temporary charge schedules by calculating effective date ranges for professional and facility fee schedules from the master charge list.
      writes TempChargeSchedules
    2. Load FeeScheduleRecordsqlload_charge_dimension__load_feeschedulerecord.sql
      Loads fee schedule records with charge codes, modifiers, and pricing for specific professional and facility practice schedules.
      writes FeeScheduleRecord · reads SourceChargeMasterTempChargeSchedules
      ↳ feeds from Load TempChargeSchedules
    3. Load ScheduleMapsqlload_charge_dimension__load_schedulemap.sql
      Maps fee schedules to specific facilities and insurance categories for professional and ambulatory surgery center services.
      writes ScheduleMap · reads FacilityTempChargeSchedules
      ↳ feeds from Load TempChargeSchedules
    4. Load ContractMapsqlload_charge_dimension__load_contractmap.sqldisabled
      Defines contract mappings for charge-based and self-pay accounts across various facility types and practice settings.
      writes ContractMap · reads Facility
    5. Load ScheduleLoadEntities
      writes Schedule · reads TempChargeSchedules
      ↳ feeds from Load TempChargeSchedules
      entity type=Schedulecustom query
    6. Load ChargeTypesqlload_charge_dimension__load_chargetype.sql
      Categorizes charge types by mapping procedure codes, modifiers, and service types from the fee schedule and charge data.
      writes ChargeType · reads SourceFeeScheduleTransformCharge
    7. Load ChargeType Dimensionsqlload_charge_dimension__load_chargetype_dimension.sql
      Updates the charge type dimension with standardized member names and display labels for reporting and analysis.
      writes DimensionMember · reads ChargeType
      ↳ feeds from Load ChargeType
    8. Load ProcedureCode Dimensionsqlload_charge_dimension__load_procedurecode_dimension.sql
      Updates the procedure code dimension by extracting codes and assigning parent categories for hierarchical reporting.
      writes DimensionMember · reads ChargeType
      ↳ feeds from Load ChargeType
    9. Load ProcedureCategory and Subcategory DMsqlload_charge_dimension__load_procedurecategory_and_subcategory_dm.sql
      Builds procedure category and subcategory dimensions by mapping charge codes to standardized hierarchies for clinical reporting.
      writes DimensionMember · reads SourceChargeMap
  5. Load-Account-Transform-Tablessub-job · 9Source-->Transform
    1. Load AccountDeltasqlload_account_transform_tables__load_accountdelta.sql
      Builds a list of account identifiers from the import log to track records requiring transformation in the current pipeline run.
      writes AccountDelta · reads AccountDelta
    2. Load TransformPatientsqlload_account_transform_tables__load_transformpatient.sql
      Updates or inserts patient demographic information, including names, contact details, and addresses, from source data into the transformed patient table.
      writes TransformPatient · reads SourcePatient
    3. Load TransformInvoiceChainsqlload_account_transform_tables__load_transforminvoicechain.sql
      Builds a historical chain of invoice relationships for specific accounts, identifying current, cloned, and rebilled charge headers.
      writes TransformInvoiceChain · reads AccountDeltaSourceChargeHeader
      ↳ feeds from Load AccountDelta
    4. Load TransformAccountsqlload_account_transform_tables__load_transformaccount.sql
      Consolidates account-level details, including facility, patient, and primary insurance information, for records identified in the current processing delta.
      writes TransformAccount · reads AccountDeltaSourceInsuranceSourceLocationSourceLogBookSourceLogDetailSourcePatBillingTransformInvoiceChain
      ↳ feeds from Load AccountDelta, Load TransformInvoiceChain
    5. Load TransformChargesqlload_account_transform_tables__load_transformcharge.sql
      Loads detailed service charge information, including procedure codes, modifiers, and payment balances, for accounts requiring updates.
      writes TransformCharge · reads AccountDeltaSourceChargeDetailSourceChargeHeaderSourceInsuranceSourcePatBillingTransformInvoiceChain
      ↳ feeds from Load AccountDelta, Load TransformInvoiceChain
    6. Load TransformTransactionsqlload_account_transform_tables__load_transformtransaction.sql
      Records financial transactions, such as payments and adjustments, while establishing chronological posting orders for each account's billing history.
      writes TransformTransaction · reads AccountDeltaSourceARDetailSourceARHeaderSourceInsuranceSourcePatBilling
      ↳ feeds from Load AccountDelta
    7. Load TransformRemitAdjustmentsqlload_account_transform_tables__load_transformremitadjustment.sql
      Loads insurance remittance adjustments and denial codes from electronic advice, linking them to specific charges and invoice chains.
      writes TransformRemitAdjustment · reads AccountDeltaAdjustmentCodeRollupSourceARHeaderSourceERAAdjustmentSourceInsuranceSourcePatBillingTransformAccountTransformInvoiceChain
      ↳ feeds from Load AccountDelta, Load TransformAccount, Load TransformInvoiceChain
    8. Load TransformRemitAdjustmentAggsqlload_account_transform_tables__load_transformremitadjustmentagg.sql
      Aggregates insurance denial data by category and amount to summarize initial and final remittance adjustments for each account.
      writes TransformRemitAdjustmentAgg · reads AccountDeltaTransformRemitAdjustment
      ↳ feeds from Load AccountDelta, Load TransformRemitAdjustment
    9. Load TransformChargeTransactionMeasuresqlload_account_transform_tables__load_transformchargetransactionmeasure.sql
      Builds financial measures for charges, including payments, adjustments, and denials, while mapping coordination of benefits and denial categories.
      writes TransformChargeTransactionMeasure · reads AccountDeltaTransformAccountTransformChargeTransformInvoiceChainTransformRemitAdjustmentAggTransformTransaction
      ↳ feeds from Load AccountDelta, Load TransformAccount, Load TransformCharge, Load TransformInvoiceChain, Load TransformRemitAdjustmentAgg, Load TransformTransaction
  6. Load-Patient-Entitysub-job · 1
    1. Execute LoadPatientsLoadPatients
      Upsert patient records into the patient dimension.
      · reads PatientTransformPatient
      custom patient query
  7. Load-Dimension-Memberssub-job · 22
    1. Load Insurance Dimensionsqlload_dimension_members__load_insurance_dimension.sql
      Loads the insurance dimension with unique insurance keys and a placeholder for unmapped records to support payer-level analysis.
      writes DimensionMember · reads Insurance
    2. Load SourceInsurance Dimensionsqlload_dimension_members__load_sourceinsurance_dimension.sql
      Builds the source insurance dimension by linking insurance maps to source system details and financial classifications.
      writes DimensionMember · reads InsuranceMapSourceInsurance
    3. Load FinancialClass Dimensionsqlload_dimension_members__load_financialclass_dimension.sql
      Loads financial class dimensions by grouping payers into standardized categories based on source utility group definitions.
      writes DimensionMember · reads DimensionMemberSourceUtilGroup
      ↳ feeds from Load ClaimStatus Dimension, Load DenialCategory Dimension, Load DiagnosisCode Dimension, Load Facility Dimensions, Load FacilityType Dimensions, Load Insurance Dimension, Load PatientAge Dimension, Load PatientSex Dimension, Load PlaceOfService Dimensions, Load Practice Dimensions, Load Provider Dimension, Load ProviderType Dimension, Load QuoteInsurance Dimension, Load SourceInsurance Dimension, Load State Dimension, Load Time Dimensions
    4. Load EligibilityInsurance Dimensionsqlload_dimension_members__load_eligibilityinsurance_dimension.sqldisabled
      Loads insurance members that support electronic eligibility and benefits verification via API integration.
      writes DimensionMember · reads DimensionMemberInsurance
    5. Load QuoteInsurance Dimensionsqlload_dimension_members__load_quoteinsurance_dimension.sql
      Builds a dimension of insurance providers associated with active contracts to facilitate accurate patient cost estimates.
      writes DimensionMember · reads ContractMapInsurance
    6. Load Time Dimensionssqlload_dimension_members__load_time_dimensions.sql
      Builds time dimensions including day, month, and year levels based on the range of service dates in the account data.
      writes DimensionMember · reads TransformAccount
    7. Load VisitStatus Dimensionsqlload_dimension_members__load_visitstatus_dimension.sqldisabled
      Loads unique appointment statuses into the visit status dimension to categorize and track the current state of patient visits.
      writes DimensionMember · reads TransformVisit
    8. Load DenialCategory Dimensionsqlload_dimension_members__load_denialcategory_dimension.sql
      Updates the denial category dimension with standardized codes and descriptions to classify and analyze insurance claim rejections.
      writes DimensionMember · reads AdjustmentCodeRollup
    9. Load Provider Dimensionsqlload_dimension_members__load_provider_dimension.sql
      Loads healthcare provider details and their associated types into the provider dimension for clinical and financial reporting.
      writes DimensionMember · reads Provider
    10. Load ProviderType Dimensionsqlload_dimension_members__load_providertype_dimension.sql
      Builds the provider type dimension by extracting unique provider categories to enable high-level grouping of medical staff.
      writes DimensionMember · reads DimensionMember
      ↳ feeds from Load ClaimStatus Dimension, Load DenialCategory Dimension, Load DiagnosisCode Dimension, Load Facility Dimensions, Load FacilityType Dimensions, Load FinancialClass Dimension, Load Insurance Dimension, Load PatientAge Dimension, Load PatientSex Dimension, Load PlaceOfService Dimensions, Load Practice Dimensions, Load Provider Dimension, Load QuoteInsurance Dimension, Load SourceInsurance Dimension, Load State Dimension, Load Time Dimensions
    11. Load Facility Dimensionssqlload_dimension_members__load_facility_dimensions.sql
      Updates the facility dimension with location names and group associations to organize data by specific service sites.
      writes DimensionMember · reads Facility
    12. Load FacilityType Dimensionssqlload_dimension_members__load_facilitytype_dimensions.sql
      Loads unique facility types into the dimension table to allow for the categorization of different healthcare service locations.
      writes DimensionMember · reads Facility
    13. Load Practice Dimensionssqlload_dimension_members__load_practice_dimensions.sql
      Populates the practice dimension with unique medical practice names to facilitate reporting across different business entities.
      writes DimensionMember · reads SourceLocation
    14. Load PlaceOfService Dimensionssqlload_dimension_members__load_placeofservice_dimensions.sql
      Updates the place of service dimension with standardized codes and descriptions for locations where healthcare services were provided.
      writes DimensionMember · reads POSCodesTransformCharge
    15. Load VisitType Dimensionssqlload_dimension_members__load_visittype_dimensions.sqldisabled
      Loads visit type dimensions from HL7 visit data to standardize appointment categories for reporting.
      writes DimensionMember · reads HL7Visit
    16. Load AccountStatus Dimensionsqlload_dimension_members__load_accountstatus_dimension.sqldisabled
      Updates account status dimensions using encounter status information to track the lifecycle of patient accounts.
      writes DimensionMember · reads SourceEncounter
    17. Load AllowedStatus Dimensionsqlload_dimension_members__load_allowedstatus_dimension.sqldisabled
      Builds allowed status dimensions to categorize how actual payments compare to expected insurance contract rates.
      writes DimensionMember
    18. Load ClaimStatus Dimensionsqlload_dimension_members__load_claimstatus_dimension.sql
      Loads claim status dimensions to define the various stages of the insurance billing and reimbursement process.
      writes DimensionMember
    19. Load DiagnosisCode Dimensionsqlload_dimension_members__load_diagnosiscode_dimension.sql
      Builds diagnosis code dimensions by extracting codes from account charges and mapping them to standardized medical categories.
      writes DimensionMember · reads AccountChargeDimensionMember
      ↳ feeds from Load ClaimStatus Dimension, Load DenialCategory Dimension, Load Facility Dimensions, Load FacilityType Dimensions, Load FinancialClass Dimension, Load Insurance Dimension, Load PatientAge Dimension, Load PatientSex Dimension, Load PlaceOfService Dimensions, Load Practice Dimensions, Load Provider Dimension, Load ProviderType Dimension, Load QuoteInsurance Dimension, Load SourceInsurance Dimension, Load State Dimension, Load Time Dimensions
    20. Load PatientAge Dimensionsqlload_dimension_members__load_patientage_dimension.sql
      Loads patient age dimensions by calculating current ages from birth dates to support demographic analysis.
      writes DimensionMember · reads Patient
    21. Load PatientSex Dimensionsqlload_dimension_members__load_patientsex_dimension.sql
      Loads patient sex dimensions from demographic records to enable gender-based reporting and filtering within the pipeline.
      writes DimensionMember · reads Patient
    22. Load State Dimensionsqlload_dimension_members__load_state_dimension.sql
      Updates state dimensions using facility location data to allow for geographic segmentation of healthcare services and revenue.
      writes DimensionMember · reads Facility
  8. Load-Account-Datasub-job · 14Load Account-Level Tables
    1. ReprocessChangedConfigurationsReprocessChangedConfigurations
      Identify and queue visits or accounts affected by configuration changes to ensure historical data reflects updated pricing or insurance rules.
      reprocess accounts
    2. AccountsToReprocess -> AccountDeltasqlload_account_data__accountstoreprocess_accountdelta.sql
      Identifies and adds unique account IDs requiring reprocessing to the delta table for incremental updates.
      writes AccountDelta · reads AccountDeltaAccountsToReprocess
    3. Load ChargeMeasuressqlload_account_data__load_chargemeasures.sql
      Updates charge-level financial metrics, including payments, adjustments, and denial categories, for accounts identified in the delta table.
      writes ChargeMeasures · reads AccountDeltaTransformAccountTransformChargeTransformChargeTransactionMeasure
      ↳ feeds from AccountsToReprocess -> AccountDelta
    4. Load AccountChargesqlload_account_data__load_accountcharge.sqldisabled
      Rebuilds the charge measures table by aggregating financial data and denial categories for current charges within the delta set.
      writes AccountChargeChargeMeasures · reads AccountDeltaChargeMeasuresChargeTypePatientProviderTransformAccountTransformCharge
    5. Load Accountsqlload_account_data__load_account.sqldisabled
      Updates the account table with aggregated financial totals, insurance mapping, and primary denial categories for accounts in the delta.
      writes Account · reads AccountChargeAccountDeltaInsuranceMapPatientTransformAccountTransformChargeTransactionMeasure
    6. Load AccountRemitsqlload_account_data__load_accountremit.sqldisabled
      Loads detailed remittance and transaction history, including payment descriptions and payer information, for accounts requiring updates.
      writes AccountRemit · reads AccountDeltaInsuranceMapTransformAccountTransformChargeTransformTransaction
    7. Clean Estimatessqlload_account_data__clean_estimates.sqldisabled
      Removes outdated non-scenario insurance estimates and associated charge calculations for encounters identified in the delta table.
      writes AccountEstimateAccountEstimateCalculationAccountEstimateCharge · reads AccountEstimateEncounterDelta
    8. LoadAccountDataLoadAccountData
      Imports historical billing data from external systems into core account tables while preserving manual user modifications and application fields.
      · reads AccountChargeAccountDeltaChargeMeasuresChargeTypeInsuranceMapPatientProviderSourcePatBilling
      ↳ feeds from AccountsToReprocess -> AccountDelta, Load ChargeMeasures
      custom account charge querycustom account querycustom account remit querycustom account insurance query
    9. Score-Accountssub-job · 1
      1. BatchProcessAccountDataBatchProcessAccountData
        Calculates patient account estimates across multiple facilities and insurance types to update pricing after contract or configuration changes.
        writes AccountEstimate · reads QuoteBatchVisitBatch
        incremental
    10. Load-Custom-Propertiessub-job · 4
      1. Update Has DenialUpdateCustomPropertyFromQuery
        · reads Accountaccountdelta
        entity=Accountcustom property key=HasDenialcustom query
      2. Update Allowed StatusUpdateCustomPropertyFromQuery
        · reads AccountAccountEstimateaccountdelta
        entity=Accountcustom property key=AllowedStatuscustom query
      3. Load-Custom-Property-Memberssub-job · 1
        1. Experity Insurancesqlload_custom_property_members__experity_insurance.sql
          Updates custom insurance property members using active mapping data to maintain consistent display names and ordering.
          writes CustomPropertyMember · reads InsuranceMap
      4. Update ExperityInsuranceUpdateCustomPropertyFromQuery
        · reads InsuranceMapTransformAccountaccountdelta
        entity=Accountcustom property key=ExperityInsurancecustom query
    11. Load AccountDetailsqlload_account_data__load_accountdetail.sqldisabled
      Populates a comprehensive account detail table merging patient demographics, provider information, and financial performance metrics for delta accounts.
      writes AccountDetail · reads AccountAccountChargeAccountDeltaAccountEstimateDimensionMemberPatientSourceEncounterInsuranceSourcePayer
    12. Load AccountChargeDetailsqlload_account_data__load_accountchargedetail.sqldisabled
      Loads granular charge-level details, including procedure codes, modifiers, and specific financial balances, for accounts in the delta set.
      writes AccountChargeDetail · reads AccountAccountChargeAccountDeltaAccountEstimateCalculationAccountEstimateChargeDimensionMemberPatientSourceEncounterInsurance
    13. WorkqueueAssignmentWorkqueueAssignment
      Assigns accounts or visits to workqueue stacks by evaluating matching criteria and updating item lists based on search terms.
  9. Execute Update Dashboard TablesUpdateDashboardTables
    Regenerates optimized aggregate tables for all dashboard reports and updates their definitions to reflect the latest source data.