Legacy Pipeline Atlas worker-1snapshot 2026-07-15

sub-job

PPRM · Load-NextGen-Files

*TROUBLESHOOTING NOTE: The password contains an escape character \ before the ". This WILL NOT WORK if attempting to connect manually via FileZilla. Remove it from the password first. Job Description: Downloads and imports NextGen data

called by Daily-Visit-Processing

sub-job PPRM/Load-NextGen-Files · db PPRM_ProdMirror · updated 2025-09-17

task tree

What the sub-job runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

sub-job

Load-NextGen-Files

30 tasks · PPRM
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. DownloadDownload
    Downloads files from remote FTP or SFTP servers to local directories with support for archiving and parallel transfers.
    server=PPRM_ProdMirror-mdcssh-sftpremote directory=/local directory={SourceDataFolder}
  2. Load AppointmentsLoadFile
    writes ImportAppointment
    data file spec=ImportAppointmentimport mode=Replace
  3. Load SourceAppointmentsqlload_nextgen_files__load_sourceappointment.sql
    ✨ Loads appointment details from the import table into the source repository, replacing existing records to ensure data freshness.
    writes SourceAppointment · reads ImportAppointment
    ↳ feeds from Load Appointments
  4. Load PatientsLoadFile
    writes ImportPatient
    data file spec=ImportPatientfile path={SourceDataFolder}\ExportPatient.txtimport mode=Replace
  5. Load SourcePatientsqlload_nextgen_files__load_sourcepatient.sql
    ✨ Updates the source patient table by replacing existing records with the latest demographic and contact information from the import layer.
    writes SourcePatient · reads ImportPatient
    ↳ feeds from Load Patients
  6. Load Patient InsuranceLoadFile
    writes ImportPatientInsurance
    data file spec=ImportPatientInsuranceimport mode=Replace
  7. Load SourcePatientInsurancesqlload_nextgen_files__load_sourcepatientinsurance.sql
    ✨ Loads patient insurance coverage and eligibility details into the source table, overwriting existing records for the same individuals.
    writes SourcePatientInsurance · reads ImportPatientInsurance
    ↳ feeds from Load Patient Insurance
  8. Load PayerLoadFile
    writes ImportPayer
    data file spec=ImportPayerfile path={SourceDataFolder}\ExportPayer.txtimport mode=Replace
  9. Load SourcePayersqlload_nextgen_files__load_sourcepayer.sql
    ✨ Refreshes the source payer table with updated insurance company information, financial classes, and subgroup classifications from the import data.
    writes SourcePayer · reads ImportPayerSourcePayer
    ↳ feeds from Load Payer
  10. Load ProvidersLoadFile
    writes ImportProvider
    data file spec=ImportProviderfile path={SourceDataFolder}\ExportProviders.txtimport mode=Replace
  11. Load SourceProvidersqlload_nextgen_files__load_sourceprovider.sql
    ✨ Updates the source provider registry with current credentials, specialties, and NPI data by replacing existing records with imported values.
    writes SourceProvider · reads ImportProviderSourceProvider
    ↳ feeds from Load Providers
  12. Load ChargeMasterLoadFile
    writes ImportChargeMaster
    data file spec=ImportChargeMasterimport mode=Replace
  13. Load SourceChargeMastersqlload_nextgen_files__load_sourcechargemaster.sql
    ✨ Synchronizes the charge master by updating existing service prices and descriptions or inserting new charge codes and library definitions.
    writes SourceChargeMaster · reads ImportChargeMaster
    ↳ feeds from Load ChargeMaster
  14. Load EncountersLoadFiledisabled
    writes ImportEncounter
    data file spec=ImportEncounterfile path={SourceDataFolder}\ExportEncounters.txtimport mode=ReplaceDISABLED
  15. Load SourceEncountersqlload_nextgen_files__load_sourceencounter.sqldisabled
    ✨ Loads clinical encounter and billing balance information into the source table, replacing existing records to maintain current visit status.
    writes SourceEncounter · reads ImportEncounterSourceEncounter
  16. Load ChargesLoadFiledisabled
    writes ImportCharge
    data file spec=ImportChargefile path={SourceDataFolder}\ExportCharges.txtimport mode=ReplaceDISABLED
  17. Load SourceChargesqlload_nextgen_files__load_sourcecharge.sqldisabled
    ✨ Loads and refreshes encounter charge details from imported files into the source charge table.
    writes SourceCharge · reads ImportChargeSourceCharge
  18. Load AdjustmentsLoadFiledisabled
    writes ImportAdjustment
    data file spec=ImportAdjustmentimport mode=ReplaceDISABLED
  19. Load SourceAdjustmentsqlload_nextgen_files__load_sourceadjustment.sqldisabled
    ✨ Loads and refreshes financial adjustment records from imported files into the source adjustment table.
    writes SourceAdjustment · reads ImportAdjustmentSourceAdjustment
  20. Load TransactionDetailLoadFiledisabled
    writes ImportTransactionDetail
    data file spec=ImportTransactionDetailimport mode=ReplaceDISABLED
  21. Load SourceTransactionDetailsqlload_nextgen_files__load_sourcetransactiondetail.sqldisabled
    ✨ Loads and refreshes detailed transaction data for encounters and patient accounts from imported files into the source table.
    writes SourceTransactionDetail · reads ImportTransactionDetailSourceTransactionDetail
  22. Load Encounter InsuranceLoadFiledisabled
    writes ImportEncounterInsurance
    data file spec=ImportEncounterInsuranceimport mode=ReplaceDISABLED
  23. Load SourceEncounterInsurancesqlload_nextgen_files__load_sourceencounterinsurance.sqldisabled
    ✨ Loads and refreshes insurance coverage and policy details for specific encounters from imported files into the source table.
    writes SourceEncounterInsurance · reads ImportEncounterInsuranceSourceEncounterInsurance
  24. Load ImportEventLoadFile
    writes ImportEvent
    data file spec=ImportEventfile path={SourceDataFolder}\ExportEvent.txtimport mode=Replace
  25. Load SourceEventsqlload_nextgen_files__load_sourceevent.sql
    ✨ Synchronizes event definitions and metadata from imported files into the source event table to maintain current records.
    writes SourceEvent · reads ImportEvent
    ↳ feeds from Load ImportEvent
  26. Load LocationsLoadFile
    writes ImportLocation
    data file spec=ImportLocationfile path={SourceDataFolder}\ExportLocation.txtimport mode=Replace
  27. Load SourceLocationsqlload_nextgen_files__load_sourcelocation.sql
    ✨ Loads and refreshes facility and service location details from imported files into the source location table.
    writes SourceLocation · reads ImportLocationSourceLocation
    ↳ feeds from Load Locations
  28. Load ImportPatientRelationLoadFile
    writes ImportPatientRelation
    data file spec=ImportPatientRelationimport mode=Replace
  29. Load SourcePatientRelationsqlload_nextgen_files__load_sourcepatientrelation.sql
    ✨ Loads and refreshes patient relationship and guarantor data from imported files into the source patient relation table.
    writes SourcePatientRelation · reads ImportPatientRelationSourcePatientRelation
    ↳ feeds from Load ImportPatientRelation
  30. Archive FilesExecuteProcess
    command=cmd.exe