Legacy Pipeline Atlas worker-1snapshot 2026-07-15

sub-job

USHP · RevFind-Source-ProcessNextGenData

called by RevFind-Daily-Processing-Accounts

sub-job USHP/RevFind-Source-ProcessNextGenData · db USHP_ProdMirror · updated 2026-04-03

task tree

What the sub-job runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

sub-job

RevFind-Source-ProcessNextGenData

19 tasks · USHP
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. DownloadDownload
    Downloads files from remote FTP or SFTP servers to local directories with support for archiving and parallel transfers.
    server=USHP_ProdMirror-mdcssh-sftpremote directory=/MDClarity/local directory={SourceDataFolder}remote archive directory=/Archive/
  2. Clean Appointment ExtractExecuteProcess
    command=powershell.exe
  3. Clean PatientInsurance ExtractExecuteProcess
    command=powershell.exe
  4. Clean ChargeMaster ExtractExecuteProcess
    command=powershell.exe
  5. Dedupe Charges FIle (temporarily-[id])ExecuteProcess
    command=powershell.exe
  6. Process ExportAdjustmentProcessFile
    writes ImportAdjustmentSourceAdjustment
    archive directory={SourceDataArchive}base table name=Adjustmentrow terminator=Newlinecolumn separator=Pipe
  7. Load ExportAppointmentProcessFile
    writes ImportAppointmentSourceAppointment
    archive directory={SourceDataArchive}base table name=Appointmentrow terminator=Newlinecolumn separator=Pipe
  8. Load ExportChargeProcessFile
    writes ImportChargeSourceCharge
    archive directory={SourceDataArchive}base table name=Chargerow terminator=Newlinecolumn separator=Pipe
  9. Load ImportChargeMasterProcessFile
    writes ImportChargeMasterSourceChargeMaster
    archive directory={SourceDataArchive}base table name=ChargeMasterrow terminator=Newlinecolumn separator=Pipe
  10. Load ExportEncounterProcessFile
    writes ImportEncounterSourceEncounter
    archive directory={SourceDataArchive}base table name=Encounterrow terminator=Newlinecolumn separator=Pipe
  11. Load ImportEncounterInsurance DataFileLoadFile
    writes ImportEncounterInsurance
    data file spec=ImportEncounterInsuranceimport mode=Replacearchive file path={SourceDataArchive}
  12. Load SourceEncounterInsurancesqlrevfind_source_processnextgendata__load_sourceencounterinsurance.sql
    ✨ Loads encounter-specific insurance coverage details, including payer information and policy identifiers, from imported source data.
    writes sourceencounterinsurance · reads ImportEncounterInsurance
    ↳ feeds from Load ImportEncounterInsurance DataFile
  13. Load ExportEventProcessFile
    writes ImportEventSourceEvent
    file path={SourceDataFolder}\TempExportEvent.txtarchive directory={SourceDataArchive}base table name=Eventrow terminator=Newlinecolumn separator=Pipe
  14. Load ExportLocationProcessFile
    writes ImportLocationSourceLocation
    archive directory={SourceDataArchive}base table name=Locationrow terminator=Newlinecolumn separator=Pipe
  15. Load ExportPatientProcessFile
    writes ImportPatientSourcePatient
    archive directory={SourceDataArchive}base table name=Patientrow terminator=Newlinecolumn separator=Pipe
  16. Load ExportPatientInsuranceProcessFile
    writes ImportPatientInsuranceSourcePatientInsurance
    archive directory={SourceDataArchive}base table name=PatientInsurancerow terminator=Newlinecolumn separator=Pipe
  17. Load ExportPayerProcessFile
    writes ImportPayerSourcePayer
    file path={SourceDataFolder}\TempExportPayer.txtarchive directory={SourceDataArchive}base table name=Payerrow terminator=Newlinecolumn separator=Pipe
  18. Load ExportProviderProcessFile
    writes ImportProviderSourceProvider
    archive directory={SourceDataArchive}base table name=Providerrow terminator=Newlinecolumn separator=Pipe
  19. Process ExportTransactionDetail DataFileProcessFile
    writes ImportTransactionDetailSourceTransactionDetail
    archive directory={SourceDataArchive}base table name=TransactionDetailrow terminator=Newlinecolumn separator=Pipe