Legacy Pipeline Atlas worker-1snapshot 2026-07-15

sub-job

OrthoAlliance · Process-NextGen-Data_ProcessDataFile

called by Daily-Accounts-Processing

sub-job OrthoAlliance/Process-NextGen-Data_ProcessDataFile · db OrthoAlliance_ProdMirror · updated 2026-05-29

task tree

What the sub-job runs

Tasks in order, each with what it does — typed stepsfrom the MDClarity task docs (click to open the reference), sub-jobsyou can expand inline (▶) to reveal their own tasks, and SQL steps summarized by Gemini (✨). Every step shows the tables it writes/reads and which earlier step it feeds from(sqlglot lineage).

sub-job

Process-NextGen-Data_ProcessDataFile

14 tasks · OrthoAlliance
sub-job / Flow action SQL / native step▶ expand a sub-job inline · ↗ open it as its own page · a typed step opens its doc
  1. DownloadDownload
    Downloads files from remote FTP or SFTP servers to local directories with support for archiving and parallel transfers.
    server=OrthoAlliance_ProdMirror-mdcssh-sftpremote directory=/local directory={SourceDataFolder}
  2. ▶Load-Adjustment_ProcessDataFilesub-job · 1↗
    1. Process ExportAdjustmentProcessFile
      writes ImportAdjustmentSourceAdjustment
      file path={FilePath}archive directory={SourceDataArchive}base table name=Adjustmentrow terminator=Newlinecolumn separator=Pipe
  3. ▶Load-Appointment_ProcessDataFilesub-job · 1↗
    1. Load ExportAppointmentProcessFile
      writes ImportAppointmentSourceAppointment
      file path={FilePath}archive directory={SourceDataArchive}base table name=Appointmentrow terminator=Newlinecolumn separator=Pipe
  4. ▶Load-Charge_ProcessDataFilesub-job · 1↗
    1. Load ExportChargeProcessFile
      writes ImportChargeSourceCharge
      file path={FilePath}archive directory={SourceDataArchive}base table name=Chargerow terminator=Newlinecolumn separator=Pipe
  5. ▶Load-ChargeMaster_ProcessDataFilesub-job · 1↗
    1. Load ExportChargemasterProcessFile
      writes ImportChargeMasterSourceChargeMaster
      file path={FilePath}archive directory={SourceDataArchive}base table name=ChargeMasterrow terminator=Newlinecolumn separator=Pipe
  6. ▶Load-Encounter_ProcessDataFilesub-job · 1↗
    1. Load ExportEncounterProcessFile
      writes ImportEncounterSourceEncounter
      file path={FilePath}archive directory={SourceDataArchive}base table name=Encounterrow terminator=Newlinecolumn separator=Pipe
  7. ▶Load-EncounterInsurancesub-job · 4↗
    1. Scan ExportEncounterInsuranceScanFiledisabled
      data file spec key=ImportEncounterInsurancefile path={FilePath}table name=ImportEncounterInsurancerow terminator=Newlinecolumn separator=Pipe
    2. Load ImportEncounterInsuranceLoadFile
      writes ImportEncounterInsurance
      data file spec=ImportEncounterInsurancefile path={FilePath}import mode=Replacearchive file path={SourceDataArchive}
    3. Create uci_ImportEncounterInsurancesqlload_encounterinsurance__create_uci_importencounterinsurance.sql
      ✨ Builds a unique index on encounter insurance import data to optimize performance and ensure record uniqueness during processing.
      · reads ImportEncounterInsurance
      ↳ feeds from Load ImportEncounterInsurance
    4. Delete/Insert SourceEncounterInsurancesqlload_encounterinsurance__delete_insert_sourceencounterinsurance.sql
      ✨ Updates encounter insurance records while adjusting coordination of benefits logic to handle multiple insurance plans per patient visit.
  8. ▶Load-Event_ProcessDataFilesub-job · 1↗
    1. Load ExportEventProcessFile
      writes ImportEventSourceEvent
      file path={FilePath}archive directory={SourceDataArchive}base table name=Eventrow terminator=Newlinecolumn separator=Pipe
  9. ▶Load-Location_ProcessDataFilesub-job · 1↗
    1. Load ExportLocationProcessFile
      writes ImportLocationSourceLocation
      file path={FilePath}archive directory={SourceDataArchive}base table name=Locationrow terminator=Newlinecolumn separator=Pipe
  10. ▶Load-Patient_ProcessDataFilesub-job · 1↗
    1. Load ExportPatientProcessFile
      writes ImportPatientSourcePatient
      file path={FilePath}archive directory={SourceDataArchive}base table name=Patientrow terminator=Newlinecolumn separator=Pipe
  11. ▶Load-PatientInsurance_ProcessDataFilesub-job · 2↗
    1. PatientInsurance File CleanupExecuteProcess
      command=powershell.exe
    2. Load ExportPatientInsuranceProcessFile
      writes ImportPatientInsuranceSourcePatientInsurance
      file path={FilePath}archive directory={SourceDataArchive}base table name=PatientInsurancerow terminator=Newlinecolumn separator=Pipe
  12. ▶Load-Payer_ProcessDataFilesub-job · 1↗
    1. Load ExportPayerProcessFile
      writes ImportPayerSourcePayer
      file path={FilePath}archive directory={SourceDataArchive}base table name=Payerrow terminator=Newlinecolumn separator=Pipe
  13. ▶Load-Provider_ProcessDataFilesub-job · 1↗
    1. Load ExportProviderProcessFile
      writes ImportProviderSourceProvider
      file path={FilePath}archive directory={SourceDataArchive}base table name=Providerrow terminator=Newlinecolumn separator=Pipe
  14. ▶Load-TransactionDetail_ProcessDataFilesub-job · 1↗
    1. Process ExportTransactionDetail DataFileProcessFile
      writes ImportTransactionDetailSourceTransactionDetail
      file path={FilePath}archive directory={SourceDataArchive}base table name=TransactionDetailrow terminator=Newlinecolumn separator=Pipe