Ops Alert Emails · Classified

Pipeline failures, last 6 months

Every ops/alert email — batch job failures, SQL Server alerts, Dagster+ asset alerts, and SQL Beacon health checks — parsed into a queryable substrate. The story underneath the volume: a handful of chronic feeds and transport drops pulling from a few flaky vendors.
5,059
alert emails
4,425
job failures
1,451
transport failures
32
customers affected
86%
HTTP retries exhausted
98%
joined to legacy-export tenant profile
Window 2025-09-09 → 2026-07-01. Counts are real (Gmail messages.list, not thread-grouping). Built from the alert substrate as of 2026-07-01; aggregates only, no patient data. Failing customers are joined to the legacy-export bundle to attribute each to its source systems & product.
How the raw volume collapses: alert emails → distinct incident-days → distinctjobs. Most emails are same-day retries of the same failure, so the true signal is far smaller than the inbox count.
4,425 alert emails▸1,468 incident-days▸72 distinct jobs67% of emails are same-day retries

What's regressing right now

The single worst-trending feed this month: its failure count against a baseline, with themonthly trend, share of retries exhausted, top error categories, and theby-hour spread that shows it's not a maintenance window.
⚠ RegressionNWDerm · FHIR-Processingselect.nextech-api.com
428
failures in 2026-06
▲ 813% vs 46.9/mo baseline
monthly
SONDJFMAMJJ
94% retries exhausted
447 transport failures
server_error 423http_524 11service_unavailable 8
by hour (UTC)spread across the day — not a maintenance window
Transport failures by vendor, per month — the spike is one vendor.
25-09525-10125-111725-1215026-0119526-0217426-0312626-046426-0511926-0659826-072
nextechappsmmapiapisftpother

The four alert streams

Total volume in each of the four alert sources over the window — batch job failures,SQL Beacon health checks, SQL Server Agent alerts, and the new-stackDagster+ asset alerts — with the date span each one covers.
4,425
Batch job failures
legacy pipeline jobs
2025-09-09 → 2026-07-01
464
SQL Beacon health checks
daily per-server checks
2026-01-27 → 2026-07-01
112
SQL Server Agent alerts
severity 016/017/020
2025-09-17 → 2026-06-30
58
Dagster+ asset alerts
new stack (since May)
2026-05-12 → 2026-07-01

Who's failing — by source system & product

Each failing tenant joined to its legacy-export profile, so failures roll up to theEHR family / source system they pull from and the product they run. The transport-drop subset is overlaid — it concentrates on the HL7 & ModMed file feeds and the FHIR API.
By EHR family / source system
A tenant pulling from several sources counts toward each — this reads as“failures from tenants touching X”, not a partition.
HL7 v2 messages7 tenants
2,121932 transport
FHIR API2 tenants
1,242479 transport
ModMed2 tenants
807533 transport
MSN LLC (radiology service bureau)1 tenant
61640 transport
NextGen6 tenants
39851 transport
(none recorded)4 tenants
3718 transport
eClinicalWorks (ECW)3 tenants
16212 transport
athenahealth2 tenants
15616 transport
Phygen2 tenants
122
X12 EDI claims / remits4 tenants
81
AWS QuickSight export1 tenant
52
Experity (CCP)1 tenant
18
Snowflake (varies)1 tenant
14
By product
Product is single-valued per tenant — a clean split.
ClarityFlow9 tenants
2,7441,332 transport
ClarityFlow, RevFind6 tenants
1,159119 transport
RevFind12 tenants
412
(unknown)1 tenant
22
Off-export — running on the new stack

4 tenants failing withno legacy pipeline profile (88 failures): AVP, MedWise, OENT, Partnercare. These are the migration tell — failures from tenants the legacy export no longer describes.

all job failurestransport-layer subset (remote data-pull drops)

Cutting through the noise — one cell per day a job failed

Raw email counts are dominated by retry storms. At day granularity the real shape shows: a few feeds fail every day (chronic), others detonate in short bursts.
SepOctNovDecJanFebMarAprMayJunJul
NWDerm FHIR-Processing
2025-09-13: 2 emails2025-10-02: 1 email2025-12-05: 11 emails2025-12-15: 9 emails2025-12-17: 1 email2026-01-04: 1 email2026-01-25: 1 email2026-01-28: 1 email2026-02-12: 1 email2026-02-13: 2 emails2026-02-15: 1 email2026-02-16: 3 emails2026-02-17: 3 emails2026-02-20: 1 email2026-02-22: 45 emails2026-02-23: 1 email2026-03-05: 67 emails2026-03-06: 172 emails2026-03-12: 7 emails2026-03-13: 1 email2026-03-14: 1 email2026-03-25: 1 email2026-03-29: 1 email2026-04-13: 21 emails2026-04-15: 5 emails2026-04-19: 1 email2026-04-29: 3 emails2026-05-01: 4 emails2026-05-09: 1 email2026-05-10: 1 email2026-05-21: 3 emails2026-05-31: 2 emails2026-06-13: 389 emails2026-06-28: 39 emails
EugeneGI Flow-MM-HL7-Processing
2025-11-21: 3 emails2025-11-26: 1 email2025-11-27: 2 emails2025-11-28: 6 emails2025-11-30: 4 emails2025-12-01: 3 emails2025-12-04: 2 emails2025-12-05: 6 emails2025-12-06: 5 emails2025-12-07: 4 emails2025-12-08: 6 emails2025-12-09: 3 emails2025-12-10: 10 emails2025-12-11: 32 emails2025-12-12: 9 emails2025-12-13: 2 emails2025-12-14: 3 emails2025-12-15: 5 emails2025-12-16: 2 emails2025-12-17: 12 emails2025-12-20: 7 emails2025-12-21: 5 emails2025-12-22: 8 emails2025-12-24: 5 emails2025-12-25: 2 emails2025-12-26: 3 emails2025-12-27: 8 emails2025-12-28: 4 emails2025-12-29: 2 emails2025-12-30: 1 email2025-12-31: 3 emails2026-01-01: 1 email2026-01-02: 3 emails2026-01-05: 8 emails2026-01-06: 3 emails2026-01-07: 3 emails2026-01-08: 5 emails2026-01-09: 5 emails2026-01-12: 10 emails2026-01-14: 7 emails2026-01-16: 4 emails2026-01-17: 10 emails2026-01-18: 1 email2026-01-19: 7 emails2026-01-20: 1 email2026-01-21: 3 emails2026-01-22: 2 emails2026-01-23: 7 emails2026-01-24: 5 emails2026-01-26: 6 emails2026-01-27: 9 emails2026-01-28: 4 emails2026-01-29: 2 emails2026-01-30: 20 emails2026-01-31: 47 emails2026-02-01: 1 email2026-02-02: 15 emails2026-02-04: 3 emails2026-02-05: 2 emails2026-02-09: 5 emails2026-02-11: 4 emails2026-02-12: 1 email2026-02-13: 3 emails2026-02-14: 2 emails2026-02-15: 2 emails2026-02-16: 3 emails2026-02-17: 4 emails2026-02-18: 2 emails2026-02-19: 5 emails2026-02-20: 1 email2026-02-24: 3 emails2026-02-26: 1 email2026-02-27: 1 email2026-02-28: 2 emails2026-03-01: 3 emails2026-03-02: 2 emails2026-03-05: 3 emails2026-03-06: 2 emails2026-03-07: 1 email2026-03-08: 1 email2026-03-09: 1 email2026-03-11: 1 email2026-03-12: 3 emails2026-03-13: 2 emails2026-03-14: 1 email2026-03-16: 6 emails2026-03-17: 1 email2026-03-18: 2 emails2026-03-19: 2 emails2026-03-21: 1 email2026-03-23: 4 emails2026-03-24: 2 emails2026-03-25: 1 email2026-03-26: 1 email2026-03-27: 18 emails2026-03-28: 1 email2026-03-31: 3 emails2026-04-01: 2 emails2026-04-02: 1 email2026-04-03: 2 emails2026-04-04: 1 email2026-04-07: 2 emails2026-04-08: 2 emails2026-04-09: 1 email2026-04-10: 2 emails2026-04-12: 1 email2026-04-13: 6 emails2026-04-16: 3 emails2026-04-17: 1 email2026-04-19: 1 email2026-04-20: 2 emails2026-04-21: 2 emails2026-04-22: 1 email2026-04-23: 2 emails2026-04-25: 1 email2026-04-27: 2 emails2026-04-29: 5 emails2026-04-30: 3 emails2026-05-01: 2 emails2026-05-02: 2 emails2026-05-03: 3 emails2026-05-06: 2 emails2026-05-07: 4 emails2026-05-08: 3 emails2026-05-11: 4 emails2026-05-12: 1 email2026-05-13: 5 emails2026-05-14: 1 email2026-05-15: 1 email2026-05-16: 3 emails2026-05-17: 1 email2026-05-19: 3 emails2026-05-20: 4 emails2026-05-21: 2 emails2026-05-22: 4 emails2026-05-24: 2 emails2026-05-25: 1 email2026-05-26: 3 emails2026-05-27: 1 email2026-05-28: 3 emails2026-05-29: 1 email2026-05-30: 1 email2026-05-31: 6 emails2026-06-01: 2 emails2026-06-02: 4 emails2026-06-05: 2 emails2026-06-07: 1 email2026-06-09: 4 emails2026-06-10: 3 emails2026-06-11: 1 email2026-06-12: 1 email2026-06-13: 3 emails2026-06-14: 3 emails2026-06-15: 4 emails2026-06-16: 2 emails2026-06-18: 3 emails2026-06-19: 3 emails2026-06-20: 2 emails2026-06-21: 1 email2026-06-22: 3 emails2026-06-23: 1 email2026-06-24: 2 emails2026-06-25: 7 emails2026-06-26: 4 emails2026-06-27: 4 emails2026-06-28: 1 email2026-06-29: 5 emails2026-06-30: 5 emails2026-07-01: 1 email
RIA Flow-HL7-Processing
2025-09-12: 1 email2025-09-15: 1 email2025-09-23: 4 emails2025-09-29: 1 email2025-10-01: 2 emails2025-10-06: 16 emails2025-10-07: 27 emails2025-10-10: 1 email2025-11-07: 1 email2025-11-11: 2 emails2025-11-14: 8 emails2025-11-15: 13 emails2025-11-20: 1 email2025-12-08: 2 emails2025-12-12: 6 emails2025-12-17: 1 email2025-12-18: 38 emails2025-12-19: 2 emails2026-01-02: 11 emails2026-01-04: 1 email2026-01-09: 8 emails2026-01-13: 2 emails2026-01-16: 2 emails2026-01-17: 1 email2026-01-19: 26 emails2026-01-20: 100 emails2026-01-25: 1 email2026-01-26: 1 email2026-02-02: 16 emails2026-02-04: 1 email2026-02-05: 2 emails2026-02-09: 1 email2026-02-12: 1 email2026-02-16: 3 emails2026-02-17: 14 emails2026-02-18: 2 emails2026-02-19: 7 emails2026-02-20: 2 emails2026-02-21: 1 email2026-02-22: 8 emails2026-02-24: 1 email2026-02-25: 1 email2026-03-03: 1 email2026-03-23: 1 email2026-04-01: 1 email2026-04-03: 34 emails2026-04-11: 8 emails2026-04-22: 1 email2026-04-26: 1 email2026-04-28: 1 email2026-04-29: 1 email2026-05-04: 2 emails2026-05-05: 1 email2026-05-06: 1 email2026-05-07: 1 email2026-05-08: 1 email2026-05-09: 2 emails2026-05-10: 1 email2026-05-12: 1 email2026-05-13: 3 emails2026-05-14: 21 emails2026-05-15: 2 emails2026-05-16: 1 email2026-05-17: 1 email2026-05-18: 1 email2026-05-19: 1 email2026-05-20: 2 emails2026-05-21: 3 emails2026-05-22: 51 emails2026-05-23: 2 emails2026-05-24: 2 emails2026-05-25: 2 emails2026-05-26: 2 emails2026-05-27: 4 emails2026-05-28: 3 emails2026-05-31: 2 emails2026-06-01: 2 emails2026-06-02: 3 emails2026-06-07: 7 emails2026-06-09: 4 emails2026-06-10: 3 emails2026-06-11: 3 emails2026-06-12: 1 email2026-06-14: 3 emails2026-06-15: 3 emails2026-06-16: 3 emails2026-06-17: 3 emails2026-06-20: 1 email2026-06-21: 3 emails2026-06-22: 3 emails2026-06-23: 3 emails2026-06-24: 3 emails2026-06-25: 3 emails2026-06-26: 3 emails2026-06-27: 3 emails2026-06-28: 11 emails2026-06-29: 3 emails2026-06-30: 7 emails2026-07-01: 3 emails
MannEye Flow-FHIR-Processing
2025-09-09: 1 email2025-09-10: 1 email2025-09-11: 1 email2025-09-12: 8 emails2025-09-13: 1 email2025-09-14: 1 email2025-09-15: 1 email2025-09-16: 1 email2025-09-17: 1 email2025-09-18: 1 email2025-09-19: 3 emails2025-09-20: 1 email2025-09-21: 1 email2025-09-22: 1 email2025-09-23: 1 email2025-09-24: 1 email2025-09-25: 1 email2025-09-26: 1 email2025-09-27: 1 email2025-09-28: 1 email2025-09-29: 1 email2025-09-30: 1 email2025-10-01: 13 emails2025-10-02: 1 email2025-10-03: 1 email2025-10-04: 1 email2025-10-05: 1 email2025-10-06: 1 email2025-10-07: 1 email2025-10-08: 9 emails2025-10-09: 1 email2025-10-10: 2 emails2025-10-11: 1 email2025-10-12: 1 email2025-10-13: 1 email2025-10-14: 1 email2025-10-15: 1 email2025-10-16: 1 email2025-10-17: 2 emails2025-10-18: 1 email2025-10-19: 1 email2025-10-20: 29 emails2025-10-21: 1 email2025-10-22: 1 email2025-10-23: 1 email2025-10-24: 8 emails2025-10-25: 1 email2025-10-26: 1 email2025-10-27: 1 email2025-10-28: 1 email2025-10-29: 1 email2025-10-30: 1 email2025-10-31: 2 emails2025-11-01: 1 email2025-11-02: 1 email2025-11-03: 1 email2025-11-04: 1 email2025-11-05: 1 email2025-11-06: 1 email2025-11-07: 7 emails2025-11-08: 1 email2025-11-09: 1 email2025-11-10: 1 email2025-11-11: 2 emails2025-11-12: 1 email2025-11-13: 6 emails2025-11-14: 5 emails2025-11-15: 1 email2025-11-16: 1 email2025-11-17: 1 email2025-11-18: 1 email2025-11-20: 4 emails2025-11-21: 1 email2025-11-22: 1 email2025-11-23: 1 email2025-11-24: 1 email2025-11-25: 1 email2025-11-26: 1 email2025-11-27: 1 email2025-11-28: 1 email2025-11-29: 1 email2025-11-30: 1 email2025-12-01: 1 email2025-12-02: 1 email2025-12-03: 1 email2025-12-04: 31 emails2025-12-05: 10 emails2025-12-06: 1 email2025-12-07: 1 email2025-12-08: 1 email2025-12-09: 1 email2025-12-10: 1 email2025-12-11: 1 email2025-12-12: 16 emails2025-12-13: 1 email2025-12-14: 1 email2025-12-15: 1 email2025-12-16: 1 email2025-12-17: 2 emails2025-12-18: 1 email2025-12-19: 5 emails2025-12-20: 1 email2025-12-21: 1 email2025-12-22: 1 email2025-12-23: 1 email2025-12-24: 1 email2025-12-25: 1 email2025-12-26: 1 email2025-12-27: 1 email2025-12-28: 1 email2025-12-29: 1 email2025-12-30: 1 email2025-12-31: 1 email2026-01-01: 10 emails2026-01-02: 3 emails2026-01-03: 1 email2026-01-04: 1 email2026-01-05: 1 email2026-01-06: 1 email2026-01-07: 8 emails2026-01-08: 1 email2026-01-09: 2 emails2026-01-10: 1 email2026-01-11: 1 email2026-01-12: 1 email2026-01-13: 1 email2026-01-14: 1 email2026-01-15: 1 email2026-01-16: 2 emails2026-01-17: 1 email2026-01-18: 1 email2026-01-19: 1 email2026-01-20: 1 email2026-01-21: 11 emails2026-01-22: 1 email2026-01-23: 4 emails2026-01-24: 1 email2026-01-25: 1 email2026-01-26: 1 email2026-01-27: 1 email2026-01-28: 1 email2026-01-29: 1 email2026-01-30: 1 email2026-01-31: 1 email2026-02-01: 1 email2026-02-02: 1 email2026-02-03: 2 emails2026-02-04: 12 emails2026-02-05: 2 emails2026-02-06: 3 emails2026-02-07: 1 email2026-02-08: 1 email2026-02-09: 1 email2026-02-10: 1 email2026-02-11: 2 emails2026-02-12: 2 emails2026-02-13: 2 emails2026-02-14: 1 email2026-02-15: 2 emails2026-02-16: 1 email2026-02-17: 3 emails2026-02-18: 1 email2026-02-19: 2 emails2026-02-20: 2 emails2026-02-21: 1 email2026-02-22: 1 email2026-02-23: 1 email2026-02-24: 4 emails2026-02-25: 2 emails2026-02-26: 9 emails
SWOrofacial Flow-HL7-Processing
2026-01-04: 1 email2026-01-08: 6 emails2026-01-09: 1 email2026-01-10: 2 emails2026-01-13: 2 emails2026-01-14: 7 emails2026-01-15: 1 email2026-01-19: 1 email2026-01-20: 1 email2026-02-04: 1 email2026-02-08: 1 email2026-02-09: 1 email2026-02-15: 21 emails2026-02-22: 10 emails2026-02-24: 1 email2026-02-26: 1 email2026-03-03: 2 emails2026-03-10: 1 email2026-03-24: 28 emails2026-03-25: 5 emails2026-03-26: 35 emails2026-03-27: 14 emails2026-03-28: 23 emails2026-03-31: 3 emails2026-04-01: 1 email2026-04-08: 3 emails2026-04-22: 3 emails2026-04-25: 2 emails2026-04-28: 1 email2026-05-01: 3 emails2026-05-02: 25 emails2026-05-03: 2 emails2026-05-05: 8 emails2026-05-06: 1 email2026-05-08: 1 email2026-05-11: 1 email2026-05-13: 2 emails2026-05-14: 6 emails2026-05-20: 1 email2026-05-22: 6 emails2026-05-28: 1 email2026-06-10: 1 email2026-06-11: 1 email2026-06-16: 44 emails2026-06-20: 8 emails2026-06-21: 15 emails2026-06-22: 41 emails2026-06-28: 3 emails
SSR Daily-Processing
2025-09-16: 3 emails2025-09-17: 1 email2025-09-19: 1 email2025-10-01: 1 email2025-10-02: 1 email2025-11-05: 1 email2025-11-07: 1 email2025-11-20: 1 email2025-11-25: 1 email2025-12-10: 1 email2025-12-16: 7 emails2025-12-17: 12 emails2026-01-01: 1 email2026-01-02: 1 email2026-01-16: 2 emails2026-02-03: 1 email2026-02-05: 1 email2026-02-09: 13 emails2026-02-10: 25 emails2026-02-17: 2 emails2026-02-19: 1 email2026-02-23: 1 email2026-02-24: 1 email2026-03-04: 3 emails2026-03-22: 3 emails2026-04-03: 7 emails2026-04-04: 9 emails2026-04-15: 1 email2026-04-29: 1 email2026-05-04: 1 email2026-05-07: 1 email2026-05-09: 1 email2026-05-11: 15 emails2026-05-12: 16 emails2026-05-13: 33 emails2026-05-14: 15 emails2026-05-27: 1 email2026-06-02: 1 email2026-06-10: 2 emails2026-06-25: 1 email
StrideCare Flow-HL7-Processing
2025-11-11: 1 email2025-11-14: 2 emails2025-11-15: 3 emails2025-11-24: 6 emails2025-12-02: 1 email2025-12-17: 1 email2025-12-19: 2 emails2025-12-29: 1 email2026-01-23: 1 email2026-02-05: 1 email2026-02-12: 3 emails2026-02-13: 1 email2026-02-18: 2 emails2026-02-19: 2 emails2026-02-24: 1 email2026-02-25: 1 email2026-03-01: 1 email2026-03-18: 1 email2026-03-29: 1 email2026-04-28: 1 email2026-04-29: 1 email2026-05-01: 2 emails2026-05-09: 1 email2026-05-10: 1 email2026-05-27: 1 email2026-06-10: 1 email2026-06-22: 53 emails2026-06-23: 9 emails
USHP RevFind-Daily-Processing-Accounts
2025-09-10: 1 email2025-09-18: 1 email2025-09-25: 1 email2025-09-30: 1 email2025-10-01: 1 email2025-10-03: 1 email2025-10-05: 1 email2025-10-10: 1 email2025-10-16: 1 email2025-10-18: 1 email2025-10-24: 1 email2025-10-26: 1 email2025-10-28: 1 email2025-10-29: 1 email2025-10-30: 2 emails2025-12-28: 1 email2025-12-29: 1 email2025-12-30: 1 email2025-12-31: 1 email2026-01-01: 1 email2026-01-02: 1 email2026-01-03: 1 email2026-01-04: 1 email2026-01-05: 1 email2026-01-06: 1 email2026-01-17: 1 email2026-01-18: 1 email2026-01-19: 1 email2026-01-20: 1 email2026-01-21: 1 email2026-01-22: 1 email2026-01-23: 1 email2026-01-24: 1 email2026-01-25: 1 email2026-01-26: 1 email2026-01-27: 1 email2026-01-28: 1 email2026-01-29: 1 email2026-01-30: 1 email2026-01-31: 1 email2026-02-01: 1 email2026-02-02: 1 email2026-02-03: 1 email2026-02-04: 1 email2026-02-05: 1 email2026-02-06: 1 email2026-02-07: 1 email2026-02-08: 1 email2026-02-09: 1 email2026-02-10: 1 email2026-02-11: 1 email2026-02-12: 1 email2026-02-13: 1 email2026-02-14: 1 email2026-02-15: 1 email2026-02-16: 1 email2026-02-17: 1 email2026-02-18: 1 email2026-03-19: 1 email2026-03-20: 1 email2026-03-25: 1 email2026-04-01: 1 email2026-04-02: 1 email2026-04-03: 1 email2026-04-04: 1 email2026-04-08: 1 email2026-04-09: 1 email2026-04-17: 1 email2026-04-18: 1 email2026-04-19: 1 email
SeaRad Daily-Visit-Processing-HL7
2025-09-13: 1 email2025-10-03: 1 email2025-11-11: 1 email2025-11-12: 1 email2025-11-14: 2 emails2025-11-15: 13 emails2025-12-19: 3 emails2026-01-26: 1 email2026-01-27: 38 emails2026-02-05: 1 email2026-02-13: 2 emails2026-02-26: 1 email2026-03-03: 2 emails2026-03-24: 1 email2026-04-03: 1 email2026-04-11: 1 email2026-04-28: 1 email
OrthoAlliance Daily-Accounts-Processing
2025-09-18: 1 email2025-09-30: 1 email2025-10-01: 1 email2025-10-02: 1 email2025-10-11: 1 email2025-10-12: 1 email2025-10-13: 1 email2025-10-14: 1 email2025-10-15: 1 email2025-10-17: 1 email2025-11-21: 1 email2025-12-12: 1 email2025-12-21: 1 email2025-12-23: 1 email2026-01-02: 1 email2026-01-06: 1 email2026-01-07: 1 email2026-01-08: 1 email2026-01-09: 1 email2026-01-10: 1 email2026-01-11: 1 email2026-01-12: 1 email2026-02-07: 1 email2026-02-15: 1 email2026-02-20: 1 email2026-03-01: 1 email2026-03-02: 2 emails2026-03-04: 1 email2026-03-12: 1 email2026-03-25: 1 email2026-03-29: 1 email2026-03-31: 1 email2026-04-01: 1 email2026-04-06: 1 email2026-04-08: 1 email2026-04-09: 1 email2026-04-10: 1 email2026-04-11: 1 email2026-04-12: 1 email2026-04-13: 1 email2026-04-14: 1 email2026-04-15: 1 email2026-04-16: 1 email2026-04-17: 1 email2026-04-18: 1 email2026-04-19: 1 email2026-04-20: 1 email2026-04-22: 1 email2026-04-24: 1 email2026-04-27: 1 email2026-05-07: 1 email2026-05-12: 1 email2026-05-22: 1 email2026-05-27: 1 email2026-06-01: 1 email2026-06-02: 1 email2026-06-03: 1 email2026-06-04: 1 email2026-06-05: 1 email2026-06-06: 1 email2026-06-12: 1 email2026-06-16: 1 email2026-06-17: 1 email2026-06-19: 1 email2026-06-25: 1 email2026-07-01: 1 email
PAA Daily-Processing
2025-09-17: 1 email2025-09-18: 1 email2025-10-09: 1 email2025-10-10: 1 email2025-10-11: 1 email2025-10-12: 1 email2025-10-13: 1 email2025-10-14: 1 email2025-10-15: 1 email2025-10-16: 1 email2025-10-23: 1 email2025-10-28: 1 email2025-11-11: 1 email2025-11-12: 1 email2025-11-25: 1 email2025-12-09: 1 email2025-12-21: 1 email2025-12-22: 1 email2025-12-23: 1 email2025-12-29: 1 email2025-12-30: 1 email2026-01-13: 1 email2026-02-19: 1 email2026-02-28: 1 email2026-03-01: 1 email2026-03-02: 1 email2026-03-18: 1 email2026-03-19: 1 email2026-03-20: 1 email2026-03-21: 1 email2026-03-22: 1 email2026-03-23: 1 email2026-03-24: 1 email2026-03-25: 1 email2026-04-12: 1 email2026-04-21: 1 email2026-04-22: 1 email2026-04-23: 1 email2026-04-24: 1 email2026-05-10: 1 email2026-05-19: 1 email2026-05-22: 1 email2026-05-23: 1 email2026-05-24: 1 email2026-05-25: 1 email2026-05-26: 1 email2026-05-27: 1 email2026-05-28: 1 email2026-05-29: 1 email2026-05-30: 1 email2026-05-31: 1 email2026-06-01: 1 email2026-06-02: 1 email2026-06-03: 1 email2026-06-04: 1 email2026-06-05: 1 email2026-06-06: 1 email2026-06-07: 1 email2026-06-25: 1 email2026-06-26: 1 email2026-06-27: 1 email2026-06-28: 1 email2026-06-29: 1 email2026-07-01: 1 email
Partnercare Revfind-Daily-Processing
2026-01-20: 1 email2026-01-21: 1 email2026-01-22: 1 email2026-01-23: 1 email2026-01-24: 1 email2026-01-25: 1 email2026-01-26: 1 email2026-01-27: 1 email2026-01-28: 1 email2026-01-29: 1 email2026-01-30: 1 email2026-01-31: 1 email2026-02-01: 1 email2026-02-02: 1 email2026-02-03: 1 email2026-02-04: 1 email2026-02-05: 1 email2026-02-06: 1 email2026-02-07: 1 email2026-02-08: 1 email2026-02-09: 1 email2026-02-10: 1 email2026-02-11: 1 email2026-02-12: 1 email2026-02-13: 1 email2026-02-14: 1 email2026-02-15: 1 email2026-02-16: 1 email2026-02-17: 1 email2026-02-18: 1 email2026-02-19: 1 email2026-02-20: 1 email2026-02-21: 1 email2026-02-22: 1 email2026-02-23: 1 email2026-02-24: 1 email2026-02-27: 1 email2026-02-28: 1 email2026-03-01: 1 email2026-03-02: 1 email2026-03-03: 1 email2026-03-04: 1 email2026-03-05: 1 email2026-03-06: 1 email2026-03-07: 1 email2026-03-08: 1 email2026-03-09: 1 email2026-05-10: 1 email2026-05-11: 1 email2026-05-12: 1 email2026-05-13: 1 email2026-05-14: 1 email2026-05-15: 1 email2026-05-16: 1 email2026-05-17: 1 email2026-05-18: 1 email2026-05-19: 1 email2026-05-20: 1 email
each cell = one day a job failedfewermore emails/day

Alert amplification — emails vs. real incident-days

One dumbbell per job: the gap between incident-days (●) and alert emails (○) is the retry amplification — the wider the gap, the more a single real failure inflates into an inbox storm. Ordered by emails-per-day.
Jobincident-days ● ───── ○ emails
NWDerm FHIR-Processing
34→803 24×
SWOrofacial Flow-HL7-Processing
48→349 7×
RIA Flow-HL7-Processing
99→583 6×
PAA Sync-Patient-Portal-Data
8→45 6×
SSR Daily-Processing
40→191 5×
SeaRad Sync-Patient-Portal-Data
9→42 5×
SeaRad Daily-Visit-Processing-HL7
17→71 4×
EugeneGI Flow-MM-HL7-Processing
169→641 4×
StrideCare Flow-HL7-Processing
28→102 4×
MannEye Flow-FHIR-Processing
170→383 2×

Noisiest jobs — chronic vs. bursty

Top feeds by email volume, each tagged with its feed family and source EHR, and scored as chronic (fails most days) or bursty (short detonations) from its active-days spread.
Customer · JobFeedEmailsActive daysPer dayShape
NWDerm FHIR-ProcessingFHIR API
fhir8033423.6bursty
EugeneGI Flow-MM-HL7-ProcessingHL7 v2 messages
hl76411693.8chronic
RIA Flow-HL7-ProcessingHL7 v2 messages
hl7583995.9bursty
MannEye Flow-FHIR-ProcessingFHIR API
fhir3831702.3chronic
SWOrofacial Flow-HL7-ProcessingHL7 v2 messages
hl7349487.3bursty
SSR Daily-ProcessingClarityFlow
other191404.8chronic
StrideCare Flow-HL7-ProcessingHL7 v2 messages
hl7102283.6chronic
USHP RevFind-Daily-Processing-AccountsNextGen
other71701chronic
SeaRad Daily-Visit-Processing-HL7HL7 v2 messages
hl771174.2chronic
OrthoAlliance Daily-Accounts-ProcessingHL7 v2 messages
other67661chronic
PAA Daily-ProcessingPhygen
other64641chronic
Partnercare Revfind-Daily-Processingoff-export
other58581chronic
SGP RevFind-Daily-ProcessingAWS QuickSight export
other52521chronic
PAA Sync-Patient-Portal-DataPhygen
portal_sync4585.6bursty
SeaRad Sync-Patient-Portal-DataHL7 v2 messages
portal_sync4294.7chronic

Transport explorer — remote data-pull failures

The shape underneath the noise: a remote pull failing at the transport layer. SFTP/WinSCPdrops on the HL7 file feeds; HTTP 5xx / 429 / timeouts on the FHIR & API feeds. Filter by protocol, feed family, or vendor.
Protocol
Feed
Vendor
1,451 failures · 35% retries exhausted
job failurestransport
Vendor / hostFailuresExhaustedTop error categories
(sftp)8550%connection_closed 249too_many_connections 138timeout 23
select.nextech-api.com44695%server_error 423http_524 11service_unavailable 8http_520 4
apps.maxrte.com9793%http_429 69service_unavailable 11bad_gateway 8server_error 5
mmapi.ema-api.com323%gateway_timeout 18http_403 8bad_gateway 6
api.availity.com210%http_400 12http_401 9

Infrastructure — DB health & server alerts

Below the pipeline layer: SQL Beacon days each server was flagged out of its daily checks, and SQL Server Agent severity alerts (016 OS/path, 017 resource, 020 fatal connection) counted per server.
SQL Beacon — days flagged per server
10.1.104.1088/156
PROD-DB-378/156
STAGING-DB-152/156
PROD-DB-142/156
STAGING-DB-333/156
PP-PROD-DB-128/156
PP-PROD-DB-221/21
PROD-DB-421/21
PROD-DB-221/21
STAGING-DB-215/23
STRAIGHTPATH-JU7/156
SQL Server Agent alerts
PROD-DB-1OS / path (016)52
PROD-DB-3OS / path (016)41
PROD-DB-1fatal conn (020)12
PROD-DB-3fatal conn (020)3
PROD-DB-1resource (017)1