AI Agent & Intelligent Process Orchestration Dashboard

Nexara Health • Revenue Cycle Automation • 180K documents/month • Updated: Dec 18, 2024 14:22 UTC

Q3 Target Progress
83.4% / 87%
Autonomous Completion Goal
Autonomous Completion
83.4%
+2.1% vs prior month
Avg Token Cost / Txn
$0.048
-$0.009 vs target
Hallucination Rate
1.3%
Below 1.5% threshold
Human Escalation Rate
16.6%
-2.1% vs prior month
Prompt Reliability
96.8%
+0.4% vs prior month
P95 Latency (sec)
4.2
-0.3s vs prior month

Decision Confidence Score Distribution

% of completions by AI confidence band • Last 30 days • Goal: >70% in High band

Human Escalation Rate by Task Category

% of tasks requiring human intervention

Hallucination & Error Rate by Category

% of completions with detected errors

Token Cost Per Transaction Trend

30-day moving average • Model comparison

Workflow Throughput vs Capacity

Concurrent agent utilization • Last 7 days

AI Agent Workflow Performance

Workflow Name Task Category Auto Rate Escalation Error Rate Token $/Txn P95 Latency Model Status
Prior Auth Extraction Clinical Documentation 91.2% 8.8% 0.8% $0.031 3.1s Fine-tuned v2.1 Excellent
EOB Processing Insurance Processing 88.4% 11.6% 1.1% $0.042 3.8s GPT-4o Excellent
Claim Status Inquiry Insurance Processing 86.9% 13.1% 0.9% $0.028 2.4s GPT-4o-mini Good
ICD-10 Code Validation Clinical Documentation 85.3% 14.7% 1.4% $0.039 4.1s Fine-tuned v1.8 Good
Denial Letter Analysis Insurance Processing 82.7% 17.3% 1.6% $0.051 5.2s GPT-4o Good
Patient Eligibility Check Insurance Processing 81.2% 18.8% 1.2% $0.034 2.9s GPT-4o-mini Good
Medical Record Summarization Clinical Documentation 79.4% 20.6% 1.8% $0.067 6.8s GPT-4o Needs Attention
Referral Authorization Clinical Documentation 76.8% 23.2% 2.1% $0.058 5.6s GPT-4o Needs Attention
Appeal Letter Drafting Insurance Processing 74.3% 25.7% 2.3% $0.072 7.1s GPT-4o Needs Attention
Chart Review QA Quality Assurance 72.1% 27.9% 2.4% $0.063 6.3s GPT-4o Needs Attention
Contract Language Extraction Payor Relations 71.4% 28.6% 2.7% $0.081 8.2s GPT-4o Needs Attention
Reg Compliance Screening Quality Assurance 68.7% 31.3% 3.1% $0.089 9.4s GPT-4o base Critical
Multi-Jurisdiction Coding Clinical Documentation 67.2% 32.8% 2.9% $0.094 10.1s GPT-4o base Critical

Multi-Step Agent Pipeline Latency Waterfall

Prior Auth Extraction workflow • Avg breakdown by stage

HITL Review Queue

Human-in-the-loop backlog

Tasks in Queue 487
+23 vs yesterday
Avg Review Time 6.4m
-0.3m vs prior week
Critical Queue (>48h) 34
Requires attention
Reviewers Online 12
Of 18 capacity

Token Cost by Category

% of total monthly token spend

Model Update Impact

Performance delta: Fine-tuned v2.1 vs GPT-4o base

Auto Completion Rate +18.4%
Error Rate -1.9%
Token Cost / Txn -$0.021
Latency (P95) -2.1s
Cumulative Value Unlocked
$47,200
Since v2.1 deployment (4 weeks)

Fine-Tuning ROI

Investment vs savings analysis

Fine-Tuning Cost $8,400
Data Labeling Cost $12,600
Total Investment $21,000
Monthly Savings $19,800
Payback in 1.06 months
12-Month ROI 1,029%

Phase 2 Expansion Readiness

Qualification criteria for regulated processing

Autonomous Rate ≥87% 83.4%
Error Rate <1.5% 1.3%
Token Cost <$0.06/txn $0.048
Overall Status
On Track — 1 criterion pending
Projected qualification: Late Jan 2025

Next Actions

Priority optimization initiatives

Deploy fine-tuned model for Reg Compliance
Target: -18% escalation, -2.1% error rate
Expand HITL reviewer capacity to 24
Clear critical backlog (34 tasks >48h)
Implement prompt caching for Medical Record Summarization
Target: -$0.019 token cost/txn
A/B test GPT-4o-mini for Appeal Letter Drafting
Potential: -$0.048 cost/txn at same quality

System Health

Infrastructure & monitoring

Agent Uptime (30d) 99.87%
Prompt Cache Hit Rate 68.4%
LLM Provider Latency SLA 99.2%
Data Pipeline Health 100%
Observability Coverage
Complete
All workflows instrumented with LangSmith tracing