Appendix B — Standouts

Positively perceived UX features.

Despite broad gaps, specific features across competitors were recognized for improving overall UX — organized by research question and feature type.

Feature type: Graph Status / Filter Action Navigation
RQ1 — Data Visualization

What type of data visualization are used and are they effective?

Standout data visualization approaches that were positively perceived across competitors.

Model Performance Line History Graph
Model Performance — MindGard

Gives users a temporal view of model performance over time — useful for reporting purposes.

Vulnerabilities by Intent Category Pie Graph
Vulnerabilities by Intent Category — Calypso

Simple, familiar chart type that lets users instantly see where vulnerability volume concentrates.

Attack Status Color-coded Tags
Attack Status — SPLX

Three-state taxonomy with clear traffic light color coding makes result prioritization intuitive — users can filter by status type to reduce cognitive load.

Dashboard Status Bar
Dashboard Status Bar — SPLX

A single progress indicator that communicates model scan state embedded in the dashboard — reducing the need to dig through for basic status information.

RQ2 — Actionability

How do competitors support users in acting on the findings?

Standout interaction patterns that were positively perceived for helping users move from findings to action.

Sidebar Configuration Step-by-step Flow
Sidebar Configuration — Promptfoo & PRISMA

Guided onboarding improves users' mental model and reduces the setup burden — especially valuable for non-technical users who need scaffolding to get started.

Apply Mitigation · View Logs Inline Action Buttons
Apply Mitigation — Promptfoo

Placing actions directly next to findings removes the friction of navigating elsewhere to act. The finding and the fix live together.

Selected Findings Expandable Side Panels
Selected Findings Side Panel — MindGard & Calypso

Expandable actions help keep the main view uncluttered while giving users depth on demand — a strong pattern for balancing density and clarity.

Critical Summary Fixed Card Header
Critical Summary Fixed Header — Calypso

Keeping the critical summary context visible while scrolling through details helps users maintain orientation.

2×2 Plot · Rankings

Promptfoo is leading in perceived usability.

Participants independently placed each competitor on a 2×2 axis:

  • · X axis: Organized vs. Disorganized
  • · Y axis: Easy vs. Difficult to Understand
2×2 plot
✓ Organized & Easy to Understand
Promptfoo6 of 6
SPLX (Zscaler)2 of 6
MindGard2 of 6
Calypso1 of 6
PRISMA1 of 6
✗ Disorganized & Difficult to Understand
SPLX (Zscaler)3 of 6
Calypso2 of 6
HiddenLayer2 of 6
MindGard1 of 6
🥇 Clear leader: Promptfoo
⚖️ Conflicting: SPLX · MindGard · Calypso
Why Promptfoo leads
Balances a minimal interface with just enough complexity
Promptfoo succeeds by providing a simple UI, inline actions, and guided flow (e.g., step-by-step configuration, in-line action buttons tied directly to the results page, and clean card-based layouts).