Measure, retain, and govern AI like any system
Give operators the same analytics depth they expect from SaaS, pair it with retention levers that respect your DPA, and layer team controls that separate everyday collaboration from audit-ready evidence—scaled to whatever your subscription enables.
- Conversation and performance analytics live under Dashboard → Analytics with Overview, Conversations, and Performance; Reports, Real-time, and A/B Testing appear when your subscription includes those capabilities
- Knowledge Base → Analytics and Embeddings help teams see how content is used—navigation marks those entries when the workspace is entitled
- Team → Members, Invitations, Roles, and Activity are always part of admin workflows; Audit Log is a separate, plan-gated trail for security reviews
- Plans carry numeric retention for chat history and analytics storage plus toggles for advanced analytics, custom dashboards, audit, SSO-class features, departments, and deployment monitoring
Signed in? Start at Dashboard → Analytics or Settings → Data & Privacy.
Where analytics & governance live
Tiles follow the sidebar structure in the product. Items tagged Plan often require higher tiers—your live menu is the source of truth.
- Analytics overviewTypical nav
- ConversationsTypical nav
- PerformanceTypical nav
- ReportsPlan
- Real-timePlan
- A/B testingPlan
- Knowledge analyticsPlan
- Team & rolesTypical nav
- ActivityTypical nav
- Audit logPlan
- Data & privacyTypical nav
- SecurityTypical nav
Visibility
Operational analytics from org overview to per-agent detail
The main dashboard summarizes volume, active agents, and team footprint. Drill into each assistant for thread and completion patterns, then open the Analytics section for cross-cutting conversation and performance views.
Workspace overview
The home dashboard orients leadership around live agents, message trends, and document coverage so you can spot drift before customers do.
- High-level KPIs align with what subscription usage meters track
- Jump links into agents, knowledge, or billing from the same shell
- Works the same for hosted and BYOK inference paths
Conversation analytics
Dedicated routes break down threads, channels, and outcomes so support and success teams can compare assistants or time windows.
- Filterable views complement per-agent history panes
- Pairs with exports or scheduled reporting when your tier includes them
- Retention windows follow plan-backed analytics storage days
Performance metrics
Latency, throughput, and quality proxies help engineers tune models, tools, and knowledge without guessing from raw logs alone.
- Surface-level metrics stay near the analytics hub for quick checks
- Correlate spikes with deployments or automation changes
- Real-time dashboards are optional—see plan section below
Knowledge analytics & embeddings
Inside Knowledge Base, Analytics watches how documents are queried while Embeddings (admin) exposes vector health for teams that need it.
- Helps librarians retire stale articles with evidence
- Complements connector sync jobs with consumption data
- Feature-gated entries disappear from the nav when not entitled
Plan depth
Advanced packs, live views, experiments, and audit trails
Feature flags on each subscription row map to dashboard entries—advanced analytics, real-time views, custom dashboards, richer reports, A/B testing, audit logging, SSO-class security, departments, deployment monitoring, and extra environments when your order includes them.
Advanced analytics & reporting
Higher tiers unlock richer reporting surfaces and custom dashboard scaffolding—exact widgets vary by release, but navigation only shows what your organization is entitled to.
- Reports child route ties to the advanced_reports capability
- Custom dashboards respect the custom_dashboards flag
- Marketing promises only what appears in your signed order form
Real-time and deployment monitoring
Real-time analytics (marked beta in navigation) and deployment monitoring help operators watch live traffic or release health when those toggles are on.
- Useful for launch windows and high-stakes campaigns
- Environment counts extend when plans include extra staging slots
- Pair with automations to alert humans on anomalies
A/B testing
Product experiments compare agent variants from Dashboard → Analytics → A/B Testing whenever the ab_testing flag is true for the workspace.
- Keeps traffic splits explicit instead of hidden in prompt tweaks
- Ideal for messaging tone, tool usage, or retrieval strategies
- Requires enough volume to reach statistical comfort
Audit log vs everyday activity
Team → Activity captures routine collaboration events, while Audit Log (audit_log feature) focuses on security-sensitive changes for compliance readouts.
- Helps SOC 2 and ISO narratives when buyers ask for evidence
- Separate from chat retention—govern each policy independently
- Export discussions belong in your success contract
Data lifecycle
Retention knobs, privacy settings, and BYOK alignment
Plans store separate retention windows for conversation history and analytics storage; Settings → Data & Privacy exposes the controls your role can touch. BYOK keeps provider keys in your vault while FlexyAgents still applies workspace retention.
Conversation and analytics retention
Separate clocks mean you can keep shorter chat windows while preserving aggregated analytics—or vice versa—depending on legal guidance.
- Null or sentinel values can mean indefinite—confirm per plan row
- Deletion jobs respect the same limits automation runs use
- Document the chosen windows in your internal DPIA pack
Data & Privacy settings hub
Administrators manage export expectations, notification defaults, and downstream integrations from the consolidated Data & Privacy page.
- Pairs with Integrations → Webhooks for event streaming
- Localization and notification tabs sit nearby for a full compliance story
- BYOK customers still configure org keys under LLM API Keys
Security settings & SSO-class features
Settings → Security centralizes workspace controls; higher plans unlock advanced SSO options when procurement requires federated identity.
- Works alongside role-based access for agents and knowledge
- Departments flag mirrors org structure for large teams
- Contractual SLAs and dedicated support remain sales-led
People
Members, roles, invitations, and least privilege
Team administration mirrors typical B2B SaaS: invite flows, role templates, and separation between who edits agents versus who pays invoices. Activity feeds help managers; audit logs satisfy security.
Members and invitations
Provision teammates from Team → Members or Invitations with email-based onboarding and seat enforcement against max_team_members.
- Seat counters include pending invites on most plans
- Deactivate instead of delete when you need a paper trail
- SCIM depth depends on enterprise agreements—confirm with sales
Roles and permissions
Role management limits who touches billing, knowledge ingestion, LLM keys, or destructive automations—reducing the blast radius of a compromised account.
- Aligns with dashboard permission checks on sensitive routes
- Supports delegated admin for distributed franchises
- Pair with audit log exports for access reviews
Branding and platform marks
A dedicated plan flag removes FlexyAgents branding from customer-facing widgets—another lever procurement tracks for white-label programs.
- Important for agencies reselling to their customers
- Complements white-label conversations in enterprise contracts
- Marketing site stays honest: check entitlement before promising
Automations and channels inherit the same roles on Automations and Channels; models and keys are covered on Hosted vs BYOK.
Next step
Align analytics, retention, and access in one workspace
Pick the plan row that matches your compliance story, configure retention in Data & Privacy, then invite operators with the right roles so audit and day-to-day activity stay separate.