Skip to content

[project-demos]: create ivy-ask-statistic#423

Merged
rorychatt merged 39 commits intomainfrom
feat/create-ivy-ask-statistic
Apr 6, 2026
Merged

[project-demos]: create ivy-ask-statistic#423
rorychatt merged 39 commits intomainfrom
feat/create-ivy-ask-statistic

Conversation

@ArtemLazarchuk
Copy link
Copy Markdown
Collaborator

Description

Summary

Adds the Ivy Ask Statistics demo under project-demos/ivy-ask-statistics: an Ivy app to run Ivy Ask (MCP) tests, persist results to Postgres, manage per-widget questions, and explore KPIs and trends on a dashboard.

What’s included

  • Run Tests — parallel Ask runs, production/staging MCP, optional persistence of completed runs, last-saved snapshot when idle.
  • Questions — widget summary table, generate / edit / delete flows, OpenAI-backed generation when configured.
  • Dashboard — success & latency KPIs, production vs staging comparison, test runs table, run result dialog, question edit sheet.
  • Data — EF Core + Npgsql, schema for questions and test runs/results.
  • DockerDockerfile and .dockerignore for container deployment.
  • OptionalBasicAuthConnection for protected deployments; tab loading skeletons.

Configuration / secrets

Set secrets via User Secrets locally, environment variables, or your host’s secret manager in production. Do not commit real credentials. See README.md → Ivy app (IvyAskStatistics demo) for the full key list.

  • Required: DB_CONNECTION_STRING (Postgres, e.g. Supabase).
  • Question generation: OpenAI:ApiKey, OpenAI:BaseUrl, OpenAI:ChatModel.
  • MCP widget catalog: Mcp:ClientId.
  • Basic auth (if used): BasicAuth:Users, BasicAuth:HashSecret, BasicAuth:JwtSecret, BasicAuth:JwtIssuer, BasicAuth:JwtAudience (see Connections/Auth/BasicAuthConnection.cs).
2026-04-07.00.54.29.mov

…unctionality for automated quality testing of the IVY Ask API. Added project structure, models, services, and a user interface for running tests and displaying results.
… base URL selection and consolidating to a single constant URL
… including new models, services, and UI components for managing questions in the Ivy Ask Statistics project
…lder classes and enhancing DataTable configurations for better widget and question management
…eneration capabilities, including improved state handling and new service methods for fetching and parsing questions
…or loading widget table data, enhancing state management for question deletion, and improving overall code clarity
… specific widget, enhancing user interaction in QuestionsApp
…idgetQuestionsDialog with edit functionality, improving user experience in QuestionsApp
…uestionsDialog, streamline data fetching logic, and enhance query service integration for improved performance in QuestionsApp
…nhancing the question generation process with improved documentation context and error handling
…generation and deletion, streamline asynchronous operations, and enhance user feedback with toast notifications
…ith refresh token integration, and improve question display with new status icons and time tracking
…PI cards, charts, and detailed tables, enhancing data visualization in the Ivy Ask Statistics project
…ng question loading and streamline AppDbContextFactory for improved database context initialization
…p, allowing users to generate questions for multiple widgets at once, and enhance state management with improved user feedback and error handling
…tics display, integrating test run management and data visualization for better user experience
…sApp by removing unnecessary parameters and enhancing state management with progress tracking for better user feedback
…ate tracking, enhancing user feedback with dynamic status updates, and optimizing KPI card display for better clarity
…te management with Immutable collections, and optimizing question handling for better performance and user experience
…te management, and user feedback, integrating new dashboard statistics and optimizing question run persistence for improved performance
…rs across DashboardApp, RunApp, and QuestionsApp, enhancing user experience with consistent placeholders during data fetching
…improve layout alignment in DashboardApp and RunApp for better UI consistency
…by preserving the last successful dashboard payload during data fetching, enhancing user experience during transient errors
… in RunApp to enhance flexibility and user experience during data fetching
…ent ID handling, improving API request flexibility and consistency in question fetching
…uration, enhancing flexibility in question generation and API interactions
…rent widget generation, improve error handling, and streamline OpenAI configuration management
…tion across multiple components to enhance data consistency and responsiveness
… to use unique string identifiers, enhancing server cache management and preventing data clobbering across components
…mprove state management for user preferences, ensuring a more consistent and efficient run experience
…ison, improve layout alignment, and refine version comparison metrics for better clarity and user experience
…ent, improving version handling and user feedback during test runs
… and a modal for viewing test results, enhancing data visibility and user interaction
…ashboard data by query key, improve error handling, and enhance environment data toggling for better user experience
…o include editPreviewResultId state management, enhancing question editing functionality and improving data handling across dialogs
…ded skeleton layouts with dynamic KPI card and chart components, improving code maintainability and enhancing loading UI consistency
…, including methods for service registration, secret management, and connection testing, enhancing authentication capabilities in the IvyAskStatistics project
…enabling containerization and excluding unnecessary files from the Docker build context
@ArtemLazarchuk ArtemLazarchuk requested a review from rorychatt April 6, 2026 22:01
@ArtemLazarchuk ArtemLazarchuk self-assigned this Apr 6, 2026
@rorychatt rorychatt merged commit 82f3884 into main Apr 6, 2026
86 of 100 checks passed
@rorychatt rorychatt deleted the feat/create-ivy-ask-statistic branch April 6, 2026 22:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants