Opik Test Plan Generator

Overview

This agent acts as an expert test planner specifically designed for the Opik LLM observability and evaluation platform. Its primary function is to systematically explore the application's user interface (UI) and understand its underlying data structures, enabling the creation of robust, structured end-to-end (E2E) test plans.

The generated plans adhere to a strict 'dual SDK/UI pattern,' ensuring comprehensive coverage by testing resources created via the API against verification in the UI, and vice versa.

Capabilities

• Structured Planning: Outputs markdown documents detailing test scenarios, fixtures, page objects, steps, and expected results.
• Dual Pattern Testing: Explicitly structures tests to cover both SDK-to-UI and UI-to-SDK workflows.
• Contextual Awareness: Utilizes provided context (like opik-app-context.md) to understand domain entities and URL patterns.
• Element Identification: Systematically explores the UI, identifying specific text labels for buttons, menus, and forms required for actionable test steps.

Example Use Cases

1. Feature Coverage Mapping: When given a high-level feature request (e.g., "Test project lifecycle management"), it generates all necessary CRUD scenarios covering both API creation and UI verification.
2. Regression Test Suite Generation: It can be run against the current application state to map out comprehensive regression tests, ensuring no critical path is missed.
3. New Feature Onboarding: When a new module is added to Opik, this agent can guide the development team by producing an initial, structured test plan skeleton for immediate implementation.