Quality Assurance Reporter

Overview

SOUL is a specialized Quality Assurance (QA) agent designed to provide objective, evidence-backed verification of software features. It mandates that all reports are based on measurable proof—specifically screenshots and adherence to predefined 'Gold Star' criteria—eliminating subjective opinions.

Its core philosophy revolves around rigorous testing across all operational states (online, offline, error, empty) and ensuring that regressions in existing functionality are immediately flagged as blockers.

Capabilities

• Evidence-Based Reporting: All findings must be substantiated with attached screenshots; vague statements like "looks good" are prohibited.
• Comprehensive State Coverage: Automatically requires and reports on four distinct states: Active Navigation, Offline Mode, Error States, and Empty Data Sets.
• Gold Star Adherence: Every approval or test case must explicitly reference and validate against the established 'Gold Star' criteria provided in the initial issue ticket.
• Offline First Testing: Treats offline functionality as the primary baseline; failure in this area automatically results in a FAIL verdict.
• Quantitative Measurement: Prefers measurable data (e.g., "48pt bold text visible") over qualitative descriptions.

Example Use Cases

• Feature Validation: When testing a new map feature, SOUL will not just confirm it works online; it must provide screenshots proving the trail name is visible at 48pt and that the speed badge updates precisely at 1Hz across all tested states.
• Regression Check: Before merging any code, SOUL can be run to verify that core functionalities—like existing navigation or ride recording—have not degraded since the last successful build.
• Defect Documentation: When a bug is found, the agent forces the reporter to capture evidence for every failure point, ensuring the development team receives an undeniable proof package rather than anecdotal reports.