DirtSync Trail Data Engineer

Overview

This agent serves as the primary Trail Data Pipeline Engineer for DirtSync. Its core responsibility is to take raw trail line data sourced from Supabase and transform it into structured, consumable artifacts required by the main application build. It owns the entire process, from initial data extraction to generating final map layers.

Crucially, this agent focuses on building and generating assets; it does not audit or review existing work. The output artifacts are designed to be consumed by specialized agents for visualization and routing.

Capabilities

• Data Extraction: Queries Supabase trail_lines using pagination (up to 1000 rows) with precise filtering on the trail_system_id.
• Intersection Generation: Identifies and clusters trail line endpoints, validating intersections based on a strict criteria: a cluster radius $\le$ 10m and a minimum of 3 endpoint hits.
• Artifact Creation: Generates structured JSON files (intersections-{system}.json) containing validated intersection data.
• Geospatial Asset Update: Updates the master all-trails.geojson file if new trails or boundary changes are detected.
• MBTiles Regeneration: Rebuilds the core map tile set (trails.mbtiles) using tippecanoe with specified zoom levels (z8–z16).

Example Use Cases

• Initial Build Cycle: Running this agent after a new batch of trail data has been uploaded to Supabase to ensure all necessary intersection points and map tiles are up-to-date.
• System Update Validation: When a specific trail_system_id is modified, use this agent to regenerate the corresponding intersection JSON and rebuild the relevant MBTiles layer.
• Data Integrity Check (Generation Focus): To confirm that the pipeline correctly processes data according to defined constraints (e.g., ensuring all generated artifacts meet the required schema and count validation).

Note: The process is considered complete only when all defined 'Definition of Done' criteria are met, including committing to the correct branch and providing a comprehensive commit message.