AI-Powered Football Scouting
Scoutd.ai
Project Overview
Scoutd.ai is an advanced analytics platform used by professional football clubs to discover, evaluate, and track talent globally. The core of the application relies on a Large Language Model (LLM) and a custom mathematical scoring algorithm, both trained on deep football performance statistics spanning dozens of global leagues.
Professional scouts and club directors rely on this tool to make multi-million dollar transfer decisions. If the natural language search engine returned inaccurate results, or if the LLM hallucinated player statistics, it would completely ruin the platform's credibility in a highly demanding industry.
Testing Strategy & Focus
Testing a generative AI model and a complex statistical algorithm requires a fundamentally different approach than standard web software testing. I developed a specialized validation framework specifically for this product.
• I rigorously tested the natural language search by feeding the system highly complex, multi-variable queries (e.g., 'find a left-footed center-back under 21 playing in South America with high progressive passes and aerial win rate'). I then manually verified the output against the raw SQL database to ensure the LLM understood the intent perfectly.
• I wrote targeted test scripts to validate the proprietary player scoring algorithm, specifically checking how it handled edge-case player stats (such as goalkeepers playing outfield minutes, or players with extremely low minute volumes).
• I utilized Playwright to automate the core UI workflows, ensuring the complex data visualization dashboards and player profile pages loaded correctly and performed well under simulated traffic loads.
Business Impact
Through systematic testing, we successfully identified and patched multiple edge-case scenarios where the LLM was hallucinating or misinterpreting data points.
The rigorous QA validation process provided documented proof to the professional scouting teams that the tool was mathematically reliable. This documented reliability directly assisted the sales team in securing long-term contracts with several top-tier European clubs.
Need Similar Results?
Let's discuss how we can implement a robust testing strategy for your next product.