AI Casework for Members of Parliament
Incumbency.ai
Project Overview
Incumbency.ai is a specialized civic-tech tool built exclusively for Members of Parliament and their local offices. It automatically reads, categorizes, tags, and drafts responses to emails sent by constituents. The system is designed to handle thousands of emails daily, operating under strict government data security standards.
The challenge was highly unique: the system had to accurately understand the nuanced intent of a constituent's message, and it had to generate a draft response that was politically appropriate, empathetic, and factually correct, all without immediate human intervention.
Testing Strategy & Focus
I focused my testing efforts heavily on the AI classification logic, natural language processing boundaries, and the strict security of the document workflow.
• I tested the email ingestion pipeline extensively, ensuring that sensitive constituent data was handled securely, encrypted at rest, and correctly tagged by the AI triage system.
• I conducted aggressive boundary testing on the auto-drafting feature. I intentionally fed the system controversial, highly complex, or emotionally charged queries to verify that the generated drafts remained neutral, professional, and strictly adhered to parliamentary communication guidelines.
• I performed end-to-end testing on the caseworker UI to make sure the 'human-in-the-loop' review process was intuitive, allowing staff to easily approve, edit, or reject the AI-generated drafts before sending.
Business Impact
The final production release allowed parliamentary caseworkers to process incoming constituent emails up to 60% faster, drastically reducing the backlog of local issues.
Due to the extensive boundary testing and prompt tuning we performed prior to launch, there were zero reported incidents in production of the AI generating or sending inappropriate, hallucinated, or politically damaging responses to citizens.
Need Similar Results?
Let's discuss how we can implement a robust testing strategy for your next product.