The What
SSC-ICT, a Dutch governmental IT service provider under the Ministry of the Interior, tasked me with investigating accessibility challenges faced by blind employees using traditional screen readers. These tools, while essential, often fail to support modern applications, struggle in Virtual Desktop environments, and depend heavily on sighted testers. The project aimed to determine whether an AI-powered screen recognizer could be a feasible solution and, if so, how it could be effectively implemented.
The Why
Traditional screen readers fall short in addressing the accessibility needs of blind employees in today’s rapidly evolving digital landscapes. This research sought to bridge that gap by exploring AI technologies capable of providing a more inclusive, efficient, and adaptive alternative to current solutions.
The How
The study focused on assessing the feasibility of AI-driven screen recognition through:
AI Techniques: Investigating and applying machine learning, image recognition, and natural language processing to identify and interpret on-screen elements like buttons, text, and input fields.
Prototype Development: Creating a functional prototype that demonstrated how real-time screen recognition could support blind users in navigating complex digital interfaces.
User Feedback: Collaborating with visually impaired users to evaluate the prototype’s practical effectiveness, usability, and potential for refinement.
External Compatibility: Ensuring the system could operate independently of secure desktop environments to comply with governmental IT restrictions.
Results
Proven Feasibility: The study confirmed that AI-driven screen recognition could address significant limitations of existing tools.
Prototype Validation: A working prototype showcased AI’s ability to enhance accessibility in controlled test environments.
Practical Insights: Key insights from the project outline a path for further development, including scaling and broader deployment.
Conclusion
This research validated AI-based screen recognition as a transformative tool for improving accessibility for blind users. By addressing the limitations of traditional screen readers, SSC-ICT can enhance its support for visually impaired employees. The next steps include refining the prototype, expanding its capabilities, and integrating it into secure governmental systems to maximize its impact.
