Digital Accessibility Office Logo-Home

AI and Digital Accessibility: What’s Up?

Various types of AI tools exist, including those that can generate text, such as creative or professional prose and conversations (e.g. IBM watsonx and ChatGPT); create visual art from photographic input or a text prompt (e.g. the DALL-E 2 and OpenArt generators and tools in Adobe and Canva); and perform tasks such as writing image descriptions (e.g. Florence-2) or conducting usability tests on web pages (e.g. accessiBe). AI learns from user input to function flexibly and improves iteratively based on user feedback. AI can benefit users with diverse experiences and needs and can facilitate tasks for individuals with disabilities, but often fail to meet expectations or otherwise do not conform to accessibility standards.

UNC ITS has a license for Microsoft Copilot, an AI tool with a diverse array of capabilities. According to its developers, Copilot is deliberately designed to be operable using assistive technology such as screen readers and voice input. Additionally, Copilot’s ability to assist with data analysis and summarization, presentation creation, and drafting emails could all prove beneficial to users with cognitive, mobility, and/or visual impairments. Neurodivergent users could benefit from its ability to jumpstart tasks and organize priorities.

However, Copilot has its own usability and design issues that could be improved upon from an accessibility standpoint; for example, it does not visibly or audibly indicate that it is in an idle ‘thinking’ state when it is generating a response. Comparatively, JAWS, a popular screen reader, has an AI assistive feature that beeps when idling and shows when scanning.

A screenshot from the JAWS demo video of Picture Smart AI, showing two crosshairs scanning the photo to generate descriptive text.

Likewise, images used in presentations or data sets have limited or incorrect alternative text and may not be compliant with WCAG recommendations for color contrast. This is true for most AI tools, as they are unable to discern context.

Some teams may be interested in using AI to provide an initial accessibility assessment or get started accessibility-related tasks, particularly since the Digital Accessibility Office has been helping the Carolina community prepare for the requirements of the new ADA Title II regulations that mandate digital accessibility in public institutions and spaces. Florence-2 is an AI tool that can be used to bulk upload images and generate alternative text for them. However, Florence-2 does not always accurately convey what is in an image, which would necessitate time and labor to go back and check each example of alt text.

Writing alt text, like many other steps toward accessibility, requires human involvement to provide appropriate context. In the below image, a Maori dancer with his tongue out is performing a haka, which is a ceremonial dance and chant ritual that portrays strength, honor, and pride.

A screenshot of a Maori dancer performing a haka dance with a pūkana (facial expression) of his tongue out. The screenshot includes an overlay of autogenerated alt text that reads “A person with his tongue out.” Original photo by Wallace Fonseca (Pexels).

Intense facial expressions, called pūkana, are a defining feature of the dance and have different meanings, such as conveying fierceness. The auto-generated caption says, “a person with this tongue out.” While this is true, identifying the dancer as performing a haka both identifies the action in the photograph more clearly and conveys the inherent significance of the ritual, rather than reducing it to a gesture that is considered rude in some cultures.

Likewise, while web-based tools to check a website’s or document’s conformance to WCAG may serve as a jumping-off point for further accessibility testing, they may offer false negatives, false positives, and an incomplete picture of one’s preparedness. Relying on AI alone for accessibility testing may create a misguided sense of assurance of compliance when human testing and remediation is essential.

Be My Eyes is a popular service where sighted people volunteer to help blind users with daily tasks that might necessitate the use of sight, such as reading labels on products in a store. Be My Eyes is currently testing an AI tool called Be My AI that aims to eliminate the need for human assistance. But the social aspect of Be My Eyes, coupled with the need for accuracy when scanning food items for ingredients that are allergens or religious and ethical dietary restrictions, for instance, might still require human involvement, as the company acknowledges.

There are several other concerns about AI’s use and application. In education, some instructors worry that students might use AI tools to complete assignments instead of relying on their own creative and intellectual abilities. Online tools, such as ZeroGPT and Quillbot, detect plagiarism and/or AI usage in writing. These tools, typically powered by AI themselves, offer quick checks to determine the probability of AI-generated content. These tools also often make mistakes, so it’s important to use your best judgment when evaluating content.

Professional creatives express concern that AI-generated digital artwork, stories, and poetry might compete with their work in commissions and publishing. Some argue that AI art could affect the integrity of artistic professions and areas where artwork is paid for or selected based on merit and talent. However, others believe there are clear signs of and evident flaws in AI involvement that would not diminish the need for and value of human creators.

Another significant issue with AI is the potential for bias and harm against marginalized populations. AI trained by humans may reflect those humans’ internal value systems, cultural beliefs, and prejudices in its learning process. Consequently, AI may adopt biased understandings of race, ability, gender, sexual orientation, culture, and other aspects of human diversity. The implications are substantial, as AI is used in applications such as determining creditworthiness, policing and surveillance, and hiring practices. It is crucial to be aware of these potential harms and exercise caution when implementing AI tools and resources in various contexts.

While AI is an exciting development for many users, it may be useful to adopt a cautious and investigative approach to using the myriad tools that are flooding the internet. Even though AI is prone to flaws and errors, you can still use it to your advantage. Alt text generators may not be perfect yet, but you can get help rewriting an email or web text in a concise, plain language way and support accessibility to help overcome cognitive overload. Be sure to always do manual checks of content, images, and sites for accessibility. The Digital Accessibility Office is here to help guide you through the compliance process and all the steps along the way.