Enhancing Accessibility for People with Visual Impairment: Bridging the Gap in Touchscreen Technology
October 11, 2023
In the today’s world, touchscreens have become an inseparable part of our lives. They offer convenience, interactivity, and functionality across various devices, from smartphones and tablets to ATMs and kiosks. However, as technology advances, it is crucial to consider the impact on different user groups, especially those with disabilities. One such group that faces significant challenges with touchscreens is people with visual impairments. The absence of tactile feedback and reliance on visual elements often leads to frustration and exclusion for those with visual impairment
In this blog, we will explore the problems faced by individuals with visual impairments while using touchscreens and look into some innovative technologies that aim to bridge this accessibility gap. It's essential to consider how what we often take for granted can lead to negative experiences for various minority groups.
Touchscreens and the Challenges for People with Visual Impairments
Touchscreens are not inherently designed with accessibility in mind. Unlike physical buttons or keyboards that offer tactile feedback and audio cues, touchscreens often lack these features. Icons, menus, and gestures, integral to the touchscreen experience, can be inaccessible for individuals relying on screen readers or magnifiers.
Research shows that touchscreens are becoming increasingly ubiquitous, but their design fails to consider the needs of those with visual impairments (Butler et al., 2008, p. 135). This creates barriers and makes it difficult for people with visual impairments to perform essential tasks or access critical information independently.
Promising Technologies for Improving Touchscreen Accessibility
Thankfully, researchers and developers are actively working on technologies to enhance touchscreen accessibility for people with visual impairments. Here are some exciting examples:
- Haptic Feedback: Haptic feedback involves using vibrations, forces, or motions to simulate the sense of touch. This technology can help individuals with visual impairments locate and identify elements on a touchscreen, such as buttons, sliders, or text fields. A research team from the University of Melbourne has created a prototype of a haptic touchscreen using electrostatic forces to create different textures and shapes on the screen surface (Butler et al., 2021, p. 1). Users can feel the contours and edges of elements with their fingers and receive audio cues during interactions. Testing with people with visual impairments revealed improved accuracy and efficiency in tasks like entering PINs or selecting options.
- Spatial Audio: Spatial audio relies on sound to create a three-dimensional representation of the environment, helping people with visual impairments orient themselves and navigate a given space. For instance, a team from the University of Sydney developed a system that guides individuals with visual impairments through indoor environments using touchscreens and spatial audio (Sato et al., 2021, p. 1). The smartphone app generates audio cues that indicate the direction and distance of Bluetooth beacons placed in the environment, providing crucial information about surroundings like doors, walls, and furniture.
- Tangible Interfaces: Tangible interfaces are physical objects that users can manipulate and sense to interact with digital information. These interfaces offer unique advantages in helping people with visual impairments access and control complex data, such as graphs, maps, or diagrams. An innovative system from the University of Queensland utilises tangible interfaces to aid visually impaired students in learning mathematics (Marriott et al., 2021, p. 1). The system consists of a tablet and tangible tokens representing numbers, operators, and variables. Placing the tokens on the tablet screen allows students to create and modify mathematical expressions, with audio feedback confirming their actions and reading out results.
Conclusion
The ever-present technology in our lives, particularly touchscreens, highlights the need for inclusivity and accessibility. While touchscreens have greatly enhanced the user experience for many, it is essential to acknowledge the challenges they pose for people with visual impairments. Developing technologies like haptic feedback, spatial audio, and tangible interfaces holds immense promise in improving touchscreen accessibility and a more inclusive environment for all users.
As we continue to embrace technological advancements, it is crucial to ensure that everyday conveniences do not exclude or frustrate groups of people. Being mindful of their needs is way for a more equitable and inclusive future.
References:
- Butler M., Neave P., & Datta A. (2008). Object appreciation through haptic interaction: A case study in accessibility for museum exhibits. In Proceedings of ASCILITE 2008 - The Australasian Society for Computers in Learning in Tertiary Education (pp. 135-144). Melbourne: ASCILITE.
- Butler M., Datta A., & Neave P. (2021). Haptic Touch Screens: A Novel Approach to Accessible Touch Screen Interfaces for Blind Users Using Electrostatic Friction. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (pp. 1-13). New York: ACM.
- Marriott K., Goncu C., Hurst J., & Jay T. (2021). Accessible Mathematics for Visually Impaired Students Using Tangible Interfaces. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (pp. 1-14). New York: ACM.
- Sato D., Cabrera D., & Ferguson S. (2021). Spatial Audio Guidance for Visually Impaired People Using Touch Screens. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (pp. 1-13). New York: ACM.
Dr. Matthew Butler: Object appreciation through haptic interaction - ASCILITE
Dr. Daisuke Sato: Spatial Audio and Acoustics research - The University of Sydney
Dr. Kim Marriott: Kimbal Marriott — Monash University
News & Insights
Check Our Latest Resources
While the NDIS continues to evolve, our commitment to supporting people remains the same.
Understanding the challenges, strengths, and support needs of people living with PWS Prader–Willi Syndrome (PWS) is a rare, complex genetic condition that affects many areas of a person’s life, including physical health, development, behaviour, and emotional wellbeing. While it’s often associated with eating and weight, PWS is much more than this, and understanding the whole picture is key to supporting individuals and their families well. PWS occurs when specific genes on chromosome 15 do not function as they should. This happens very early in development and is usually completely out of anyone’s control. It is not caused by anything a parent did or didn’t do, and in most cases it is not inherited. Although PWS is considered rare, families living with it are navigating its impacts every day. The condition is lifelong, and support needs often change as the person grows. Early signs and development Many children with PWS are identified in infancy. Babies often have very low muscle tone, which can make them appear “floppy.” Feeding can be difficult at first, with poor sucking and slow weight gain. Some babies may need extra feeding support during this stage. As children grow, the presentation of PWS changes. Muscle tone usually improves, but new challenges emerge. One of the most well‑known features of PWS is hyperphagia , a persistent and overwhelming sense of hunger that develops in early childhood. People with PWS do not experience fullness in the same way others do, which means food can become a constant focus without careful management. Alongside this, children may experience developmental delays, learning differences, short stature, and delayed puberty. Behavioural and emotional regulation can also be challenging, particularly during times of change, stress, or unmet expectations. Behavioural and emotional considerations People with PWS often thrive on routine, predictability, and clear boundaries. When these supports are in place, many individuals do very well. When they aren’t, anxiety, distress, or challenging behaviours can increase. Some common behavioural features include: Strong need for routine and consistency Difficulty coping with change or uncertainty Emotional outbursts linked to anxiety or frustration Repetitive or compulsive behaviours, such as skin picking These behaviours are not about “choice” or poor parenting. They are closely linked to how the brain processes information, stress, and impulse control in PWS. Health considerations Because of differences in metabolism, muscle mass, and hunger regulation, people with PWS are at higher risk of obesity and related health conditions if food access is not carefully managed. This can include diabetes, sleep apnoea, and cardiovascular issues. Hormonal differences are also common and may affect growth, bone health, puberty, and energy levels. Many individuals benefit from ongoing medical monitoring and treatment, including growth hormone therapy, which can support muscle tone, strength, and overall health. Support across the lifespan There is no cure for Prader–Willi Syndrome, but early, consistent, and coordinated support makes a significant difference . Support often includes: Clear structure around meals and food access Allied health supports such as speech therapy, occupational therapy, and physiotherapy Behaviour support that focuses on predictability, emotional regulation, and skill‑building Medical care from paediatricians, endocrinologists, and other specialists Strong collaboration with families, schools, and support workers As individuals move into adolescence and adulthood, planning for independence, supported living, employment, and community participation becomes especially important. Families and the invisible work Families supporting someone with PWS often carry a significant, ongoing load. Managing food environments, advocating for understanding in schools and services, navigating systems like the NDIS , and planning for the future requires constant attention and emotional energy. This work is often invisible to others, but it is essential. Families are experts in their child, and their knowledge and insight should always be valued and respected. Prader–Willi Syndrome and the NDIS In Australia, PWS is recognised as a lifelong condition under the NDIS . Many individuals require ongoing supports related to daily living, behaviour support, therapies, and community participation. Because PWS is rare and sometimes misunderstood, families may find themselves needing to explain the condition and its risks repeatedly. Strong, informed advocacy and clear documentation are often key to securing appropriate and responsive supports. Why awareness matters Greater awareness of Prader–Willi Syndrome helps reduce stigma, improves understanding, and leads to better outcomes. When professionals, communities, and systems understand that PWS is a complex neurological and genetic condition — not simply an issue of eating — support becomes more compassionate, effective, and sustainable. With the right structure, understanding, and support, people with PWS can live meaningful, connected lives, and families can feel less alone in the journey.
One thing we see time and time again in behaviour support is that the most effective plans aren’t created in isolation, they’re built together. That’s really what co-design is about. It’s not just a buzzword. It’s making sure the people who know the participant best are actively involved in understanding what’s going on and shaping what we do next. This becomes especially important during formulation. So, what’s a formulation session? A formulation session is where we slow things down and try to make sense of behaviour as a team. Rather than jumping straight into “how do we stop this?”, we take a step back and ask: What might this behaviour be communicating? When does it tend to happen? What seems to make things better or worse? It’s not about getting a perfect answer on the day. It’s about building a shared understanding that we can keep refining over time. Why co-design actually matters in practice Everyone comes into a formulation session with a different perspective. Families and carers often bring the history and the day-to-day reality Support workers see what happens in the moment Support Coordinators are looking at the bigger system and consistency Practitioners bring a framework to help organise it all If we don’t bring those views together, we end up with gaps or plans that look good on paper but don’t quite work in real life. When people are properly involved in the process, there’s usually better buy-in, more consistency, and less reliance on reactive strategies. What we’re trying to do in these sessions At its core, formulation is about understanding patterns. We might map things out simply: What’s happening before the behaviour? What does the behaviour actually look like? (clearly and without labels) What tends to happen afterwards? From there, we start looking at possible reasons—or functions—behind the behaviour. For example, is the person: trying to communicate something? overwhelmed or dysregulated? trying to get away from something? seeking connection or something preferred? There’s rarely just one answer, and that’s okay. What matters is that the team has a shared way of making sense of it. Making it useful, not just theoretical A good formulation should actually help guide what we do next. That’s where co-design really makes a difference. It keeps strategies grounded in reality: Will this work in the home or school environment? Is it something staff feel confident to try? Does it fit with the participant’s preferences and goals? If the answer is no, then we adjust it. That flexibility is part of the process. A few things that help sessions run well From experience, formulation sessions tend to be most useful when: People bring specific examples , not just general concerns There’s space for different viewpoints , even if they don’t fully align We focus on patterns over time , not one-off incidents The tone stays curious rather than critical Even small shifts in language can help, moving away from “non-compliance” and towards “what might be driving this?” Co-design takes a bit more time upfront, but it makes everything else easier. When a team has a shared understanding of behaviour, support becomes more consistent, more proactive, and more aligned with the person’s needs. And ultimately, that’s what we’re aiming for, support that actually makes sense in the person’s world, not just in a report. Have you attended a formulation session with your Behaviour Support Practitioner ? Book one now.
