The Scott-Morgan Foundation and Lenovo debuted a new technology suite combining predictive AI, hyper-realistic avatars, personalized voices, and eye-gaze tracking
At Lenovo Tech World ’24 on October 15, global technology leader Lenovo and the Scott-Morgan Foundation (SMF), a non-profit organization pioneering assistive technology, introduced a groundbreaking AI-driven solution designed to empower individuals with amyotrophic lateral sclerosis (ALS) and other severe disabilities. This innovative, scalable technology showcases the potential of generative AI in addressing accessibility challenges, reinforcing their joint mission of delivering Smarter AI for All.
The solution integrates several cutting-edge technologies:
- A circular keyboard interface designed by SMF and developed by Lenovo.
- Predictive AI technology from Lenovo.
- Personalized AI voice replicas provided by ElevenLabs.
- Hyper-realistic avatars from D-ID.
- Eye-tracking technology from IrisBond for seamless communication.
Currently in active testing with SMF’s ALS community and leading clinicians, this proof of concept builds on years of collaboration between Lenovo and SMF. The project focuses on ALS, a progressive neurodegenerative disease that often leads to full-body paralysis, while aiming to extend its benefits to other conditions and disabilities.
Lenovo Tech World ’24 highlighted the profound impact of this technology, sharing the story of a father recently diagnosed with ALS. Using the solution, he could tell bedtime stories and sing lullabies to his children in his own voice, preserving cherished family moments.
“This is what Smarter AI for All is about—applying transformative technologies to the most pressing human challenges,” said Linda Yao, Vice President of AI Solutions and Services at Lenovo. “Through compassionate partnerships like ours with the Scott-Morgan Foundation, we are using AI to illuminate what’s possible and inspire hope for the future.”
The collaboration is driven by SMF’s mission to dismantle technological barriers and democratize life-changing solutions that uphold the universal right to thrive.
“We live in a world where more than half a billion people are silenced—not by choice, but by disability,” said LaVonne Roberts, Executive Director of SMF. “Imagine a world where even the most severely disabled can express themselves fully, where technology gives voice to the voiceless. Together with Lenovo, we’re not just imagining this world; we’re building it. With over 500 million people globally facing muscular or neurological conditions, our work has the potential to transform lives on a massive scale.”
Live at Lenovo Tech World
Erin Taylor, a passionate disability advocate and botany enthusiast living with ALS, demonstrated the transformative power of AI-driven technology at Lenovo Tech World. Using the innovative solution, she introduced herself and welcomed Lenovo Chairman and CEO Yuanqing Yang to the stage.
“I find renewed strength and hope when I see what’s possible through technology, especially with the latest advances in AI,” said Erin, who has been sharing her journey and insights with a rapidly growing social media audience.
While being able to speak in her pre-diagnosis voice is undeniably powerful, Erin emphasized a broader impact: “What excites me most is participating in the development of smarter technology for others.”
Her involvement highlights the potential of AI not only to restore personal communication but also to drive innovation that benefits the wider disability community.
At Lenovo Tech World, Erin Taylor played a pivotal role not only on stage but also on the show floor, helping to showcase the revolutionary AI-powered assistive technology. As a key collaborator, she continues to provide essential feedback to refine the solution.
Building on concepts first revealed at CES 2024, Lenovo has since developed a fully functional, integrated prototype. “We prioritized human-centric design and leveraged our expertise in innovative user experiences,” said Daniel Pollock, Lenovo UX prototyper and lead interface developer. “It’s an absolute privilege to contribute to a project that incorporates such powerful AI technology.”
Redefining Voice and Expression Through AI
Traditional voice banking for individuals with ALS has long been a challenging process, often hindered by the early onset of vocal deterioration. Additionally, older models lacked emotional nuance, delivering speech in robotic and unnatural tones. However, advancements in AI have revolutionized the field. Even with limited or poor-quality audio samples, today’s technology can generate highly expressive, on-demand AI voices.
“Over the past year, we’ve been inspired by individuals reclaiming their voices despite immense challenges,” said Mati Staniszewski, CEO of ElevenLabs. “With the incredible support of the Scott-Morgan Foundation, we’re advancing these efforts to new heights. Removing communication barriers and empowering people is what drives us.”
ElevenLabs’ AI voice seamlessly integrates with hyper-realistic avatars from D-ID, which can create lifelike avatars using minimal input, such as a still photo. “While our technology has many applications in business and entertainment, its greatest impact lies in promoting social good,” said Gil Perry, co-founder and CEO of D-ID. “We’re proud to collaborate on projects that transform lives, aligning perfectly with our mission to use AI for a better, more connected world.”
A Fully Integrated, Scalable Solution
The prototype solution currently operates on Lenovo’s ThinkPad x12 detachable PC, chosen for its balance of power and portability. Its detachable design allows easy mounting on various surfaces, from wheelchairs to kitchen tables, while integrating IrisBond’s eye-tracking technology. IrisBond’s Hiru camera precisely tracks eye movements across different conditions, enabling seamless communication for users.
“We’ve partnered with SMF for years to revolutionize assistive technology and empower users with greater independence,” said Eduardo Jauregui Torrecilla, CEO of IrisBond. “Our experience in supporting people with ALS, cerebral palsy, and other conditions highlights how AI can push the boundaries of what’s possible.”
Honoring a Visionary Legacy
This groundbreaking collaboration builds on the vision of the late Dr. Peter Scott-Morgan, a renowned roboticist who dreamed of transforming assistive technology. When he passed in 2022, avatar rendering and voice banking were still time-consuming and resource-intensive. Today, generative AI has drastically accelerated these processes, delivering unprecedented accuracy and expressiveness.
“The advancements in just two years are extraordinary,” said Andrew Morgan, CEO of the Scott-Morgan Foundation. “AI is unlocking a revolution in assistive tech, but we must continue advocating for these innovations and including those who need them most. This is only the beginning, and I’m excited to see the solutions we’ll pioneer and democratize next.”
The Scott-Morgan Foundation remains committed to working with clinicians, technologists, and individuals with ALS to refine and expand this transformative technology, pushing the boundaries of what assistive tools can achieve.
