A speech therapy game, powered by Twilio Video

What I built

Category Submission: COVID-19 Communications

Memory is a game that Speech-Language Pathologists (SLPs) can use to facilitate therapy over video and voice chat. COVID-19 has eliminated most in-person speech therapy, which tends to take place in schools and clinics. Many SLPs choose to use games as a pretense for therapy for younger patients, but these games need to meet four requirements:

1. Video and voice chat to facilitate the therapy
2. A visual game interface
3. SLP controls the flow of the game to encourage practice
4. Strong security and privacy

Currently, there are not many options available for SLPs that satisfy all of these requirements... until now!

Demo Link

https://memory.slpgames.com

This project is a simple memory matching game. Before the therapy session, the SLP chooses an appropriate number of cards, and then selects one or more articulation decks:

Then, the SLP chooses particular words to use in the game, using their experience to select which words would be best for the person to practice:

Finally, two links are generated: one for the SLP, and one for the client. These can be added to a calendar invite or sent in an email ahead of the therapy session.

When the therapy session starts, both the SLP and client join the session via their respective links. The Twilio Video SDK is used to open video, audio, and data channels between the browsers, and the game/therapy can commence:

The SLP controls the flow of the game. A young student might select two cards, and then be asked to use both words in a sentence. The SLP controls when the student can take their next turn, ensuring that there is a good balance between gameplay and therapy. The above screenshot is what the SLP sees; the student has no controls available in the bottom right quadrant.

Link to Code

https://github.com/scott113341/slp-memory

How I built it

The project is built using:

• Video/voice/data: Twilio Video
• Frontend: Vue.js
• Backend and hosting: Vercel
• Database: Airtable

Additional Resources/Info

• SLP Games

Comments

[dannymorson]

Wow, this is an incredible project! I love how it combines the need for effective speech therapy with engaging gameplay. The use of Twilio Video for real-time communication, along with the SLP's control over the game flow, ensures a balanced and effective therapy session. The focus on security and privacy is also crucial. Great job!

[Elizabeth Jean Thomas]

This would increase engagement in speech therapy for kids.

25-05-2024