SOOTHER’s frontend app is a simple fork of Macsen’s Flutter app. Macsen is an open-source Welsh-language voice assistant, to which SOOTHER is heavily indebted. Flutter is an app-develoment platform, developed by Google, which makes it possible to develop iOS and Android apps using the same codebase. Importantly, at the time of SOOTHER’s development, the age of the code in the Macsen Flutter repo made it incompatible with the newer version of iOS on my iphone, leading me to develop SOOTHER’s prototype only for Android. Time limitations prevented me from updating the code.
Significant changes to the Macsen Flutter codebase include:
- Speech-to-text capability parses the user’s utterance and sends the resulting text to the chatbot API to determine the appropriate response. In Macsen, STT is handled by a separate API, whereas in SOOTHER, it is performed with the
speech-to-textFlutter module, which queries Google’s STT servers.
- Re-skinning of the app to implement SOOTHER’s design, see prototype.
- Finally, pre-recorded dialogue files take the place of a Text-to-speech API due to the malfunctioning of SOOTHER in inference.
I need to remove some environment variables from the SOOTHER Flutter codebase; when I get around to doing this, I will make the github repo public and link it here.
See here for more discussion about SOOTHER’s app and future interface changes.