The “LogoLeon” project delivered a mobile, augmented‑reality (AR) application that uses depth‑sensor based face recognition to support healthy oral motor development in children from the age of four. The core technical innovation is an AR Mirror (ARM) that overlays interactive game elements onto a live video feed of the user’s face. The mirror is powered by Apple’s TrueDepth camera on iOS devices and by Dlib or OpenCV face‑landmark detection on Android, both integrated into the Unity3D engine via the AR Foundation framework. This combination allows real‑time tracking of mouth positions such as blowing, opening, and side‑shifting a kiss‑mouth, which are then compared against target poses to provide immediate visual and auditory feedback. Four minigames exploit these movements, while two “participatory songs” (hand‑washing and body‑movement tracks) reinforce the same gestures. A 3‑D, rotatable model of the character Leon is displayed during gameplay, enabling children to view the mouth from multiple angles and improving the clarity of the required motions. The app also includes a calibration routine that detects when the device is tilted too far back, pauses the game, and animates the correct holding position, thereby encouraging proper posture during use.
User‑interface design prioritises age‑appropriate usability. The child area is text‑free and navigated with large, intuitive icons; a parental gate protects the adult section, which contains explanatory videos and adjustable settings. Audio cues are clear and child‑friendly, and the app can be played without sound, ensuring accessibility. The first beta version was released on 1 October 2020, followed by an alpha with two minigames on 1 April 2022, and the latest stable release (version 2.2.0) on 1 July 2022. All versions are available for free on the App Store and Google Play, with a freemium model planned for future market launch. The project also filed a patent application with the European Patent Office in August 2019, pending approval due to pandemic‑related delays.
Collaboration and funding were coordinated by InnerMe GmbH (formerly LogoLeon GmbH) based in Freiburg, Germany. The project was financed by the German Federal Ministry of Education and Research under grant number 16SV8576, covering the period from early 2020 through mid‑2022. The team comprised software developers, UX designers, and clinical experts in pediatric oral health, all working within a mobile‑office setup that reduced personnel costs during the pandemic. The budget of €376,480 was partially realised (€340,752.55) due to reduced staffing and the cancellation of planned studies and trade‑show participation. Despite these constraints, the project achieved its primary objectives: a market‑ready, GDPR‑compliant AR application that demonstrates real‑time face‑tracking performance and provides an engaging, evidence‑based tool for early childhood oral motor training.
