About the program

In light of the digital transformation of public services this project endeavours to create a UI component tailored for Flutter applications The main objective is to address the challenge faced by many citizens in completing digital forms by developing a voicebased formfilling solution This component when integrated into a Flutter form will automatically extract existing form elements and conversationally engage users to facilitate form completion By offering a generic voicebased formfilling capability the project aims to significantly enhance the user experience of Flutterbased apps Given the increasing popularity of Flutter for building mobile applications used by citizens and frontline workers such innovation has the potential to streamline interactions with digital services and improve accessibility for all users Goals Design and develop a voicebased formfilling component specifically tailored for Flutter applications on DIGIT Create a conversational interface that engages users to facilitate form completion using voice commands The interface should allow the user to hear as well as see the voice prompts and recorded responses Expected Outcome Design and build UI elements to activate voice based form filling Implement logic to extract existing form elements from Flutter forms and dynamically generate conversational prompts for users Design and build of Interface where users can see written versions of the voice prompts and recorded responses Interface should provide feedback to users during the formfilling process including confirmation messages error notifications and prompts for clarification Design and build of a backend service or API that can process speech input and convert it into text This could involve utilizing existing speech recognition APIs must be open source Integrationbuild of LLM to understand and interpret users input Acceess to Open AI or alternate LLM can be provided Thorough testing and debugging to ensure reliability accuracy and performance of the component across different devices and platforms Optimization of the frontend code for efficiency minimizing resource usage and maximizing responsiveness during voice interactions Acceptance Criteria VoiceBased FormFilling Component Development The voicebased formfilling component must be designed and developed The component should work on Flutter applications on DIGIT The component should seamlessly integrate into existing Flutter forms allowing users to interact with forms using voice commands Users should be able to activate the voicebased formfilling feature through a designated UI element Conversational Interface The component must feature a conversational interface that engages users during the formfilling process Users should be provided with clear and concise voice prompts to guide them through the form completion process The interface must allow users to both hear and see the voice prompts and recorded responses Form Element Extraction and Dynamic Prompt Generation The component should automatically extract existing form elements from Flutter forms Dynamic conversational prompts must be generated based on the extracted form elements to facilitate user interaction User Interface Design A user interface must be designed and built to display written versions of the voice prompts and recorded responses The interface should provide feedback to users during the formfilling process including confirmation messages error notifications and prompts for clarification Backend Speech Processing Service A backend service or API must be implemented to process speech input and convert it into text The backend serviceAPI should utilize opensource speech recognition APIs to achieve speechtotext conversion Integration with NLP Service Integration with an NLP service or API is required to understand and interpret user input The NLP serviceAPI must be capable of analyzing user utterances and extracting relevant intents and entities Thorough Testing and Debugging Comprehensive testing must be conducted to ensure the reliability accuracy and performance of the voicebased formfilling component Testing should cover different devices platforms and scenarios to identify and address any issues or bugs Frontend Optimization The frontend code must be optimized for efficiency to minimize resource usage and maximize responsiveness during voice interactions Measures should be taken to ensure smooth performance across various devices and screen sizes Out of Scope The component should be able to identify the selected language of the user and provide voice prompts accordingly Implementation Details Libraries3rd Party tools may be used but must be opensource DIGIT uses Java Spring Boot in the backend and Flutter for the frontend for mobile applications Staging environment of DIGIT will be provided and an existing form from a product may be used

Perks

1 Lucrative stipend of INR 1 lakh over a period of 3 months 2 Dedicated 1 to 1 mentorship by industry experts 3 Handson experience to hone your skills 4 Access to bootcamps and expert sessions 5 Potential job extended internship opportunities 6 Opportunity to network with global opensource tech leaders

Who can apply?

Only those candidates can apply who:

1. are from Any,
2. and specialisation from Any,
3. are available for duration of 3 Months
4. have relevant skills and interests

Terms of Engagement

1 50000 received on completion of midpoint milestone as decided with mentor 2 50000 received on completion of final milestone as decided with mentor 3 Certificate of completion received on successful completion of internship

Number of openings

1