Designing machine learning app that helps to create ML models from any object
MOBILE APP DESIGN
Overview
The goal of this project was to make machine learning accessible and practical for business use. The primary challenge was designing a system that enables users to create data models of real-world objects using nothing more than a standard mobile device. This solution bridges the gap between complex machine learning technology and everyday business needs, empowering users to harness its potential without requiring technical expertise.
I've started with discovery, understanding the need and benchmarking. Having access to potential users - I've conducted series of interview to better understand their current pains, needs and preferable workflow. After 8 interviews with end-users and 2 workshops with stakeholders and development representatives I managed to propose an MVP feature list.
87% not familiar with Machine Learning (ML)
People tend to hear about machine learning, but were not sure about how it works. Which gave me a strong feeling that proper onboarding for the app will be needed.
43% used a 3D modelling software at least once
Getting mixed responses from user interview gave me an insight of introducing several tools to create a 3D "bounding boxes" - simple way and advanced.
78% of potential users happen to be technicians
My target audience mostly consisted of technicians who were eager to make their workflows more efficient and were looking forward to incorporate modern technologies into their daily tasks.
Solution
Scanning flow
During scanning user is asked to walk around an object while the app is taking series of pictures which will be later used as a base for data model creation and machine learning. To help user understand when it is enough to film specific surface of the bounding box we've introduced dynamic color filling, which visually shows which area is already covered good enough.
ML model training
You can start a data model training process by selecting scans you've just did. System will update you on a status of each data model and will notify when training is done.