ML Model Creator

ML model creator app

Designing machine learning app that helps to create ML models from any object

MOBILE APP DESIGN

Overview

The goal of this project was to make machine learning accessible and practical for business use. The primary challenge was designing a system that enables users to create data models of real-world objects using nothing more than a standard mobile device. This solution bridges the gap between complex machine learning technology and everyday business needs, empowering users to harness its potential without requiring technical expertise.

Role:
Product Designer at CareAR

Activities:
Research, Prototyping, Testing, Visual design

Date:
October 2023

Research

I've started with discovery, understanding the need and benchmarking. Having access to potential users - I've conducted series of interview to better understand their current pains, needs and preferable workflow. After 8 interviews with end-users and 2 workshops with stakeholders and development representatives I managed to propose an MVP feature list.

87%
not familiar with Machine Learning (ML)

People tend to hear about machine learning, but were not sure about how it works. Which gave me a strong feeling that proper onboarding for the app will be needed.

43%
used a 3D modelling software at least once

Getting mixed responses from user interview gave me an insight of introducing several tools to create a 3D "bounding boxes" - simple way and advanced.

78%
of potential users happen to be technicians

My target audience mostly consisted of technicians who were eager to make their workflows more efficient and were looking forward to incorporate modern technologies into their daily tasks.

Solution

Scanning flow

During scanning user is asked to walk around an object while the app is taking series of pictures which will be later used as a base for data model creation and machine learning. To help user understand when it is enough to film specific surface of the bounding box we've introduced dynamic color filling, which visually shows which area is already covered good enough.

ML model training

You can start a data model training process by selecting scans you've just did. System will update you on a status of each data model and will notify when training is done.