Apps that help to fix the problems of your customers


5 Project costs (digits) 3 Running costs (per month, digits) Apps that help to fix the problems of your customers Rationalization Unlock sales potential Plug and Play Project costs (digits) 5 Running costs (per month, digits) 3 Josef Pokrivcak The problem Škoda Auto wanted to offer its customers a simple way to load the trunk using augmented reality Škoda Auto ist innovativ und sucht stets nach neuen Möglichkeiten seine App zu entwickeln. Somit sind Lösungen, die den eignen Kunden bei Ihren alltäglichen Problemstellungen rund um das Thema Mobilität behilflich sind, eine wunderbare Möglichkeit die Kundenzufriedenheit zu erhöhen. Škoda Auto wollte seinen Kunden eine einfache Möglichkeit der Beladung des Kofferraums mittels Augmented Reality anbieten, allerdings sind die Beladungs-Möglichkeiten und die Art der Gepäckstücke praktisch unbegrenzt. Dies bedeutete eine echte Herausforderung. Berechnet werden solche Probleme meistens an Universitäten von großen Teams. The solution An app that allows a very complex process with (almost) infinite possibilities of baggage and loading options all made to enable the customer a very simple and practical use. Heute ist die App Škoda-LoadIn in der Haupt-App von Škoda Auto integriert und hilft den Kunden aller Fahrzeugtypen eine individuelle, optimale Beladestrategie für den Kofferraum zu finden. Dazu wurde ein 3D Netz entwickelt, welches dem Kofferraum entspricht. Danach wurde der Algorithmus trainiert, um eine schnelle und gleichzeitig möglichst präzise Aussage über Beladevarianten zu treffen. Zu Gunsten der Usability, wurde eine intelligente Texterkennung eingebaut, für Gegenstände welche ggf. bereits entsprechend beschriftet sind (bspw. Möbel). Ebenso ist eine Größenanpassung des Objekts über Multi-Touchgest möglich und zu guter Letzt kann der Nutzer mit Hilfe von Augmented Reality den Gegenstand vermessen. Die App wurde zuerst als internes Release getestet. Die Mitarbeiter von Škoda Auto haben die App mit einem Rating A+ bewertet und somit wurde die App in den Live-Betrieb übergeben. Die Auswahl für genau den Anbieter erfolgte auf Grund der Designkompetenz (Clutch-Awards 2019) und der hohen Kompetenz im Bereich iOS-Development. Insights Stumbling blocks In order to test the functionality, iteration had to be performed and potential scenarios had to be differentiated. The results of the calculation could be displayed directly in a matrix in 3D in order to precisely identify any defects in the concrete result. Additional challenges at the customerFor Škoda Auto, using augmented reality was a total novelty and nobody had experience with it. Business Benefits The app was successfully integrated into the brand strategy. The calculation does not have a certain correct solution, but is potentially infinite. This means that the problem had to be broken down into individual possible solutions and then defined what the ideal solution could look like. Successively, several different strategies of the loading process were implemented, whereby the most effective one was ultimately chosen. The project schedule Škoda Auto provided various 3D trunk models for all supported vehicle models. These had to be converted into a uniform form. The first challenge was to standardize the documents in a format that could be used for calculations: The trunk of the car was divided into virtual small cubes with an edge length of 5 cm, which proved to be ideal in tests. Most of the luggage is loaded into this net and the calculation is faster than if something is manually stowed in the trunk. Computer scientists and mathematicians visualize this in the form of the so-called backpack problem. Since the calculation using an app should not take longer than the calculation in the head, the algorithms had to be optimized and a balance between accuracy and speed had to be found. The load in the trunk is calculated in four ways. The most effective method of loading is then displayed directly in the mobile device using vector masks. The input of the dimensions of the individual items should not degenerate into boredom. Therefore, ways were considered how to simplify and facilitate the associated routine work. Users can enter the baggage dimensions and any information on the fragility or softness of the load into the app themselves. However, for some packages - such as those for furniture kits - the dimensions are already given. In this case it is sufficient to pull out the camera and leave the input of the dimensions to the intelligent text recognition. Project maturity level Used company-wide Project duration 3 months Project cost (digits) 5 Running costs (per month, digits) 3 Involved employees (Operating phase, FTE) 0.5 Technical Skills required by the customer The app is maintained by the provider including the management of updates. No special skills were required on the part of Škoda Auto. The project schedule The task was to create an independent module of a mobile app for Android and iOS that can tell the user within 60 seconds whether the entered cargo fits into his car and if so, show a safe way to load it. For the representation of the objects in the cargo area of the car, it had to be assumed that the respective cargo area with an open trunk was merely rendered in 2D. Therefore, a special way of calculating the perspective and projecting the objects into the 2D space was developed - including masks for displaying the hidden parts. The models of the interior of the cargo area are provided in the standard triangular format. The task was to devise a discrete format suitable for the calculations, including a transformation of the coordinate system suitable for representation and calculation. A mere manual numerical input of the size of the objects would be insufficient and not user-friendly. For this reason, the input of an object is based on visualization and animation, and it is even possible to handle the object including its size adjustment by means of multi-touchgest. With the help of OCR, the app can recognize an object and rewrite its size. The user has the possibility to measure the object with the help of AR, if he does not have a measuring stick at hand or does not know the exact size. Technical facts iOS already online as part of the My Škoda App, Android on the road The version for Android is based on MVVM architecture. The coding was done in Kotlin. The app for iOS is kept in Swift in MVVM-C architecture. Since Load-in is currently part of the app MyŠkoda, everything has been packaged into a library for use in other apps using common package management systems. The algorithm running on the backend was developed in the Python language, which has a very good set of tools for working with scientific computations and which allows fast iteration. For the final solution, the code is also translated into C using the Cython tool, which makes the calculation even faster. All in all, this runs on Azure Cloud - with intelligent scaling, any number of users can be served. To handle the trunk packing problem, several strategies were successively used - Residual Space and Minimal Space, both in two variants: lean and brute-force. Where is the data stored? The data is on-premise at the end customer Providers Josef Pokrivcak "If a customer is looking for an average app, we can't help, but when it comes to an app with all the trimmings (including a backend solution, marketing and proof of concept), we're at the forefront." Josef Pokrivcak The information may of course vary in individual cases. Please contact the provider for an assessment of your project.

Project costs (digits)

Running costs
(per month, digits)

Apps that help to fix the problems of your customers

Rationalization

Unlock sales potential

Plug and Play

Project costs (digits)

Running costs
(per month, digits)

Josef Pokrivcak

The problem

Škoda Auto wanted to offer its customers a simple way to load the trunk using augmented reality

Škoda Auto ist innovativ und sucht stets nach neuen Möglichkeiten seine App zu entwickeln. Somit sind Lösungen, die den eignen Kunden bei Ihren alltäglichen Problemstellungen rund um das Thema Mobilität behilflich sind, eine wunderbare Möglichkeit die Kundenzufriedenheit zu erhöhen. Škoda Auto wollte seinen Kunden eine einfache Möglichkeit der Beladung des Kofferraums mittels Augmented Reality anbieten, allerdings sind die Beladungs-Möglichkeiten und die Art der Gepäckstücke praktisch unbegrenzt. Dies bedeutete eine echte Herausforderung. Berechnet werden solche Probleme meistens an Universitäten von großen Teams.

The solution

An app that allows a very complex process with (almost) infinite possibilities of baggage and loading options all made to enable the customer a very simple and practical use.

Heute ist die App Škoda-LoadIn in der Haupt-App von Škoda Auto integriert und hilft den Kunden aller Fahrzeugtypen eine individuelle, optimale Beladestrategie für den Kofferraum zu finden. Dazu wurde ein 3D Netz entwickelt, welches dem Kofferraum entspricht. Danach wurde der Algorithmus trainiert, um eine schnelle und gleichzeitig möglichst präzise Aussage über Beladevarianten zu treffen. Zu Gunsten der Usability, wurde eine intelligente Texterkennung eingebaut, für Gegenstände welche ggf. bereits entsprechend beschriftet sind (bspw. Möbel). Ebenso ist eine Größenanpassung des Objekts über Multi-Touchgest möglich und zu guter Letzt kann der Nutzer mit Hilfe von Augmented Reality den Gegenstand vermessen. Die App wurde zuerst als internes Release getestet. Die Mitarbeiter von Škoda Auto haben die App mit einem Rating A+ bewertet und somit wurde die App in den Live-Betrieb übergeben. Die Auswahl für genau den Anbieter erfolgte auf Grund der Designkompetenz (Clutch-Awards 2019) und der hohen Kompetenz im Bereich iOS-Development.

Insights

Stumbling blocks

In order to test the functionality, iteration had to be performed and potential scenarios had to be differentiated. The results of the calculation could be displayed directly in a matrix in 3D in order to precisely identify any defects in the concrete result.

Additional challenges at the customerFor Škoda Auto, using augmented reality was a total novelty and nobody had experience with it.

Business

Benefits

The app was successfully integrated into the brand strategy.

The calculation does not have a certain correct solution, but is potentially infinite. This means that the problem had to be broken down into individual possible solutions and then defined what the ideal solution could look like. Successively, several different strategies of the loading process were implemented, whereby the most effective one was ultimately chosen.

The project schedule

Škoda Auto provided various 3D trunk models for all supported vehicle models. These had to be converted into a uniform form. The first challenge was to standardize the documents in a format that could be used for calculations:

The trunk of the car was divided into virtual small cubes with an edge length of 5 cm, which proved to be ideal in tests. Most of the luggage is loaded into this net and the calculation is faster than if something is manually stowed in the trunk. Computer scientists and mathematicians visualize this in the form of the so-called backpack problem.

Since the calculation using an app should not take longer than the calculation in the head, the algorithms had to be optimized and a balance between accuracy and speed had to be found.

The load in the trunk is calculated in four ways. The most effective method of loading is then displayed directly in the mobile device using vector masks.

The input of the dimensions of the individual items should not degenerate into boredom. Therefore, ways were considered how to simplify and facilitate the associated routine work.

Users can enter the baggage dimensions and any information on the fragility or softness of the load into the app themselves. However, for some packages - such as those for furniture kits - the dimensions are already given. In this case it is sufficient to pull out the camera and leave the input of the dimensions to the intelligent text recognition.

Project maturity level

Used company-wide

Project duration

3 months

Project cost
(digits)

Running costs
(per month, digits)

Involved employees
(Operating phase, FTE)

0.5

Technical

Skills required by the customer

The app is maintained by the provider including the management of updates. No special skills were required on the part of Škoda Auto.

The project schedule

The task was to create an independent module of a mobile app for Android and iOS that can tell the user within 60 seconds whether the entered cargo fits into his car and if so, show a safe way to load it.

For the representation of the objects in the cargo area of the car, it had to be assumed that the respective cargo area with an open trunk was merely rendered in 2D. Therefore, a special way of calculating the perspective and projecting the objects into the 2D space was developed - including masks for displaying the hidden parts.

The models of the interior of the cargo area are provided in the standard triangular format. The task was to devise a discrete format suitable for the calculations, including a transformation of the coordinate system suitable for representation and calculation.

A mere manual numerical input of the size of the objects would be insufficient and not user-friendly. For this reason, the input of an object is based on visualization and animation, and it is even possible to handle the object including its size adjustment by means of multi-touchgest. With the help of OCR, the app can recognize an object and rewrite its size. The user has the possibility to measure the object with the help of AR, if he does not have a measuring stick at hand or does not know the exact size.

Technical facts

iOS already online as part of the My Škoda App, Android on the road
The version for Android is based on MVVM architecture. The coding was done in Kotlin. The app for iOS is kept in Swift in MVVM-C architecture. Since Load-in is currently part of the app MyŠkoda, everything has been packaged into a library for use in other apps using common package management systems.
The algorithm running on the backend was developed in the Python language, which has a very good set of tools for working with scientific computations and which allows fast iteration. For the final solution, the code is also translated into C using the Cython tool, which makes the calculation even faster. All in all, this runs on Azure Cloud - with intelligent scaling, any number of users can be served.
To handle the trunk packing problem, several strategies were successively used - Residual Space and Minimal Space, both in two variants: lean and brute-force.

Where is the data stored?

The data is on-premise at the end customer

Providers

Josef Pokrivcak

"If a customer is looking for an average app, we can't help, but when it comes to an app with all the trimmings (including a backend solution, marketing and proof of concept), we're at the forefront."

Josef Pokrivcak

The information may of course vary in individual cases. Please contact the provider for an assessment of your project.