Transforming UX

with Leonardo’s Machine Learning

and SCP SDK for iOS

Gavin P. Quinn Thu 8:30-9:30

DX251

A Machine Learning app for:

Age, Gender, and Sentiment Analysis

Me before having 3 kids:

And after

https://github.com/cocoa-ai/FacesVisionDemo

Learning Points

• What is UX. Why Transform it?

• SCP SDK for iOS • Leonardo ー Not a Ninja Turtle

• AI - How we can all get started now. (No PhD required)

• Bringing it all together - an example or 2.

What is UX?

The relationship between a human and the technology she uses

Typical relationship between

SAP and User:

UI

Colors

Fonts

Screens

Inputs

Buttons

Spacing

CSS - type things

iOS

UX

Emotions

Interactions

Flow

Goals

ML

• 8000+ Apps

• Design Standards

• Technology (that is growing)

The default UI for all of SAP applications, most importantly S/4 HANA

Fiori has really changed things

Still some flaws in Fiori:

Performance True mobility Limited experts

From Fiori -> Fiori for iOS

What is it?

• A Wizard!

• A bunch of cool controls.

• Design Guidelines

• Training

* it is only for SCPms -- (I’ll show you why)

SAP Cloud Platform SDK for iOS

https://cloudplatform.sap.com/capabilities/mobile/ios-sdk.html

SCP SDK for iOS I - Let’s start!

1.	Create an OData service on Gateway (HR Days off)
2.	Setup SCP Trial Edition (or get your own of course)
3.	Setup cloud connector
4.	Turn on mobile services.
5.	Create a new app with destination to this service
6.	Use a Mac (duh).
7.	Download the wizard.
8.	Connect and create the app and deploy to your phone. (see?)

https://yourserver.com/sap/opu/odata/sap/HCM_TIMESHEET_MAN_SRV/TimeDataList?$filter=StartD

ate%20eq%20%2720171105%27%20and%20EndDate%20eq%20%2720171118%27&sap-client=100

Hint: If you have Fiori, you can grab an

OData service from any app - just go to

the catalog.

Setup the mobile app on SAP SCPms

Download the SDK and install and run

You get the SDK here:

https://store.sap.com/sap/cp/ui/resources/stor

e/html/SolutionDetails.html?pid=0000014485

Since you are probably developing for iOS 11 now, use Xcode 9.1 beta 2 —

Build the app

SCP SDK for iOS II

SAP Fiori Mentor App:

https://itunes.apple.com/us/app/

sap-fiori-

mentor/id1215284965?mt=8

SCP SDK for iOS III

• Offline—no connection needed

• Push—tell me what’s happening

• Logging—tell nerds what’s happening

SCP SDK for iOS IV - Cargill Example

SAP Leonardo—What SAP Says I

“SAP Leonardo is a holistic digital innovation system that

seamlessly integrates future-facing technologies and capabilities into the SAP Cloud Platform, using our Design Thinking Services. This powerful portfolio enables you to rapidly innovate, scale new models, and continually redefine your business.”

-SAP’s “What is SAP Leonardo?”

slide deck

SAP Leonardo—What SAP Says II

SAP’s “What is SAP Leonardo?” slide deck

SAP Leonardo — Um

What?

SAP Leonardo — GQ: Demystified

• A platform for innovation

• A set of technology capabilities

• Industry templates

• Love the direction -- but more to come :)

SAP Leonardo—For Today?

SAP’s “What is SAP Leonardo?” slide deck

SAP Leonardo—Machine Learning

• Services:

–They’re there –They’re alpha • Product components:

–Resume matching in Fieldglass –CoPilot in Fiori 2.0 –Service Ticketing in Hybris Cloud for Customer

What is Machine Learning?

Getting the computer to do something useful, without explicitly programming it to do it.

This can lead to incredible UX!

AI is Everywhere

• iOS Photos - iOS 11 image

recognition in the background.

• Uber - Surge pricing

• Alexa / Siri / Google Home - NLP

• Facebook - Tagging friends Snapchat - Lenses

• Amazon - Related products

Machine Learning - For the Rest of Us

1. Use existing API’s (Like Leonardo)

2. Use a pre-trained model from the net

3. Train your own model from public data

4. Train your own model on your own data with wizards

5. (After that, it gets hard)

Existing API’s

• https://azure.microsoft.com/en-us/services/cognitive-

services/directory/

<- 29 APIs (Free Tier)

• https://api.sap.com/shell/discover/contentpackage/SAPLeonard

oMLFunctionalServices/?section=ARTIFACTS <- 12 API’s (Trial Versions)

• https://cloud.google.com/products/machine-learning/ <- 7 APIs (Free Tier)

• https://aws.amazon.com/amazon-ai/?nc2=h_l3_ai <- 3 API’s

• https://www.ibm.com/watson/products-services/ <- 13 API’s

Easiest - use a pre-trained model:

Apple CoreML

Example: Inception v3

Detects the dominant objects present in an

image from a set of 1000 categories such

as trees, animals, food, vehicles, people,

and more.

● View original model details

● Download Core ML Model (94.7 MB)

AWS Celebrity Spotter

https://console.aws.amazon.com/re

kognition/home?region=us-east-1#

Use public data

• Use data, and create your

OWN API.

• Check out all these data sets (392!)

http://archive.ics.uci.edu/m

l/index.php

• https://www.openml.org/se

arch?type=data

• https://en.wikipedia.org/wik

i/List_of_datasets_for_ma

chine_learning_research

Train a model with wizards

• First we need a pile of data. Export your HR time off data (CSV):

Train a model with wizards

• Next upload that data to AWS S3, then try it out!

Train a model with wizards

• A new API is born!

Try switching around a few variables, works nicely.

After that - it gets harder

TensorFlow example

•	From Google
	Tutorials:
•	https://www.tensorflow .org/tutorials/image_re cognition ~/tensorflow-mnist-

tutorial/python3

mnist_1.0_softmax.py

Move TensorFlow Model to SCP

• Build TensorFlow model

locally.

• Build web api’s around it.

• Get CloudFoundry

• Push and test API

• Wire through API Management or SCPms and connect to iOS

SDK

https://account.hanatrial.ondeman

d.com/cockpit#/home/overview

* https://github.com/cgrotz/tensorflow-cloudfoundy

Cool - How about an example?

• Download calendar data.

• Upload to a ML wizard and create endpoints.

• Build an iOS app with SDK as starting point.

• Connect live to calendars and continue training.

Next: Connect to calendars and project data in SF + HCM.

Mindset

Gavin P. Quinn

Founder & Chief Architect gavin@mindsetconsulting.com

Mindset—Relevant Books

Mindset Perspectives: SAP Development

Tips, Tricks, & Projects

SAPUI5 and SAP Fiori - The Psychology

of UX Design

By Paul Modderman

Summary

• Transforming work through UX is the goal. UI is part of it.

• Fiori for iOS adds new great mobile capabilities from cloud.

• Leonardo is an innovation platform of tools.

• ML is part of AI, and it’s easy to get started.

ML will have an incredible impact on UX transformation.

Thank You!