Connected Home – Machine Learning at the Edge

IoT Machine Learning on Home Devices

Build and Deploy an ML model 3 1 Locally connected devices send their data to the IoT
Home Gateway.
2
1 IoT Home Gateway Update Model Training 2 AWS IoT Greengrass Core is installed on the IoT Home
Gateway and uses ML Inference, an optimized ML model
running at the edge.
Deploy Optimized Model
3 Create, train, optimize, and deploy ML models in the
cloud. Amazon SageMaker optimizes models to less than
ML Model Executable a tenth of the memory footprint for resource-constrained
Amazon SageMaker devices, such as home security cameras and actuators.
AWS IoT Greengrass Core publishes local events from its
4
4 5 Greengrass Aware Devices to AWS IoT Core. This enables
your locally connected devices to send and receive
AWS Lambda Function
Telemetry updates from AWS IoT Core through AWS IoT Greengrass
Core.
AWS IoT Core sends telemetry to AWS IoT Analytics. AWS
5
Locally Connected Devices AWS IoT Core AWS IoT Analytics IoT Analytics performs statistical or custom ML analysis in
the cloud.
AWS IoT Greengrass Core
6 A security video camera runs AWS IoT Greengrass Core as
well as the Amazon Kinesis Video Producer SDK.
ML Edge Processing: Video Inference
6 7 The camera sends telemetry data to AWS IoT Core via
IoT Video Camera MQTT. AWS IoT Core sends the telemetry data to AWS
IoT Analytics.
7 8 8 AWS IoT Events tracks and performs state transitions for
important events that are captured from the camera.
AWS IoT Events can receive multiple inputs from sensors
ML Model Executable Video Events
within the home. In this case, any alarm triggers an
Amazon Simple Notification Service (Amazon SNS)
notification.
AWS IoT Core AWS IoT Analytics AWS IoT Events Amazon SNS
Video data is sent to Amazon Kinesis Video Streams. In
9
addition to sending video to Kinesis Video Streams, the
AWS IoT Greengrass Core
9 10 camera uses ML Inference to detect images within video
frames locally.
Video Stream Consume video from Kinesis Video Streams using a
Amazon Kinesis 10
Mobile Application variety of options. In this case, video is consumed directly
Video Streams from a mobile application for the homeowner to see the
Video Camera
person in the camera.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Reference Architecture