QUICK START GUIDE

Deep Learning with MATLAB

Deep Learning Toolbox™ provides built-in functionality for creating, training, and validating deep neural networks. This reference shows
some common use cases. For additional examples, visit the documentation: mathworks.com/help/deeplearning/examples.html

Choosing an Architecture Pretrained Networks

Convolution Neural Network (CNN) Import Networks

• Image data: classification, detection
The toolbox provides several functions for exporting
• Common layers:
models and layers. More can be found on GitHub
• Convolution layer
and File Exchange.
• Max pooling
• ReLU layer importCaffeLayers
Import layers
• Batch normalization importKerasLayers
• Train from scratch or use transfer learning importCaffeNetwork
Import network
with pretrained models importKerasNetwork
Long Short Term Memory (LSTM) Network Export exportONNXNetwork
• Sequential data: time series forecasting,
signal classification, text prediction Pretrained Models
• Common layers: From Add-on Explorer, use one of the following
• LSTM layer Use the Deep Network Designer app commands to import a network:
• BiLSTM layer to interactively create and alexnet vgg19 inceptionv3
• Perform regression or classification tasks evaluate networks googlenet resnet50 squeezenet
vgg16 resnet101

Training Options Validation Improving Accuracy

Training Options Inference Improving model accuracy depends on the

Execution Parallel, GPU, multi-
Environment
GPU, auto (default)
An epoch is one full
MaxEpochs pass over entire
training set
Subset of training set to
MiniBatchSize evaluate gradient and
update weights
A higher initial rate will
InitialLearnRate speed up training but
may diverge
Drop the learn rate
LearnRateSchedule
over time by a factor
ValidationData Validate during training
Stop training if
ValidationPatience accuracy is repeated a
certain (saves time)
predict Returns probabilities belonging to task and the data. Common approaches
include:
each class
classify Returns labels and probabilities Network architecture:
belonging to each class • Use pretrained models from community
[Ypred,scores] = classify(net,X); experts
State • Update layers and adjust parameters
Network state can be captured and updated Data preparation:
with predictAndUpdateState and • Add data
classifyAndUpdateState • Training/validation/test split
Visualization • Normalize data
Several forms of validations and visualizations • Remove outliers
can be specified through trainingOptions • Balance classes (add weights)
Hyperparameter tuning:
Plots Visualize progress
• Tune the training parameters with Bayes
Set to true to display
optimization
Verbose training progress each
epoch • Set up problem with
VerboseFrequency
optimizableVariable
How often to display
• Write function calling model and options
OutputFcn Custom function
• Perform optimization with bayesopt
Directory to save model
CheckpointPath
each epoch obj = bayesopt(ObjFcn,OptVars,…);

Learn more: mathworks.com/solutions/deep-learning

mathworks.com

© 2018 The MathWorks, Inc. MATLAB and Simulink are registered trademarks of The MathWorks, Inc. See mathworks.com/trademarks for a list of additional trademarks.
Other product or brand names may be trademarks or registered trademarks of their respective holders.