Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Ground to Cloud
Prerequisites
• Complete Installation
• Using a Lab Environment
• Walk-Through Demos
aka.ms/sqlworkshops
Introduction and Setup
Module 01
Migrating to Azure
Module 05
1. Discovery
2. Envisioning
3. Architecture Design Session
(ADS)
4. Proof-Of-Concept (POC)
5. Implementation
6. Handof
Modernizing the WideWorldImporters Company
Mixture of SQL Server 2008, 2014, and 2016 servers
Expensive ETL applications for data sources outside of SQL Server
Should we use “Big Data” technologies?
Query performance tuning expensive
Some database applications sufer from I/O performance
Need data secure end-to-end with classification and auditing
Applications need better availability and less downtime
Our company uses a mixture of diferent operating system platforms
Popularity of containerized applications growing
What, when, and how should I migrate to the cloud?
Desire to build more intelligent applications with AI and Machine
Learning
Module 02
What you will learn in This Module Connect to Azure SQL Database
SQL Server in
Azure Virtual Machine (IAAS)
SQL
SQL Server 2008
SQL Server 2008R2 Azure SQL Database
SQL Server 2012 Azure SQL Database Managed Instance
SQL Server 2014
(PAAS)
SQL
1010 Secure Enclaves
Intelligent 0101
0110
Query Processing
Learn Memory
grant
In-Memory Databases
plaintext
Data Classification
Cosmos DB
Run query Enclave
R
High Availability
Profiling
Sequential Key Insert Performance
Batch Mode Batch Mode Row Mode
In-Memory Database
Hybrid Buffer Pool
Memory-Optimized TempDB
Metadata
In-Memory OLTP
Persistent Memory Support
150
SQL Server 2017
The problem
Build a query processor to work and adapt to any type of workload with no application
changes required
Example
security
Confidential computing
plaintext ciphertext
plaintext
TDE scan suspend and resume
Enclave
Example
Security Classification
High Availability
Keep SQL Server running
Availability groups
Enhancements
Accelerated Database
Recovery
SQL Server Recovery and rollback
The problem(s)
Long running transactions afect recovery time
Rollback can take a long time for long transaction
Parallel redo can
Log grows out of control due to old active transactions help
Undo dependent
on oldest active
transaction
“Long” recovery
usually due to
long undo
Transactions accelerated
Persisted
Version Store
Logical
Revert
sLog
Cleaner
What is SQL Server Polybase? “It’s all about
Data Virtualization”
Distributed compute engine integrated with SQL Server
Excel
Cosmos DB
HDFS
Legacy Suppliers
Mobile
App Orders
SQL Server
WWI
SQL WideWorldimporters
2019
Combine data from many sources without Store high volume data in a data lake and access Easily feed integrated data from many sources to
moving or replicating it it easily using either SQL or Spark your model training
Scale out compute and caching to boost Management services, admin portal, and Ingest and prep data and then train, store, and
performance integrated security make it all easy to manage operationalize your models all in one system
The same abstraction layer with SQL Server on Linux
Windows Linux
Host extension mapping to OS system calls
(IO, Memory, CPU scheduling)
Containers
Microsoft Container Registry
Red Hat Images
Non-root Containers
SQL Server on Windows Containers (Private
Preview)
Why SQL Server and Containers?
Portable Container configuration
Run anywhere Docker is supported
Persisted storage
Lightweight
Reduced disk, CPU, and memory footprint
Database
Switch for
simple
Consistent upgrades
Consistent image of SQL Server, scripts, and tools
Efficient
Faster deployment, reduced patching, and
less downtime Container Container Container
Docker
Host OS
Infrastructure
Click icon to add picture
Example
Pod Pod
User
Kubernetes
Pod
SQL Server
developer
experience Satellite
R
SQL Graph enhancements
SQL
Server
T-SQL Direct
UTF-8 support communications
for performance
Launch pad
Example
Database Experimentation
Assistant
SQL SQL
Microsoft Access
In-Place (Windows)
Database Backup
Data Migration Log Shipping
Assistant Bulk Import SQL Server Migration Assistant (SSMA)
Azure Database Migration SSIS Query Tuning
Service Assistant
* Coming by GA
Certify once, run on-premises and in the cloud with Compatibility
Certification
Upgrade & modernize your SQL Server database on-premises, in the cloud and on the edge with Compatibility
Certification that eliminates risks of application compatibility
They also allow longer historical data storage, and as time goes on become
part of that storage lineage
Use-Cases
In-store analytics
Supply chain optimization
Customer retention
Spark
Hadoop
Virtualization
Hardware Abstraction
Physical Computer
Cluster Orchestration
Master
Web Tier
Hybrid
On Premises Public/Private
cloud
Control BDC
SQL Data Pool
Cluster
Orchestration SQL Server
Master
App Pool
SQL Server SQL Server
Master ML Server
Compute Pool
Job (SSIS)
SQL Server
Controller Storage Pool
(Web Apps)
HDFS
Managing the Big Data Cluster
Tools and Process Flow
Cluster Orchestration
Management Proxy
Master
Controller
Kibana Grafana
Operator InfluxDB
Elastic Search
Telegraf
CollectD
Fluentbit
Controller
Listener
Operator (Readable Secondary)
Cluster Orchestration
SQL Server SQL Server
Master SQL Server
AG
Secondary Secondary
Primary
(Becomes Primary)
Replication Controller
Listener
(Primary)
Knox
Kibana Grafana
Livy
ACLS
YARN Controller
HDFS
Spark
Takeaways
• SQL Server 2019 Big Data cluster includes SQL Server together with the HDFS and Spark Compute
engine as one package for big data processing, Machine Learning and AI
• Spark is a distributed compute engine that provides a unified framework for E2E big data processing
pipeline including Machine learning and AI
• You can use SQL Server 2019 to create a secure, hybrid, machine learning architecture starting with data
preparation, training a machine learning model, operationalizing your Model and using it for scoring
• Go Do > Practice with installing, configuring, and operating SQL Server 2019
• Go Do > Download this deck and practice a demo on Big Data Clusters on SQL Server
• Go Do > Follow a complete workshop
Resources
Breakthrough
Seamless and Industry-leading Built-in
Competitive TCO productivity &
compatible security intelligence
performance
The broadest SQL Up to 80% savings with Up to 100 TB of on- Layers of security and Intelligent performance
Server compatibility and Azure Hybrid Benefit demand scalable 99.99 percent tuning and intelligent
VNET support and reserved capacity storage per DB availability SLA protection
Azure SQL
SQL virtual machines Managed instances Databases
Best for migrations and Best for most lift-and-shift Best for modern cloud applications. Hyperscale and
applications requiring OS- migrations to the cloud serverless options are available
level access
• SQL Server and OS • SQL Server surface area • Hyperscale storage (up • Resource sharing
server access (vast majority) to 100TB) between multiple
• Expansive SQL And OS • Native virtual network • Serverless compute databases to price
version support support optimize
• Fully managed service
• Automated • Fully managed service • Simplified performance
manageability features management for
for SQL Server multiple databases
• Fully managed service
Azure SQL: multi-faceted service
Compute tier
Provisioned, Serverless
Tier
General Purpose, Hyperscale,
Business Critical
Deployment
VM, Managed Instance, Single
Database, Elastic Pools
In-Memory Database *
Always Encrypted with Enclaves
Data Classification
UTF-8
Extensibility Framework
2. Once subscription registration is complete, register your VM with the SQL VM Resource Provider:
# Register your existing SQL Server VM with the new resource provider
az sql vm create -n <VMName> -g <ResourceGroupName> -l <VMLocation>
Note: Requires full SQL Server restart. Note: Does not enable full functionality.
*If you’re unable to select Full or Lightweight RP, choose an Agentless approach. Note this option does not enable verification of Resource Provider.
Demo: enabling resource provider on Azure SQL VM
Azure SQL Database
Demo: creating an Azure SQL database
The Allscripts prescription
for agility: lift and shift to
the cloud
AccuWeather weathers
news outlets and other companies plug into their enterprise resource planning, customer relationship
management, and other business applications. The company receives more than 40 billion API calls a day
the storm with Azure for weather information, and Azure provides a more scalable, cost-effective way to manage this service.
Next the company moved its big data storage and processing, using services such as Azure Blob storage,
Azure Data Factory, and Azure SQL Database.
When AccuWeather set out to build an automated, scalable weather prediction service for business
customers, it turned to Azure as well. To create highly accurate forecasts, Radich’s team needed
sophisticated machine learning tools that it could customize using R and Python code.
“With Azure, we have access to sophisticated data science services in a real-time, on-demand basis, which helps us innovate faster.”
- Chris Patti: Chief Technology Officer, AccuWeather
Adapts compute resources to the Pay only for compute resources you Fully-managed and intelligent
workload without sacrificing performance consume, on a per-second basis database service
Automatically pauses and resumes Further optimize costs with configurable Built-in 99.99% availability
compute thresholds
Serverless databases…
Databases with provisioned compute…
HS
Proportional BC
RBPEX to compute
size Files
Page Servers
<0.5ms for all data access
Full coverage
RBPEX
Azure Storage
Azure Storage
~2ms for all data access Attached SSD
*Top industries for General Purpose, by total ACR (FY19 YTD), from $1K+ ACR customers
Business Critical
• Offers highest resilience to failures using
Resources
several isolated replicas. Consistently high IO.
Includes a built-in availability group for high
availability Storage Local SSD storage (1-2 ms latency)
Single database: 5 GB – 4 TB
• Best for critical OLTP business applications Managed Instance: 32 GB - 4 TB
with consistent high IO requirements
Compute Gen4: 1 to 24 vCore
• Key Scenarios (vCores) Gen5: 1 to 80 vCore
• Tier 1 OLTP applications
• Optimized for in-memory workloads
I/O 5000 IOPS per core with 200,000 maximum IOPS
• Workloads with high IO (ie gaming, eCommerce,
financial services)
HA 3 replicas + 1 read-scale replica, zone-redundant
HA
• Top 5 Industries* (Sample Customer)
• Partner & Professional Services (Aprimo LLC, Docusign) In-Memory Supported
• Travel & Transportation (BMW AG, UAL Corp)
• National Government (Shandong Provincial Gov’t, Welsh Assembly Gov’t)
• Discrete Manufacturing (Siemens AG Germany, HP Inc.)
• Retailers (GS Retail Co, LTD, Starbucks Corp)
*Top industries for Business Critical, by total ACR (FY19 YTD), from $1K+ ACR customers
Hyperscale
• Offers VLDB support without the headaches with Resources
a built-for-the-cloud architecture of highly-
scalable storage & a multi-layer cache optimized
for OLTP and HTAP workloads. Provides low Storage Local SSD storage for local buffer pool
latency and high throughput without size of data cache/data
Azure remote storage as final long-term data
operations. Future-proofing on size and data.
store
Supports up to 100TB storage
• Best for HTAP VLDB workloads with highly
Compute Gen4: 1 to 24 vCore
scalable storage and read-scale (vCores) Gen5: 1 to 80 vCore
requirements
I/O TBD
• Key Scenarios
• Migrating on-premises or cloud VLDB
• Real-time analytics & reporting HA 2 replicas (up to 5 at GA)
• Data marts running SMP on-premises
• HTAP applications In-Memory Not supported
As a result a number of features are available in MI that are not in DB – for example:
SQL Server Agent, Linked Servers, Cross database transactions, Common Language Runtime, Resource governor, SQL Server
Auditing, Time zone choice, Collation on server / instance level
Because you control the instance, a number of features are not in MI that are in DB - for example:
Active Geo-replication, Auto-scale (serverless), Automatic tuning, Availability Zones, Azure Resource Health, Long-term backup
retention, SQL Data Sync, Query Performance Insights, R Services (in preview)
Only a detailed analysis of requirements can tell you which is the best fit:
Read-only reporting
Read Scale-out
Read-only replica
Free with SQL MI BC
Hyperscale provides this too.
Azure SQL Hyperscale
What is Azure SQL Database Hyperscale?
SQL
HS
Platform-as-a-Service (PaaS)
SQL Server
Enterprise Edition
4x General purpose or
Hyperscale vCores
Module 05
What you will learn in this Module Capability exists for Azure SQL VMs
https://aka.ms/azuresqlslides
Data migration Process
Upgrade & migration tools
NEW
Azure Migrate + DMS + DMA
Azure Migrate
Azure Migration Program (AMP)
Available to all Azure customers, scaled through specialized migration partners
Reduce cost and risk | Accelerate migration velocity | Deliver customer success
Database Discovery
and Assessment
Tailspin Toys - Preferred solution – Gaming services
GW
mysqldbsrv.database.windows.net `
westus1-a.control.database.windows.net
104.44.238.205
GW
Node Node
1433 TR 3
proxy GW
CR1
Dedicated VNet1
customer isolation
Tenant isolation
(compute,
SQL instance #3 storage)
VPN/Express On-premises
route gateway
Isolation and connectivity of Managed Instance
public
IP*
Network isolation
SQL instance #1 SQL instance #2 (customer
VNET)
Tenant isolation
(virtual private
cluster)
SQL instance #3
MI Subnet
VNet
On-premises 1
MI Virtual Cluster SQL Management (public IP) TDS endpoint (private IP)
SQL VNet
G
W mymi.<clusterid>.database
primary Node
.windows.net
node TLS
G ILB
Windows Firewall W TDS endpoint
Node (Private IP)
SQL
TLS SQL
Manageme
Engine
nt
TLS Node Agent
LB Node
G
SQL Management W
(Public IP)
Virtual cluster
Host your application in the cloud or keep on-premises
SQL MI VNet “VNet Integration”
Web app
App subnet
App Service “VNet Integration”
IaaS Hosted
Web app peered VNet
App App
Application VNet
IaaS Hosted
App
App Service
On-premise app
Express Route / VPN Gateway
App
Network isolation
VNet
GW
primary node Node mi_name.<dns_zone>.database.windows.net
TLS
ILB
GW
Windows Firewall TDS endpoint (private IP)
Node
SQL
TLS
SQL Engine
Management
Node Agent
TLS
LB Node
GW
SQL Management (public IP)
Virtual cluster
Legend:
Data
VNet
Azure
VNet
Azure
VNet
Certificate
Revocation
List
Service dependencies
Azure
Customer applications & tools
Maintenance
On-Premises + Azure VNet
Corpnet
Legend:
Data
Management
Certificate
Azure
VNet
TLS
TLS Certificate
Revocation
List
TLS
VIP
56.226.155.47
Public IP
3342 52.246.255.77 Allow 52.246.255.77 3342
Out
Application VNet
App Service
6
Environment
Managed Instance #1 Managed Instance #2
7 On-premises app
Express Route / VPN Gateway
Learn more
This content tile This content tile This content tile This content tile
measures 2.95”w x 3”h measures 2.95”w x 3”h measures 2.95”w x 3”h measures 3”w x 3”h
Hardware guidelines
Use the latest devices from the current year.
Screen captures should be up-to-date.
Remove OEM logos when possible.
Drop shadows for devices only
Use drop shadows to provide subtle depth.
Added drop shadows should appear as natural as possible.
Photos separated by gaps Design Tip: Turn on the drawing guides
(View -> Guides) to see how content tiles
are aligned to the underlying grid system.
This text shape has no fill. Align all text blocks to the content Text can be used on, above or
It uses the same default interior tiles interior margins below photos.
margins as content tiles
Illustration resources and guidelines
The Microsoft Brand
Illustration library in
PowerPoint form can
be found here.
—Adweek
Five column
Header Header
Descriptor Descriptor
text here text here
Three photo layout with tile
Second point
Detail
Third point
Detail
Three rows with photo
First point
Detail
Second point
Detail
Third point
Detail
Four row layout with icons
First point
Detail
Second point
Detail
Third point
Detail
Fourth point
Detail
Four rows with photo
First point
Detail
Second point
Detail
Third point
Detail
Fourth point
Detail
Five row layout with icons
First point
Detail
Second point
Detail
Third point
Detail
Fourth point
Detail
Fifth point
Detail
Horizontal bar chart
Chart Title
7 Label 1
6
4
Label 2
3
Label 3
2
0
1 2 3 4
Chart example
7
0
1 2 3 4
2 column table
Tables are easy to modify
Text Text
Text Text
Text Text
Row 1
Row 2
Row 3
Row 4
Color map
FY13 FY14 Overall
US
Canada
LATAM
UK
Germany
France
WE
CEE
MEA
Japan
APAC
GCR