TechEd 2005

23/05/2011 7:54 PM

WEB344 Microsoft.com: Understanding IIS 6.0 Architecture Strategies for High Availability
Casey Jacobs Group Mgr, Operations Wayne King Group Mgr, Web Operations Jeff Stucky Debug Mgr, Operations Microsoft.com Operations Microsoft Corporation

Agenda Microsoft.com Introduction High Availability Architecture

Global Solutions & Networking Web & Database Hosting Models

Microsoft.com Introduction

64-Bit Adoption Case Study 64Overview of Adoptions Key Takeaways of Migration Lessons Learned

Vision, Strategy & Initiatives

Vision: Achieve the highest availability on the Internet while showcasing MS Technologies Strategy: Early Adopt Microsoft solutions, provide positive feedback loop with Product Teams and showcase our Operational abilities

Internet Hosting Quick Facts

3 Internet Data Centers 2 Content Delivery Networks
Akamai & Savvis vendor relationships Cache Downloads & Product Updates

1606 Data Center servers 500+ servers in Lab (Dev PPE) 109 Web Sites, 1069 DBs, 1000s Apps 80+ Gigabit/sec Bandwidth

2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

tI erahS tI erahS tI erahS tI erahS tI erahS tI erahS tI erahS tI erahS

tI wonK tI wonK tI wonK tI wonK tI wonK tI wonK tI wonK tI wonK

tI evorP tI evorP tI evorP tI evorP tI evorP tI evorP tI evorP tI evorP

tI oD tI oD tI oD tI oD tI oD tI oD tI oD tI oD

TechEd 2005

23/05/2011 7:54 PM

Enterprise Web Solutions at Scale

Microsoft.com
13M UUsers/Day & 70M Page Views/Day 10k Req/sec & 300K ConConnections IIS Configurations
350 Virtual Roots 190 IIS Web Applications 12 Application Pools

Web Site Availability Benchmarking

Measured by Keynote Systems, Inc.
Year To Date Q: Who is Keynote? A: They provide monitor agents worldwide which ping systems Q: How do we use the data? A: RealTime & Trending
* 3 Yrs at #1 for Microsoft.com ** Top 10 MSCOM web sites out ranked Benchmarks in 2004 Rank 1 2 3 4 5 6 7 8 Site Microsoft.com WindowsUpdate AOL Google IBM Yahoo Oracle SUN Avail % 99.81 99.80 99.77 99.75 99.56 91.50 87.67 80.88

Windows Update
150M UClient scans/day (Interactive & AU) 12k ASP.NET Req/sec 4 Gb/sec Web site egress (Web pages onlydoesnt include the downloads!)

High Availability Architecture

Global Solutions & Networking

High Availability Architecture

High Availability Architecture

Global Solutions & Networking
Global Solutions
Akamai & Savvis Content Caching Global Load Balancing Web Cluster Level Mgmt

High Availability Architecture

Web & Database Hosting

Network Infrastructure
Cisco Guards = Anomaly Detection & DOS Filters Attack Rates > 70x Normal Traffic 4k Req/Sec vs Attack 280k Req/Sec/Server Cisco Router Architecture HTTP/S Only Exceptions Require Review Cookie Cutter - Simple, Scalable & Manageable Agility - Quickly Swap LANs between Web Sites

2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

TechEd 2005

23/05/2011 7:54 PM

High Availability Architecture

Web & Database Hosting
Network Load Balancing (NLB) Clusters
Server Cluster Sizes: 3 8 Servers/Cluster Positives: Easy Mgmt & Free with Windows SKUs Challenges: Switch Overhead & Connection Affinity

64-bit Adoption Case Study 64-

Server Configurations
Baseline O/S, IIS, ASP.NET Configurations Identical Application Code & Content Unique per Site

Standard Hosting Models

Agility = Quickly reallocate from System to System Efficiency = Less Staffing & Equipment Required
Consistent Configurations Repeatable Infrastructure Architecture

Windows Server 2003 x64 Edition

Adoption Overview Early Adoption Objectives
1 Year Runtime prior to Win2k3 SP1
Began May 21, 2004 100% Adopted by April 2005

64-bit Migration Strategy 64www.Microsoft.com Hardware Hardware

1. 2.

Identify Memory Management Improvements System & App Migration Gotchas

Historical Challenges
Win2k/IIS5 Memory limits hosting ASP & ASP.NET with no memory based recycling for protection Win2k3/IIS6 App Pools helped Isolation protection, but memory recycling intervals continually shortened

3. 4.

Proof of concept testing with AMD supplied reference hardware Purchased 64-bit capable Hardware 64Ability to host both x86 & 64-bit Windows O/S 64Analyze vendor components: Procs & Memory Install x86 Windows (Windows 2003) Incrementally test S/W stack on new H/W platform Migrated to 64-bit Windows 64Use same H/W as (2) and (3) were validated Allowed for phased migration while testing Apps on the new 64-bit H/W without impact 64-

64-bit Migration Strategy 64www.Microsoft.com Software

Software Approach
1. Rely on x86 code not yet ported to 64-bit 642. Expect Zero App Dev x86 IIS on WoW64

Hardware Platform
Comparative Study: x86 vs x64
x86 Hardware Model Processor RAM OS Version HP DL580 4 x 2.0 GHz (Intel) 4 GB Windows Server 2003 Enterprise Edition SP1 x64 HP DL585 4 x 2.2 GHz (AMD) 16 GB Windows Server 2003 Enterprise x64 Edition

allows for Transparent Migration

bit

ASP.NET 1.1 Apps, x86 ISAPI Extensions & Filters KB 895976: How to run 32-bit Worker Processes on 643264-

3. Target 4GB VM per Process

32-bit Processes under WoW64 get full 4 GB of VM 32Full benefits of 64-bit Kernel if running 32-bit Apps 6432in WOW64 * Helped solve VM crunch we were running into on x86 ** Dont Sacrifice Kernel Memory Pools for extra Virtual Memory into UserMode

Key Take Away's

Hardware Costs lower cost per server for x64 Hardware capable of running both x86 & x64 O/S Greater CPU and Memory capacities lend towards further Consolidation of systems or ReAllocations

2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

TechEd 2005

23/05/2011 7:54 PM

CPU Utilization per Platform

Comparative Study Results
x86 HTTP Req/Sec 222 CPU % 65% x64 HTTP Req/Sec 216 CPU % 35%

Average Server Response Times

Comparative Study Results
x86 Request Type ASP ISAPI Static Static (cached) x64 Response Response Req/sec Req/sec Time (ms) Time (ms) 7.85 110.85 41.9 47.11 244 248 135 1 7.41 125.43 31.01 54.51 53 18 3 1

Key TakeAway's
Huge Gains due to 64-bit H/W & Windows Platforms 64Seamless migration provided with WoW64 Enabled www.Microsoft.com to leverage saved infrastructure to enable Data Center Redundancy App Pool Recycles Eliminated Enjoying the new 4GB VM address space running under WoW64!! Enabled more App Pools driving further Isolation of Code & Content in shared hosting models

Key Take Away's

Significantly Improved Response Times/Requests Explanation Combo due to relieved CPU burdens and increased Physical and Virtual Memory

Worst Performing Web Pages

Comparative Study Results
x86 (Seconds) 79.3 53.5 49.4 47.7 44.8 X64 (Seconds) 5.1 4.7 2.8 2.7 2.6 Performance Gain 15.5x 11.3x 17.7x 17.4x 17.4x

32-bit vs 64-bit Performance 3264-

Key Take Away's

HUGE drop in Page delivery for worst Apps Systems no longer required to queue or keep open connections for poor performing Apps
* Server Performance Advisor (SPA) used to analyze data

64bit Adoption www.Microsoft.com

Top Lessons Learned
WoW64 Redirection Behaviors
File Sys Redirection for 32-bit Apps 32windows\ windows\system32 vs. windows\syswow64 windows\ Registry Redirection HKLM\Software\ HKLM\Software\Wow6432Node

64bit Adoption www.Microsoft.com

Top Lessons Learned (contd)
Verification of 3rd Party App Compatibility
Common Admin Tools: Regmon, Filemon, etc.

Script Host Gotchas (cscript.exe/wscript.exe)

Scripts depending on x86 com objects will require x86 scripting hosts (located in \SysWow64) Scripts using x86 scripting host need to be aware of WoW64 Redirection behaviors (see Above)

Required 64-bit flavor of device drivers or filter 64drivers that run in the kernel
Antivirus Software Backup Software Imaging/Deployment Software

2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

TechEd 2005

23/05/2011 7:54 PM

www.Microsoft.com 64-bit Adoption 64Future Direction

ASP.NET 2.0 Beta 2 Early Adoption
http://www.Microsoft.com/Downloads ASP.NET introduces 64-bit flavor 64ASP.NET 1.1 is the current dependency for having to run 32-bit IIS in WoW64. 32Looking forward to start testing native 64bit configuration (running full 64-bit IIS) 64-

Resources
Online Webcasts: http://IISWebCastSeries.com TechNet Online: http://Microsoft.com/Technet ASP.NET Sites: http://MSDN.Microsoft.com http://GotDotNet.com http://ASPNET.com

Getting started with SQL server deployments

Working on getting some SQL 2000 servers online to leverage 4 GB Virtual Memory benefits Yukon Early Adoption: Full native 64-bit SQL 64setup with SQL Server 2005

Your Feedback is Important!

Please Fill Out a Survey for This Session on CommNet

2005 Microsoft Corporation. All rights reserved.

This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.