Energy Efficiency in Data Centers

Green
Energy Efficiency in Data Centers

Marina Zapater
GreenLSI Integrated Systems Lab Electronic Engineering Dept
Marina Zapater 1 | Going Green
Green
Data Centers
Marina Zapater | Going Green
Green
Outline
Why Data Centers (DC) in this Workshop? The DC in next-generation applications Energy consumption at the Data Center Insight on optimization strategies Conclusions
Marina Zapater | Going Green 3
Green
Outline
Why Data Centers (DC) in this Workshop?

The DC in next-generation applications Energy consumption at the Data Center Insight on optimization strategies Conclusions
Green
Why DC in this Workshop?

Motivation
US EPA 2007 Report to Congress on Server and Data Center Energy Efficiency
Green
Motivation
Energy consumption of data centers

1.3% of worldwide energy production in 2010 USA: 80 mill MWh/year in 2011 = 1,5 x NYC 1 data center = 25 000 houses
More than 43 Million Tons of CO2 emissions per year (2% worldwide) More water consumption than many industries (paper, automotive, petrol, wood, or plastic)
Jonathan Koomey. 2011. Growth in Data center electricity use 2005 to 2010
Green
Motivation
World server installed base (thousands) 35000 30000 25000 20000 15000 10000 5000 0 2000 2005 2010 High-end servers Mid-range servers
It is expected for total data center electricity use to exceed 400 GWh/year by 2015. The required energy for cooling will continue to be at least as important as the energy required for the computation.
Volume servers
5,75 Million new servers per year 10% unused servers (CO2 emissions similar to 6,5 million cars)
300 Electricity use (billion kWh/year)
250
200 150 100 50 0 2000
Infrastructure Communications Storage High-end servers
Energy optimization of future data centers will require a global and multi-disciplinary approach.
Mid-range servers
Volume servers
2005
2010
Jos M.Moya | Madrid (Spain),7 July 27, 2012
Green
What about urban DC?
50% of urban DC have already or will soon reach the maximum capacity of the power grid
Green
Tier 4 Data Center
Green
Outline
Why Data Centers (DC) in this Workshop? The DC in next-generation applications Energy consumption at the Data Center Insight on optimization strategies Our vision and future trends
Green
The DC in next generation applications
Traditional uses of Data Centers:

Webmail, Web search, Databases, Social networking or distributed storage, High-performance computing (HPC), Cloud computing
Next-generation applications:
Population monitoring applications: e-Health, Ambient Assisted Living Smart cities
Next-generation applications generate huge amounts of data Need to store, analize and generate knowledge
11
Green
Global energy optimization
Solution: GoingGreen! How: Global energy optimization strategies

Proposal of a holistic energy optimization framework Minimizing overall power consumption Multi-level optimization: WBSN, Personal Servers and Data Centers
12
Green
Global energy optimization
Executing part of the workload in the Personal Servers

Classifying tasks depending on their demand Resource management techniques based on fast runtime allocation algorithms executed on the Personal Servers Executing some tasks in Personal Servers instead of forwarding load to DC. Up to 10% in energy savings and 15% execution time savings
13
Green
Outline
Why Data Centers (DC) in this Workshop? The DC in next-generation applications
Energy consumption at the Data Center

Insight on optimization strategies Conclusions
14
Green
Energy Consumption at the DC

What is really a Data Center?
Resource Manager Execution
WORKLOAD
Scheduler
http://cesvima.upm.es
Green
How does cooling work?
Typical raised-floor air-cooled Data Center:
16
Green

Power consumption breakdown
The major contributors to electricity costs are:

Cooling (around 50%) Servers (around 30-40%)
The most common metric to measure efficiency in Data Centers is PUE (Power Usage Effectiveness)
17
Green
Power Usage Effectiveness (PUE)
Average PUE 2 State of the Art: PUE 1,2

The important part is IT energy consumption Current work in energy efficient data centers is focused in decreasing PUE Decreasing PIT does not decrease PUE, but it has in impact on the electricity bill
Green
Traditional approaches
What would Google do?
PUE = 1.2
19
Green
Research trends
Abstraction level
Higher levels of abstraction bring more benefits Some areas have brought more benefits than others
Solutions proposed by the State of the Art

Green
Outline
Why Data Centers (DC) in this Workshop? The DC in next-generation applications Energy consumption at the Data Center
Insight on optimization strategies

Conclusions
21
Green
Our approach
Global strategy to allow the use of multiple information sources to coordinate decisions in order to reduce the total energy consumption Use of knowledge about the energy demand characteristics of the applications, and characteristics of computing and cooling resources to implement proactive optimization techniques
22
Green
Energy Optimization: Holistic Approach

Chip Server 2 Rack Room 1 Multiroom
Sched & alloc Application OS/middleware Compiler/VM architecture technology 5
3 4
3 4
23
Green
Resource Management at the Room level

Sched & alloc Application OS/middleware Compiler/VM architecture technology 5
3 4
3 4
24
Green
Resource Management at the Room level Leveraging heterogeneity IT perspective
Use heterogeneity to minimize energy consumption from a static/dynamic point of view

Static: Finding the best data center set-up, given a number of heterogeneous machines Dynamic: Optimization of task allocation in the Resource Manager
We show that the best solution implies an heterogeneous data center

Most data centers are heterogeneous (several generations of computers) 5 to 22% energy savings for static solution 24% to 47% energy savings for dynamic solution
M. Zapater, J.M. Moya, J.L. Ayala. Leveraging Heterogeneity for Energy Minimization in Data Centers, CCGrid 2012
Green
Resource Management at the Room level Leveraging heterogeneity IT perspective
Energy profiling of tasks of the SPEC CPU 2006 benchmark Usage of MILP algorithms to schedule tasks in servers where they consume less energy Implemented in a real resource manager (SLURM)
26
Green
Resource Management at the Room level IT + Cooling perspective
Generating a thermal model for the data room:

Data Center environmental monitoring to gather temperature, humidity, differential pressure Predict server temperature and room temperature
Optimum resource management attending to cooling and IT power

Real environment with heterogeneous servers SLURM resource manager
27
Green
Resource Management at the Server level

Sched & alloc Application OS/middleware Compiler/VM architecture technology
3 4 5
3 4
28
Green
Resource Management at the Server level Leakage-temperature tradeoffs - Cooling
Exploring the leakage-temperature tradeoffs at the server level

At higher temperatures, CPU increases power consumption due to leakage To decrease CPU temperature, fan speed raises, increasing server cooling consumption.
M. Zapater, J.L. Ayala., J.M. Moya, K. Vaidyanathan, K. Gross, and A. K. Coskun, Leakage and temperature aware server control for improving energy efficiency in data centers, DATE 2013
Green
Resource Management at the Server level Leakage-temperature tradeoffs - Cooling
Implemented fan speed controllers that reduce server power consumption by 10%.
30
Green
Resource Management at the Chip level

3 4 5
3 4
31
Green
Scheduling and resource allocation policies in MPSoCs UCSD System Energy Efficiency Lab
A. Coskun , T. Rosing , K. Whisnant and K. Gross "Static and dynamic temperatureaware scheduling for multiprocessor SoCs", IEEE Trans. Very Large Scale Integr. Syst., vol. 16, no. 9, pp.1127 -1140 2008
Fig. 3. Distribution of thermal hot spots, (ILP). Fig. 3. Distribution of thermal hot spots, with with DPMDPM (ILP).
Fig. 4. Distribution of spatial gradients, (ILP). Fig. 4. Distribution of spatial gradients, with with DPMDPM (ILP).
A. Static Scheduling Techniques A. Static Scheduling Techniques hot spots. While Min-Th reduces the high spatial differentials hot spots. While Min-Th reduces the high spatial differentials provide an extensive comparison of ILP the ILP based above C, observe we observe a substantial increase in spatial the spatial We We nextnext provide an extensive comparison of the based above 15 15 C, we a substantial increase in the Marina Zapater | Going Green 32 techniques. We refer to our static approach as Min-Th&Sp . gradients above 10 C. In contrast, our method achieves lower techniques. We refer to our static approach as Min-Th&Sp . gradients above 10 C. In contrast, our method achieves lower As discussed in Section III, implemented we implemented the ILP for minmore balanced temperature distribution in die. the die. As discussed in Section III, we the ILP for minand and more balanced temperature distribution in the
Green
Scheduling and resource allocation policies in MPSoCs
Energy characterization of applications allows to define proactive scheduling and resource allocation policies, minimizing hotspots Hotspot reduction allows to raise cooling temperature +1oC means around 7% cooling energy savings
33
Green
Energy Optimization: Holistic Approach

3 4 5
3 4
34
Green
JIT Compilation in Virtual Machines
Virtual machines compile (JIT compilation) the applications into native code for performance reasons The optimizer is generalpurpose and focused in performance optimization
35
Green
JIT compilation for energy minimization

Back-end
Front-end Optimizer Code generator
Application-aware compiler
Energy characterization of applications and transformations Application-dependent optimizer Global view of the data center workload
Energy optimizer
Currently, compilers for high-end processors oriented to performance optimization
36
Green
Energy saving potential for the compiler (MPSoCs)
T. Simunic, G. de Micheli, L. Benini, and M. Hans. Source code optimization and profiling of energy consumption in embedded systems, International Symposium on System Synthesis, pages 193 199, Sept. 2000
77% energy reduction in MP3 decoder

Fei, Y., Ravi, S., Raghunathan, A., and Jha, N. K. 2004. Energy-optimizing source code transformations for OS-driven embedded software. In Proceedings of the International Conference VLSI Design. 261266.
Up to 37,9% (mean 23,8%) energy savings in multiprocess applications running on Linux
37
Green
Global Management of Low Power Modes

3 4 5
3 4
38
Green
Global Management of Low-power modes (DVFS)
DVFS (Dynamic Voltage and Frequency Scaling) is based upon:

As suppy voltage decreases, power decreases quadratically But delay increases (performance decreases) only linearly The maximum frequency also decreases linearly
Currently, low-power modes, if used, are activated by inactivity of the server operating system To minimize energy consumption, changes between modes should be minimized On the other hand, workload knowledge allows to globally schedule low-power modes without any impact in performance
Green
Global Management of Low-power modes (DVFS)
By using a thermal model, we can predict the behaviour of a workload under each power mode We can use resource management algorithms to change DVFS on runtime, adapting to our workload.
40
Green
Temperature-aware floorplanning of MPSoCs

3 4 5
3 4
41
Green
Temperature-aware floorplanning of MPSoCs
42
Green
Potential energy savings with floorplanning
Y. Han, I. Koren, and C. A. Moritz. Temperature Aware Floorplanning. In Proc. of the Second Workshop on Temperature-Aware Computer Systems, June 2005
Up to 21oC reduction of maximum temperature Mean: -12oC in maximum temperature Better results in the most critical examples
Green
Temperature-aware floorplanning in 3D chips
3D chips are getting interest due to:

Scalability: reduces 2D equivalent area Performance: shorter wire length Reliability: less wiring
Drawback:
Huge increment of hotspots compared with 2D equivalent designs
44
Green
Temperature-aware floorplanning in 3D chips
Up to 30oC reduction per layer in a 3D chip with 4 layers and 48 cores
45
Green
Outline
Why Data Centers (DC) in this Workshop? The DC in next-generation applications Energy consumption at the Data Center Insight on optimization strategies
Conclusions
46
Green
There is still much more to be done
Smart Grids
Consume energy when everybody else does not Decrease energy consumption when everybody else is consuming
Reducing the electricity bill

Variable electricity rates Reactive power coefficient Peak energy demand
47
Green
Conclusions
Reducing PUE is not the same than reducing energy consumption

IT energy consumption dominates in state-of-the-art data centers
Application and resources knowledge can be effectively used to define proactive policies to reduce the total energy consumption
At different levels In different scopes Taking into account cooling and computation at the same time
Proper management of the knowledge of the data center thermal behavior can reduce reliability issues Reducing energy consumption is not the same than reducing the electricity bill
Green
Thank you for your attention
Marina Zapater marina@die.upm.es http://greenlsi.die.upm.es (+34) 91 549 57 00 x-4227

ETSI de Telecomunicacin, B105 Avenida Complutense, 30 Madrid 28040, Spain
Thanks to our collaborators:
49

Energy Efficiency in Data Centers

Caricato da

Informazioni sul documento

Copyright

Formati disponibili

Condividi questo documento

Condividi o incorpora il documento

Opzioni di condivisione

Hai trovato utile questo documento?

Questo contenuto è inappropriato?

Copyright:

Formati disponibili

Energy Efficiency in Data Centers

Caricato da

Copyright:

Formati disponibili

Green

Energy Efficiency in Data Centers

Marina Zapater 1 | Going Green

Marina Zapater | Going Green

Why Data Centers (DC) in this Workshop?

Why DC in this Workshop?

Marina Zapater | Going Green

Energy consumption of data centers

Marina Zapater | Going Green

Infrastructure Communications Storage High-end servers

Jos M.Moya | Madrid (Spain),7 July 27, 2012

What about urban DC?

Marina Zapater | Going Green

Tier 4 Data Center

Marina Zapater | Going Green

The DC in next generation applications

Traditional uses of Data Centers:

Marina Zapater | Going Green

Global energy optimization

Solution: GoingGreen! How: Global energy optimization strategies

Marina Zapater | Going Green

Global energy optimization

Executing part of the workload in the Personal Servers

Marina Zapater | Going Green

Why Data Centers (DC) in this Workshop? The DC in next-generation applications

Energy consumption at the Data Center

Marina Zapater | Going Green

Energy Consumption at the DC

Energy Consumption at the DC

How does cooling work?

Typical raised-floor air-cooled Data Center:

Marina Zapater | Going Green

Energy Consumption at the DC

The major contributors to electricity costs are:

Marina Zapater | Going Green

Power Usage Effectiveness (PUE)

Average PUE 2 State of the Art: PUE 1,2

Marina Zapater | Going Green

Solutions proposed by the State of the Art

Insight on optimization strategies

Marina Zapater | Going Green

Marina Zapater | Going Green

Energy Optimization: Holistic Approach

Sched & alloc Application OS/middleware Compiler/VM architecture technology 5

Marina Zapater | Going Green

Resource Management at the Room level

Sched & alloc Application OS/middleware Compiler/VM architecture technology 5

Marina Zapater | Going Green

Resource Management at the Room level Leveraging heterogeneity IT perspective

Use heterogeneity to minimize energy consumption from a static/dynamic point of view

We show that the best solution implies an heterogeneous data center

Resource Management at the Room level Leveraging heterogeneity IT perspective

Marina Zapater | Going Green

Resource Management at the Room level IT + Cooling perspective

Generating a thermal model for the data room:

Optimum resource management attending to cooling and IT power

Marina Zapater | Going Green

Resource Management at the Server level

Sched & alloc Application OS/middleware Compiler/VM architecture technology

Marina Zapater | Going Green

Resource Management at the Server level Leakage-temperature tradeoffs - Cooling

Exploring the leakage-temperature tradeoffs at the server level

Resource Management at the Server level Leakage-temperature tradeoffs - Cooling

Marina Zapater | Going Green