High Performance

Computing
Cloud Computing
Dr. Rami YARED

1
 Outline
High Performance Computing
Parallel Computing

Cloud Computing
Definitions
Advantages and drawbacks

Cloud Computing vs Grid Computing

2
3
4
5
6
7
8
9
10
 Outline
High Performance Computing
Parallel Computing

Cloud Computing
Definitions
Advantages and drawbacks

Cloud Computing vs Grid Computing

11
 Cloud Computing

New paradigm

“Clouds will transform the information Technology (IT)

industry… profoundly change the way people work and
companies operate”

 Provides massively scalable computing resources

from anywhere.
 Simplifies services delivery.
 Enables rapid innovation of new business models.
 Dynamic infrastructure for next generation data 12
 The “Cloud” = 10X
Improvements
• Ease of Use
• Scalability
• Reliability
• Cost

13
 Ease of Use
• Deploy infrastructure with a mouse
or API
– No cabling
– Middle of the night
– Do it yourself remotely from anywhere
anytime

14
 Scalability

Control your infrastructure with your

app
Nothing to purchase and take delivery
on Instant

15
 Reliability
Based on enterprise grade hardware
Design for failures:
Automatically spin up
replacements
Use multiple clouds
Cost
“Turn off the lights” = turn off servers
you aren’t using
Ex: Turn off development and test
environments
Pay for only what you use
No need to buy in advance
Zero Capital Outlay
No contracts

16
 Cloud computing
• Understanding how others view
“Cloud Computing”
• Multiple Definitions

17
Cloud Computing Definition by Forrester
research
“A pool of abstracted, highly scalable, and
managed compute infrastructure capable of
hosting end-customer applications and billed
by consumption”

18
Cloud Computing Definition by Forrester
research
• Different than SaaS (Software as a Service)
– Prescript & Abstract Infrastructure
– Fully Virtualized
– Dynamic Infrastructure Software
– Pay by Consumption
– Free of Long-Term Contracts
– Application and OS Independent
– Free of Software or Hardware Installation

“Cloud computing has all the earmarks of being

a potential innovation that all infrastructure
and operations professionals should pay close
attention.”
19
 Other Definitions
“Cloud computing is an emerging approach to
shared infrastructure in which large pools of
systems are linked together to provide IT
services.”
– IBM press release on “Blue Cloud”

“…a hosted infrastructure model that delivers

abstracted IT resources over the Internet”
– Thomas Weisel Partners LLC from “Into the Clouds: Leveraging Data Centers
and the Road to Cloud Computing”

“Cloud computing describes a systems

architecture. This particular architecture
assumes nothing about the physical location,
internal composition or ownership of its
component parts.”
– James Urquhart blog post
20
 Cloud Computing definition
• SaaS
– Software as a Service
– Storage as a Service
• PaaS – Platform as a Service
• IaaS – Infrastructure as a Service

Hosting Industry Change

Cloud Computing -“Enabling
Technology” to move from
Traditional Hosting to Cloud
Hosting
21
 The Cloud’s “Snowball
Effect”
• Maturation of Virtualization
Technology
• Virtualization enables Compute Clouds
• Compute Clouds create demand for
Storage Clouds
• Storage + Compute Clouds create
Cloud Infrastructure
• Cloud Infrastructure enables Cloud
Platforms & Applications
22
 Cloud Computing
• Build upon a foundation
• Building blocks: Infrastructure, Platforms,
Applications
Cloud Computing is…
… virtualized compute power and storage
delivered via platform infrastructures of
abstracted hardware and software
accessed over the Internet.

These shared, on-demand IT resources,

are created and disposed of efficiently,
are dynamically scalable through a
variety of programmatic interfaces and
are billed variably based on measurable 23
 Cloud computing

• Develop in the cloud

– Integrated, dynamically provisioned
environment
– Repository for source and reusable
assets

24
 Cloud computing
• Deploy in the cloud
– One click application provisioning
– Deployment optimization
– Collaboration platform for knowledge
sharing

25
 Cloud computing
• Deliver services from the cloud
– Seamless transition to production
environment
– Easily accessed from anywhere

26
 Cloud computing
• Overflow to another cloud
– Hybrid cloud for dynamic Infrastructure
– Leverage extra capacity from public
clouds
– Single systems management view across
clouds

27
 Cloud “Applications”
• SaaS resides here
• Most common Cloud / Many providers
of different services
• Examples: SalesForce, Gmail, Yahoo!
Mail
• Advantages: Free, Easy, Consumer
Adoption
• Disadvantages: Limited functionality,
no control or access to underlying
technology 28
 Cloud “Platforms”
• “Containers”
• “Closed” environments
• Examples: Google App Engine, Joyent
or Force.com (SalesForce Dev
Platform)
• Advantages: Good for developers,
more control than “Application”
Clouds, tightly configured
• Disadvantages: Restricted to what is
available
29
 Traditional Hosting vs Cloud
Hosting
• Static  Dynamic = Quick & Easy
Scalability
• Cost Prohibitive  Cost Effective = Cost
Efficiencies based on usage, no
contracts, no upfront costs
• Predictable  Unpredictable =
Innovations
• Stagnant  Growth = Evolution

Reference: Paul Lancaster, Business Development Manager,

Traditional Hosting  Cloud Hosting =
GoGrid
http://www.GoGrid.com
FUTURE! 30
 Cloud “Infrastructure”
• Provide “Compute” and “Storage”
clouds
• Virtualization layers
(hardware/software)
• Examples: Amazon EC2, Amazon S3
• Advantages: Full control of
environments and infrastructure
• Disadvantages: premium price point,
limited competition

31
32
 Cloud Computing vs Grid
computing
• Cloud computing is a style of
computing in which dynamically
scalable and often virtualized
resources are provided as a service
over the Internet. Users need not
have knowledge of, expertise in, or
control over the technology
infrastructure in the "cloud" that
supports them.
33
 Comparisons
Cloud computing can be confused with:

1) grid computing: "a form of distributed

computing whereby a super and virtual
computer is composed of a cluster of
networked, loosely-coupled computers, acting in
concert to perform very large tasks".

2) utility computing: the "packaging of

computing resources, such as computation and
storage, as a metered service similar to a
traditional public utility such as electricity“

3) autonomic computing: "computer systems

34
capable of self-management".
 Cloud computing
• characteristics
Cloud computing customers do not generally own the
physical infrastructure serving as host to the software
platform in question. Instead, they avoid capital
expenses by renting usage from a third-party provider.

• They consume resources as a service and pay only for

resources that they use. Many cloud-computing
offerings employ the utility computing model, which is
analogous to how traditional utility services (such as
electricity) are consumed, while others bill on a
subscription basis.

• Computing power among multiple tenants can improve

utilization rates, as servers are not unnecessarily left
idle (which can reduce costs significantly while 35
History of Cloud Computing
The Cloud is a term that borrowed from
telephony. Up to the 1990s, data
circuits (including those that carried
Internet traffic) were hard-wired
between destinations. Subsequently,
long-haul telephone companies began
offering Virtual Private Network (VPN)
service for data communications.
Telephone companies were able to offer
VPN based services with the same
guaranteed bandwidth as fixed circuits
at a lower cost because they could
switch traffic to balance utilization as
they saw fit, thus utilizing their overall
network bandwidth more effectively. 36
History of Cloud Computing
• As a result of this arrangement,
it was impossible to determine
in advance precisely paths
traffic would be routed over.
The term "telecom cloud" was
used to describe this type of
networking, and cloud
computing is conceptually
somewhat similar.
37
 Disadvantage of cloud
Computing
• Since cloud computing does not allow users to
physically possess the storage of their data (the
exception being the possibility that data can be
backed up to a user-owned storage device, such as a
USB flash drive or hard disk) it does leave
responsibility of data storage and control in the hands
of the provider.
• Cloud computing has been criticized for limiting the
freedom of users and making them dependent on the
cloud computing provider, and some critics have
alleged that is only possible to use applications or
services that the provider is willing to offer. Thus, The
London Times compares cloud computing to
centralized systems of the 1950s and 60s, by which
users connected through "dumb" terminals to
mainframe computers. Typically, users had no
freedom to install new applications and needed
approval from administrators to achieve certain tasks.38
Overall, it limited both freedom and creativity. The
 Disadvantage of cloud
Computing
• Similarly, Richard Stallman, founder
of the Free Software Foundation,
believes that cloud computing
endangers liberties because users
sacrifice their privacy and personal
data to a third party. He stated that
cloud computing is "simply a trap
aimed at forcing more people to buy
into locked, proprietary systems that
would cost them more and more over 39
 Outline
High Performance Computing
Parallel Computing

Cloud Computing
Definitions
Advantages and drawbacks

Cloud Computing vs Grid Computing

40
 Cloud Computing
• With cloud computing, companies can scale
up to massive capacities in an instant
without having to invest in new
infrastructure, train new personnel, or
license new software.
• Cloud computing is of particular benefit to
small and medium-sized businesses who
wish to completely outsource their data-
center infrastructure, or large companies
who wish to get peak load capacity without
incurring the higher cost of building larger
data centers internally. In both instances,
service consumers use what they need on
the Internet and pay only for what they use.
41
 Cloud Computing
• The service consumer no longer has to
be at a PC, use an application from the
PC, or purchase a specific version that's
configured for smart phones, PDAs, and
other devices. The consumer does not
own the infrastructure, software, or
platform in the cloud.
• He has lower upfront costs, capital
expenses, and operating expenses. He
does not mind about how servers and
networks are maintained in the cloud.
• The consumer can access multiple
servers anywhere on the globe without
knowing which ones and where they are
located. 42
 Grid computing
Cloud computing evolves from grid computing and provides on-
demand resource provisioning. Grid computing may or may not be
in the cloud depending on what type of users are using it. If the
users are systems administrators and integrators, they care how
things are maintained in the cloud. They upgrade, install, and
virtualize servers and applications. If the users are consumers, they
do not mind how things are run in the system.

Grid computing requires the use of software that can divide and
farm out pieces of a program as one large system image to several
thousand computers. One concern about grid is that if one piece of
the software on a node fails, other pieces of the software on other
nodes may fail. This is alleviated if that component has a failover
component on another node, but problems can still arise if
components rely on other pieces of software to accomplish one or
more grid computing tasks. Large system images and associated
hardware to operate and maintain them can contribute to large
43
capital and operating expenses.
 Grid vs Cloud: Similarities and
differences
• Cloud computing and grid computing
are scalable. Scalability is accomplished
through load balancing of application
instances running separately on a
variety of operating systems and
connected through Web services.
• CPU and network bandwidth is allocated
and de-allocated on demand. The
system's storage capacity goes up and
down depending on the number of
users, instances, and the amount of
data transferred at a given time. 44
 Grid vs Cloud Similarities and
differences
• Both computing types involve
multitasking, meaning that many
customers can perform different tasks,
accessing a single or multiple application
instances. Sharing resources among a
large pool of users assists in reducing
infrastructure costs and peak load
capacity.
• Cloud and grid computing provide
service-level agreements (SLAs) for
guaranteed uptime availability of, say,
99 percent.
• If the service slides below the level of the
guaranteed uptime service, the
45
 Grid vs Cloud Computing
• The Amazon S3 provides a Web
services interface for the storage and
retrieval of data in the cloud. Setting a
maximum limits the number of objects
one can store in S3. It can store an
object as small as 1 byte and as large
as 5 GB or even several terabytes. S3
uses the concept of buckets as
containers for each storage location of
your objects. The data is stored
securely using the same data storage
infrastructure that Amazon uses for its 46
 Grid vs Cloud Computing
• While the storage computing in the grid
is well suited for data-intensive storage,
it is not economically suited for storing
objects as small as 1 byte. In a data
grid, the amounts of distributed data
must be large for maximum benefit.
• A computational grid focuses on
computationally intensive operations.
Amazon Web Services in cloud
computing offers two types of
instances: standard and high-CPU. 47
 Summary
High Performance Computing
Parallel Computing

Cloud Computing
Definitions
Advantages and drawbacks

Cloud Computing vs Grid Computing

48
Thank you