Distributed Systems: Principles and Paradigms

Definition of a Distributed System (1)

A distributed system is:
A collection of independent computers that appears to its users as a single coherent system

Definition of a Distributed System (2)

1.1

A distributed system organized as middleware Note that the middleware layer extends over multiple machines

Transparency in a Distributed System

Transparency Description Hide differences in data representation and how a resource is accessed Hide where a resource is located

Access
Location

Migration
Relocation Replication Concurrency Failure Persistence

Hide that a resource may move to another location

Hide that a resource may be moved to another location while in use Hide that a resource may be shared by several competitive users Hide that a resource may be shared by several competitive users Hide the failure and recovery of a resource Hide whether a (software) resource is in memory or on disk

Different forms of transparency in a distributed system

Scalability Problems
Concept Example

Centralized services
Centralized data Centralized algorithms

A single server for all users

A single on-line telephone book Doing routing based on complete information

Examples of scalability limitations

Scaling Techniques
1. Hiding communication latencies 2. Distribution 3. Replication

Scaling Techniques (1)

1.4

The difference between letting:

a) a server or b) a client check forms as they are being filled

Scaling Techniques (2)

1.5

An example of dividing the DNS name space into zones

Hardware Concepts

1.6

Different basic organizations and memories in distributed computer

systems

Multiprocessors (1)

1.7

A bus-based multiprocessor

Multiprocessors (2)

1.8

a) A crossbar switch b) An omega switching network

Homogeneous Multicomputer Systems

1-9

a) Grid b) Hypercube

Software Concepts
System DOS NOS Middleware Description Tightly-coupled OS for multi-processors and homogeneous multicomputers Loosely-coupled OS for heterogeneous multicomputers (LAN and WAN) Additional layer atop of NOS implementing general-purpose services Main Goal Hide and manage hardware resources Offer local services to remote clients Provide distribution transparency

An overview of DOS (Distributed Operating Systems) NOS (Network Operating Systems) Middleware

Uniprocessor Operating Systems

1.11

Separating applications from OS code through a microkernel

Multicomputer Operating Systems (1)

1.14

General structure of a multicomputer operating system

Distributed Shared Memory Systems (1)

a) Pages of address space distributed among four machines

b)

Situation after CPU 1 references page 10

Situation if page 10 is read only and replication is used

c)

Distributed Shared Memory Systems (2)

1.18

False sharing of a page between two independent processes

Network Operating System (1)

1-19

General structure of a network operating system

Network Operating System (2)

1-20

Two clients and a server in a network operating system

Positioning Middleware

1-22

General structure of a distributed system as middleware

Middleware and Openness

1.23

In an open middleware-based distributed system, the protocols used by each middleware layer should be the same, as well as the interfaces they offer to applications

Comparison between Systems

Item
Degree of transparency Same OS on all nodes Number of copies of OS Distributed OS Multiproc. Very High Yes 1 Multicomp. High Yes N

Network OS
Low No N

Middlewarebased OS
High No N

Basis for communication

Resource management Scalability Openness

Shared memory
Global, central No Closed

Messages
Global, distributed Moderately Closed

Files
Per node Yes Open

Model specific
Per node Varies Open

A comparison between multiprocessor OS, multicomputer OS, network OS, and middleware based distributed systems

Clients and Servers

1.25

General interaction between a client and a server

Processing Level

1-28

The general organization of an Internet search engine into three different layers

Multitiered Architectures (1)

1-29

Alternative client-server organizations (a) (e)

Multitiered Architectures (2)

1-30

An example of a server acting as a client

Modern Architectures

1-31

An example of horizontal distribution of a Web service