Sei sulla pagina 1di 43

Openwave Messaging

Presentation

Utpal Thakrar Mike Blum


Product Manager Product Technologist
Worldwide Messaging Customers

CONFIDENTIAL 2008 Openwave Systems Inc. 2


Agenda

Market Trends
Solution Overview
Solution Details
Anti-Abuse Platform

CONFIDENTIAL 2008 Openwave Systems Inc. 3


Continued Growth in Email Traffic and Web-based
access

Email Growth

By 2011 the number of mailboxes will


exceed 2B.
Total messages sent and average size of
messages sent is on a steep rise
IDC, March 2009

Webmail is Dominant Mail Client

60% of subscribers use Webmail or IMAP


as their primary access method; this will
grow to 65% by 2011.
IDC, March 2009

CONFIDENTIAL 2008 Openwave Systems Inc. 4


Mobile E-mail Trends

5
Subscriber Expectations, Operator Needs

Subscriber Expectations Operator Needs


Always Available Ensure service is Carrier Grade reliability, scalability,
always on manageability.
Easy to Use desktop-like Lower TCO while meeting subscriber
capabilities in the Web. needs for multi-GB mailbox, rich media,
Safe Email protection from virus advanced search & more.
and phishing attacks, spam and Seamless Anti-Abuse protection
advertising comprehensive protection that is easy
Unlimited storage allow them to to manage and cost-effective
store and search all their messages, Deep subscriber relationship more
rich multi-media without having to than Internet access beating Yahoo,
worry about storage space Google, MSN with key services.
Personalized ability to customize Maximize revenue growth easily
service (aggregate email, content), add new, integrated VAS; deliver
work with subscribers preferred targeted advertising; grow voice usage.
services (IM, VoIP, mobile).

CONFIDENTIAL 2008 Openwave Systems Inc. 6


The Problem

2009
7 Openwave
The Problem

sers expectation:
finite storage & fast performance

Operator impact:
Skyrocketing storage costs
2009
8 Openwave
High Storage Demand

G MAILBOX SIZE FOR 5 MILLIONIncreased


MAILBOX storage
needs grow costly
with the use of current
Storage in
Terabytes

hardware solution.

Average Mailbox Size in Megabytes


2009
9 Openwave
Rising Storage Costs

T OF STORAGE SPACE
This becomes a $22B market by 2013Increase in
average mailbox
for storage vendors!
Cost in $$

size leads to
very high
storage needs

Storage Size in Terabytes

STRIBUTION FOR OPERATOR


17% 32% Typical operator
spends 32%
of their budget
on storage
22%

27%
Radacati Mar 2009
2009
10 Openwave
Agenda

Market Trends
Solution Overview
Solution Details
Anti-Abuse Platform

CONFIDENTIAL 2008 Openwave Systems Inc. 11


Messaging Overview

CONFIDENTIAL 2009 Openwave Systems Inc. 12


Platform that you can build upon

Openwave Messaging Platform includes a carrier grade Directory, Message


Store, Notification and Index services along with Anti-abuse capabilities

64-bit Application Support Full IPv4 / IPv6 Support


Able to utilize large addressable memory Mobile and Broadband operators running
for tomorrows scalability needs out of public IP addresses on all-IP devices
Improved performance with use of Support for IPv6 is crucial as devices move
towards IPv6
sophisticated cache techniques
Satisfies government / corporate mandate
Enables full-hardware utilization to move to IPv6
Supports for multi-gigabyte mailbox
Extensible Carrier-Grade
Standards-compliant, open interfaces High performance
Allows rapid deployment of new services Only immutable data is indexed
on existing platform All index data for a user resides on a
Extend to additional content types single server
Messaging today, Other apps in future Reliable, Cost-effective
Unlimited Scalability

All components are completely horizontally and vertically scalable for


right-sized capacity management.
Two tier architecture for massive Front End Processors
scalability Voice MTA MMS POP IMAP Richmail

Application redundancy for 5-9s


reliability
Server Properties: Platform Components
Directory LDAP Message Queue
Multi-threaded to take full Replicas Directory Store Servers
advantage of SMP systems
Multiple servers, separate hosts
Multiple servers, same machines
Storage Area Network
Stateless front end processors
Allow seamless horizontal
scaling with zero-down time
Require minimal downtime and
offer full scalability
CONFIDENTIAL 2008 Openwave Systems Inc. 14
Email MX Roadmap

Email Mx 8.2
Lower TCO storage
- Enable use of commodity storage
Stateless MSS
- True 5 9s reliability
- Reduced OPEX
Infinite horizontal scalability
- Use of distributed file system
- Use of distributed database
Product Hardening
- IMAP performance improvements

Today June, 2010 March, 2011

Email Mx 8.3

Open Interfaces
Email Mx 8.2.x - MSS open interface
Platform enhancements
3rd Gen Queue Server - Global de-duping support
- Enhanced Management Indexing Service
- Enhanced Reporting
- Folder sort orders
- Improved performance - Indexing per folder
and scalability Product hardening
- Enhanced notifications
Reporting and Monitoring
- Improved reporting, stats gathering and
monitoring

15
Agenda

Market Trends
Solution Overview
Solution Details
Anti-Abuse Platform

CONFIDENTIAL 2008 Openwave Systems Inc. 16


ADDRESSING THE
STORAGE TSUNAMI

CONFIDENTIAL 2009 Openwave Systems Inc. 17


What are we doing about it?

Expanding on our rock-solid messaging platform that is highly


scalable, reliable, carrier-grade, low-TCO.
Platform that enables high volume storage at low cost.
The Solution
Mx 8.1: July 31 2009 Mx 8.2: June 2010

Stateless Message Store


Multi-Gigabyte mailboxes Reduced TCO
Significant performance Low Cost Storage
improvements Lowered Operational Costs
IPV6 support Eliminated 3rd party Lic Cost
64-bit support Increased Overall Reliability
Simpler & Cheaper growth path

Platform you can build on Get Ahead

CONFIDENTIAL 2009 Openwave Systems Inc. 18


What is the typical mail storage model?

OVM iMTA oMTA POP Web IMAP MMS

MSS 1 MSS 2 MSS 3


Users Users Users
0-300,000 300,001-600,000 600,001-900,000

DATABASE DATABASE
Storage
Disk 1 DATABASE
Storage
Disk 2
Storage
Disk 3

2009
19 Openwave
Solution: New Stateless Architecture

OMV oMTA POP Web IMAP MMS

Service
Broker

sMSS 1 sMSS 2 sMSS 3


Users Users Users
0-900,000 0-900,000 0-900,000

ared Storage Layer (All Use


Distributed DISK
Database DISK DISK DISK DISK

2009
20 Openwave
Low Cost Storage

Storage Layer (All Users)


DATABASE DATABASE DATABASE DATABASE

Low Cost Low Cost Low Cost Low Cost Low Cost
Hardware Hardware Hardware Hardware Hardware

ORAGE COSTS $14,000,000


Lower TCO by
using Low Cost
Cost in $$

$12,000,000 EMC
$10,000,000
3Par
hardware (can
$8,000,000
$6,000,000 reduce storage
Commodity HW
$4,000,000
$2,000,000
cost 50-65%)
$0
50 200 500 1000

Storage Size in Terabytes


2009
21 Openwave
Characteristics of Service Broker

Intelligently directs front end processors (MTA, POP, IMAP, etc) to most suitable
stateless MSS based on:
Keep-alive status of sMSS
sMSS CPU utilization
sMSS Memory utilization
sMSS Cached mailboxes
Fully Redundant
No single point of failure, hosts are load balanced
All hosts maintain in-memory cache consistency
Extensible
Can be expanded to additional services beyond mail
Example: Indexing, calendar, album, etc

Software solution
Doesnt require specific brand/model hardware
No additional 3rd Party software licensing requirements.

22
What Is Our Low Cost Storage Goal?

Network connected machines with:


Internal Storage
JBOD (Just a Bunch Of Disks)
Attached Storage (SAN or NAS)
Software providing a Virtualized Storage Platform
Client software connects servers to virtual storage
Storage Node physical hosts which provide storage
Configurable
Store single object on multiple servers
Distribute objects based on storage node characteristics
Cpu load
Mem util
Physical storage capacity

Easily expandable add new storage node to increase capacity


High performance (read-ahead, write-behind, cacheing)
23
What is a distributed File System

Stateless MSS
Storage Client

High Speed Network

Storage Node
Internal Drives

Storage Node
Attached JBOD

Storage Node
SAN Attached Disk

24
What is Distributed Database?

MSS Stateless
Stateless MSS
MSS Stateless
Stateless MSS
MSS Stateless
Stateless MSS
MSS
Layer

GbE / 10 GbE / Infiniband Network

Distributed DB Distributed DB Distributed DB


Distributed Server Server Server

Storage Gossip Gossip

Layer

25
Improvement In Overall Service Reliability

Current Architecture Single Future Architecture Single


Points of Failure Points of Failure Eliminated

26
Multiple Architectures
Stateful + Stateless in single deployment

OVM iMTA oMTA POP Web IMAP MMS

Svc
Broker
Cluster

sMSS sMSS sMSS sMSS sMSS MSS MSS

Storage Storage Storage Storage DB DB


Storage Storage Storage Storage Array Array

Storage Storage Storage Storage

Stateless Cluster Stateful MSSs


27
Multiple Architectures
Multiple Stateless in single deployment

OVM iMTA oMTA POP Web IMAP MMS

Svc Svc
Broker Broker
Cluster Cluster

sMSS sMSS sMSS sMSS sMSS sMSS sMSS sMSS sMSS sMSS

Storage Storage Storage Storage Storage Storage Storage Storage

Storage Storage Storage Storage Storage Storage Storage Storage

Storage Storage Storage Storage Storage Storage Storage Storage

Stateless Cluster Stateless Cluster


28
Queue server history

1st generation queuing


Spooling at local MTA.
Disadvantages:
MTAs become stateful, heavy and expensive (disk
requirements)
Messages tied to an MTA spool, single point of failure

29
Queue Server History (2)

2nd generation queuing


Standalone queue server shared by multiple MTAs
Advantages:
Results in near stateless MTAs, inexpensive
Avoids single point of failure

Disadvantages:
If a large email service provider like yahoo or hotmail goes
down, the queue handling becomes inefficient
Inefficient handling of messages that are undeliverable,
ends up clogging the queue
Insufficient statistics and reports

30
3rd Generation Queue

More efficient de-queuing regarding queue size


Domain preference de-queuing
Introduction of Sleepycat DB to store message metadata
Elimination of Control/Header/Body files messages stored as a complete file
No DB backups required
DB can be rebuilt with original stored files (combined file)
Enhance queue reporting mechanism
How many domains are queued?
What is the queue size of a particular domain
Report queue size of all the domains.
Get the messages in a particular queue sorted by oldest first or newest first
Get the messages in a queue based on the processing time (Recently processed,
currently being processed etc.)
Get the list of domains based on the increasing priority level.
Get the list of messages from a particular queue.

31
3rd Generation Queue Server

Queue
QueueDB
DB
MTA Message
Metadata

Message
Queue
MTA
Server
Queue
QueueFS
FS
MTA
Message 1
Message 2
Message 3
Message 4

Metadata is written to DB Message 32164

Message3Garrives
Queue in receives
MTA whichheader,
cannot be processed. MTA
control, and body information.
determines
Parses that the messageinfo into
header/control
should
meta beand
data queued
combines all parts
to Body. and combined Body is saved in the
Queue FS
3rd Generation Queue Benefits

Significantly improves de-queuing performance


DB stores message metadata
Eliminates brute force scans on Queue file system
Guaranteed FIFO de-queuing per domain
Reduced I/O on Queue File System
Body not touched until it de-queued, removed or needed for DB rebuild
Search on entire message not required information resides in DB
Reporting is simpler no need for brute force search on Queue File System
Improved Reporting DB maintains relevant data
Originating/Destination user/domain
Reason for queuing (Example failed extension)
# of attempted de-queue
Longevity of message in queue

33
Agenda

Market Trends
Solution Overview
Solution Details
Anti-Abuse Platform

CONFIDENTIAL 2008 Openwave Systems Inc. 34


Edge Gx -- Premium Anti-Abuse Protection

Advanced anti-abuse protection designed specifically to meet the needs of


operators.

Consumer Trends -
First line of defense on the network
edge
Mobile
Eliminated 95% of unwanted traffic
from flowing downstream
Unique voting framework
dramatically improves abuse
detection while minimizing system
resource requirements.
Sophisticated features including
Flow Control, Shared Server
Intelligence, Classifier Cross Talk,
DHA protection and more.
Extended reporting and
administration for better insight and
rapid response
Seamlessly integrates with Email
Mx for rapid deployment and
protection
CONFIDENTIAL
of messaging features.
2008 Openwave Systems Inc. 35
Increased Effectiveness

Edge Gx combined with a filter delivers highest level of effectiveness.


Filter only solution was only blocking 60% - 70% prior to Edge Gx.
Connection and Message Management
12am 4am
Connections Recieved 2,262K
4%
9%
Gx Connections Blocked 1,939K
87%
Filter Messages Blocked 278K

Messages Delivered 106K


Total Blocked 96%

Edge Gx Blocking >90% of


spam before it enters
Blocked by Blocked by network
Edge Gx Filter
Messages
Delivered
Tier 1 Tier 2
Comprehensive Anti-Abuse Protection

Anti-Abuse Features Embedded Scripting


Dynamically compiles customized scripts at runtime
Critical platform security
settings for combating abuse
Classifiers Voting Framework
Dynamically evaluates Collects weights from
connections and messages and individual classifiers and
assigns abuse probability score makes earliest abuse verdict

Connection Classifiers Message & Content Classifiers Message Content


SMTP Trust IP Reputation* Classifiers
DNS RBL Message Rate Limit Commtouch AS
Spamhaus Shared Message Rate Limit Cloudmark AS
Shared Connection Limit Recipient Rate Limit Commtouch AV
Data Before Greeting Mail From Change Cloudmark AV
Deep Scan McAfee AV
No Hops No Authorization Custom Content Classifiers
Global Allow List
Sender Policy Framework (SPF)
CONFIDENTIAL 2008 Openwave Systems Inc. 37
Shared Server Intelligence

Providing System-wide Inbound & Outbound - Anti-Abuse Defense


Set and Enforce AUP independently of Horizontal Scaling for Load
Without Shared Server Intelligence With Shared Server Intelligence
Desired Rate 10 messages Desired Rate 10 messages
Limit Policy: per hour Limit Policy: per hour

10

10

10 10

Messages 10 Messages

10
10

Effective Rate 60 messages Effective Rate 10 messages


Limit Policy: per hour Limit Policy: per hour

38
Net New Bots/Month

Source: MAAWG 2009


MAAWG | maawg.org | Philadelphia, October 2009 39
Botnet Characteristics

Botnet Characteristics Combating Botnets


Botnet consists of tens of Need a combination of traffic
thousands of zombie computers shaping and filtering techniques to
combat botnets
Fastest growing threat vector
The current Innocent until proven
Spam come from mllions of guilty (IP blacklisting) needs to
computers, millions of IP change to Dont trust until proven
addresses (Positive reputation)

Hard to detect as each IP address


generates low volume of spam

RBL relying on negative reputation


are not always effective

Typical botnets are impatient


give up if the connection is slowed
down as slow connections disrupt
the spam economics
40
New Edge GX Improvements

41
Edge GX

Edge GX 4.0

Reporting and Monitoring enhancements


- Report generation flexibility
- Improved statistics coverage
- Improved managability
Performance and Scalability enhancement
- Enhance traffic shaping capability
- Support for up to 10k simultaneous
Product Hardening
- Eliminate dependency on Mx schema and Directory
- Revamp Shared Brain architecture for scalability
64-bit, IPv6 support

Today July, 2010 March, 2011

Edge GX 4.1

Classifier development environment enhancements


- Automate skeleton code generation for new classifier
development

Introduce Scriptable Extensions


- Add a embedded scripting language (LUA) to allow
quick scripts to be written by the customer

Integration with Common Policy Decision framework


- Policies are leveraged by more than one product

42
CONFIDENTIAL 2008 Openwave Systems Inc. 43

Potrebbero piacerti anche