2014 MapR Technologies 1

2014 MapR Technologies

ETL Offload
2014 MapR Technologies 2
Source1
Source2
Source3
Validation Staging
Tier
2
Tier
3
Data Lab
Teradata Edge External Core
Tier
1
MapR
Apps
Tier
1
Tier
1
Tier
1
2014 MapR Technologies 3
Source1
Source2
Source3
Validation Staging
Tier
2
Tier
3
Data Lab
Teradata Edge External Core
Tier
1
MapR
Teradata tools, out of scope
Abstract with Adapter Pattern
Apps
Tier
1
Tier
1
Tier
1
2014 MapR Technologies 4
Validation Staging
Tier
2
Data Lab
Teradata Edge Core
Tier
1
MapR
Apps
A
B
C
D
F
Coordination
Tier
1
Tier
1
Tier
1
G
E
A ingest and validation workflows
B
C export builds to Teradata
D efficient join of T2
current
to T1
future
E expose T1
current
to Data Lab
F coordination of services, workflow scheduling
G snapshots of T1 for e.g. DR
2014 MapR Technologies 5
ingest/validation


Write to Teradata
Merge T2 to build


T1 Data Lab access
Coordination
Snapshots
Pig, Hive, Lingual, Cascading


MapR NFS + TD tools
Sqoop, JDBC, Hive,
Lingual, Cascading, HBase
Hive, Drill, Impala, HBase
Oozie
MapR admin tools

A

B
C
D

E
F
G
2014 MapR Technologies 6
Hive, Pig, Lingual
Key feature for all is CLI

SQL (Lingual) and
SQL-like (Hive) support
Pig is a scripting language
2014 MapR Technologies 7
Sqoop
2014 MapR Technologies 8
Oozie, Cascading
Oozie is more scheduling focused
Cascading is more workflow focused
2014 MapR Technologies 9
HBase
2014 MapR Technologies 10
Drill
2014 MapR Technologies 11
Impala
Provides CLI support like
Hive, Pig, Lingual
In-memory DS for lower-latency queries
Specialized (limited utility)
2014 MapR Technologies 12
ingest/validation


Write to Teradata
Merge T2 to build


T1 Data Lab access
Coordination
Snapshots
Pig, Hive, Lingual, Cascading


MapR NFS + TD tools
Sqoop, JDBC, Hive,
Lingual, Cascading, HBase
Hive, Drill, HBase
Oozie
MapR admin tools

A

B
C
D

E
F
G