Designs, Lessons and Advice from Building Large ...

[Pages:73]Designs, Lessons and Advice from Building Large Distributed Systems

Jeff Dean Google Fellow jeff@

Computing shifting to really small and really big devices

UI-centric devices

Large consolidated computing farms

Google's data center at The Dalles, OR

The Machinery

Servers ? CPUs ? DRAM ? Disks

Racks ? 40-80 servers ? Ethernet switch

Clusters

Architectural view of the storage hierarchy

P

P

... L1$

L1$

...

L2$

P

P

... L1$

L1$

L2$

Local DRAM

Disk

One server

DRAM: 16GB, 100ns, 20GB/s Disk: 2TB, 10ms, 200MB/s

Architectural view of the storage hierarchy

P

P

... L1$

L1$

...

L2$

P

P

... L1$

L1$

L2$

Local DRAM

Disk

One server

DRAM: 16GB, 100ns, 20GB/s Disk: 2TB, 10ms, 200MB/s

DRAM DRAM DRAM DRAM

Rack Switch

Disk Disk Disk Disk

...

DRAM DRAM DRAM DRAM

Local rack (80 servers)

Disk Disk

DRAM: 1TB, 300us, 100MB/s

Disk

Disk Disk: 160TB, 11ms, 100MB/s

Architectural view of the storage hierarchy

P

P

... L1$

L1$

...

L2$

P

P

... L1$

L1$

L2$

Local DRAM

Disk

One server

DRAM: 16GB, 100ns, 20GB/s Disk: 2TB, 10ms, 200MB/s

DRAM DRAM DRAM DRAM

Rack Switch

Disk Disk Disk Disk

...

DRAM DRAM DRAM DRAM

Cluster Switch

...

Local rack (80 servers)

Disk Disk

DRAM: 1TB, 300us, 100MB/s

Disk

Disk Disk: 160TB, 11ms, 100MB/s

Cluster (30+ racks)

DRAM: 30TB, 500us, 10MB/s Disk: 4.80PB, 12ms, 10MB/s

Storage hierarchy: a different view

A bumpy ride that has been getting bumpier over time

 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download