Towards Balanced, Data-intensive Scalable Computing

June 23, 2014

While many interesting systems are able to scale linearly with additional servers, per-server performance can lag behind per-server capacity by more than an order of magnitude. In this CSE Colloquia, we will present Themis, a runtime supporting highly-efficient data-intensive computing. It is designed to process large datasets with very high throughput and is also the winner of the 100TB “Indy” and “Daytona” JouleSort benchmarks. In this talk, we present an overview of the hardware and software architecture necessary to drive this level of efficiency. Bridging the gap between high scalability and high performance will enable either significantly cheaper systems, or provide the ability to address significantly larger problem sets with the same infrastructure.

George Porter, UC San Diego, Center for Networked Systems