DataSys: Data-Intensive Distributed Systems LaboratoryData-Intensive Distributed Systems Laboratory

Illinois Institute of Technology
Department of Computer Science

CFP (TXT, PDF) | News | Topics | Dates | Submission | Organization | Program | Sponsors

7th Workshop on Many-Task Computing on Clouds, Grids, and Supercomputers (MTAGS) 2014

Co-located with Supercomputing/SC 2014
In cooperation with ACM SIGHPC 
New Orleans, Louisiana -- November 16th, 2014


Dr. Owen O'Malley

Where is Hadoop Going Next? 

Abstract: Over the last 8 years Hadoop has grown from a small project with a couple people working on it into a powerhouse that is changing the landscape of how enterprises use the huge amount of data they collect.  The original use case for Hadoop was at the internet companies like Yahoo, Facebook, Twitter, and LinkedIn analyzing their weblogs to gather information about users and optimizing how the users interacted with the company's services. Currently Hadoop has spread into almost every sector of the economy from financial, telecommunication, medical, retail, and insurance. I'll talk about the forces that we see moving the ecosystem as it covers an entirely new set of use cases.

Owen O'MalleyOwen O'Malley is a co-founder and software architect at Hortonworks, a rapidly growing company (25 to 525 employees in 3.5 years), which develops the completely open source Hortonworks Data Platform (HDP). HDP includes Hadoop and the large ecosystem of big data tools that enterprises need for their data analytics. Owen has been working on Hadoop since the beginning of 2006 at Yahoo, was the first committer added to the project, and used Hadoop to set the Gray sort benchmark in 2008 and 2009. In the last 8 years, he has been the architect of MapReduce, Security, and now Hive. Recently he has been driving the development of the ORC file format and adding ACID transactions to Hive. Before working on Hadoop, he worked on Yahoo Search's WebMap project, which was the original motivation for Yahoo to work on Hadoop.  Prior to Yahoo, he wandered between testing (UCI), static analysis (Reasoning), configuration management (Sun), and software model checking (NASA). He received his PhD in Software Engineering from University of California, Irvine.