Online Meetup | How to Develop and Operate Cloud-Native Data Platforms and Applications
feat. Electronic Arts (EA) use cases
Get access to the on-demand video
In cloud-based software stacks, there are varying degrees of automation across different layers: infrastructure, platform, and application. The mismatch in automation often breaks balance in devops, causing ops nightmares in platforms and applications. This talk will overview two projects at Electronic Arts (EA) that address the mismatch by data orchestration: One project automatically generates configurations for all components in a large monitoring system, which reduces the daily average number of alerts from ~1000 to ~20. The other project introduces Alluxio for caching and unifying address space across ETL and analytics workloads, which substantially simplifies architecture, improves performance, and reduces ops overheads.
In this online meetup, you will learn about:
- Lessons learned in building and rebuilding EA’s monitoring systems
- Redesigning data platform by replacing HDFS with Alluxio for data orchestration and help with scaling
Interested in learning more?
Speaker: Du Li
Architect of Data Infrastructure at Electronic Arts
Du Li, is currently an Architect of Data Infrastructure at Electronic Arts. He worked in academia and industrial labs for many years after earning his Ph.D. degree from UCLA. Prior to joining EA in mid-2018, he was a software engineer at Yahoo and Apple.
Speaker: Bin Fan
Founding Engineer & VP of OS, Alluxio
Bin Fan is the founding engineer and VP of Open Source at Alluxio, Inc. Prior to Alluxio, he worked for Google to build the next-generation storage infrastructure. Bin received his Ph.D. in Computer Science from Carnegie Mellon University on the design and implementation of distributed systems.
...a data orchestration layer for compute in any cloud. It unifies data silos on-premise and across any cloud to give you data locality, accessibility, and elasticity.
Whether it’s accelerating big data frameworks on the public cloud, running big data workloads in hybrid cloud environments, or enabling big data on object stores or multiple clouds, Alluxio reduces the complexities associated with orchestrating data for today’s big data and AI/ML workloads.