Real-time data insight is getting more important for trend capturing and just-in-time decision making. eBay as one of the world’s largest and most vibrant marketplace, it relies on real-time data analysis at multiple domains to run the business, like user info protection, promotion prediction as well as site performance detect and monitor etc.
In this session Ken will introduce a new zero latency streaming OLAP engine built on Apache Kylin and how the streaming OLAP engine serves eBay's real-time data analysis business. The new Kylin streaming engine uses column based storage and indexes as well as in-memory query technique to make real-time data be visible with no latency. The new streaming engine will also provide exactly once delivery semantics to make sure data quality when used together with Apache Kafka.
