Apache: Big Data North America 2017 will be held at the Intercontinental Miami in Miami, Florida. 

Register now for the event taking place May 16-18, 2017. 
Back To Schedule
Thursday, May 18 • 12:20pm - 1:10pm
ING CoreIntel: On The Bank Secret Service - Krzysztof Adamski, ING

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Security is at the core of every bank activity. ING set an ambitious goal to have an insight into the overall network data activity. The purpose is to quickly recognize and neutralize unwelcomed guests such as malware, viruses and to prevent data leakage or track down misconfigured software components. Since the inception of the CoreIntel project we knew we were going to face the challenges of capturing, storing and processing vast amount of data of a various type from all over the world. In our session we would like to share our experience in building scalable, distributed system architecture based on Kafka, Spark Streaming, Hadoop and Elasticsearch to help us achieving these goals. Why choosing good data format matters? Why dealing with Elasticsearch is a love-hate relationship for us or how we just managed to implement persistency in an OpenShift cluster.

avatar for Krzysztof Adamski

Krzysztof Adamski

Data Infrastructure Architect, ING
Over 10 years of experience working with data and maintaining data platform from RDBMS, through DWH, Hadoop to cloud environments. From the architecture design decisions till full production support. Got his hands dirty managing 2500 Hadoop cluster at Spotify and taking a part in... Read More →

Thursday May 18, 2017 12:20pm - 1:10pm EDT
  Use Cases