March 13-15, 2019
Montreal, Canada

Lessons learned running data pipeline on AWS

Before doing any data science, machine learning or AI, you need to get your data right. As the volume of data grows, having a reliable, available and scalable data pipeline becomes a challenge.
In this talk we will share our learnings from running a data pipeline in AWS infrastructure using technologies like Apache Spark, gRPC, Protocol buffers.

View all 149 sessions

Majid Fatemian

Red Ventures

Majid Fatemian, is a senior software/data engineer at Red Ventures. With more than a decade experience he has contributed to many projects for architecture, implementation and performance-optimization of high-traffic online services in distributed environments.

You can find him on twitter @majidfn .

Read More