Kafka, Go, and BigQuery - combining open source and cloud

By Elad Amit

Elevator Pitch

Over the past four years we’ve had quite a roller coster ride of data. In this session we will review the evolution we’ve gone through along with the various tidbits and workarounds we’ve collected about using Kafka, Go, and BigQuery at petabyte scale.

Description

Over the past four years we’ve had quite a roller coster ride of data. From using Spark, to adhoc applications and finally finding ourselves squeezing everything we could from BigQuery. In this session we will review the evolution we’ve gone through along with the various tidbits and workarounds we’ve collected about using Kafka, Go, and BigQuery at petabyte scale.