blog
2018/10/31
Inaugural edition of the Beam Summit Europe 2018 - aftermathMatthias Baetens [@matthiasbaetens]
Almost 1 month ago, we had the pleasure to welcome the Beam community at Level39 in London for the inaugural edition of the Beam Summit London Summit.
Day 1 of the first Beam Summit London going full speed ahead! Sessions by @SkyUK @GCPcloud @Talend @PlantixApp and more! #ApacheBeam #apachebeamlondon #l39 #level39 @ApacheBeam #summit pic.twitter.com/aEESFnbgxT
— Matthias Baetens 🌆 (@matthiasbaetens) October 1, 2018
First edition!
This first edition of the summit was a free event, with over 125 RSVPs. We had two days of content; day one was focused on the roadmap of the project, the ASF and use cases from companies that use Beam. The second day was divided into tracks (a beginner and an advanced track). Those presentations & workshops were organised for the more than 80 attendees - and next to that there were several other activities like discussions, a brainstorm session, a UX booth and a signing session. We were able to offer the attendees 17 sessions from a great line-up of companies: Google, Spotify, Talend, Sky, Amazon, Data Artisans, Datatonic, Vente Exclusive, ML6, Flumaion, Plantix, Polidea, Seznam and more!
#### Topics included using Python to run Beam on Flink:
Don't miss @snntrable's session at Beam Sumit London, Oct. 2, 2018, about #Python Streaming Pipelines with @ApacheBeam and @ApacheFlink! Register here: https://t.co/wblzUeiTIg #streamprocessing #BigData #MachineLearning pic.twitter.com/7Ph51WqspW
— data Artisans (@dataArtisans) 26 september 2018
#### ML with Beam with the TensorFlow transform integration:
Such a great pleasure to listen to the talk by @FsMatt on TensorFlow transform at the #BeamSummit! @ApacheBeam @TensorFlow @Level39CW
— datatonic (@teamdatatonic) 2 oktober 2018
Check the code for his demo at https://t.co/8IS41A2aF2 https://t.co/UWytiudmRO
#### The portability layer was a big topic:
Excellent talk by @stadtlegende on adding portability to #ApacheBeam, awesome milestone and next step to make the Apache Beam vision become a reality! pic.twitter.com/M9jERlTeAE
— Matthias Feys (@FsMatt) 2 oktober 2018
#### As well as a session on how to build your own SDK:
Robert Bredshaw explains how to build a new @ApacheBeam SDK.#BeamSummit pic.twitter.com/Bj84GJimdo
— Maximilian Michels 🧗 (@stadtlegende) 2 oktober 2018
Presentations
In the aftermath of the Summit, you can check the presentations of all the sessions.
Day 1: Use cases
- Day 1 - Session 1 - Large scale stream analytics with Apache Beam at Sky
- Day 1 - Session 2 - Running Quantitative Analytics with Apache Beam
- Day 1 - Session 3 - Talend Data Streams: Building Big Data pipelines with Apache Beam
- Day 1 - Session 4 - Lesson Learned from Migrating to Apache Beam for Geo-Data Visualisation
Day 2: Beginners track
- Day 2 - Beginner - Session 1 - Development Environment with Apache Beam
- Day 2 - Beginner - Session 2 - Towards Portability and Beyond
- Day 2 - Beginner - Session 3 - Python Streaming Pipelines with Beam on Flink
- Day 2 - Beginner - Session 4 - How runners execute a Beam pipeline
- Day 2 - Beginner - Session 5 - IO Integration Testing framework in Apache Beam
Day 2: Advanced track
- Day 2 - Advanced - Session 1 - Pre-processing for TensorFlow pipelines with Apache Beam & tf.Transform
- Day 2 - Advanced - Session 2 - Streaming data into BigQuery: schema generation with Protobuf
- Day 2 - Advanced - Session 3 - Implementing a SplittableParDo
- Day 2 - Advanced - Session 4 - Big Data on Google Cloud with Scala and Scio
- Day 2 - Advanced - Session 5 - Landuse Classification of Satellite Imagery
- Day 2 - Advanced - Session 6 - Java 8 DSL for Beam SDK
- Day 2 - Advanced - Session 7 - So, You Want to Write a Beam SDK?
Recordings
In case you prefer rewatching the recorded talks together with those slides, we are also happy to share the recordings of the majority of the sessions:
Day 1: Use cases
- Day 1 - Session 1 - Large scale stream analytics with Apache Beam at Sky
- Day 1 - Session 2 - Running Quantitative Analytics with Apache Beam
- Day 1 - Session 3 - Talend Data Streams: Building Big Data pipelines with Apache Beam
- Day 1 - Session 4 - Lesson Learned from Migrating to Apache Beam for Geo-Data Visualisation
Day 2: Advanced track
- Day 2 - Advanced - Session 1 - Pre-processing for TensorFlow pipelines with Apache Beam & tf.Transform
- Day 2 - Advanced - Session 2 - Streaming data into BigQuery: schema generation with Protobuf
- Day 2 - Advanced - Session 3 - Implementing a SplittableParDo
- Day 2 - Advanced - Session 4 - Big Data on Google Cloud with Scala and Scio
- Day 2 - Advanced - Session 5 - Landuse Classification of Satellite Imagery
- Day 2 - Advanced - Session 6 - Java 8 DSL for Beam SDK
- Day 2 - Advanced - Session 7 - So, You Want to Write a Beam SDK?
Wrapping up
We are also gathering feedback and thoughts on the Summit - please add your thoughts and discussions to the topic on the mailing list.
Overall, we hope our attendees enjoyed this first edition of our summit and want to thank our sponsors Google, Datatonic, Vente-Exclusive to make this possible.
Wrapping up the first day of the #BeamSummit. Excellent view from the #level39 venue. Very happy with the line up. pic.twitter.com/7FhokKbQY5
— Alex Van Boxel (@alexvb) 1 oktober 2018