Apache Beam - portable, parallel, powerful data processing pipelines. Official Apache Beam Twitter account managed by the Beam PMC.
Joined January 2016
- Tweets733
- Following7
- Followers5.9K
- Likes103
Apache Beam retweeted
Deploy EmbeddingGemma at scale with Dataflow to build real-time knowledge ingestion pipelines, eliminate remote procedure calls, simplify operations with a unified system, and scale pipelines up or down based on demand.
developers.googleblog.com/en…
Apache Beam retweeted
Discover the powerful synergy between @ApacheBeam, @ApacheFlink, and @kubernetesio while building an #Autoscaler for high-volume streaming environments, optimizing resource use for efficiency and peak performance under varying loads. Check it out now! beam.apache.org/blog/apache-… – at Santa Clara, CA
Apache Beam retweeted
Join me on Dec 7 at the @ApacheFlink Meetup! I'll discuss "Building Managed Services for @ApacheBeam Jobs with Flink on Kubernetes" @PaloAltoNtwks. Learn how we handle 10K+ jobs, platform, and key takeaways. #ApacheFlink #DataEngineering #Kubernetes
meetup.com/bay-area-apache-f…
Apache Beam retweeted
💻 Gradle now supports @TheASF with free instances of #Develocity. Here are the projects already benefiting from features like Build Cache and Predictive Test Selection:
@ApacheBeam
@ApacheKafka
@ApacheLucene
@Apache_Pulsar
@ApacheGroovy
More here 👇
gradle.com/blog/apache-softw…
Apache Beam retweeted
Things I'm excited about this week:
1. Apache Beam
2. Faking compute
3. picking our peaches
4. Branding building and story telling
Apache Beam retweeted
@cadetiloye from @mavencode is talking about using @ApacheBeam to the #ML pipeline development on Kubernetes.
Apache Beam retweeted
Today was the kickoff for #BeamSummit 2023, a free, multi-day event in NYC.
Join the @ApacheBeam community at Google’s event space for keynotes, track talks, and networking.
🚶 Walk-ins are welcome!
📍NYC’s Pier 57 at 25 11th Ave.
➡️ Details: beamsummit.org/.
Apache Beam retweeted
Don't miss the @ApacheBeam #BeamSummit next week in NY then! 😅
I am sure there will be potential candidates among the attendees. Tickets (free!) are available at beamsummit.org/tickets/
Apache Beam retweeted
Time to add a new Google Cloud Skill Badge to your tool kit 🧰
This badge is designed to help you demonstrate your skills in Apache Beam, a unified programming model for large-scale data processing. Learn more and start your quest today → goo.gle/3P90rs2
ALT Earn your skill badge
Apache Beam retweeted
I'm excited to share that my team's work has been featured in a case study with @ApacheBeam and Google.
In it, we describe:
1. How we identified data pipeline challenges
2. How we modernized systems
3. How we continue to iterate
beam.apache.org/case-studies…
Apache Beam retweeted
Is here anyone who would be interested in @ApacheBeam runner based on pure @ApacheKafka?
Cool features like ultra-low latency, (possible) rolling upgrade of running Pipeline minimizing downtime and more.
Sketch of design below 👇
♥️ RT
Apache Beam retweeted
Why I like @ApacheBeam?
Stream processing works the same as our physical reality - we perceive events (points in spacetime) and act upon them (causally).
Apache Beam is the correct (and portable) model for stream processing. The fact it unifies stream and batch is implied.
Apache Beam retweeted
In our second keynote of the day, @fdaapproved from @googlecloud shares why #ApacheBeam+ #ApachePulsar = 😎
#PulsarSummitSF
Apache Beam retweeted
Signal boosting: Upcoming @ApacheBeam talks in upcoming open source summits:
1️⃣The Ray Beam Runner Project: Unified batch, streaming, and ML (anyscale.com/ray-summit-2022…) at Ray Summit
2️⃣Beam + Pulsar: Powerful Stream Processing at Scale (pulsar-summit.org/event/san-…) at @PulsarSummit
Apache Beam retweeted
Want to #recruit great engineers? Publish your open-source use case. You would contribute to OSS by sharing your story. And Great candidates will find out about your awesome team!
@ApacheBeam has a growing list (beam.apache.org/case-studies…). We would love to highlight you as a user!
Apache Beam retweeted
@BeamSummit, a conference focused on the world of data and stream processing held for the @ApacheBeam community, recently took place in Austin, TX. Luckily, we had a Wizeliner on-site to give us first hand takeaways from the big event. Check them out ⬇️
bit.ly/3PPjJjJ
Apache Beam retweeted
My talk Migration #Spark to #Beam #CloudDataflow with #hexagonalArchitecture and #DDD given at @BeamSummit is now available online
youtu.be/d-HTrLiwrNU
@ApacheBeam @GoogleCloudTech @googlecloud #data #pipeline
The videos from Apache Beam Summit 2022 are now available online : youtube.com/playlist?list=PL…
Lots of great sessions and my favorites were use cases from Twitter, Spotify, PANW, Orange, HSBC, Google and more.
What was your favorite session? :)
#BeamSummit
Apache Beam retweeted
Happening now @praveenklm and @zhen____w talking about data replication and ingestion at #BeamSummit watch online now 2022.beamsummit.org/sessions…
Apache Beam retweeted
Robert explains How he ended up writing a Go Runner while writing Go SDK #BeamSummit i learned so many things from his @ApacheBeam experience
