Data Eng Weekly covers the week's top news in data engineering-related open source and cloud products. Curated by @joecrobak
Joined August 2015
- Tweets121
- Following29
- Followers991
- Likes19
Data Eng Weekly retweeted
To all my dear #BigData colleagues!
Feel invited to submit an abstract to #BigDataTechWarsaw 2020, so that we can meet in Warsaw, talk about data and have a beer 🍺
This is the conference that I co-organise :) The CfP is open until Sep 30th.
medium.com/getindata-blog/2%…
Data Eng Weekly retweeted
A couple of good links, both from @DataEngWeekly:
1. Review of idempotence complete with elevator analogy: lispcast.com/what-is-idempot…
2. How to learn to build distributed systems: brooker.co.za/blog/2019/04/0…
Data Eng Weekly retweeted
What changed in the Big data landscape from 2013 to 2019 blog.marouni.fr/bidata-trend… - interesting analysis from @abbassmarouni based on articles in @DataEngWeekly
Data Eng Weekly retweeted
My @apachekafka @kafkastreams challenges github repo has been announced in the last @DataEngWeekly issue: dataengweekly.com/Data-Eng-W… Thank you guys!
Data Eng Weekly retweeted
Aaand another chapter is done! 🎉 The Early Release of "Stream Processing with @ApacheFlink" was updated with a new chapter about connectors and end-to-end consistency. Only two chapters ("Setup & Configuration", "Operations") are left. I should start looking for another hobby 🤔
Data Eng Weekly retweeted
Apache Airflow 1.10.0 is out ❤️🎉 !!
Highlights:
- New RBAC web interface in beta
- First class kubernetes operator
- Experimental kubernetes executor
- Timezone support
- Performance optimizations for large DAGs
- Many GCP and S3 integration improvements
- Tons of Bug Fixes
Data Eng Weekly retweeted
We've just released Apache Arrow 0.10.0, the biggest release yet with 4 months of work and nearly 500 issues closed. We've added 3 new languages to the project: Go, Ruby, and Rust. Read more arrow.apache.org/blog/2018/0…
Data Eng Weekly retweeted
The @ApacheFlink community reached 10,000 issues in JIRA.
Thanks to everyone who participated!
Let's file another 10,000 feature requests/bug reports and keep the community alive!
issues.apache.org/jira/brows…
Data Eng Weekly retweeted
Apache Accumulo 1.9.2 was released with fixes for a few serious bugs.
accumulo.apache.org/release/…
Data Eng Weekly retweeted
HDP 3.0 delivers new capabilities for the enterprise to enable agile application deployment, new #machinelearning /deep learning workloads, real-time database, & security and governance. Learn more about the enhancements, here: bit.ly/2JZms8t #BigData
Data Eng Weekly retweeted
Just received word that the new @OReillyMedia book "Getting Started with Kudu" has gone to print, shipping in about 3 weeks! Buy your copy here shop.oreilly.com/product/063…
Data Eng Weekly retweeted
Haven't checked out our latest podcast episode? Tune in. 👂
Last week, we linked up with @danimberman, Senior Software Engineer at @TechAtBloomberg, and @schniebot, Astronomer CTO, to discuss running Airflow on @kubernetesio. Enjoy!
soundcloud.com/the-airflow-p…
Data Eng Weekly retweeted
If you work in analytics, BI, data warehousing, data engineering, big data…call it what you will, DataEngWeekly is a great newsletter to read: dataengweekly.com/index.html – at Ilkley, England
Data Eng Weekly retweeted
New episode of the @ApacheAirflow Podcast hot off the press!
This week, we linked up with Daniel Imberman, Senior Software Engineer at Bloomberg, and @schniebot, Astronomer CTO, to discuss running Airflow on @kubernetesio. Hope you enjoy!
soundcloud.com/the-airflow-p…
Data Eng Weekly retweeted
Data Eng Weekly #270
Data Reliability Engineering at Criteo, history of the @ApacheArrow project, stream processing with @WallarooLabs & St8Flow (javascript framework), @ApacheParquet backend for SQLite, and a few posts on working with large scale rdbms.
dataengweekly.com/Data-Eng-W…
Data Eng Weekly retweeted
Great news - this makes it easier to use API Gateway for internal microservices and APIs. nitter.cf/awscloud/status/100739…
Just launched! Amazon API Gateway now supports Private APIs which are only accessible from within your Amazon VPC using VPC Endpoints. amzn.to/2MsgY7Q
Data Eng Weekly retweeted
The #KafkaSummit CfP closes THIS SATURDAY! Don’t delay…submit your awesome stories about what you’re doing with @apachekafka today :) kafka-summit.org/kafka-summi…
(And remember…you just need to write your abstract. The actual presentation can come later 😁) – at Ilkley, England
Data Eng Weekly retweeted
We welcome our newest Apache Airflow Meetup group -- this one in London, UK : bit.ly/2kEXoZ2
Data Eng Weekly retweeted
We've decided to extend the Call for Presentations for Flink Forward Berlin 2018 to give you some extra time to work on your @ApacheFlink talk submissions.
The new deadline is Monday, June 11, 11:59 PM CEST. flink-forward.org/call-for-p…
#streamprocessing #flinkforward
Data Eng Weekly retweeted
We are open-sourcing the Katran forwarding plane software library that powers the network load balancer used in Facebook's infrastructure. Katran delivers improved flexibility, scalability, reliability, and performance.
code.facebook.com/posts/1906…
