Throughout the week, I read a lot of blog-posts, articles, and so forth that has to do with things that interest me:
- AI/data science
- data in general
- data architecture
- streaming
- distributed computing
- SQL Server
- transactions (both db as well as non db)
- and other “stuff”
This blog post is the “roundup” of the things that have been most interesting to me for the week just ending.
Azure Data Explorer
- What’s New in Azure Synapse Data Explorer – Ignite 2022 !. Microsoft Ignite was held October 12 - 14., As always, there were a lot of exciting announcements. This post looks at what was announced for Azure Data Explorer. A lot of cool stuff!
Distributed Computing
- Polyglot Microservices Communication Using Dapr on AKS. Dapr is a useful tool for solving several challenges engineers might face when developing microservices. This post looks at using Dapr on Azure AKS and how to communicate between microservices. The post comes at a perfect time for us at Derivco as we are going “all-in” on AKS and Dapr.
Data Architecture
- Orchestrating Data/ML Workflows at Scale With Netflix Maestro. This Netflix blog post, introduces and shares learnings on Maestro. Maestro is a workflow orchestrator for data and machine learning pipelines that schedules and manages workflows at a massive scale. Really interesting!
Streaming
- Announcing ksqlDB 0.28.2 and Improvements to ksqlDB in Confluent Cloud. The title says it all! ksqlDB 0.28.2 is released. What I find really interesting in this release is the new Terraform support. At Derivco, we are implementing Infrastructure as Code, and the ksqlDB Terraform support will make things much easier.
~ Finally
That’s all for this week. I hope you enjoy what I did put together. Please comment on this post or ping me if you have ideas for what to cover.