As much as off-the-shelf Customer Data Platforms promise to offer a click-and-play solution, they cannot magically crack every intricate data engineering challenge compared to building an in-house solution on your own data stack. One thing is sure: the best choice will depend on an understanding of your organization.
Microsoft introduced Fabric this week. Possibly and probably the game-changing solution that can transform data analytics and integration. We dived into what Microsoft has unveiled with Microsoft Fabric and how this can impact Data Engineers, Analysts and Scientists. But we also have some open questions that we will answer once we are finished testing this exciting technology.
Tired of manually provisioning and managing your infrastructure? Well, then it's time to adopt best practices and treat your infrastructure as code. In this blog post, we’ll be diving into the world of Infrastructure as Code (IaC) using one of the most popular tools available - Terraform.
By the end of this post, you’ll have a better understanding of how to leverage Terraform to deploy your AWS Glue Pyspark jobs, giving you a more automated and scalable infrastructure. So, let’s get started and spark your infrastructure!
With the rise of modern data platforms and cloud-based solutions, BI has become just one part of a much larger data ecosystem. This evolution has presented data teams with a host of new challenges, primarily in terms of the skills and expertise to create and manage data products that meet the needs of data consumers.
