Data Engineering Resources

Distributing Data and Logic: Enhancing Performance, Resilience, and Efficiency With Akka

Discover how distributing data and logic with the actor model enhances performance, resilience, and efficiency in mission-critical applications.

May 30, 2024

by Tom Smith

CORE

· 2,244 Views · 2 Likes

Data Migration With AWS DMS and Terraform IaC

Learn how to migrate data from any supported source database to target databases using AWS Database Migration Service (AWS DMS) and Terraform IAC.

May 30, 2024

by Sameer Danave

· 2,108 Views · 1 Like

Beyond a Query Language: How GQL Is Shaping the Future of Graph Databases

This article delves into the specifics of GQL, highlighting its transformative potential, key definitions, and significant advancements.

May 29, 2024

by Yang Fang

· 695 Views · 3 Likes

Transforming Proprietary Trace Context to W3C Trace Context

GCP/AWS proprietary trace context to W3C standard trace context for out-of-the-box OpenTelemetry integration to support distributed tracing.

May 29, 2024

by Arvind Bharti

· 3,680 Views · 4 Likes

Pillars of a Strong and Resilient Data Architecture

This article explores advanced data architecture practices for embracing a more holistic viewpoint of data architecture.

May 29, 2024

by Amlan Patnaik

· 799 Views · 1 Like

Profiling Big Datasets With Apache Spark and Deequ

Struggling to maintain large dataset quality or ensure reliable data attributes in your analyses? Integrating Deequ with Spark might be the solution you need.

May 29, 2024

by Akshay Jain

· 75,514 Views · 4 Likes

Understanding and Learning NoSQL Databases With Java: Three Key Benefits

Discover how Eclipse JNoSQL assists Java developers in implementing NoSQL capabilities such as polyglot persistence into their applications.

May 29, 2024

by Otavio Santana

CORE

· 3,409 Views · 3 Likes

Feature Flags for Coordinated Spring API and Mobile App Rollouts

Feature flags enable coordinated releases across back-end APIs and mobile apps, ensuring smooth rollouts of new features without disrupting the user experience.

May 29, 2024

by Amol Gote

CORE

· 1,290 Views · 3 Likes

From Code to Insight: Using NLP and Sentiment Analysis in Git History

In this article, I will explain how to utilize technical textual data to transform traditional team management and achieve better results.

May 28, 2024

by Pavel Perfilov

· 3,108 Views · 1 Like

MuleSoft: API Experience Hub vs. API Community Manager vs. Anypoint Exchange

This blog presents a comparison study of platforms for management, discovery, and the utilization of APIs, highlighting the differences and similarities of each.

May 28, 2024

by PRAVEEN SUNDAR

· 753 Views · 1 Like

Streamlining Data Warehouse Migrations From RedShift, Snowflake, and BigQuery to Apache Doris

Migrate Redshift, Snowflake, and BigQuery to Apache Doris for high-performance OLAP using tools like Apache Nifi, Talend, and Python.

May 28, 2024

by Sameer Danave

· 520 Views · 2 Likes

Fast Setup: Golang and Testcontainers

Most of the time, our scripts set up an entire test environment right on our computers, but why? In the test environment, we have everything, but we need it?

May 28, 2024

by Ilia Ivankin

· 1,284 Views · 1 Like

Preventing and Fixing Bad Data in Event Streams (Part 1)

In this blog, we’ll take a look at how bad data may come to be, and how we can deal with it when it comes to event streams.

May 28, 2024

by Adam Bellemare

· 2,057 Views · 1 Like

Building an AI-Powered Slack Bot With IBM WatsonX

Leverage WatsonX's AI capabilities to create innovative applications that streamline processes and boost productivity, making life easier and more productive for users.

May 28, 2024

by Pradeep Gopalgowda

· 680 Views · 6 Likes

Microservices: Consistent State Propagation With Debezium Engine

Learn challenges of state propagation across different (micro)services, architectural patterns for such challenges, and an implementation using Debezium Engine.

May 28, 2024

by David Cano

· 1,891 Views · 3 Likes

ARM CPU for Cost-Effective Apache Kafka at the Edge and Cloud

Learn about ARM CPU for cost-effective and energy-efficient data streaming with Apache Kafka at the Edge and in the Cloud, including use cases.

May 27, 2024

by Kai Wähner

CORE

· 1,218 Views · 1 Like

Less Time Learning, More Time Building

Secure cloud adoption no longer requires an investment in proprietary cloud infra knowledge, allowing teams to implement security that aligns with the business.

May 27, 2024

by John Vester

CORE

· 22,659 Views · 2 Likes

Firebase Genkit With Ollama

Explore a Firebase project that uses the Gen AI Kit with Gemma using Ollama and learn how to test it locally with the Firebase emulator and the Gen UI Kit.

May 27, 2024

by Xavier Portilla Edo

CORE

· 1,019 Views · 1 Like

Upgrade Your Hobbyist Arduino Firmware To Work With STM32 For Wider Applications

Running out of processing power or memory? Want better timing control of your functions? Here, get started with making the switch to 32-bit ARM-based MCUs.

May 27, 2024

by Akanksha Jhunjhunwala

· 519 Views · 2 Likes

Bridging the Gap: Exploring Innovative Paths in Data Integration

This article solely focuses on delving into understanding data integrations, associated challenges, emerging technologies, and advanced methodologies.

May 27, 2024

by Yash Mehta

· 572 Views · 1 Like

The Latest Data Engineering Topics