Big Data Resources

How to Create — and Configure — Apache Kafka Consumers

Elevate your open-source Apache Kafka deployment by better understanding how Kafka consumers work. Use this guide to create and configure your consumers.

February 6, 2024

by Anil Inamdar

· 3,142 Views · 4 Likes

Top 3 AI Tools to Supercharge Your Software Development

Whether you are a Java developer at a beginner level or an expert, you have a lot to tap into using AI-powered tools and enjoy a rewarding coding experience.

February 6, 2024

by Freny Choudhary

· 1,779 Views · 1 Like

Introduction to Grafana, Prometheus, and Zabbix

This article discusses three observability tools, demonstrates their integration, how to collect the metrics, and how to show them in the dashboard.

February 6, 2024

by Babul Bansal

· 3,386 Views · 1 Like

Are Your ELT Tools Ready for Medallion Data Architecture?

To effectively execute ELT in Medallion Data Architecture, it is important to comprehend the data integration capabilities.

February 6, 2024

by Rajat Pandey

· 2,900 Views · 2 Likes

Unlocking the Power Duo: Kafka and ClickHouse for Lightning-Fast Data Processing

Explore integration strategies for Kafka and ClickHouse, focusing on various methodologies like Kafka Engine, Kafka Connect, DoubleCloud Transfer, and ClickPipes.

February 5, 2024

by Andrei Tserakhau

· 2,339 Views · 1 Like

Data Lineage in Modern Data Engineering

Data lineage is a critical aspect of data engineering that often plays a pivotal role in ensuring data quality, traceability, and compliance.

February 5, 2024

by Kshitiz Jain

· 2,150 Views · 1 Like

GenAI in Data Engineering Beyond Text Generation

In data engineering, GenAI — particularly ChatGPT — is showcasing its potential to drive innovation, efficiency, and intelligence in data-centric operations.

February 4, 2024

by Deepak Jayabalan

· 2,712 Views · 3 Likes

WebRTC vs. RTSP: Understanding the IoT Video Streaming Protocols

With video surveillance booming, WebRTC and RTSP meet diverse streaming needs in IoT. Let's discuss the basics and benefits of each protocol.

February 3, 2024

by Carsten Rhod Gregersen

· 8,149 Views · 1 Like

Edge Computing Orchestration in IoT: Coordinating Distributed Workloads

In IoT, edge computing orchestration uses AI to coordinate tasks across devices. Benefits include real-time decisions, resource efficiency, and scalability.

February 2, 2024

by Deep Manishkumar Dave

· 4,294 Views · 1 Like

From Chaos to Control: Nurturing a Culture of Data Governance

Explore the key to unleashing the true potential of your data. This article unveils expert insights and approaches to establish a robust data governance framework.

February 2, 2024

by Kshitiz Jain

· 3,507 Views · 2 Likes

AI for Testers

This article explores navigating AI transformation for testers, including key considerations and pitfalls in embracing AI for effective testing evolution.

February 1, 2024

by Priyanka Chauhan

· 2,787 Views · 2 Likes

Decoding Data Analysis: Transforming Cross-Tabulation Into Structured Tabular Tables

In this tutorial, we will explain how to convert cross-tabulation into structured tabular data, which allows for enhanced analysis and insights.

February 1, 2024

by Henri Chen

· 2,602 Views · 4 Likes

What You Possibly Don’t Know About Columnar Storage

Columnar storage is a commonly used storage technique. Often, it implies high performance and has become a standard configuration for today’s analytical databases.

February 1, 2024

by Judy Liu

· 3,167 Views · 4 Likes

Predictive Maintenance in Industrial IoT With AI

In the Industry 4.0 realm, the convergence of IIoT and AI has led to revolutionary advancements in predictive maintenance.

February 1, 2024

by Yulia Gavrilova

· 3,061 Views · 2 Likes

AI and Rules for Agile Microservices in Minutes

Create a project instantly using AI and API/Logic Automation. Customize later with Python, Rules, and Flask, which is open-source.

February 1, 2024

by Val Huber

CORE

· 4,999 Views · 10 Likes

Harnessing the Power of Artificial Intelligence to Improve Human Health and Safety

This article focuses on the use of artificial intelligence as a tool for improving the health of humans and the safety of their working lives.

January 31, 2024

by Varun Shah

· 2,157 Views · 2 Likes

Strategic Considerations for Seamless Migration to a Modern Data Ecosystem

Discover effective strategies to seamlessly migrate to a modern cloud-based data ecosystem and drive innovation in your organization's data landscape.

January 31, 2024

by Mandeep Kaur

· 2,289 Views · 3 Likes

Apache Kafka + Vector Database + LLM = Real-Time GenAI

How Apache Kafka, Flink, and Vector Databases with semantic search make an LLM and GenAI reliable with real-time context.

January 31, 2024

by Kai Wähner

CORE

· 2,278 Views · 1 Like

Data Streaming for AI in the Financial Services Industry (Part 1)

A deep dive into the challenges blocking the Financial Services Industry from successfully adopting AI—and how to solve them.

January 31, 2024

by Christina Lin

CORE

· 3,054 Views · 2 Likes

Rethinking Data Governance: Metrics for Meaningful Outcomes

Data governance has been obsessed with a metric that feels more like accounting than strategic decision-making: coverage. The problem? Coverage misses the mark.

January 30, 2024

by Kirit Basu

· 2,175 Views · 2 Likes

The Latest Big Data Topics