Data Engineering Resources

Modern software development requires API testing, and Playwright offers a strong, adaptable framework for building thorough API test suites.

May 27, 2024

by Kailash Pathak

CORE

· 2,960 Views · 2 Likes

Leveraging AI and Vector Search in Azure Cosmos DB for MongoDB vCore

This article explains the inbuilt vector search functionality in Cosmos DB for MongoDB vCore and also provides a quick exploration guide using Python code.

May 26, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 769 Views · 3 Likes

Apache Doris for Log and Time Series Data Analysis

NetEase has replaced Elasticsearch and InfluxDB with Apache Doris, achieving 11X query performance and saving 70% of resources.

May 25, 2024

by Frank Z

· 1,119 Views · 1 Like

How To Protect Node.js Form Uploads With a Deterministic Threat Detection API

Learn more about the prevalence of custom file upload forms in web applications and a deterministic threat detection solution for Node.js form uploads.

May 24, 2024

by Brian O'Neill

CORE

· 1,764 Views · 2 Likes

Application Task Driven: LLM Evaluation Metrics in Detail

List of common LLM systems evaluation metrics that are based on specific applications and a supporting open-source framework.

May 24, 2024

by Sapan Patel

· 685 Views · 1 Like

Capturing Acknowledgement in Kafka Streaming With RecordMetadata

In this article, explore RecordMetadata, and its attributes, and discover how it can be leveraged using various use cases.

May 24, 2024

by Raja Chattopadhyay

· 1,219 Views · 2 Likes

AWS: EC2 User Data vs. EC2 AMI

A comparison study among two EC2 initialization/configuration tools — User Data and AMI, which help in the configuration and management of EC2 instances.

May 24, 2024

by PRAVEEN SUNDAR

· 627 Views · 1 Like

Middleware in Autonomous Vehicles

Self-driving cars are becoming common; however, software development outside of ML topics is not well known. This post demystifies middleware for vehicles.

May 23, 2024

by Shobhit Kukreti

· 1,231 Views · 3 Likes

Using Schema Annotations to Create and Execute SQL Queries

See how schema annotations and QueryBuilder can be used to simplify the creation and execution of native SQL queries in Java.

May 23, 2024

by Greg Brown

· 943 Views · 1 Like

Constructing Secure and Strong Data Access Layers With JPA

Determine how to control JPA features and secure coding practices to build secure data access layers that protect sensitive information in your applications.

May 23, 2024

by Humashankar Vellathur Jaganathan

· 3,138 Views · 3 Likes

Optimizing the Traveling Salesman Problem: Integrating Graph Neural Networks With Branch and Bound Algorithms

Learn how integrating Graph Neural Networks (GNNs) with the Branch & Bound (B&B) algorithm significantly advances solving the Traveling Salesman Problem (TSP).

May 23, 2024

by Priyanka Koushik

· 1,137 Views · 2 Likes

Universal Semantic Layer: Going Meta on Data, Functionality, Governance, and Semantics

What is a universal semantic layer, and how is it different from a semantic layer? Is there actual semantics involved? Who uses that, how, and what for?

May 23, 2024

by George Anadiotis

· 712 Views · 1 Like

Practical Use Cases With Terraform in Network Automation

Terraform is a powerful tool that has become essential to modern engineering. Let's dive in and explore its many benefits!

May 23, 2024

by Karthik Rajashekaran

· 966 Views · 2 Likes

Fine-Grained Access Control for Stored Procedures

This article presents a flexible approach to securing your stored procedures using a programmable database proxy. Read more!

May 23, 2024

by Max Tardiveau

· 706 Views · 1 Like

How To Reduce MTTR

This article discusses ten ideas that can help reduce Mean Time To Recover for your critical production services.

May 22, 2024

by Krishna Vinnakota

· 1,757 Views · 6 Likes

Useful Tips and Tricks for Data Scientists

In this article, I will share some of the tricks and tools that I am using to interpret the data in a fast and precise way and get useful insights from it.

May 22, 2024

by Pavel Perfilov

· 4,845 Views · 1 Like

How To Create a Network Graph Using JavaScript

Learn how to quickly create an interactive network graph in JavaScript, visualizing Volkswagen's structure with easy steps and ready-to-use JS chart examples.

May 22, 2024

by Alex Carter

· 1,657 Views · 2 Likes

Hexagonal Architecture in the Frontend: A Real Case

Discover why hexagonal architecture, decoupling, and dependency injection can be very useful in the front end.

May 22, 2024

by Sergio Carracedo

· 3,627 Views · 3 Likes

Securing Generative AI Applications

There are various types of security considerations needed to ensure the safety of a Gen AI application and the uptime of the application.

May 22, 2024

by Pranav Kumar Chaudhary

· 1,468 Views · 1 Like

Cost Optimization Strategies for High-Volume Data Platforms

Managing costs in running a Big Data Platform can be very challenging. This article talks through various strategies to optimize cost at every layer of the platform.

May 22, 2024

by Mayank Singhi

· 610 Views · 2 Likes

The Latest Data Engineering Topics