Frank Z

Reputation:	1133
Pageviews:	89.3K
Articles:	33
Comments:	0

Steps To Industry-Leading Query Speed: Evolution of the Apache Doris Execution Engine

From the Volcano Model to the Pipeline Execution Engine, and now PipelineX, Apache Doris brings its computation efficiency to a higher level with each iteration.

June 24, 2024

· 1,415 Views · 1 Like

Another Lifesaver for Data Engineers: Apache Doris Job Scheduler for Task Automation

The built-in Doris Job Scheduler triggers pre-defined operations efficiently and reliably. It is useful in many cases including ETL and data lake analytics.

June 17, 2024

· 1,402 Views · 1 Like

Apache Doris for Log and Time Series Data Analysis

NetEase has replaced Elasticsearch and InfluxDB with Apache Doris, achieving 11X query performance and saving 70% of resources.

May 25, 2024

· 1,119 Views · 1 Like

Multi-Tenant Workload Isolation: A Better Balance Between Isolation and Utilization

Workload Group in Apache Doris supports CPU and memory resource isolation at a more granular level to increase utilization.

May 21, 2024

· 415 Views · 1 Like

SQL Convertor for Easy Migration from Presto, Trino, ClickHouse, and Hive to Apache Doris

Users can execute queries with their old SQL syntaxes directly in Doris or batch convert their existing SQL statements on the visual SQL conversion interface.

May 14, 2024

· 524 Views · 1 Like

Cross-Cluster Replication for Read-Write Separation: Story of a Grocery Store Brand

Cross-cluster replication (CCR) in Apache Doris is proven to be fast, stable, and easy to use. It secures a real-time data synchronization latency of 1 second.

May 6, 2024

· 996 Views · 1 Like

Data Warehouse for Data Science: Adopting Arrow Flight SQL for 10X Data Transfer

Apache Doris 2.1 supports Arrow Flight SQL protocol for reading data from Doris. It delivers tenfold speedups compared to PyMySQL and Pandas.

May 1, 2024

· 1,062 Views · 2 Likes

Auto-Increment Columns in Apache Doris

Auto-increment columns in Apache Doris accelerate dictionary encoding and pagination without damaging data writing performance.

April 26, 2024

· 946 Views · 1 Like

A New Data Type 8 Times Faster Than JSON for Semi-Structured Data Analysis

Apache Doris 2.1.0 provides a new data type: Variant, for semi-structured data analysis, enabling 8 times faster query performance than JSON with one-third storage space.

April 4, 2024

· 967 Views · 1 Like

Breaking Down Data Silos With a Unified Data Warehouse: An Apache Doris-Based CDP

An insurance company uses Apache Doris in replacement of Spark+Impala+HBase+NebulaGraph, in their Customer Data Platform for 4 times faster customer grouping.

March 19, 2024

· 7,352 Views · 2 Likes

A Financial Anti-Fraud Solution Based on the Apache Doris Data Warehouse

This post will go into detail about how a retail bank builds its fraud risk management platform based on Apache Doris and how it performs.

February 26, 2024

· 3,410 Views · 1 Like

How Inverted Index Accelerates Text Searches by 40 Times

This post is a deep dive into the inverted index and NGram BloomFilter index, providing a hands-on guide to applying them for various queries.

February 1, 2024

· 2,561 Views · 2 Likes

Fast, Secure, and Highly Available Real-Time Data Warehousing Based on Apache Doris

A whole-journey guide for financial users looking for fast data processing performance, data security, and high service availability.

January 11, 2024

· 2,426 Views · 1 Like

Apache Doris Speeds Up Data Reporting, Tagging, and Data Lake Analytics

The user leverages the capabilities of Apache Doris in reporting, customer tagging, and data lake analytics and achieves high performance.

December 29, 2023

· 4,431 Views · 2 Likes

From Elasticsearch to Apache Doris: Upgrading an Observability Platform

An observability platform replaces its data query and storage engine and realizes 70% less storage costs and 200%~400% query performance.

December 20, 2023

· 3,488 Views · 1 Like

Introduction to Apache Doris: A Next-Generation Real-Time Data Warehouse

This is a technical overview of Apache Doris, introducing how it enables fast query performance with its architectural design, features, and mechanisms.

December 13, 2023

· 2,808 Views · 2 Likes

Data Analysis for Live Streaming: What Happens in Real Time Is Analyzed in Real Time?

This post is about how a live streaming service provider with 800 million end users found the right database to support its analytic solution.

November 16, 2023

· 1,837 Views · 2 Likes

Less Components, Higher Performance

This post is about building a unified OLAP platform to undertake all their customer-facing, analyst-facing, and management-facing data analysis workloads.

November 2, 2023

· 2,536 Views · 1 Like

Auto-Synchronization of a Whole MySQL Database for Data Analysis

Learn how to automatically ingest and update MySQL or Oracle database into an OLAP engine, and say goodbye to tedious manual configuration.

October 13, 2023

· 2,516 Views · 1 Like

Database in Fintech: How To Support 10,000 Dashboards Without Causing a Mess

This article introduces the lifecycle of financial metrics in a database, from how they're produced to how they're efficiently presented in data reports.

October 11, 2023

· 1,808 Views · 1 Like

Migrating From ClickHouse to Apache Doris: What Happened?

Explore this migration process from ClickHouse to Apache Doris to figure out if it is the right move for you and your data.

October 2, 2023

· 2,303 Views · 1 Like

Choosing an OLAP Engine for Financial Risk Management: What To Consider?

This post provides reference for what you should take into account when choosing an OLAP engine in a financial scenario.

August 16, 2023

· 1,744 Views · 1 Like

Is Your Latest Data Really the Latest? Check Your Data Update Mechanism

This is about how to support both row updates and partial column updates in a database in a way that is simple in execution and efficient in data quality guarantee.

July 26, 2023

· 5,244 Views · 2 Likes

For Entry-Level Data Engineers: How To Build a Simple but Solid Data Architecture

This article aims to provide a reference for non-tech companies who are seeking to empower their business with data analytics.

July 12, 2023

· 2,515 Views · 1 Like

Hot-Cold Data Separation: What, Why, and How?

Hot data is the frequently accessed data, while cold data is the one you seldom visit but still need. Separating them is for higher efficiency in computation and storage.

June 28, 2023

· 2,111 Views · 1 Like

Database Dissection: How Are Fast Data Queries Implemented?

What's more important than the quick performance itself is the architectural design and mechanism that enable it. The rest will be easy.

June 23, 2023

· 5,785 Views · 1 Like

Say Goodbye to OOM Crashes

A more robust and flexible memory management solution with optimizations in memory allocation, memory tracking, and memory limit.

June 14, 2023

· 1,850 Views · 1 Like

Understanding Data Compaction in 3 Minutes

Think of your disks as a warehouse: The compaction mechanism is like a team of storekeepers who help put away the incoming data.

June 6, 2023

· 2,643 Views · 1 Like

Building A Log Analytics Solution 10 Times More Cost-Effective Than Elasticsearch

Inverted indexing in Apache Doris 2.0.0 realizes two times faster log query performance than Elasticsearch with 1/5 of the storage space it uses.

May 19, 2023

· 4,807 Views · 4 Likes

30,000 QPS Per Node: How We Increase Database Query Concurrency by 20 Times

Learn five ways to accelerate point queries and four methods to improve concurrency further: row storage format, short circuit, prepared statement, and row storage cache.

April 26, 2023

· 1,432 Views · 1 Like

Articles