<- Back to all posts
December 22, 2025
January 6, 2026

Cost-Per-Query at Scale: A 2026 Benchmark of Cloud Data warehouses

Listen to this article

Powered by NotebookLM
Listen to this article

Introduction

Traditional warehouses and lakehouses force you to choose between performance, cost, and simplicity. Firebolt delivers all three on a single platform—with the best price-performance in the market so you can ship faster without compromises.

We're built for companies that need their data platforms to do more — run AI workloads, power sub-second customer-facing analytics at scale, or execute ELT jobs faster at a fraction of the cost.

ClickHouse recently published a couple of articles titled "How the 5 major cloud data warehouses really bill you" & “How the 5 major cloud data warehouses compare in cost-performance” introducing their Bench2Cost framework for translating benchmark runtimes into real costs. We agree with the core premise:

Price lists don't tell you real costs. Compute models do.

That's why we ran Bench2Cost on Firebolt Cloud. We ran the complete 43-query ClickBench suite at 10 billion and 100 billion rows with comparable Firebolt compute clusters. We compared our results against the results of all cloud data warehouses in the original article. We also agree that, as data and workloads grow, architectural differences become undeniable.

This blog post walks you through Firebolt’s compute and billing model, the results of the benchmark and a full review of where we win and where we lose.

VIDEO HERE

TL;DR: Firebolt delivers better performance and significantly lower cost than ClickHouse, Snowflake, BigQuery, Redshift, and Databricks. 

Key takeaways:

  • Firebolt is 43% faster than the runner up (Clickhouse)
  • Firebolt is 68% cheaper than the runner up (Clickhouse)
  • Firebolt dominates the field on individual query performance.

Firebolt's Compute and Billing Model

Before diving into results, and in the spirit of transparency, let's explain how Firebolt bills compute.

Firebolt Units (FBUs)

Firebolt uses Firebolt Units (FBUs) as its billing currency. It is a hardware-grounded compute unit similar in spirit to ClickHouse's 8 GiB memory increments, but with a key difference: Firebolt offers two engine families optimized for different workloads.

Engine Family FBU Table
Engine Family S M L XL
Storage-Optimized 8 FBU 16 FBU 32 FBU 64 FBU
Compute-Optimized 4 FBU 8 FBU 16 FBU 32 FBU

Compute-Optimized engines deliver more CPU per FBU by trading off local NVMe storage—ideal for analytical workloads where data resides in object storage and compute is the bottleneck. 

Pricing (AWS us-east-1, December 2025)

Pricing Tier Table
Tier FBU Rate Storage
Standard $0.23/FBU/hour $27.07/TiB/month
Enterprise $0.30/FBU/hour $27.07/TiB/month

Different pricing tiers are included here for full transparency. The benchmark was executed entirely on our Standard tier.

How Bench2Cost Computes Firebolt Costs

Our enrichment script calculates costs using this formula:

Compute Cost = query_time_seconds × (fbu_rate_per_hour / 3600) × total_fbu

Where total_fbu = fbu_per_node × cluster_size.

For a 20 node Large Compute-Optimized cluster:

  • FBU per node: 16
  • Total FBU: 320
  • Cost per second (Standard): 320 × ($0.23 / 3600) = $0.0204/sec

The Benchmarks: 10B and 100B Rows

We ran the complete ClickBench suite (43 analytical queries) on a (20n) Firebolt cluster and used the results from other systems with comparable configurations:

System Configuration Table
System Configuration
ClickHouse Cloud 20 × 236 GiB nodes
Firebolt Cloud 20 × Large Compute-Optimized
Redshift Serverless Serverless
Snowflake 4X Large
Databricks 4X Large
BigQuery Serverless

Firebolt test ran on AWS us-east-1 with per-second billing. Each query was executed 3 times and following the ClickBench approach, we use the best run for comparison.

Results: 10 Billion Rows

Vendor Performance Comparison
Vendor/System Total Runtime Queries Won Cost (Standard) Cost (Enterprise)
Firebolt 20n 22.40s 🏆 36 🏆 $0.46 🏆 $0.60 🏆
ClickHouse 20n 66.70s 4 $2.38 $4.27
Snowflake 4XL 135.06s 1 $9.60 $14.41
Databricks 4XL 187.78s 0 $19.28 $19.28
BigQuery 350.24s 0 $7.82 $19.55
Redshift SL 1067.53s 2 $13.58 $13.58

Relative Comparison (vs Best)

We calculated the ratio of total runtime between each system and the fastest system as well as the ratio of cost between each system and the cheapest system at both standard and enterprise pricing.

Example: Firebolt’s total runtime was the best at 22.4s, ClickHouse was 66.7s, so the Runtime ratio is 66.7 / 22.4 = 2.98 which means Firebolt is almost 3 times faster than Clickhouse at this scale.

Vendor Performance Ratios
Vendor Runtime Ratio Cost (Std) Ratio Cost (Ent) Ratio
Firebolt 20n 1.00x 1.00x 1.00x
ClickHouse 20n 2.98x 5.21x 7.14x
Snowflake 4XL 6.03x 20.97x 24.12x
Databricks 4XL 8.38x 42.10x 32.28x
BigQuery 15.64x 17.07x 32.72x
Redshift SL 47.66x 29.66x 22.74x

Summary

At 10 billion rows Firebolt is the leader:

  • Fastest: Firebolt 20n (22.40s) 
  • Most Queries Won: Firebolt 20n (36 of 43 = 84%)
  • Cheapest (Standard): Firebolt 20n ($0.46)
  • Cheapest (Enterprise): Firebolt 20n ($0.60)

Results: 100 Billion Rows

At 100B rows, the differences grow:

Vendor Performance Comparison
Vendor Total Runtime Queries Won Cost (Standard) Cost (Enterprise)
Firebolt 20n 156.11s 🏆 29 🏆 $3.19 🏆 $4.16 🏆
ClickHouse 20n 275.42s 12 $9.85 $17.62
Databricks 4XL 1048.94s 0 $107.69 $107.69
Snowflake 4XL 1211.80s 1 $86.17 $129.26
BigQuery 3869.55s 0 $84.35 $210.86
Redshift SL 5015.59s 1 $55.06 $55.06

Relative Comparison (vs Best)

Vendor Performance Ratios
Vendor Runtime Ratio Cost (Std) Ratio Cost (Ent) Ratio
Firebolt 20n 1.00x 1.00x 1.00x
ClickHouse 20n 1.76x 3.08x 4.23x
Databricks 4XL 6.72x 33.74x 25.87x
Snowflake 4XL 7.76x 27.00x 31.05x
BigQuery 24.79x 26.43x 50.65x
Redshift SL 32.13x 17.25x 13.23x

Summary

At 100 billion rows Firebolt continues to lead:

  • Fastest: Firebolt 20n (156.11s) 
  • Most Queries Won: Firebolt 20n (29 of 43 = 67%)
  • Cheapest (Standard): Firebolt 20n ($3.19)
  • Cheapest (Enterprise): Firebolt 20n ($4.16)

Query Level Breakdown at 100 Billion rows

Firebolt (29 queries won)

Firebolt dominates in the most demanding analytical query types:

Query Categories and Examples
Category Queries Examples
High-Cardinality GROUP BY 10 Grouping on UserID, SearchPhrase, URL, MobilePhoneModel with millions of distinct values
Filtered Analytics 6 Queries with specific filters (CounterID=62, date ranges) - Q37-Q42
Very High-Cardinality GROUP BY 5 WatchID, ClientIP, URL grouping - Q31-Q34, Q36
Low-Cardinality GROUP BY 2 AdvEngineID, RegionID grouping - Q7, Q8
ORDER BY + LIMIT 2 Top-N with text/time sorting - Q24, Q26
COUNT DISTINCT 1 UserID cardinality - Q4
Complex Aggregation 1 String functions with HAVING - Q28
Wide Aggregation 1 89 SUM columns - Q30
Pattern Matching 1 Complex LIKE with GROUP BY - Q23

Key Strength: Firebolt excels at the hardest analytical queries—those involving high-cardinality grouping and filtered scans on large datasets. These queries stress hash aggregation and data pruning, where Firebolt's architecture provides significant advantages.

ClickHouse (12 queries won)

ClickHouse wins on simpler, full-scan workloads:

Query Categories and Examples
Category Queries Examples
Simple Aggregations 3 COUNT(), SUM, AVG on full table - Q0, Q2, Q3
LIKE/Pattern Matching 2 Substring search on URL - Q21, Q22
ORDER BY + LIMIT 2 Time-based sorting - Q25, Q27
COUNT DISTINCT 1 SearchPhrase cardinality - Q5
Low-Cardinality GROUP BY 1 RegionID with multiple aggregates - Q9
Very High-Cardinality GROUP BY 1 URL with constant column - Q35
Point Lookup 1 Specific UserID lookup - Q20
Complex Aggregation 1 REGEXP_REPLACE extraction - Q29

Key Strength: ClickHouse excels at full-table scans, string operations, and queries that don't require complex aggregation state management. Its vectorized execution shines on straightforward column scans.

Snowflake (1 query won)

Query Descriptions
Query Description
Q6 MIN/MAX EventDate - Simple date range metadata scan

Snowflake's optimizer handles this simple metadata query efficiently but struggles with more complex analytical workloads at 100B scale.

Redshift Serverless (1 query won)

Query Descriptions
Query Description
Q1 COUNT() with AdvEngineID filter - Simple filtered count

Redshift wins this single filtered aggregation but is significantly slower on all other query types.

Key Insight

The query breakdown reveals a clear pattern:

  • Firebolt wins the complex queries that define real-world analytics: high-cardinality grouping, filtered aggregations, and multi-column operations
  • ClickHouse wins the simple queries: basic counts, full-table scans, and string searches
  • Traditional DWs (Snowflake, Redshift, Databricks, BigQuery) win almost nothing at this scale

This suggests that as analytical workloads become more sophisticated (beyond simple scans), Firebolt's architecture provides increasingly significant advantages. For analytical workloads at enterprise scale, the numbers are clear: faster queries compound into dramatically lower costs.

Clickhouse’s article includes a visualization of performance/cost comparing results among cloud data warehouses and shows that it is faster and more cost efficient than the others. We replicated the same chart and included Firebolt in the mix.

At the 10 billion row scale, using the 20-node results, Firebolt is roughly 3x faster and 5x less expensive than Clickhouse. As the data volume grows tenfold to 100 billion rows, both engines increase in cost and slow down in query performance. It is, afterall, an order of magnitude more data so this is expected for many of the benchmark queries. The rate of change in performance and cost as the data grows, however, is different across systems. As data volume grows, Firebolt scales more efficiently than any other system tested. At 100 billion rows, Firebolt is still roughly 2x faster and 3x less expensive than ClickHouse; the runner up. The differences with other systems are much larger.

Conclusion

ClickHouse's Bench2Cost framework is valuable as it brings transparency to cloud data warehouse pricing. When we include Firebolt in the picture and use the same metrics to compare them, Firebolt is the clear winner.

At scale (10B-100B rows), Firebolt consistently delivers:

  • 40-66% faster query performance
  • 68-81% lower compute costs
  • More query wins across diverse workload patterns

Where ClickHouse excels:

  • Simple LIKE pattern matching (Q21-Q23)
  • Trivial queries under 10ms (Q1)

For analytical workloads at enterprise scale, the numbers are clear: faster queries compound into dramatically lower costs

All benchmarks were run using the open-source Bench2Cost framework and publicly documented pricing. The full results are reproducible and available in the bench-2-cost public repository.

Get started with Firebolt Cloud today. Visit firebolt.io for a free trial.

To all posts

Intrigued? Want to read some more?