analytics
14 articles on analytics — what drives the cost, how it is priced, and where the savings actually are.
ClickHouse cost vs a managed warehouse: when self hosting pays off
ClickHouse on your own instances can serve analytical queries for a fraction of per query warehouse pricing, but only above a certain query volume. Here is where the crossover sits and what it costs to cross it.
Parquet vs CSV cost: the file format decision that changes your query bill by 10x
Switching a table from CSV to columnar Parquet typically cuts storage by 70 percent and query scan volume by 90 percent or more. On per TB scan pricing that is the difference between $500 and $40 a month.
Query pruning cost savings: how partitioning turns a $5 query into 3 cents
On scan priced engines you pay for every byte the engine reads, not every byte you use. Partitioning, clustering, and file layout decide which of those two numbers you get billed for.
How much does it cost to run a data pipeline processing 1 TB a day?
A streaming and batch pipeline ingesting 1 TB a day costs about 5,721 dollars a month on AWS, which is 19 cents per gigabyte. Here is the breakdown, and why the transform step is the cheapest part of it.
Athena partitioning cost savings: pay for less scanned data
Athena charges $5 per terabyte scanned, so the whole cost game is scanning less. Partitioning, columnar formats, and compression can cut the data a query reads by 10 to 100 times. Here is how each lever works and how they stack to slash an Athena bill.
AWS Glue crawler cost: the minimum charges that add up
Glue crawlers keep your Data Catalog in sync with S3, but they bill per DPU-hour with a 10-minute minimum and a 2-DPU floor, so frequent crawls of many tables cost more than teams expect. Here is the pricing and how to crawl less to spend less.
Azure Synapse serverless vs dedicated SQL pool cost
Synapse offers a serverless SQL pool billed per terabyte scanned and dedicated SQL pools billed per hour of provisioned capacity. Which is cheaper depends on how often you query and how much data each query touches. Here is the comparison.
Azure Databricks DBU cost explained: the compute unit behind the bill
Azure Databricks bills a DBU rate for its platform on top of the underlying VM cost, and the DBU rate varies by workload type and tier. Understanding DBUs is the key to controlling Databricks spend. Here is how they work.
dbt Cloud vs dbt Core cost: paying for convenience or running it yourself
dbt Core is free and open source but you run and orchestrate it yourself. dbt Cloud is a paid managed service with scheduling, IDE, and collaboration. The cost comparison is subscription fees versus your own compute and engineering time. Here is how to choose.
Data warehouse cost optimization: compute and storage discipline
Data warehouse cost is compute (queries and transformations) plus storage, whether Snowflake credits, BigQuery bytes scanned, or Redshift nodes. Scanning less, right-sizing compute, and auto-suspend cut it. Here is how.
Azure Data Explorer cost: cluster compute plus storage
Azure Data Explorer (Kusto) bills the compute of its cluster VMs (with a markup) plus storage, running continuously unless stopped, or serverless-style with autoscale. Idle clusters and over-provisioning drive the bill. Here is the model.
AWS QuickSight cost: authors, readers, and SPICE capacity
QuickSight bills per author (a monthly subscription) and per reader (session-based with a monthly cap), plus SPICE in-memory capacity beyond the included allowance. Matching author and reader licensing to real usage is the main lever. Here is the model.
Redshift vs Athena cost: provisioned cluster or pay-per-scan?
Athena bills $5/TB scanned and costs nothing idle; Redshift bills for a provisioned cluster (~$793/month per node) or per RPU. Here's the crossover by query volume and how table design cuts both.
BigQuery cost: on-demand vs slots, and how to stop scanning terabytes
BigQuery on-demand bills ~$6.25/TB scanned; capacity bills for slots. Here's which model is cheaper for your query volume, and why partitioning and never SELECT * is the biggest saving on either.