Skip to content
data, page 2

data

32 articles on data — what drives the cost, how it is priced, and where the savings actually are.

gcpdataflowdata

GCP Dataflow cost: workers, memory, and the shuffle charge

Dataflow bills per vCPU-hour and GB-hour of worker time, plus a data-processed charge for Shuffle (batch) or Streaming Engine. Right-sizing workers and using the managed shuffle are the main levers. Here is how the model works.

The C3X Team··5 min read
gcpdataprocdata

GCP Dataproc cost: the surcharge on top of Compute Engine

Dataproc adds about $0.01 per vCPU-hour on top of the Compute Engine instances it runs, so the cluster costs more than the VMs alone. Ephemeral clusters, preemptible workers, and Dataproc Serverless are the main levers. Here is how to cut it.

The C3X Team··5 min read
awsathenadata

AWS Athena cost optimization: you pay per terabyte scanned

Athena charges $5 per TB of data scanned, so cost is decided by how much data each query reads, not how often you query. Partitioning, columnar formats, and compression cut scans by an order of magnitude. Here is how.

The C3X Team··5 min read