Cloud Cost Engineering and Open Source FinOps
Notes from the team building C3X. Cost estimation for Terraform, the economics of cloud infrastructure, and how to ship FinOps tooling without a SaaS gate.
Rate limiting: protecting your backend from expensive traffic
Rate limiting caps how many requests a client can make, protecting your backend from abuse, runaway clients, and traffic spikes that would drive up compute and downstream cost. It is a cheap control that prevents expensive incidents. Here is the case.
Azure ExpressRoute cost: circuit port fee plus egress model
ExpressRoute bills a circuit port fee by bandwidth, in a metered plan (per-GB egress) or unlimited plan (flat, higher fee), plus provider connectivity charges. For large, steady traffic to Azure it can beat VPN. Here is the model.
Azure Private Link cost: per endpoint hour plus data processed
Private Link bills per private endpoint per hour plus per GB of data processed, keeping traffic to Azure services on the backbone privately. It adds cost but can reduce egress and improve security. Here is the model and the tradeoff.
GCP Cloud Interconnect cost: VLAN attachments plus egress
Cloud Interconnect bills per VLAN attachment (by capacity) plus discounted egress over the connection, in Dedicated (your own 10G/100G ports) or Partner (via a provider) flavors. For large steady traffic it beats VPN. Here is the model.
Azure NetApp Files cost: provisioned capacity by service level
Azure NetApp Files bills provisioned capacity pool size per hour by service level (Standard, Premium, Ultra), which set throughput per TB. You pay for the pool whether or not it is full, so right-sizing capacity and tier is the lever.
Azure Files cost: tiers, transactions, and provisioned premium
Azure Files bills by tier, transaction-optimized, hot, and cool (pay per GB stored plus transactions), or premium (provisioned capacity with bundled performance). Matching tier to access pattern and using premium only when needed are the levers.
GCP Hyperdisk cost: pay for capacity, IOPS, and throughput separately
Hyperdisk is GCP's newer block storage that decouples capacity, IOPS, and throughput, so you provision and pay for each independently. This flexibility avoids over-buying, but over-provisioning any dimension wastes money. Here is the model.
Azure Stream Analytics cost: you pay for streaming units
Stream Analytics bills per streaming unit-hour, the provisioned capacity that runs your streaming query, whether or not data flows. Right-sizing streaming units to real throughput and stopping idle jobs are the levers. Here is the model.
GCP Dataplex cost: data compute units for tasks and management
Dataplex bills per data compute unit (DCU) hour for its processing tasks (discovery, quality, tiering) plus shuffle storage, and its catalog metadata. Running unnecessary tasks and over-provisioning DCUs drive the bill. Here is the model.
gRPC vs REST: the cost of the bytes on the wire
gRPC's binary encoding and HTTP/2 multiplexing send fewer bytes and use connections more efficiently than JSON over HTTP/1.1, which can cut egress and compute at high volume. But REST is simpler and universal. Here is the cost tradeoff.
Image optimization: cutting storage and egress with smaller files
Images are often the largest bytes a site serves, so optimizing them, right-sizing dimensions, modern formats like WebP and AVIF, and compression, cuts egress and storage substantially. Here is where image optimization saves cloud cost.
Load balancer cost compared: AWS vs Azure vs GCP
AWS (ALB/NLB), Azure (Load Balancer, Application Gateway), and GCP (Cloud Load Balancing) price load balancing on hourly plus capacity/data axes. Layer-4 is cheaper than layer-7. This compares them and the shared choice of layer to your needs.
Terraform state storage cost: cheap backend, watch the locking
Terraform remote state on S3, GCS, or Azure Blob costs almost nothing, tiny storage plus a few requests per run. The only real cost is state locking (a DynamoDB table on AWS) and, at scale, request volume. Here is the tiny model.
AWS Translate cost: per character of text translated
Translate bills per character of input text (about $15 per million), with a free tier and higher rates for custom terminology and Active Custom Translation. Translating more text than needed drives the bill. Here is the per-character model.
AWS Polly cost: per character, standard vs neural voices
Polly bills per character of text synthesized to speech, with neural voices costing several times more than standard, plus a free tier. Synthesizing the same text repeatedly, or using neural where standard suffices, drives the bill. Here is the model.
AWS Kendra cost: an always-on index with a high baseline
Kendra bills per index-hour by edition (Developer and Enterprise), running around the clock, plus connector scans and extra query or document capacity. The always-on index fee is a significant baseline. Here is when Kendra's intelligent search pays off.
AWS Personalize cost: training, ingestion, and inference capacity
Personalize bills data ingestion, training hours to build recommendation models, and real-time inference by provisioned throughput (TPS-hours). Over-provisioned recommendation capacity and frequent retraining drive the bill. Here is the model.
AWS Connect cost: pay per minute of contact-center usage
Amazon Connect bills per minute of end-customer contact usage plus telephony (per-minute inbound/outbound and phone number charges), with optional add-ons for features. Call volume and duration drive the bill. Here is the pay-as-you-go model.
Azure Communication Services cost: per minute, message, and email
Communication Services bills per usage across channels, per minute for calling, per SMS, per email, per chat message, with pay-as-you-go rates and no fixed platform fee. Channel volume drives the bill. Here is the per-channel model.
GCP Vision AI cost: per image, by feature
Cloud Vision bills per image per feature (label, face, text, object, safe-search, and more), so requesting several features on one image bills for each, with a free tier and volume discounts. Analyzing more features than needed drives the bill.
CDN cost compared: CloudFront vs Front Door vs Cloud CDN
CloudFront, Azure Front Door, and Google Cloud CDN price content delivery similarly, egress to users (tiered by region) plus requests, with free origin-to-CDN transfer. The cheapest depends on traffic geography and volume, and a CDN usually lowers total cost.
Cold start mitigation cost: paying to keep functions warm
Serverless cold starts add latency; mitigating them with provisioned concurrency or minimum instances means paying for warm capacity around the clock. Whether that trade is worth it depends on traffic and latency needs. Here is the cost math.
FinOps maturity: from reactive cost cuts to continuous engineering
FinOps maturity moves from reactive (chasing bills after the fact) to proactive (visibility and allocation) to continuous (cost as a first-class engineering metric). Knowing where you are guides what to build next. Here is the progression.
Carbon and cost: where sustainability and savings align
Reducing cloud waste cuts both cost and carbon, since unused resources burn power for nothing. Many cost optimizations are also sustainability wins. Here is where the two align, where they diverge, and how to think about both.