How Alphaus saves on costs by "stitching storage"
(Repost from https://flowerinthenight.com/blog/2024-07-24-spillover-store/)
One of Alphaus' data processing pipelines ingests around 10TB of client financial data per day. The processing engine is running on GKE with around 80-100 (depending on what week of the month) pods sharing the total workload. Each pod has around 10GB of memory and 30GB of attached storage. The consistency of this load allowed us to purchase enough Committed Use Discounts (CUDs) for the underlying VMs to save on compute costs.