Skip to content

Unit Cost Documentation

Introduction

Unit cost is a critical concept in cost management, particularly in cloud environments. It refers to the cost associated with a single unit, which could be a product, a customer, an environment, or any other entity that consumes resources. Understanding unit costs helps organizations allocate expenses more accurately, identify cost-saving opportunities, and improve financial transparency.

Purpose

The purpose of this documentation is to provide a comprehensive guide on unit cost, its components, and methodologies for calculating and managing unit costs in cloud environments. This will address common challenges faced by organizations in breaking down costs, especially when multiple units share services.

Components of Unit Cost

In unit cost analysis, there are two fundamental concepts: Unit Types and Unit Items.

Unit Types

Unit Types represent the different categories or entities for which you want to break down costs. These could include:

  • Products: The various products offered by the organization.
  • Customers: The different customers or customer segments served.
  • Environments: Distinct operational environments, such as development, testing, and production.

Unit Items

Under each Unit Type, there are specific Unit Items. These are the individual entities within the Unit Type for which costs need to be divided and tracked. For example:

  • Products: Individual products like "Octo," "Wave," and "Ripple."
  • Customers: Specific customers or groups of customers.
  • Environments: Different operational environments such as "Development Environment," "Testing Environment," and "Production Environment."

By defining Unit Types and Unit Items, organizations can more accurately allocate and track costs, ensuring a clear understanding of where resources are being utilized and how expenses are being incurred.

Process of Calculating Unit Cost

Version 1: Manual Input and Processing

Currently, this concept is in version 1 and involves a manual process. The Unit Types and Unit Items, along with their corresponding percentages, are manually input by the user. An automated identification system for these elements is under ongoing investigation.

Data Storage

Once the user manually inputs the Unit Types and Unit Items, this data is stored in a GCP Spanner table called cover_unitcost.

Sample Data

Column Name Sample Value
id 35022b5d-91bb-4cd4-8fdd-5577a017f9cc
orgId MSP-5aa311904d5d6
date 2024-08-02
unitType Product
description Cost per product
unitItems {"octo":0.3,"ripple":0.5,"wave":0.2}
createdBy Christian
createTime 2024-08-01T23:17:56.92991733Z
lastUpdatedAt 2024-08-01T23:17:56.9299174Z

Batch Processing

A daily batch process reads the entries from cover_unitcost, processes each one, and stores the results in another GCP Spanner table called cover_tag_management.

Sample Data

Column Name Sample Value
id 00bb3f07-eeb3-4cbd-9a92-963a791c7bca
orgId MSP-5aa311904d5d6
date 2024-06-03
filter [{"and":{"account":"000001000001"}}, ...]
tag octo:0.3000000000|ripple:0.5000000000|wave:0.2000000000|
createTime 2024-08-01T23:19:17.551506Z
updateTime 2024-08-01T23:19:17.551506Z
category alphaus:Product

Tag Generation

The batch process generates tags based on the unit items. The unitType is used as the category, formatted as alphaus:<unitType>. The tag string is constructed by concatenating the unit items and their corresponding percentages, separated by the pipe character (|).

For example, for the unit type "Product" with items "octo", "ripple", and "wave", the tag might look like this:

octo:0.3000000000|ripple:0.5000000000|wave:0.2000000000|

Applying Filters

Filters are applied to specify where the tags will be reflected. In the current version, the filter covers all accounts in AWS and GCP for the organization.

Special Computation for Customers

For the "Customer" unit type, our organization has a unique process to calculate the cost percentage. This process is exclusive to our organization and is based on the size of the Cost and Usage Reports (CUR) for each customer.

Steps for Customer Cost Calculation

  1. Collect CUR Sizes:

  2. Collect the size of the CUR for each customer from tables in BigQuery.

  3. Calculate Percentages:

  4. Calculate each customer's percentage based on the size of their CUR relative to the total size of all customers' CURs.

  5. Generate Tags:

  6. Generate tags in the format customer1:0.3|customer2:0.2|customer3:0.1|customer4:0.4| based on these percentages.

  7. Store in cover_tag_management:

  8. Store the generated tags in the cover_tag_management table using the same structure and process as other unit types.

Summary

Every day, the batch process reads all items in cover_unitcost, processes each, and stores the results in cover_tag_management. The tags are used to attribute costs accurately to the defined unit items, facilitating detailed cost tracking and management. For customers, the process involves a unique calculation based on CUR sizes, ensuring precise cost distribution among different customers.