Skip to content

AI Cost

AI Cost is a feature in Octo that allows organizations to gain detailed insights into their AI-related spending. It helps break down costs by AI services across multiple cloud providers, making it easier for teams to analyze usage and manage budgets effectively. By grouping services into AI cost groups, users can monitor consumption trends, identify key cost contributors, and support better financial planning. This feature provides clarity and control over AI investments, whether for individual projects or large-scale operations.

AI Cost also enables stakeholders to align AI investments with business goals by offering visibility into service-level costs. Whether a team is focused on model training, inference workloads, or third-party AI APIs, AI Cost simplifies the process of tracking and attributing those expenses accurately.

Create ai cost group

Creating an AI cost group allows teams to organize and track AI spending in a more granular and meaningful way. Follow the steps below to create a new AI cost group using the New UI:

  1. Navigate to Cost group management and click Create cost group.

  2. Switch to the New UI
    Toggle the switch to enable the New UI, as AI cost group creation is only available in this interface.

  3. Select AI cost and Continue
    Once in the New UI, select AI Cost from the list of cost types and click Next.

  4. Choose AI services
    Browse and select the AI services you want to include in the group.

    Note

    As of now, only AWS-based AI services are supported by the platform. Integration with Google Cloud Platform (GCP) and Microsoft Azure is not yet available, but future versions will include support for these providers.

  5. Define Group Details
    Provide the basic information for the cost group:

    • Name: A descriptive title for the cost group.
    • Description (optional): Any additional context or purpose for the group.
    • Avatar and Theme: Customize the appearance of the group in your dashboard.

  6. Review and submit
    Review the cost group configuration, including the selected services and group details. If everything looks correct, click Confirm and create to finalize the setup.

Viewing AI Cost Insights

After an AI cost group has been created, users can monitor and analyze AI-related spending by following the steps below:

  1. Navigate to the AI cost group created
    From the sidebar menu, users should click on Cost Group and locate the AI cost group they previously created.

  2. Access the Insights tab
    Within the selected AI cost group, users can click the Insights tab to view detailed analytics on cost trends, usage breakdowns, and resource consumption.
    To view AI costs across other services, users can use the Services dropdown menu to filter insights by individual services. This allows for a more detailed and customized view of AI expenditures across the organization.

  3. Detailed Feature Overview
    To explore more information, simply click on the feature name or product family title displayed at the top of each card. This action will open a detailed view, providing in-depth insights, specifications, and related resources for the selected item.
    Additionally, users have the flexibility to customize the data view using the Group By and Metrics dropdowns:

    • Group By: Organize data according to various categories such as account, region or other relevant dimensions.
    • Metrics Selection: Tailor the visual representation by switching between different metrics like Total Cost, Usage Volume, Unit Economics, and more—giving you deeper control and insight based on your priorities.