Cost Tracking Flow Architecture

This document illustrates how the Blueberry IDP tracks and analyzes costs for environments, resources, and usage patterns.

Cost Tracking System Overview

Environment Cost Lifecycle

Cost Allocation and Attribution

Cost Metrics and KPIs

Budget Management System

Cost Optimization Recommendations

Cost Tracking Configuration

Cost Collection Settings

# Cost tracking configuration
cost_tracking:
  enabled: true
  collection_interval: 300  # 5 minutes
  storage_retention: 90     # days

  metrics:
    - name: cpu_cost
      type: resource
      unit: core-hours
      rate: 0.031  # per core-hour

    - name: memory_cost
      type: resource
      unit: gb-hours
      rate: 0.0034  # per GB-hour

    - name: storage_cost
      type: resource
      unit: gb-months
      rate: 0.04  # per GB-month

    - name: network_cost
      type: usage
      unit: gb-egress
      rate: 0.085  # per GB egress

  allocation:
    method: proportional
    dimensions:
      - environment
      - user
      - project

  budgets:
    default_monthly: 1000  # USD
    alert_thresholds:
      warning: 50   # 50%
      critical: 80  # 80%
      limit: 95     # 95%

Cost Dashboard Configuration

# Dashboard configuration
dashboard:
  refresh_interval: 30  # seconds

  widgets:
    - type: cost_trend
      title: "Cost Trend (Last 30 Days)"
      metrics: [total_cost]
      period: 30d

    - type: environment_costs
      title: "Top 10 Environment Costs"
      metrics: [cost_per_environment]
      limit: 10

    - type: budget_status
      title: "Budget Status"
      metrics: [budget_used, budget_remaining]

    - type: optimization_savings
      title: "Optimization Savings"
      metrics: [potential_savings]

  alerts:
    - type: budget_exceeded
      threshold: 80
      severity: warning

    - type: cost_spike
      threshold: 200  # 200% of average
      severity: critical

Cost Reporting and Analytics

Cost Report Types

Cost Analytics Queries

-- Example cost analytics queries
-- Top 5 most expensive environments
SELECT
  environment_id,
  SUM(cost_usd) as total_cost,
  AVG(cost_usd) as avg_daily_cost
FROM cost_metrics
WHERE date >= DATE_SUB(CURRENT_DATE, INTERVAL 30 DAY)
GROUP BY environment_id
ORDER BY total_cost DESC
LIMIT 5;

-- Cost trend by user
SELECT
  user_id,
  DATE_TRUNC(date, WEEK) as week,
  SUM(cost_usd) as weekly_cost
FROM cost_metrics
WHERE date >= DATE_SUB(CURRENT_DATE, INTERVAL 12 WEEK)
GROUP BY user_id, week
ORDER BY week, weekly_cost DESC;

-- Budget utilization
SELECT
  budget_category,
  budget_amount,
  SUM(actual_cost) as used_amount,
  (SUM(actual_cost) / budget_amount) * 100 as utilization_percent
FROM budgets b
JOIN cost_metrics c ON b.category = c.category
WHERE c.date >= DATE_TRUNC(CURRENT_DATE, MONTH)
GROUP BY budget_category, budget_amount;

Cost Optimization Strategies

Cost Monitoring Alerts

# Cost monitoring alerts
alerts:
  - name: "Environment Cost Spike"
    condition: "cost_per_hour > 2 * avg_cost_per_hour"
    duration: "10m"
    severity: "warning"

  - name: "Daily Budget Exceeded"
    condition: "daily_cost > daily_budget * 1.2"
    duration: "5m"
    severity: "critical"

  - name: "Unused Environment"
    condition: "environment_inactive_hours > 24"
    duration: "1h"
    severity: "info"

  - name: "Cost Anomaly"
    condition: "cost_deviation > 3 * standard_deviation"
    duration: "15m"
    severity: "warning"

Cost Data Export and Integration

Export Formats

# Cost data export formats
def export_cost_data(format_type, date_range, filters=None):
    """Export cost data in various formats"""

    formats = {
        'json': export_to_json,
        'csv': export_to_csv,
        'excel': export_to_excel,
        'pdf': export_to_pdf,
        'api': export_to_api
    }

    if format_type not in formats:
        raise ValueError(f"Unsupported format: {format_type}")

    return formats[format_type](/developer-docs/docs/architecture/diagrams/date_range, filters)

# API endpoint for cost data
@app.get("/api/costs/export")
async def export_costs(
    format: str = "json",
    start_date: str = None,
    end_date: str = None,
    environment_id: str = None,
    user_id: str = None
):
    """Export cost data with filters"""
    pass

Integration with External Systems

# External system integrations
integrations:
  billing_system:
    enabled: true
    endpoint: "https://billing.example.com/api/costs"
    authentication: "api_key"
    sync_frequency: "daily"

  monitoring_system:
    enabled: true
    type: "prometheus"
    metrics_endpoint: "/metrics"

  slack_notifications:
    enabled: true
    webhook_url: "${SLACK_WEBHOOK_URL}"
    channels:
      - "#cost-alerts"
      - "#finance-team"

Related Documentation

• Cost Tracking API
• Budget Management
• Cost Optimization Guide
• Monitoring and Alerting

Last Updated: January 2024