Beta documentation

LLM Usage Monitor

A beta Power BI custom connector for analysts who need to monitor organization-level LLM token usage, request volume, model consumption, and cost.

Download .mez Back to product

Connector output

Usage
Costs
Models
UsageByApiKey
UsageByProject
UsageByServiceTier

Use case

Understand the AI usage behind the work.

Token and request monitoring

Track input tokens, output tokens, total tokens, and request volume by day so teams can see how LLM usage is changing over time.

Cost visibility

Bring daily cost data into Power BI so analysts and finance operations teams can review spend patterns without manually collecting reports.

Operational clarity

Break usage down by model, API key, provider project, and service tier where the provider API makes those dimensions available.

Install

Add the connector to Power BI Desktop.

  1. 1 Download LLMUsageMonitor.mez.
  2. 2 Create the folder Documents\Microsoft Power BI Desktop\Custom Connectors if it does not already exist.
  3. 3 Copy LLMUsageMonitor.mez into that Custom Connectors folder.
  4. 4 Restart Power BI Desktop.
  5. 5 Open File > Options and settings > Options > Security and enable custom data extensions if Power BI blocks uncertified connectors.
  6. 6 Restart Power BI Desktop again after changing the security setting.

Connect

Choose a provider and authenticate.

In Power BI Desktop, select Get Data, search for LLM Token Usage, and select the connector.
Select OpenAI (Organization Admin API) or Anthropic (Organization Admin API only).
Paste the matching provider Admin API key into the Power BI credential prompt. The connector uses Power BI Key authentication and does not store API keys in connector source files.

Provider requirements

Use organization admin credentials.

OpenAI

Requires an OpenAI Admin API key with access to organization usage and cost endpoints. Runtime project keys are not sufficient for organization usage reporting.

Anthropic

Requires an Anthropic organization account, an admin role, and an Admin API key that starts with sk-ant-admin. Standard sk-ant-api keys and individual Anthropic accounts cannot access usage and cost reports.

Tables

Load the tables your report needs.

Usage

Daily provider, date, total tokens, input tokens, output tokens, and requests.

Costs

Daily provider, date, and cost in USD.

Models

Daily usage by model, including token and request measures.

UsageByApiKey

Daily usage by provider API key identifier.

UsageByProject

Daily usage by provider project or workspace identifier.

UsageByServiceTier

Daily usage by service tier when returned by the provider API.

Need help?

Bring LLM usage into your reporting layer.

Reach out if you have questions about installation, provider admin keys, or how to model token usage and cost in Power BI.

Download .mez Ask a question