Context & Assumptions

Use Case Type: Enterprise data & system assessment using Azure OpenAI

(Discovery, lineage analysis, metadata enrichment, documentation support)

Scope Constraints
  • Assessment only (NO model training)
  • Human-in-the-loop usage
  • Max duration: 3 months
  • Outputs: insights, summaries, classifications, Atlan enrichment
  • No latency SLA, no real-time dependency

Usage Profile

Users: ~10 Analysts / Architects / PMs

Activities:

  • Summarizing repos, APIs, DB schemas
  • Classifying systems and data domains
  • Generating draft lineage descriptions
  • Writing glossary entries / metadata for Atlan
  • Comparing systems for redundancy & ownership

What This Is NOT:

  • Customer-facing AI
  • Automated pipelines calling OpenAI
  • Real-time decisioning
  • Model fine-tuning
  • Large-scale batch inference

Estimated Token Consumption

Conservative, interview-safe assumptions

  • Avg prompts per analyst per day: 10–15
  • Avg tokens per prompt (in + out): 2k–4k
  • Working days per month: 20
Monthly Token Estimate
7–7.5M
10 analysts × 12 prompts/day × 3k tokens × 20 days

Recommended Pricing Model

✓ Pay-As-You-Go (Token-Based)

Why:

  • Short-lived workload (3 months)
  • Irregular usage patterns
  • No need for guaranteed throughput
  • Easier cost control & shutdown

Avoid:

  • Provisioned Throughput Units (PTUs) - Overkill, long-term commitment, poor fit

Cost Estimation

Monthly Cost
$1,000 – $2,000
per month
Total Program Cost (3 Months)
$3,000 – $6,000
total

Depending on: prompt discipline, model choice (full vs mini), use of embeddings vs chat, re-prompting inefficiencies

Component Contribution
Analyst prompts ~70%
Iteration / re-prompts ~20%
Atlan enrichment & summaries ~10%

Cost Control Measures

  • Prompt templates & guardrails
  • Shared system prompts per use case
  • Token limits per request
  • Daily / weekly spend alerts
  • Disable auto-scaling beyond limits
  • Centralized Azure OpenAI resource (not per team)

"This is not a production AI cost. This is a time-boxed assessment expense to replace weeks of manual analysis."

Decision Recommendation

  • Approve Medium – Assessment-Only Azure OpenAI usage
  • PAYGO pricing
  • Hard stop after 90 days
  • Outputs retained in Atlan, AI turned off