sendingdocu2024
V2EX  ›  外包

寻 Opentelemetry SDK 外包开发,需要比较了解 LLM,纯 Python

  •  
  •   sendingdocu2024 · Jan 6 · 1023 views
    This topic created in 212 days ago, the information mentioned may be changed or developed.

    有完整需求文档,开发量大概 2 周时间,预算充足

    需求框架如下

    1. Project Overview

    High-level Requirements

    OpenTelemetry instrumentation packages that capture telemetry from LLM provider SDKs. These packages should support:

    • Auto-Instrumentation:
      • Hook into LLM client libraries with zero code changes for end users
      • Capture tokens, latency, cost, and optionally request/response content
      • Export data via standard OTLP protocol to our-company's backend
      • Follow OpenTelemetry Gen AI Semantic Conventions
    • Manual Instrumentation:
      • Provide tracer API for custom spans (agent workflows, tools, business logic)
      • Support @trace decorator for easy function tracing
      • Allow nesting of custom spans with auto-instrumented LLM calls

    2. Scope of Work

    In Scope

    Task ID Component Description Est. Days
    OTEL-001 OpenAI Chat, completions, embeddings, streaming with TTFT (sync + async)
    OTEL-002 Anthropic Messages API, streaming with TTFT (sync + async)
    OTEL-003 Gemini Content generation, embeddings, streaming with TTFT (sync + async)
    OTEL-004 Content Capture Optional request/response content capture with sanitization
    OTEL-005 Wrapper Package our-company-llm package with one-line setup
    OTEL-006 Multi-Modal Image/audio/video metadata capture for vision and media APIs
    OTEL-007 Manual Instrumentation Tracer API, @trace decorator for custom spans
    Total

    Out of Scope

    • Backend/collector infrastructure (our-company handles this)
    • Dashboard/UI development
    • TypeScript/Node.js instrumentations - future phase

    欢迎 Email 或 留 VX

    neosnaky
        1
    neosnaky  
       Jan 7
    邮箱:[email protected]
    微信:clippers1001
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   996 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 29ms · UTC 19:12 · PVG 03:12 · LAX 12:12 · JFK 15:12
    ♥ Do have faith in what you're doing.