Skip to content

add web search server-side tool spans to anthropic and openai instrumentation - #161

Merged
Andrew Kent (realark) merged 4 commits into
mainfrom
ark/sdk-113-web-search
Aug 19, 2026
Merged

add web search server-side tool spans to anthropic and openai instrumentation#161
Andrew Kent (realark) merged 4 commits into
mainfrom
ark/sdk-113-web-search

Conversation

@realark

@realark Andrew Kent (realark) commented Aug 15, 2026

Copy link
Copy Markdown
Collaborator

new spec tests: braintrustdata/braintrust-spec#53

update anthropic and openai instrumentation to create server-side tool call spans

caveat: the instrumentation is on-par with python, but some info is simply not given by the llm vendor:

  • web search latency is not reported (we just make the span start some time inside of the llm parent with a zero-length duration)
  • cost is not reported (server tool use is and this can be used to update cost computation metrics in some cases)

@realark
Andrew Kent (realark) force-pushed the ark/sdk-113-web-search branch 2 times, most recently from 184a1db to 1524a28 Compare August 18, 2026 00:01
@realark
Andrew Kent (realark) force-pushed the ark/sdk-113-web-search branch 5 times, most recently from b16f3fe to 3e4aced Compare August 18, 2026 20:22
@realark Andrew Kent (realark) changed the title add web search cost and latency add web search server-side tool spans to anthropic and openai instrumentation Aug 18, 2026
@realark
Andrew Kent (realark) marked this pull request as ready for review August 18, 2026 21:01
@realark
Andrew Kent (realark) merged commit c0ffa18 into main Aug 19, 2026
1 check passed
@realark
Andrew Kent (realark) deleted the ark/sdk-113-web-search branch August 19, 2026 17:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants