Demo Proposal: Observability of browser agent with Arize Phoenix - #3042
Open
jiashunkang wants to merge 2 commits into
Open
jiashunkang wants to merge 2 commits into
jiashunkang wants to merge 2 commits into
Conversation
Collaborator
|
Readme is not correctly formatted Got: ['Assignment Proposal', 'Title', 'Names and KTH ID', 'Deadline', 'Category', 'Description', 'Relevance'] |
jiashunkang
changed the title
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Assignment Proposal
Title
Observing and Debugging a Browser Agent with Arize Phoenix
Names and KTH ID
Deadline
Week 7
Category
Demo
Description
We will demonstrate an observable browser-agent workflow using the OpenAI Agents SDK, Playwright MCP, and Arize Phoenix. The agent will interact with Amazon: find products matching a budget and quantity requirement, add them to the cart, and verify the items, quantities, and displayed total.
Phoenix will capture agent, model, and client-side browser-tool traces. We will inspect tool inputs and outputs, repeated actions, and latency. To demonstrate debugging, we plan to configure an overly short client-side tool timeout, examine the resulting failure, then adjust the timeout and rerun from a clean browser session.
Relevance
The demo illustrates observability for tool-using agents. It connects multiple components and shows why a final answer alone is insufficient to assess execution or task completion.