Skip to content

Tracking similar projects in this space #172

Closed

Description

@technicalpickles

I wanted somewhere to track projects and news around with similar proxy / LLM tool selection functionality. This could be a discussion if we had those.

Leaving specific things as comments.

Activity

  1. technicalpickles commented on Dec 5, 2025

    @technicalpickles
    ContributorAuthor

    From Claude: Introducing advanced tool use on the Claude Developer Platform

    Instead of loading all tool definitions upfront, the Tool Search Tool discovers tools on-demand. Claude only sees the tools it actually needs for the current task.

    Tool Search Tool diagram
    Tool Search Tool preserves 191,300 tokens of context compared to 122,800 with Claude’s traditional approach.
    Traditional approach:

    All tool definitions loaded upfront (~72K tokens for 50+ MCP tools)
    Conversation history and system prompt compete for remaining space
    Total context consumption: ~77K tokens before any work begins
    With the Tool Search Tool:

    Only the Tool Search Tool loaded upfront (~500 tokens)
    Tools discovered on-demand as needed (3-5 relevant tools, ~3K tokens)
    Total context consumption: ~8.7K tokens, preserving 95% of context window
    This represents an 85% reduction in token usage while maintaining access to your full tool library. Internal testing showed significant accuracy improvements on MCP evaluations when working with large tool libraries. Opus 4 improved from 49% to 74%, and Opus 4.5 improved from 79.5% to 88.1% with Tool Search Tool enabled.

    This seems to be part of the Agent SDK, rather than part of Claude Code at this time

  2. technicalpickles commented on Dec 5, 2025

    @technicalpickles
    ContributorAuthor

    From Docker: MCP Gateway

    MCP Gateway runs MCP servers in isolated Docker containers with restricted privileges, network access, and resource usage. It includes built-in logging and call-tracing capabilities to ensure full visibility and governance of AI tool activity.

    GitHub

  3. Dumbris commented on Dec 5, 2025

    @Dumbris
    Member

    I wanted somewhere to track projects and news around with similar proxy / LLM tool selection functionality. This could be a discussion if we had those.

    Leaving specific things as comments.

    Great idea starting a consolidated place to track projects in this space.
    Since the Discussions tab is now enabled, we can use it as a home for links, comparisons, and any design notes around tool-selection strategies or proxy patterns. That should keep the issue list focused while still giving us a running knowledge base.

  4. locked and limited conversation to collaborators on Dec 5, 2025
  5. converted this issue into a discussion #175 on Dec 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions