Repository navigation
Release v1.57.0 - #6123
Merged
Merged
Release v1.57.0#6123
Conversation
Co-authored-by: openhands <openhands@all-hands.dev>
all-hands-bot
added
integration-test
Contributor
|
Contributor
🔒 Release Security Scan🔒 Approval drift (time-of-check vs time-of-use)❌ 4 finding(s) Baseline:
Audited 12 PR(s): 8 clean, 4 flagged, 0 un-auditable. 📦 Supply-chain dependency diff✅ no findings Baseline: OSV: no known vulns across 4 new/bumped dep(s). Internal `openhands-*` bumps
Deterministic scanners: approval-drift + supply-chain dependency diff. Read-only; no PR code executed. |
Contributor
REST API breakage checks (OpenAPI) — ✅ PASSEDResult: ✅ PASSED |
Contributor
|
Hi! I started running the integration tests on your PR. You will receive a comment with the results shortly. |
Contributor
Coverage Report •
|
||||||||||||||||||||
Contributor
|
Hi! I started running the behavior tests on your PR. You will receive a comment with the results shortly. |
Contributor
🔄 Running Examples with
|
| Example | Status | Duration | Cost |
|---|---|---|---|
| 01_standalone_sdk/02_custom_tools.py | ✅ PASS | 28.5s | $0.03 |
| 01_standalone_sdk/03_activate_skill.py | ✅ PASS | 25.6s | $0.03 |
| 01_standalone_sdk/05_use_llm_registry.py | ✅ PASS | 10.2s | $0.01 |
| 01_standalone_sdk/07_mcp_integration.py | ✅ PASS | 35.5s | $0.03 |
| 01_standalone_sdk/09_pause_example.py | ✅ PASS | 14.1s | $0.01 |
| 01_standalone_sdk/10_persistence.py | ✅ PASS | 24.3s | $0.02 |
| 01_standalone_sdk/11_async.py | ✅ PASS | 28.7s | $0.04 |
| 01_standalone_sdk/12_custom_secrets.py | ✅ PASS | 15.0s | $0.01 |
| 01_standalone_sdk/13_get_llm_metrics.py | ✅ PASS | 28.4s | $0.03 |
| 01_standalone_sdk/14_context_condenser.py | ✅ PASS | 3m 4s | $0.18 |
| 01_standalone_sdk/17_image_input.py | ✅ PASS | 22.0s | $0.02 |
| 01_standalone_sdk/18_send_message_while_processing.py | ✅ PASS | 26.3s | $0.02 |
| 01_standalone_sdk/19_llm_routing.py | ✅ PASS | 18.9s | $0.02 |
| 01_standalone_sdk/20_stuck_detector.py | ✅ PASS | 15.9s | $0.02 |
| 01_standalone_sdk/21_generate_extraneous_conversation_costs.py | ✅ PASS | 12.3s | $0.00 |
| 01_standalone_sdk/22_anthropic_thinking.py | ✅ PASS | 18.6s | $0.01 |
| 01_standalone_sdk/23_responses_reasoning.py | ✅ PASS | 49.7s | $0.01 |
| 01_standalone_sdk/24_planning_agent_workflow.py | ✅ PASS | 5m 49s | $0.36 |
| 01_standalone_sdk/25_agent_delegation.py | ✅ PASS | 1m 28s | $0.08 |
| 01_standalone_sdk/26_custom_visualizer.py | ✅ PASS | 24.7s | $0.03 |
| 01_standalone_sdk/28_ask_agent_example.py | ✅ PASS | 47.2s | $0.03 |
| 01_standalone_sdk/29_llm_streaming.py | ✅ PASS | 40.0s | $0.02 |
| 01_standalone_sdk/30_tom_agent.py | ✅ PASS | 11.3s | $0.01 |
| 01_standalone_sdk/31_iterative_refinement.py | ✅ PASS | 4m 31s | $0.26 |
| 01_standalone_sdk/32_configurable_security_policy.py | ✅ PASS | 19.4s | $0.02 |
| 01_standalone_sdk/33_hooks/main.py | ✅ PASS | 36.4s | $0.04 |
| 01_standalone_sdk/34_critic_example.py | ✅ PASS | 27.8s | $0.02 |
| 01_standalone_sdk/36_event_json_to_openai_messages.py | ✅ PASS | 15.2s | $0.00 |
| 01_standalone_sdk/37_llm_profile_store/main.py | ✅ PASS | 6.3s | $0.00 |
| 01_standalone_sdk/38_browser_session_recording.py | ✅ PASS | 40.0s | $0.04 |
| 01_standalone_sdk/39_llm_fallback.py | ✅ PASS | 12.5s | $0.01 |
| 01_standalone_sdk/40_acp_agent_example.py | ✅ PASS | 47.8s | $0.34 |
| 01_standalone_sdk/41_task_tool_set.py | ✅ PASS | 36.6s | $0.03 |
| 01_standalone_sdk/42_file_based_subagents.py | ✅ PASS | 42.8s | $0.04 |
| 01_standalone_sdk/44_model_switching_in_convo.py | ✅ PASS | 13.5s | $0.01 |
| 01_standalone_sdk/45_parallel_tool_execution.py | ✅ PASS | 3m 0s | $0.33 |
| 01_standalone_sdk/46_agent_settings.py | ✅ PASS | 12.9s | $0.01 |
| 01_standalone_sdk/47_defense_in_depth_security.py | ✅ PASS | 4.6s | $0.00 |
| 01_standalone_sdk/48_conversation_fork.py | ✅ PASS | 21.7s | $0.01 |
| 01_standalone_sdk/49_switch_llm_tool.py | ✅ PASS | 8.0s | $0.04 |
| 01_standalone_sdk/50_async_cancellation.py | ✅ PASS | 15.4s | $0.00 |
| 01_standalone_sdk/51_agent_hooks/main.py | ✅ PASS | 37.6s | $0.06 |
| 01_standalone_sdk/52_dynamic_workflow.py | ✅ PASS | 2m 53s | $0.13 |
| 01_standalone_sdk/53_client_defined_tools.py | ✅ PASS | 18.2s | $0.01 |
| 01_standalone_sdk/54_goal_completion_loop.py | ✅ PASS | 26.8s | $0.02 |
| 01_standalone_sdk/55_persistent_memory.py | ✅ PASS | 18.2s | $0.02 |
| 01_standalone_sdk/56_structured_output.py | ✅ PASS | 31.4s | $0.04 |
| 01_standalone_sdk/57_prompt_hooks/main.py | ✅ PASS | 11.9s | $0.00 |
| 01_standalone_sdk/58_ask_oracle_tool/main.py | ✅ PASS | 15.6s | $0.01 |
| 01_standalone_sdk/59_route_task_to_model.py | ✅ PASS | 11.3s | $0.05 |
| 02_remote_agent_server/01_convo_with_local_agent_server.py | ✅ PASS | 42.7s | $0.02 |
| 02_remote_agent_server/02_convo_with_docker_sandboxed_server.py | ✅ PASS | 55.0s | $0.04 |
| 02_remote_agent_server/03_browser_use_with_docker_sandboxed_server.py | ✅ PASS | 3m 1s | $0.17 |
| 02_remote_agent_server/04_convo_with_api_sandboxed_server.py | ✅ PASS | 1m 20s | $0.04 |
| 02_remote_agent_server/06_custom_tool/main.py | ✅ PASS | 5m 8s | $0.03 |
| 02_remote_agent_server/07_convo_with_cloud_workspace.py | ✅ PASS | 38.2s | $0.03 |
| 02_remote_agent_server/08_convo_with_apptainer_sandboxed_server.py | ✅ PASS | 3m 56s | $0.03 |
| 02_remote_agent_server/09_acp_agent_with_remote_runtime.py | ✅ PASS | 1m 55s | $0.44 |
| 02_remote_agent_server/10_cloud_workspace_share_credentials.py | ❌ FAIL Exit code 1 |
14.1s | -- |
| 02_remote_agent_server/11_conversation_fork.py | ✅ PASS | 53.9s | $0.00 |
| 02_remote_agent_server/12_settings_and_secrets_api.py | ✅ PASS | 2m 25s | $0.02 |
| 02_remote_agent_server/13_workspace_get_llm.py | ✅ PASS | 31.7s | $0.01 |
| 02_remote_agent_server/14_client_defined_tools.py | ✅ PASS | 36.7s | $0.02 |
| 02_remote_agent_server/15_openai_compatible_gateway.py | ✅ PASS | 24.3s | $0.04 |
| 02_remote_agent_server/16_deferred_init.py | ✅ PASS | 21.7s | $0.01 |
| 04_llm_specific_tools/01_gpt5_apply_patch_preset.py | ✅ PASS | 38.1s | $0.02 |
| 04_llm_specific_tools/02_gemini_file_tools.py | ✅ PASS | 46.3s | $0.08 |
| 05_skills_and_plugins/01_loading_agentskills/main.py | ✅ PASS | 15.4s | $0.02 |
| 05_skills_and_plugins/02_loading_plugins/main.py | ✅ PASS | 25.4s | $0.03 |
| 05_skills_and_plugins/04_mixed_marketplace_skills/main.py | ✅ PASS | 9.2s | $0.00 |
❌ Some tests failed
Total: 70 | Passed: 69 | Failed: 1 | Total Cost: $3.64
Failed examples:
- examples/02_remote_agent_server/10_cloud_workspace_share_credentials.py: Exit code 1
Contributor
🧪 Integration Tests ResultsOverall Success Rate: 100.0% 📁 Detailed Logs & ArtifactsClick the links below to access detailed agent/LLM logs showing the complete reasoning process for each model. On the GitHub Actions page, scroll down to the 'Artifacts' section to download the logs.
📊 Summary
📋 Detailed Resultslitellm_proxy_anthropic_claude_sonnet_4_6
litellm_proxy_gemini_3.1_pro_preview
litellm_proxy_deepseek_deepseek_v4.1_flash
Skipped Tests:
litellm_proxy_openai_gpt_5.5
|
Contributor
🧪 Behavior Tests ResultsOverall Success Rate: 100.0% 📁 Detailed Logs & ArtifactsClick the links below to access detailed agent/LLM logs showing the complete reasoning process for each model. On the GitHub Actions page, scroll down to the 'Artifacts' section to download the logs.
📊 Summary
📋 Detailed Resultslitellm_proxy_openai_gpt_5.5
litellm_proxy_deepseek_deepseek_v4.1_flash
litellm_proxy_gemini_3.1_pro_preview
litellm_proxy_anthropic_claude_sonnet_4_6
litellm_proxy_minimax_MiniMax_M2.7
|
VascoSch92
approved these changes
Oct 21, 2026
VascoSch92
left a comment
VascoSch92
left a comment
Member
There was a problem hiding this comment.
I checked the security issues and there are no problems.
Moreover, I check the failing example and it is not related to the release. Same for the integration test which is failing.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Release v1.57.0
This PR prepares the release for version 1.57.0.
Started by: @VascoSch92
Release Checklist
integration-test)behavior-test)test-examples)security-scan)release-note-requiredPRs are accurately called out in the final release notesWhat happens on merge
When this PR is merged, the
create-release.ymlworkflow will automatically:v1.57.0and auto-generated notes, plus an explicit preamble for mergedrelease-note-requiredPRsv1.57.0version-bump-prs.ymlafter successful PyPI publication🐳 Agent Server images for this PR — GHCR package, pull/run commands, and all pushed tags (click to expand)
• GHCR package: https://github.com/OpenHands/agent-sdk/pkgs/container/agent-server
Variants & Base Images
eclipse-temurin:17-jdkpython-node-runtimepython-node-runtimepython-node-runtimegolang:1.21-bookwormPull (multi-arch manifest)
# Each variant is a multi-arch manifest supporting both amd64 and arm64 docker pull ghcr.io/openhands/agent-server:01da2c8-pythonRun
All tags pushed for this build
About Multi-Architecture Support
01da2c8-python) is a multi-arch manifest supporting both amd64 and arm6401da2c8-python-amd64) are also available if needed