Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
google
artemis
Repository navigation
Code
Issues
47
(47)
Pull requests
93
(93)
Discussions
Actions
Projects
Security and quality
Insights
More
items
feat: local multimodal agent platform — Gemma 4 E4B + Flash loop
- #176
#176
Draft
banggaoo
wants to merge 60 commits into
google:main
google/artemis:main
from
banggaoo:feat/gemma4-upstream
banggaoo/artemis:feat/gemma4-upstream
Copy head branch name to clipboard
Conversation
Commits
60
(60)
Checks
Files changed
Draft
feat: local multimodal agent platform — Gemma 4 E4B + Flash loop
#176
banggaoo
wants to merge 60 commits into
google:main
google/artemis:main
from
banggaoo:feat/gemma4-upstream
banggaoo/artemis:feat/gemma4-upstream
Copy head branch name to clipboard
Commits
Commits on Oct 7, 2026
feat: route LLM endpoints to local OpenAI-compatible providers
Show description for b0fad5d
banggaoo
committed
b0fad5d
View commit details
Copy full SHA for b0fad5d
Browse repository at this point
feat: prepare multimodal unification for Gemma 4 E4B
Show description for ee3931a
banggaoo
committed
ee3931a
View commit details
Copy full SHA for ee3931a
Browse repository at this point
test: reset the Apple Vision OCR breaker counter between tests
banggaoo
committed
27006da
View commit details
Copy full SHA for 27006da
Browse repository at this point
Commits on Oct 9, 2026
feat: gate local model installs through the readiness engine
Show description for edde23d
banggaoo
committed
edde23d
View commit details
Copy full SHA for edde23d
Browse repository at this point
fix: use the gemma4-e4b alias actually served by the platform
banggaoo
committed
fcbaec1
View commit details
Copy full SHA for fcbaec1
Browse repository at this point
Bind ARTEMIS to the local platform: gemma4-e4b default, vision-hybrid OCR
Show description for bb43c5f
banggaoo
committed
bb43c5f
View commit details
Copy full SHA for bb43c5f
Browse repository at this point
Bind vision nodes to gemma4-e4b; vision-hybrid reserved as OCR route
Show description for 837d53f
banggaoo
committed
837d53f
View commit details
Copy full SHA for 837d53f
Browse repository at this point
Route perform_ocr through platform vision-hybrid (ARTEMIS_OCR_PROVIDER=platform)
Show description for 5f2d1a9
banggaoo
committed
5f2d1a9
View commit details
Copy full SHA for 5f2d1a9
Browse repository at this point
Remove apple_vision_ocr worker; vision-hybrid is the OCR path
Show description for 636c8fa
banggaoo
committed
636c8fa
View commit details
Copy full SHA for 636c8fa
Browse repository at this point
Revert platform OCR wiring: ARTEMIS stays a consumer, unchanged
Show description for cbefe03
banggaoo
committed
cbefe03
View commit details
Copy full SHA for cbefe03
Browse repository at this point
fix: object_detector uses yx_1000 for gemma4-e4b
Show description for 44187a9
banggaoo
committed
44187a9
View commit details
Copy full SHA for 44187a9
Browse repository at this point
fix: provider compatibility and prompt discipline for local gemma4-e4b
Show description for 4f751d4
banggaoo
committed
4f751d4
View commit details
Copy full SHA for 4f751d4
Browse repository at this point
docs: mark on-device lightweight VLMs roadmap item delivered
banggaoo
committed
068c0f3
View commit details
Copy full SHA for 068c0f3
Browse repository at this point
docs: add on-device gemma4-e4b execution evidence screenshots
banggaoo
committed
65a26b1
View commit details
Copy full SHA for 65a26b1
Browse repository at this point
docs: local models guide; generic pull hint for non-platform servers
banggaoo
committed
58d1282
View commit details
Copy full SHA for 58d1282
Browse repository at this point
refactor: keep local-model support server-agnostic; drop platform-specific references
banggaoo
committed
6dad0c2
View commit details
Copy full SHA for 6dad0c2
Browse repository at this point
Commits on Oct 10, 2026
feat: artemis model CLI pulls and serves local models itself
Show description for 2c39050
banggaoo
committed
2c39050
View commit details
Copy full SHA for 2c39050
Browse repository at this point
feat: vision soft-token budget for managed local serving
Show description for c80f651
banggaoo
committed
c80f651
View commit details
Copy full SHA for c80f651
Browse repository at this point
fix: image-first ordering at remaining text-first multimodal sites
banggaoo
committed
ba580f8
View commit details
Copy full SHA for ba580f8
Browse repository at this point
feat: mark_done completion affordance; all-resolved plans terminate via settlement
banggaoo
committed
5d50d3a
View commit details
Copy full SHA for 5d50d3a
Browse repository at this point
feat: console-guided local model setup — readiness card, managed pull/serve/stop endpoints
banggaoo
committed
f75b596
View commit details
Copy full SHA for f75b596
Browse repository at this point
docs: mark_done/blocked-plan termination contract; console Run buttons for model lifecycle
banggaoo
committed
0e5eea4
View commit details
Copy full SHA for 0e5eea4
Browse repository at this point
fix: harden Flash tool-call resolution for local VLM servers
banggaoo
committed
e118e48
View commit details
Copy full SHA for e118e48
Browse repository at this point
Commits on Oct 14, 2026
feat: add System-One decision layer client and planner-validation offload
banggaoo
committed
f27b9f5
View commit details
Copy full SHA for f27b9f5
Browse repository at this point
feat: hybrid Flash loop — VLM describes, decision model picks the action
Show description for b20aa8e
banggaoo
committed
b20aa8e
View commit details
Copy full SHA for b20aa8e
Browse repository at this point
feat: managed laya-serve lifecycle; decision plumbing; idle-turn re-observation
banggaoo
committed
c68011f
View commit details
Copy full SHA for c68011f
Browse repository at this point
Commits on Oct 15, 2026
fix: mask already-tried actions from the hybrid menu; escalate on repeats
banggaoo
committed
770f3d3
View commit details
Copy full SHA for 770f3d3
Browse repository at this point
fix: goal-anchored decision question; enumerate all elements in describe
banggaoo
committed
b502faf
View commit details
Copy full SHA for b502faf
Browse repository at this point
fix: escalate terminal picks to VLM verification; describe names the reach-path
banggaoo
committed
1d8aebb
View commit details
Copy full SHA for 1d8aebb
Browse repository at this point
fix: ground hybrid plan on first observation instead of planning blind
banggaoo
committed
4b7a732
View commit details
Copy full SHA for 4b7a732
Browse repository at this point
fix: plan prompt requires goal-path milestones, not element inventory
banggaoo
committed
9315a69
View commit details
Copy full SHA for 9315a69
Browse repository at this point
feat: TARGET visibility gate — decision model only picks on-screen elements
banggaoo
committed
0af4925
View commit details
Copy full SHA for 0af4925
Browse repository at this point
feat: goal-token visibility gate — VLM navigates when no menu label matches the goal
banggaoo
committed
cfdfade
View commit details
Copy full SHA for cfdfade
Browse repository at this point
fix: same-turn tool-call re-ask; menu-size-aware laya floor; deterministic am-start app launch
banggaoo
committed
1029056
View commit details
Copy full SHA for 1029056
Browse repository at this point
fix: correct retry variable name in same-turn re-ask
banggaoo
committed
b5f92dc
View commit details
Copy full SHA for b5f92dc
Browse repository at this point
feat: index stateful controls with live on/off state in the element list
banggaoo
committed
05e4711
View commit details
Copy full SHA for 05e4711
Browse repository at this point
fix: mask only dead taps — screen-change-gated repeat tracking + verbatim-call detection
banggaoo
committed
ee400a6
View commit details
Copy full SHA for ee400a6
Browse repository at this point
fix: restore single-screenshot tail contract; block-list retry notice; update stale provider and image-first test assertions
banggaoo
committed
e4779b6
View commit details
Copy full SHA for e4779b6
Browse repository at this point
feat: verify completed reports at the terminal boundary — Pro final check gates release, rejects feed verdicts back, budget-exhausted blocks as failed
banggaoo
committed
8a38522
View commit details
Copy full SHA for 8a38522
Browse repository at this point
fix: route TARGET:reached describes to VLM verification; retry degenerate system-windows-only hierarchy captures
banggaoo
committed
832fbb9
View commit details
Copy full SHA for 832fbb9
Browse repository at this point
feat: last-action outcome in decision state; describe reports control state; TARGET:reached escalates
banggaoo
committed
1f6f2aa
View commit details
Copy full SHA for 1f6f2aa
Browse repository at this point
fix: repeat notices name navigation alternatives and escalate to honest failure after streak 3
banggaoo
committed
da74892
View commit details
Copy full SHA for da74892
Browse repository at this point
fix: suppress verbatim dead call sets — answer with an error and nav alternatives instead of re-tapping
banggaoo
committed
af959c2
View commit details
Copy full SHA for af959c2
Browse repository at this point
fix: detect A-B-A screen alternation (ping-pong) cycles that verbatim tracking misses
banggaoo
committed
7a0b048
View commit details
Copy full SHA for 7a0b048
Browse repository at this point
fix: fail fast after three verbatim re-issues of a suppressed dead call
banggaoo
committed
b6989d9
View commit details
Copy full SHA for b6989d9
Browse repository at this point
Commits on Oct 16, 2026
fix: grace window on device-offline — poll for return instead of failing queued tasks instantly
banggaoo
committed
d2ad38a
View commit details
Copy full SHA for d2ad38a
Browse repository at this point
fix(flash): render goal and plan into hybrid plan/describe prompts
banggaoo
committed
9ca0fbd
View commit details
Copy full SHA for 9ca0fbd
Browse repository at this point
chore: keep local model PR scoped to Flash lifecycle
banggaoo
committed
c3fc63c
View commit details
Copy full SHA for c3fc63c
Browse repository at this point
Commits on Oct 17, 2026
feat(flash): deterministic goal-invariant guards
Show description for 4beece3
banggaoo
committed
4beece3
View commit details
Copy full SHA for 4beece3
Browse repository at this point
feat(flash): expose unlabeled control state to verification
Show description for 78c3bff
banggaoo
committed
78c3bff
View commit details
Copy full SHA for 78c3bff
Browse repository at this point
feat(flash): declare goal invariants via agent.flash config
Show description for fdd9460
banggaoo
committed
fdd9460
View commit details
Copy full SHA for fdd9460
Browse repository at this point
fix(flash): re-observe before evaluating goal invariants
Show description for 1eb0a15
banggaoo
committed
1eb0a15
View commit details
Copy full SHA for 1eb0a15
Browse repository at this point
feat(flash): dense-UI grounding guards verified on a live dial-pad task
Show description for cb76d8b
banggaoo
committed
cb76d8b
View commit details
Copy full SHA for cb76d8b
Browse repository at this point
fix(flash): hit-test coordinate taps against the described target
Show description for 9017775
banggaoo
committed
9017775
View commit details
Copy full SHA for 9017775
Browse repository at this point
docs: coordinate-tap hit-testing and stale-dump oracle evidence
banggaoo
committed
85aca0b
View commit details
Copy full SHA for 85aca0b
Browse repository at this point
Commits on Oct 18, 2026
test(flash): reproducible 102-run live suite; E4B verifies 52.9% on complex UI
banggaoo
committed
2a0537c
View commit details
Copy full SHA for 2a0537c
Browse repository at this point
feat(flash): order screenshot last in observation block for prefix-cache reuse
Show description for a9d8b28
banggaoo
committed
a9d8b28
View commit details
Copy full SHA for a9d8b28
Browse repository at this point
test(flash): update observation-block order assertions for image-last tail
banggaoo
committed
77786d6
View commit details
Copy full SHA for 77786d6
Browse repository at this point
test(flash_live): raise task budgets so max_turns binds before the wall clock
Show description for 997165f
banggaoo
committed
997165f
View commit details
Copy full SHA for 997165f
Browse repository at this point
docs: record APC re-run results - 23/34 verified, zero timeouts
banggaoo
committed
4a8f0e2
View commit details
Copy full SHA for 4a8f0e2
Browse repository at this point
You can’t perform that action at this time.
