Repository navigation
Add Clef Omni audio and video support - #86
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds
@cf/cloudflare/clef-omnitoCloudflareWorkersAIDecisionModel, with optional embeddedaudioandvideosalongside text, JSON, and images. Synchronous REST, asynchronous REST, and Python Worker AI bindings use the existing adapter paths and preserve native answers, probabilities, and token usage. Older Clef models reject audio/video arguments before transport, and the/decisionWorker example forwards the new fields.Adds shared synthetic fixtures for square/circle videos, open/closed speech, video soundtracks, and mixed image/audio/video requests in both supported encodings. Documents media formats and limits, and bumps
langchain-cloudflareto0.4.2with changelog and lockfile updates.Validation:
reject_if_busyoptions.make lint(Ruff, formatting, mypy),pre-commit run --all-files, andgit diff --check: passed.Both integration selections ran without retries or expected failures. REST validation uses default options because Cloudflare's existing native Clef REST validator rejects
options.rejectIfBusywith HTTP 422; that limitation remains unchanged.