An MCP Multimodal AI Agent with eyes and ears!
-
Updated
Jan 5, 2026 - Python
An MCP Multimodal AI Agent with eyes and ears!
A local Model Context Protocol server for building, inspecting, and operating Pixeltable applications.
One video intelligence app built three ways, on Pixeltable, Supabase and Convex. Every number measured, all three executed, tradeoffs stated.
Video moment search API for cooking classes: frame sampling, vision captions, semantic search that returns the mm:ss moment, scene detection and teaser clips · built with Pixeltable
Example notebooks showing how to use Pixeltable with Backblaze B2 for managing and querying multimodal datasets.
A context-aware Discord bot with semantic search and conversational memory. Uses Pixeltable + OpenAI for human-like responses
Scheduled Excel intake pipeline for cheese cave batches and climate loggers, with a local proxy roll-up · built with Pixeltable
Split violin play-test recordings into silence-aware chunks, transcribe luthier voice notes with WhisperX, and evolve the schema safely · built with Pixeltable
Inspect rail yard switch throws from trackside video: keyframe-accurate clips, blade position per clip, a vision-model note with semantic search, and switch-motor run times split from the audio at its silences, all as Pixeltable computed columns and views · built with Pixeltable
A CLI that answers questions about a Git checkout of a static-site generator using Pixeltable sentence chunks and embeddings · built with Pixeltable
Sticky-notes REST API where titles and previews are computed columns, served with FastAPI · built with Pixeltable
Incident intake API for delivery drivers: voice note + photo upload, transcription, Pydantic-validated structured records from a vision model, async dispatch routing and SQL export · built with Pixeltable
Stage-management dashboard for a Twelfth Night rehearsal period: call hours, punctuality, absences and department notes from joins and JSON list functions, plus OpenTelemetry traces of every Pixeltable operation stored back in a table · built with Pixeltable
Neighborhood lost-and-found API: multipart photo and video uploads, thumbnails to a configurable media destination, gpt-4o-mini vision captions, and CLIP search by text or by photo from one FastAPIRouter · built with Pixeltable
Recipe box API with ingredient counts and quick-meal search as computed columns and queries · built with Pixeltable
Hot-air balloon flight log CLI: idempotent batch imports keyed by content hashes, computed burn/propane/payload columns, pxt revert and pxt rename for recovery, and a fingerprint command that rebuilds the cloud deploy fingerprint with Pixeltable's public hashing helpers · built with Pixeltable
Durable, searchable long-term memory for an AI research assistant: per-user semantic recall, retrieval_udf lookups, tool calling and memory consolidation with custom aggregates · built with Pixeltable
A command-line tool for ski-lift turnstiles: passes and gate scans as Pixeltable tables with a computed gate verdict, a per-zone view built with list_iterator, OpenTelemetry span traces of every command, and the same commands against a Pixeltable Cloud database · built with Pixeltable
Architecture-firm drawing archive served to agents over MCP: image sheets with thumbnails, gpt-4o-mini captions and an embedding index in Pixeltable, an MCP server exposing the searches as tools, and a question table whose LLM calls those tools via pxt.mcp_udfs · built with Pixeltable
Procurement approval agent whose every decision is versioned: read the agent's verdicts as of any table version, see why one request was decided the way it was across policy changes, roll back a bad policy rollout with revert() and freeze a quarter-close snapshot · built with Pixeltable
To associate your repository with the pixeltable topic, visit your repo's landing page and select "manage topics."