Skip to content

Pure image/video tools + local-first history#86

Open
KillerQueen-Z wants to merge 1 commit into
mainfrom
fix/pure-media-tools
Open

Pure image/video tools + local-first history#86
KillerQueen-Z wants to merge 1 commit into
mainfrom
fix/pure-media-tools

Conversation

@KillerQueen-Z

Copy link
Copy Markdown
Collaborator

What

  • Remove the LLM "media router" from ImageGen/VideoGen. It made a second LLM call (on a free NVIDIA model) to rewrite the prompt + pick a model, which hit the gateway's 120s provider timeout and made video generation appear broken to customers. Tools now use exactly the caller's model + prompt.
  • VideoGen keeps a pure price-math cost confirm (no LLM) — only when an onAskUser bridge exists (CLI/agent). Direct callers (desktop) generate immediately.
  • ImageGen is pure direct generation.
  • Delete src/agent/media-router.ts and its local tests.
  • Cloud sync is now opt-in (FRANKLIN_CLOUD_SYNC=on) instead of default-on → desktop is local-first like Claude Code / Codex.

Why

Customer reported 'video generation broken' — root cause was the media-router's free-NVIDIA call timing out at 120s, not the video pipeline (Seedance → token360 is fine).

Verified

  • npm run build clean; 446 local tests pass (media-router tests removed)
  • Live smoke: ImageGen (nano-banana) 8s OK; VideoGen (seedance-2.0-fast) 5s video downloaded OK — both zero LLM, zero NVIDIA

ImageGen and VideoGen no longer call an LLM 'media router' to rewrite the
prompt or pick a model. That second call ran on a free NVIDIA model and hit
the gateway's 120s provider timeout, making video generation appear broken.
The tools now use exactly the model + prompt the caller gives:
- delete src/agent/media-router.ts (+ its local tests)
- videogen: keep a pure price-math cost confirm (no LLM); only prompts when an
  onAskUser bridge exists (CLI/agent), so direct callers generate immediately
- imagegen: pure direct generation

Also make conversation-history cloud sync OPT-IN (FRANKLIN_CLOUD_SYNC=on)
instead of default-on, so the desktop is local-first like Claude Code / Codex.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant