-
Notifications
You must be signed in to change notification settings - Fork 28
feat: Add Runway video generation service for Issue #303 #304
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
feat: Add Runway video generation service for Issue #303 #304
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This PR is being reviewed by Cursor Bugbot
Details
Your team is on the Bugbot Free tier. On this plan, Bugbot will review limited PRs each billing cycle for each member of your team.
To receive Bugbot reviews on all of your PRs, visit the Cursor dashboard to activate Pro and start your 14-day free trial.
b223cf2 to
9bb6b61
Compare
9bb6b61 to
7b2c884
Compare
Adds RunwayService for video generation using Runway ML API. This fills a gap in the generative miner - video modality now has an API service. Features: - Text-to-video generation - Image-to-video (animate still images via URL or bytes) - Gen-3 Alpha Turbo model support - 5 or 10 second video clips - Aspect ratios: 1280:768 (landscape), 768:1280 (portrait) - Configurable via RUNWAY_MODEL and RUNWAY_DEFAULT_DURATION env vars Tested with real API - video generation works correctly. Complements PR BitMind-AI#301 (StabilityAI for images) - this PR adds video support. Closes BitMind-AI#303
7b2c884 to
412472e
Compare
|
@dylanuys Please check the PR and give me your feedback. |
dylanuys
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please attach a generated mp4 file (or send to @_dubm on discord if too large for github) so that I can verify c2pa metadata for Runway data.
|
@dylanuys Just added the test video file. Runway videos include proper C2PA Content Credentials signed by RUNWAY AI, INC. with AI generation assertions. |
Resolves conflict in service_registry.py by including both stabilityai and runway services.
- Re-raise AssertionError so test_invalid_api_key properly fails if API unexpectedly succeeds - Delete env var in finally block when original was None, matching pattern from test_model_env_validation
feat: Add Runway video generation service
Summary
Adds
RunwayServicefor video generation using Runway ML API. This fills a critical gap in the generative miner - the video modality now has an API-based service option.Closes #303
Motivation
Currently, generative miners can only generate videos using local models, which requires significant GPU resources. This PR adds Runway ML as an API-based alternative, enabling miners to participate in video generation tasks without local GPU infrastructure.
This complements PR #301 (StabilityAI for images) - together they provide complete API coverage for both modalities.
Changes
neurons/generator/services/runway_service.pyneurons/generator/services/service_registry.py.env.gen_miner.templatedocs/Generative-Mining.mdtests/generator/runway_service.pyFeatures
RUNWAY_MODELandRUNWAY_DEFAULT_DURATIONenv varsRUNWAY AI, INC.Configuration
Testing
All tests pass with real API:
Implementation Notes
stabilityai_service.pyandopenai_service.pyprocess()method to match existing servicesChecklist
RUNWAY AI, INC.Note
Add Runway ML video generation service with registry integration, env/docs configuration, and tests.
RunwayService(neurons/generator/services/runway_service.py): Implements Runway ML video generation with text-to-video and image-to-video, polling/status handling, aspect ratio selection, 5/10s durations, and env-configurable model/duration; exposes service info and API key requirements.neurons/generator/services/service_registry.py): AddsrunwaytoSERVICE_MAP; updates modality selection to allowVIDEO_SERVICE=runwayand documents options..env.gen_miner.template): AddsRUNWAYML_API_SECRETand optionalRUNWAY_MODEL/RUNWAY_DEFAULT_DURATION; updates service selection notes and API key links.docs/Generative-Mining.md): Adds Runway service section with features, pricing, and setup instructions.tests/generator/runway_service.py): Tests aspect ratio conversion, service info, invalid modality, env model validation, happy-path generation, and invalid API key handling.Written by Cursor Bugbot for commit 6a7c800. This will update automatically on new commits. Configure here.
Contribution by Gittensor, learn more at https://gittensor.io/