calesthio/openmontage

dashscope

DashScope (Alibaba Cloud Bailian / 阿里云百炼) integration — image generation (qwen-image-2.0-pro), text-to-speech (qwen3-tts-flash), and ASR with word-level timestamps (qwen3-asr-flash-filetrans).

Voir la source

Mode d’emploi

  1. Copiez la commande et examinez le paquet avant de l’installer dans votre environnement agent.
  2. Consultez le document original pour les outils, identifiants et environnements requis.
  3. Décrivez les entrées et le livrable souhaité ; comparez la sortie aux sources.
npx skills add https://github.com/calesthio/openmontage --skill dashscope

Avant de commencer

  • L’installation n’inclut ni abonnement au modèle, ni quota API, ni accès aux fichiers.
  • Étoiles et installations reflètent l’activité, pas un test indépendant de qualité ou de sécurité.
Document Skill original

Rendu depuis le dépôt source en conservant titres, exemples, code, tableaux, liens et images.

DashScope

Requires DASHSCOPE_API_KEY in .env. Get one at https://dashscope.aliyun.com/.

Current API

CRITICAL: DashScope's /compatible-mode/v1/ only supports /chat/completions and /embeddings. Image generation, TTS, and ASR all use DashScope-native endpoints — not OpenAI-compatible paths.

All three tools use Authorization: Bearer $DASHSCOPE_API_KEY.

Image Generation

text
POST https://dashscope.aliyuncs.com/api/v1/services/aigc/multimodal-generation/generation
  • Model: qwen-image-2.0-pro (default), qwen-image-max, wan2.7-image, z-image-turbo
  • Body: {model, input: {messages: [{role: "user", content: [{text: "prompt"}]}]}, parameters: {size: "W*H", n, prompt_extend, watermark}}
  • Size format uses asterisk: "1024*1024" not "1024x1024"
  • Response: output.choices[0].message.content[0].image (URL, valid ~24h) — must download separately

Text-to-Speech

text
POST https://dashscope.aliyuncs.com/api/v1/services/aigc/multimodal-generation/generation

Same endpoint as image gen, different body.

  • Model: qwen3-tts-flash (default), qwen3-tts-instruct-flash, qwen-tts-2025-05-22
  • Body: {model, input: {text, voice: "Cherry", language_type: "Auto"}}
  • Response: output.audio.url (WAV, valid ~24h) — must download separately

ASR with Word-Level Timestamps

text
POST https://dashscope.aliyuncs.com/api/v1/services/audio/asr/transcription
Header: X-DashScope-Async: enable
  • Model: qwen3-asr-flash-filetrans (NOT qwen3-asr-flash — the sync version has no word timestamps)
  • Body: {model, input: {file_url: "https://public-url/audio.mp3"}, parameters: {enable_words: true, language_hints: ["zh","en"]}}
  • Returns task_id → poll GET /api/v1/tasks/{task_id} until SUCCEEDED → download output.result.transcription_url → JSON with transcripts[].sentences[].words[]
  • Timestamps in begin_time/end_time are in milliseconds — the tool normalizes to seconds

OpenMontage Usage

Image via selector

python
from tools.graphics.image_selector import ImageSelector

result = ImageSelector().execute({
    "preferred_provider": "dashscope",
    "prompt": "一只猫坐在沙发上",
    "output_path": "projects/my-video/assets/images/cat.png",
})

TTS via selector

python
from tools.audio.tts_selector import TTSSelector

result = TTSSelector().execute({
    "preferred_provider": "dashscope",
    "text": "如果 AI 真的会改变未来,普通人到底该怎么参与?",
    "voice": "Cherry",
    "output_path": "projects/my-video/assets/audio/narration.wav",
})

ASR directly (word timestamps for subtitles)

python
from tools.analysis.dashscope_asr import DashscopeAsr

result = DashscopeAsr().execute({
    "audio_url": "https://example.com/narration.wav",
    "output_path": "projects/my-video/assets/audio/transcription.json",
})

# result.data["words"] is a flat list of {text, begin_time_seconds, end_time_seconds}

Recommended Workflow

  1. Image: Generate a sample first. Check prompt_extend: true (default) — DashScope rewrites your prompt for better results. Disable if you need literal prompt adherence.
  2. TTS: Generate a 10-15 second sample before full narration. Approve voice and pacing before committing to full generation.
  3. ASR: Audio must be at a publicly accessible URL. Upload to any public host (S3, etc.) first. Local paths are rejected with a clear error.
  4. Subtitles: Build from result.data["words"] — each word has begin_time_seconds and end_time_seconds. Group words into caption phrases by language semantics, not fixed character count.

Parameters

Image (dashscope_image)

  • prompt (required): text prompt
  • model: default qwen-image-2.0-pro
  • size: default "1024*1024" — asterisk separator, not "x"
  • n: 1-6 images
  • negative_prompt: things to avoid (max 500 chars)
  • prompt_extend: default true — auto-rewrite prompt for better results
  • watermark: default false
  • seed: for reproducibility

TTS (dashscope_tts)

  • text (required): text to synthesize (max 600 chars for qwen3-tts-flash)
  • model: default qwen3-tts-flash
  • voice: default "Cherry" — other voices: "Ethan", "Chelsie", etc.
  • language_type: default "Auto" — "Chinese", "English", "Japanese", "Korean"
  • instructions: natural language delivery instructions (only for qwen3-tts-instruct-flash)

ASR (dashscope_asr)

  • audio_url (required): must be publicly accessible URL
  • model: qwen3-asr-flash-filetrans (only model that supports word timestamps)
  • language_hints: default ["zh", "en"]
  • enable_words: default true — required for word-level timestamps
  • poll_interval_seconds: default 5.0
  • timeout_seconds: default 300

Troubleshooting

  • Image size error: Use "W*H" with asterisk, not "WxH". Example: "2048*2048".
  • TTS no audio URL: Check output.audio.url — if empty, the model name or voice may be wrong.
  • ASR "file not accessible": audio_url must be publicly reachable. DashScope servers fetch the file; local paths and auth-gated URLs don't work.
  • ASR poll timeout: Increase timeout_seconds (default 300). Long audio files take longer to transcribe.
  • ASR no word timestamps: Ensure enable_words: true and model is qwen3-asr-flash-filetrans (not the sync qwen3-asr-flash).
  • Auth error (401): Verify DASHSCOPE_API_KEY is set. Use Authorization: Bearer $KEY header.

Safety

Never print or write the API key to logs, metadata, patches, or project artifacts. .env.example should contain only empty variable names. The tool's _safe_error() method redacts the key from error messages.

Tâches connexes

du même dépôt

Autres Skills

Tous les Skills
calesthio
Communauté

hyperframes-cli

HyperFrames CLI dev loop. Use when running npx hyperframes init, add, catalog, capture, lint, validate, inspect, layout, snapshot, preview, play, render, publish, lambda, doctor, browser, info, upgrade, skills, compositions, docs, benchmark, telemetry, transcribe, tts, or remove-background, or when troubleshooting the HyperFrames build/render environment. Entry point for AWS Lambda cloud rendering (hyperframes lambda deploy / render / progress / destroy / policies).

Installations / 1h
2
GitHub Stars
77,7 k
Mis à jour
3 nov.
calesthio
Communauté

pose-library-design

Design reusable 2D character pose libraries, action cycles, and expression states for data-driven animation.

Installations / 1h
2
GitHub Stars
77,7 k
Mis à jour
3 nov.
calesthio
Communauté

create-video

Create videos from a text prompt using HeyGen's Video Agent. Use when: (1) Creating a video from a description or idea, (2) Generating explainer, demo, or marketing videos from a prompt, (3) Making a video without specifying exact avatars, voices, or scenes, (4) Quick video prototyping or drafts, (5) One-shot prompt-to-video generation, (6) User says "make me a video" or "create a video about X".

Installations / 1h
2
GitHub Stars
75,9 k
Mis à jour
3 nov.
calesthio
Communauté

ffmpeg

Video and audio processing with FFmpeg. Use for format conversion, resizing, compression, audio extraction, and preparing assets for Remotion. Triggers include converting GIF to MP4, resizing video, extracting audio, compressing files, or any media transformation task.

Installations / 1h
2
GitHub Stars
75,9 k
Mis à jour
3 nov.