Skip to main content

toCaptions()v4.0.216

Converts the output from transcribe() into an array of Caption objects, so you can use the functions from @remotion/captions.

generate-captions.mjs
tsx
import {toCaptions, transcribe} from '@remotion/install-whisper-cpp';
import path from 'path';
 
const whisperCppOutput = await transcribe({
  inputPath: '/path/to/audio.wav',
  whisperPath: path.join(process.cwd(), 'whisper.cpp'),
  model: 'medium.en',
  tokenLevelTimestamps: true,
});
 
const {captions} = toCaptions({
  whisperCppOutput,
});
 
console.log(captions); /*
 [
    {
      text: "William",
      startMs: 40,
      endMs: 420,
      timestampMs: 240,
      confidence: 0.813602,
    }, {
      text: " just",
      startMs: 420,
      endMs: 650,
      timestampMs: 480,
      confidence: 0.990905,
    }, {
      text: " hit",
      startMs: 650,
      endMs: 810,
      timestampMs: 700,
      confidence: 0.981798,
    }
  ]
*/
generate-captions.mjs
tsx
import {toCaptions, transcribe} from '@remotion/install-whisper-cpp';
import path from 'path';
 
const whisperCppOutput = await transcribe({
  inputPath: '/path/to/audio.wav',
  whisperPath: path.join(process.cwd(), 'whisper.cpp'),
  model: 'medium.en',
  tokenLevelTimestamps: true,
});
 
const {captions} = toCaptions({
  whisperCppOutput,
});
 
console.log(captions); /*
 [
    {
      text: "William",
      startMs: 40,
      endMs: 420,
      timestampMs: 240,
      confidence: 0.813602,
    }, {
      text: " just",
      startMs: 420,
      endMs: 650,
      timestampMs: 480,
      confidence: 0.990905,
    }, {
      text: " hit",
      startMs: 650,
      endMs: 810,
      timestampMs: 700,
      confidence: 0.981798,
    }
  ]
*/

See also​