Problem saving audioBuffer to file - whisper api

[terse fox]

Hi,

how can i convert the audioBuffer into a e.g. wav file?

I want to use whisper for spech regognition.

this is my code:

    tmp.file({ postfix: ".ogg" }, (err, path, fd, cleanup) => {
      if (err) {
        reject(err);
        return;
      }

      fs.writeFile(path, msg.audioBuffer, (err) => {
        if (err) {
          reject(err);
          return;
        }

        resolve({ path, cleanup });
      });
    });
  });

The file is written successfully, but I can't play it (unrecognized file format)

I also tried to post audioBuffer directly, but that doesn't work either.

  const transcription = await openai.audio.transcriptions.create({
    file: audioBuffer,
    model: "whisper-1",
    response_format: "verbose_json",
    timestamp_granularities: ["word"],
  });
}```

error: BadRequestError: 400 Could not parse multipart form
      at APIError.generate (/home/git/discord-speech-recognition/examples/simpleBot/node_modules/openai/error.js:44:20)
      at OpenAI.makeStatusError (/home/git/discord-speech-recognition/examples/simpleBot/node_modules/openai/core.js:263:33)
      at OpenAI.makeRequest (/home/git/discord-speech-recognition/examples/simpleBot/node_modules/openai/core.js:306:30)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
      at async Object.resolveSpeechWithWhisper [as speechRecognition] (/home/git/discord-speech-recognition/examples/simpleBot/index.js:20:25) {

```"@discordjs/opus": "^0.8.0",
    "@discordjs/voice": "^0.11.0",
    "discord-speech-recognition": "^3.4.1",
    "discord.js": "^14.3.0",
    "dotenv": "^16.4.5",
    "openai": "^4.29.2",
    "tmp": "^0.2.3",
    "tweetnacl": "^1.0.3"```


Can anyone help me with this? Thanks

[unborn gazelle]

• What's your exact discord.js npm list discord.js and node node -v version?
• Not a discord.js issue? Check out #1081585952654360687.
• Consider reading #how-to-get-help to improve your question!
• Explain what exactly your issue is.
• Post the full error stack trace, not just the top part!
• Show your code!
• Issue solved? Press the button!
• ✅ Marked as resolved by OP

[terse fox]

node: v20.11.0

[terse fox]

Problem saving audioBuffer to file - whisper api

[wheat cloak]

Where does audioBuffer come from?

[terse fox]

im using the SpeechEvents.speech event.

  // If bot didn't recognize speech, content will be empty
  // if (!msg.content) return;

  console.log("msg", msg);

  console.log("audioBuffer type:", typeof msg.audioBuffer);
  console.log("audioBuffer:", msg.audioBuffer);
}```

  intents: [
    GatewayIntentBits.GuildVoiceStates,
    GatewayIntentBits.GuildMessages,
    GatewayIntentBits.Guilds,
    GatewayIntentBits.MessageContent,
  ],
});
addSpeechEvent(client, {
  speechRecognition: resolveSpeechWithWhisper,
  ignoreBots: true,
});

im using this repo https://github.com/Rei-x/discord-speech-recognition

        end: {
          behavior: EndBehaviorType.AfterSilence,
          duration: 300,
        },
      });

      const bufferData: Uint8Array[] = [];
      opusStream
        .pipe(new OpusDecodingStream())
        .on("data", (data: Uint8Array) => {
          bufferData.push(data);
        });

      opusStream.on("end", async () => {
        const voiceMessage = await createVoiceMessage({
          client,
          bufferData,
          user,
          connection,
          speechOptions,
        });

        if (voiceMessage) client.emit(SpeechEvents.speech, voiceMessage);
      });```

this is how audioBuffer is created
https://github.com/Rei-x/discord-speech-recognition/blob/main/src/bot/events/speech.ts

[wheat cloak]

it appears that VoiceMessage class there has a method to do exactly what you want. not djs related, read their documentation instead

msg.saveToFile(...)