sherpa-onnx supports both offline and online speech enhancement with three model families: GTCRN, DPDFNet and VoxLock.
- See also
- SherpaOnnxCreateOfflineSpeechDenoiser, SherpaOnnxCreateOnlineSpeechDenoiser
Offline GTCRN
memset(&config, 0, sizeof(config));
wave->sample_rate);
"./clean.wav");
struct SherpaOnnxOfflineSpeechDenoiser SherpaOnnxOfflineSpeechDenoiser
Opaque offline speech denoiser handle.
void SherpaOnnxDestroyOfflineSpeechDenoiser(const SherpaOnnxOfflineSpeechDenoiser *sd)
Destroy an offline speech denoiser.
const SherpaOnnxDenoisedAudio * SherpaOnnxOfflineSpeechDenoiserRun(const SherpaOnnxOfflineSpeechDenoiser *sd, const float *samples, int32_t n, int32_t sample_rate)
Run offline speech denoising on a complete waveform.
const SherpaOnnxOfflineSpeechDenoiser * SherpaOnnxCreateOfflineSpeechDenoiser(const SherpaOnnxOfflineSpeechDenoiserConfig *config)
Create an offline speech denoiser.
int32_t SherpaOnnxWriteWave(const float *samples, int32_t n, int32_t sample_rate, const char *filename)
Write floating-point PCM to a mono 16-bit WAVE file.
void SherpaOnnxDestroyDenoisedAudio(const SherpaOnnxDenoisedAudio *p)
Destroy denoised audio returned by a speech enhancement API.
Denoised audio returned by offline or online speech enhancement APIs.
Configuration for offline speech denoising.
SherpaOnnxOfflineSpeechDenoiserModelConfig model
SherpaOnnxOfflineSpeechDenoiserGtcrnModelConfig gtcrn
Model file: gtcrn_simple.onnx
Example source: speech-enhancement-gtcrn-c-api.c
Offline DPDFNet
memset(&config, 0, sizeof(config));
float attenuation_limit_db
SherpaOnnxOfflineSpeechDenoiserDpdfNetModelConfig dpdfnet
Model file: dpdfnet_baseline.onnx (also: dpdfnet2.onnx, dpdfnet4.onnx, dpdfnet8.onnx for 16 kHz; dpdfnet2_8khz.onnx, dpdfnet8_8khz.onnx for 8 kHz; and dpdfnet2_48khz_hr.onnx, dpdfnet8_48khz_hr.onnx for 48 kHz)
Example source: speech-enhancement-dpdfnet-c-api.c
Offline VoxLock
VoxLock is a target-speaker voice isolation model: it keeps the voice of one speaker (the caller) and removes the other voices. The model is from https://github.com/arbazsiddiqui/voxlock
memset(&config, 0, sizeof(config));
"./sherpa-onnx-voxlock-int8/test_wavs/en-voice-sample-f.wav";
SherpaOnnxOfflineSpeechDenoiserVoxLockModelConfig voxlock
const char * enroll_model
const char * voice_sample
Model files: enroll.onnx and chunk.onnx (or chunk_int8.onnx) from https://github.com/k2-fsa/sherpa-onnx/releases/tag/speech-enhancement-models
voice_sample is optional: a wave file with at least 3 seconds of the caller's voice. From a longer file, the loudest 3 seconds within its first 30 seconds are used; a file that is shorter or cannot be read is ignored. If it is empty or ignored, the offline denoiser uses the loudest 3 seconds in the first 15 seconds of the input, and the online denoiser passes the audio through unchanged until 3 seconds of speech have been heard, then uses that speech.
Example source: speech-enhancement-voxlock-c-api.c, speech-enhancement-voxlock-with-voice-sample-c-api.c
Online GTCRN
memset(&config, 0, sizeof(config));
int32_t frame_shift =
void SherpaOnnxDestroyOnlineSpeechDenoiser(const SherpaOnnxOnlineSpeechDenoiser *sd)
Destroy an online speech denoiser.
struct SherpaOnnxOnlineSpeechDenoiser SherpaOnnxOnlineSpeechDenoiser
Opaque online speech denoiser handle.
const SherpaOnnxOnlineSpeechDenoiser * SherpaOnnxCreateOnlineSpeechDenoiser(const SherpaOnnxOnlineSpeechDenoiserConfig *config)
Create an online speech denoiser.
int32_t SherpaOnnxOnlineSpeechDenoiserGetFrameShiftInSamples(const SherpaOnnxOnlineSpeechDenoiser *sd)
Return the recommended chunk size in samples for streaming input.
const SherpaOnnxDenoisedAudio * SherpaOnnxOnlineSpeechDenoiserFlush(const SherpaOnnxOnlineSpeechDenoiser *sd)
Flush buffered samples and reset the online denoiser.
Configuration for streaming speech denoising.
SherpaOnnxOfflineSpeechDenoiserModelConfig model
Model file: gtcrn_simple.onnx
Example source: online-speech-enhancement-gtcrn-c-api.c
Online DPDFNet
memset(&config, 0, sizeof(config));
Model files: dpdfnet_baseline.onnx, dpdfnet2.onnx, dpdfnet4.onnx, dpdfnet8.onnx for 16 kHz; dpdfnet2_8khz.onnx, dpdfnet8_8khz.onnx for 8 kHz; and dpdfnet2_48khz_hr.onnx, dpdfnet8_48khz_hr.onnx for 48 kHz.
Example source: online-speech-enhancement-dpdfnet-c-api.c
Online VoxLock
memset(&config, 0, sizeof(config));
Model files: enroll.onnx and chunk.onnx (or chunk_int8.onnx); see se_offline_voxlock for the optional voice_sample and for links to the models.
Example source: online-speech-enhancement-voxlock-c-api.c, online-speech-enhancement-voxlock-with-voice-sample-c-api.c