doytsujin / android-vad

This VAD library can process audio in real-time utilizing GMM which helps identify presence of human speech in an audio sample that contains a mixture of speech and noise.

Android Voice Activity Detection (VAD)

This VAD library can process audio in real-time utilizing Gaussian Mixture Model (GMM) which helps identify presence of human speech in an audio sample that contains a mixture of speech and noise. VAD work offline and all processing done on device.

Library based on WebRTC VAD from Google which is reportedly one of the best available: it's fast, modern and free. This algorithm has found wide adoption and has recently become one of the gold-standards for delay-sensitive scenarios like web-based interaction.

If you are looking for a higher accuracy and faster processing time I recommend to use Deep Neural Networks(DNN). Please see for reference the following paper with DNN vs GMM comparison.

Parameters

VAD library only accepts 16-bit mono PCM audio.

Valid sample rates are 8000, 16000, 32000 and 48000 Hz.

Frame size can be 80, 160, 240, 320, 480, 640, 960 or 1440 bytes depending on the sample rate.

Classifier supports NORMAL, LOW_BITRATE, AGGRESSIVE and VERY_AGGRESSIVE modes.

Silence duration (ms) - this parameter used in Continuous Speech detector, the value of this parameter will define the necessary and sufficient duration of negative results to recognize it as silence.

Voice duration (ms) - this parameter used in Continuous Speech detector, the value of this parameter will define the necessary and sufficient duration of positive results to recognize result as speech.

Recommended parameters:

• sample rate - 16KHz,
• frame size - 480,
• mode - VERY_AGGRESSIVE,
• silence duration - 500ms,
• voice duration - 500ms;

Usage

VAD supports 2 different ways of detecting speech:

1. Continuous Speech detector was designed to detect long utterances without returning false positive results when user makes pauses between sentences.

 Vad vad = new Vad(VadConfig.newBuilder()
                .setSampleRate(VadConfig.SampleRate.SAMPLE_RATE_16K)
                .setFrameSize(VadConfig.FrameSize.FRAME_SIZE_480)
                .setMode(VadConfig.Mode.VERY_AGGRESSIVE)
                .setSilenceDurationMillis(500)
                .setVoiceDurationMillis(500)
                .build());

        vad.start();
        
        vad.isContinuousSpeech(short[] audioFrame, new VadListener() {
            @Override
            public void onSpeechDetected() {
                //speech detected!
            }

            @Override
            public void onNoiseDetected() {
                //noise detected!
            }
        });
        
        vad.stop();

2. Speech detector was designed to detect speech/noise in small audio frames and return result for every frame. This method will not work for long utterances.

 Vad vad = new Vad(VadConfig.newBuilder()
                .setSampleRate(VadConfig.SampleRate.SAMPLE_RATE_16K)
                .setFrameSize(VadConfig.FrameSize.FRAME_SIZE_480)
                .setMode(VadConfig.Mode.VERY_AGGRESSIVE)
                .build());

        vad.start();
        
        boolean isSpeech = vad.isSpeech(short[] audioFrame);
        
        vad.stop();

Requirements

Android VAD supports Android 4.1 (Jelly Bean) and later.

Development

To open the project in Android Studio:

1. Go to File menu or the Welcome Screen
2. Click on Open...
3. Navigate to VAD's root directory.
4. Select setting.gradle

Download

Gradle is the only supported build configuration, so just add the dependency to your project build.gradle file:

1. Add it in your root build.gradle at the end of repositories:

allprojects {
   repositories {
     maven { url 'https://jitpack.io' }
   }
}

2. Add the dependency

dependencies {
    implementation 'com.github.gkonovalov:android-vad:1.0.0'
}

You also can download precompiled AAR library and APK files from GitHub's releases page.

---

Georgiy Konovalov 2019 (c) MIT License