Trouble converting pyAudio Mic input to VAD frames about py-webrtcvad

[Deamon12]

Damn, I think I got it working.... I had to reset the frame_generator offset to keep it chugging along for each frame.
Still not sure its in a great place, but your lib is detecting speech and chunking off files still. I am hearing some distortion in the recordings however.

    def frame_generator(self, frame_duration_ms, audio, sample_rate):
        """Generates audio frames from PCM audio data.

        Takes the desired frame duration in milliseconds, the PCM data, and
        the sample rate.

        Yields Frames of the requested duration.
        """
        print("len(audio): " + str(len(audio)))
        channels = 2
        n = int(sample_rate * (frame_duration_ms / 1000.0) * channels)
        print("n : " + str(n))
        offset = 0
        timestamp = 0.0
        duration = (float(n) / sample_rate) / channels

        for audioFrame in audio:
            offset = 0  # reset for every frame
            if audioFrame is not None:
                while offset + n < len(audioFrame):
                    yield Frame(audioFrame[offset:offset + n], timestamp, duration)
                    # print("Frame created")
                    timestamp += duration
                    offset += n

[Deamon12]

Eh, nah. I need help with this.
I now have gstreamer pulling audio frames in from an alsasrc. This is working, until I get to passing audio frames to the VAD detection. Blows up after frame_generator.

Errors when attempting to evaluate the frames:
File "SoundDetector.py", line 351, in vad_collector
is_speech = vad.is_speech(frame.bytes, sample_rate)
File "python3.8/site-packages/webrtcvad.py", line 27, in is_speech
return _webrtcvad.process(self._vad, sample_rate, buf, length)

I am struggling with creating the 10, 20, 30 ms segments...

[Deamon12]

I ended up getting it by setting the gstreamer alsasrc 'blocksize' to match pyAudio size. The buffer data was not adequate for the VAD parsing.

works now tho

[alexissinglaire]

I ended up getting it by setting the gstreamer alsasrc 'blocksize' to match pyAudio size. The buffer data was not adequate for the VAD parsing.

works now tho

Hi,

Can i have sample of your code that reading the mic input realtime and output the result into chunks of files?

thanks in advance