aenet's Introduction

Audio Event Net

This README shows how to run AENet which classify the audio events. Paper: (https://arxiv.org/abs/1701.00599)

Requirements

Python 2
Lasagne (https://github.com/Lasagne/Lasagne)
HCopy from HTK (http://htk.eng.cam.ac.uk/)

How to use

Prerequisites

Install all requirements. (This repository includes "HCopy" but you probably need to compile on your machine.)
Define the path where you want to keep your models with export AENET_DATA_DIR='YOUR_DATA_PATH'

Run example

Run python run_sample.py to test the installation and see how to use the code.

This sample program reads wave files and stores corresponding AENet features in "ae_feat".
For testing your installation, the sample program also displays the error between your extraction and a reference.
If you got a high error, it might be due to the installtion of "HCopy".

Install as a package

Make sure to have set the data directory: AENET_DATA_DIR
Download the model files by running bin/download.sh
Install the package with python setup.py install
Now you can use it via import aenet

Supported format

Currently only wave file format with 16kHz sampling rate, 16bit, monoral channel is supported. If you would like to extract AENet feature from other format audio files, please first convert it.

For convenience the class aenet.AENet contains the function write_wav which writes the audio stream of a video in the correct format using moviepy.

Known problems

Sometimes, the function write_wav fails, due to a moviepy error. See Zulko/moviepy#377

Reference

If you end up using this code or the pre-trained network, we ask you to cite the following paper:

Naoya Takahashi, Michael Gygli, and Luc Van Gool, "AENet: Learning Deep Audio Features for Video Analysis", arXiv preprint arXiv:1701.00599, 2017.

Recommend Projects