m-bain Goto Github PK

bert-as-service

Mapping a variable-length sentence to a fixed-length vector using BERT model

chimp-detector

clip

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

clip-hitchhiker

A Clip-Hitchiker's Guide to Long Video Retrieval [Arxiv 2022]

collaborative-experts

Video embeddings for retrieval - code for the paper "Use What You Have: Video retrieval using representations from collaborative experts"

conceptual-12m

Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.

condensedmovies

Story-Based Retrieval with Contextual Embeddings. Largest freely available movie video dataset. [ACCV'20]

condensedmovies-chall

Condensed Movies Challenge 2021

frozen-in-time

Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval [ICCV'21]

hydra

Hydra is a framework for elegantly configuring complex applications

lavis

LAVIS - A One-stop Library for Language-Vision Intelligence

meeteval

paddleocr

Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provide data annotation and synthesis tools, support training and deployment among server, mobile, embedded and IoT devices)

primate-behaviour-recognition

Automated Audiovisual Behaviour Recognition in Wild Primates

pyannote-audio

Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding

pytorch-image-models

PyTorch image models, scripts, pretrained weights -- (SE)ResNet/ResNeXT, DPN, EfficientNet, MixNet, MobileNet-V3/V2, MNASNet, Single-Path NAS, FBNet, and more

pytorch-multi-label-classifier

A pytorch implemented classifier for Multiple-Label classification

simplediarization

Simple Diarization model

slurm_gpustat

A simple command line tool to show GPU usage on a SLURM cluster

torchvggish

Pytorch port of Google Research's VGGish model used for extracting audio features.

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

video-transformers

Implementations of Transformers for Video

video2dataset

Easily create large video dataset from video urls

video_features

Extract video features from raw videos using multiple GPUs. We support RAFT and PWC flow frames as well as S3D, I3D, R(2+1)D, VGGish, CLIP, ResNet features.

web-retrieval-demo

webvid

Large-scale text-video dataset. 10 million captioned short videos.

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

whisper-asr-webservice

OpenAI Whisper ASR Webservice API

whisperx

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)