pkmital Goto Github PK
Name: Parag K Mital
Type: User
Bio: Artist and researcher with 20+ years experience in AI and computational arts
Twitter: pkmital
Location: Los Angeles, CA
Blog: https://pkmital.com
Name: Parag K Mital
Type: User
Bio: Artist and researcher with 20+ years experience in AI and computational arts
Twitter: pkmital
Location: Los Angeles, CA
Blog: https://pkmital.com
A working example of nginx+flask+postgres multi-container setup using Docker Compose
CARPE is "Computational Algorithmic Representation and Processing of Eye-movements". It supports visualizations of film/eye-movements in columnar format, peak-through visualizations, heatmaps, optical flow analysis, gaze clustering, and many other visualization options. CARPE using NSWindow, Multiple Heatmaps, XML file settings, Difference of Heatmaps, GPU optimizations
openFrameworks addon for visualizing and interfacing with pre-trained models in Caffe: Convolutional Architectures for Fast Feature Embedding. Requires Caffe, openFrameworks 64-bit, glog, hdf5, OpenCV, CUDA, pkmMatrix, and pkmHeatmap. Pre-trained models not included but can be found linked in Caffe's "Model Zoo" and placed in the bin/data directory of the example project.
simple way to stream 32-bit float data from itunes in real-time
ofxOpenCV linking against OpenCV 2.4.6.1, including libraries for OSX
Ph.D. Thesis from Goldsmiths, University of London entitled, "Audiovisual Scene Synthesis". Hosts all images and latex files.
Sound synthesis library. Implements a number of feature databses including frame-based, segment-based, and sequence-based audio analysis/storing/retrieval. Also includes libraries for GPS-based synthesis including binarualization retrieval. Complements many other libraries including pkmBinaural and Memory Mosaic. Heavy dependence on vectorized ops using pkmMatrix and OSX's library Accelerate.
For performing GPS based concatenative sound synthesis, ANN retrieval based on GPS locations, HRTF based binauralization (mono->stereo using HRTF FFT-based Overlap-Add Convolution) using the IRCAM HRTF Database
Background modeling for foreground subtraction, tracks multiple blobs (people), their orientations (using leading motion vector), and has a nice visual display for seeing the results... video demonstration here: http://vimeo.com/22054133 - more info here: http://pkmital.com
track overhead using color and map tracked points to a new geometry using a homography transformation and calibration routine - some example test videos are provided in the bin/data directory of an overhead capture. The tracking transformation is useful for when you need a defined metric space of your tracking parameters, or need to account for different user heights in tracking their paths in a space.
3d Object Tracking and Pose Estimation for the iPhone
Interfacing libcluster for doing Variational Dirichlet Process Gaussian Mixture Models. Depends on Eigen3 and pkmMatrix. Libcluster included.
pkmEXTAudioFileReader and pkmEXTAudioFileWriter provides simple interfaces to reading and writing audio files.
facial shape modeling, appearance modeling, and head pose recognition. Uses Jason Mora Saragih's FaceTracker code to track facial landmarks; GreatYao's aam-library for building/reprojecting the model (which may in fact be an uncited port of Jason's DeMoLib).
pkmFFT provide simple interfaces to the Accelerate.framework for performing vectorized FFT. pkmSTFT builds on pkmFFT to perform Short Time Fourier Transform efficiently using vectorized ops. Also handles options for windowing. pkmDCT provides a simple discrete cosine transform using Accelerate and pkmMatrix.
GPU Shader implementation of common heatmap/colormaps for mapping grayscale->colormap such as JET, COOL, HOT, difference heatmaps which map to similar ranges, and support for sending point list for creating a Gaussian Mixture Model which can be visualized as a heatmap or readback for your own purposes..
Kalman filter optimized for iOS/OSX
Locality Sensitive Hashing
pkmMatrix provides a lightweight Matrix class using the Accelerate.framework for vectorized operations
Interface for OpenCV's TV-L1 Duality Based Approach to Optical Flow. Does some additional tricks to speed up processing, allow for analysis of the spatio-temporal changes in flow, and visualize the results.
Phase vocoder using pkmFFT and pkmMatrix. Does not seem to do as well as commerical applications. Would love it if anyone made use of this and improved upon it.
Calibrate head pose with respect to a screen (television/monitor) for an attention-based measure. Uses Jason Mora Saragih's FaceTracker, please contact him for the code.
openFrameworks based projection mapping for distorting or mapping a collection of drawing commands/videos/images etc... needed a lightweight and robust projection mapping utility though lpmt was too heavy. homography code stolen from lpmt.
quadtree
For streaming/recording audio files, circular buffers (see pkmMatrix and pkmEXTAudioFile as well)
Creates a dense SIFT image description and displays the image based on a PCA reprojection. Based on SIFT Flow code by Ce Lui, Jenny Yuen, and Antonio Torralba.
Python package with source code from the course "Creative Applications of Deep Learning w/ TensorFlow"
Minimum-distortion embedding with PyTorch
real time object detection using opencv and simple UI to select the object to track
Code from the Responsive Ecologies exhibition. Using overhead motion capture and 4 channels of video projection, users are invited to interact in an immersive cinematic environment. This code was developed for the installation in Waterman's Art Centre, London, UK, where artists captincaptin and Parag K Mital have been collaborating to install their piece, "Responsive Ecologies" for their residency during December 2010 and January 2011. The work occurs as part of a larger on-going collaboration with ZSL London Zoo and the Musion Academy.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.