madwort / improv-analysis

Improv Analysis

Interactive visualisation for Rodrigo Constanzo's improvisation self-reflection framework.

Contents

• a Wordpress plugin to store improv analyses in a database
  • mostly written in PHP/MySQL, but uses $wpdb object & hides behind the Wordpress login
• a standalone PHP script to dump out analyses as JSON
• analysis visulation
  • written in JS

Install

Wordpress plugin

• get plugin files to Wordpress install
  • e.g. cp -r plugin/ $WORDPRESS_PATH/wp-content/plugins/improv-analysis-2.0
  • OR ln -s ~user/improv-analysis-2.0/plugin $WORDPRESS_PATH/wp-content/plugins/improv-analysis-2.0
• enable plugin
• go to the "install" page of the plugin & create the tables!

Standalone PHP script

• create plugin/db_config.php from the template in plugin/db_config_sample.php

Analysis visualisation

• install nodejs
  • ubuntu12: https://rtcamp.com/tutorials/nodejs/node-js-npm-install-ubuntu/
  • ubuntu18: https://www.digitalocean.com/community/tutorials/how-to-install-node-js-on-ubuntu-18-04
• sudo npm install -g bower
• bower install
• mv bower_components plugin/

Datafiles

• audio file readable by Web Audio API in your browser of choice (eg. MP3)

CSV file - improv analysis format

"time","streamid","comment"
00:02.000,3,"Rhythm not responding like I would like. Adjust."
00:04.000,3,"Rhythm density to liking, prepare to play percussion."
00:06.000,1,"Reset mind."

• time is mm:ss.0000
• streamid is
  • 1: Material
  • 2: Formal
  • 3: Interface
  • 4: Interaction

CSV file - Reaper format

#,Name,Start
M1,Not Sure what to do,0:01.729
M2,Initial hesitation,0:02.716
M3,"Impulsive start (Inner monologue: ""Just GO, FFS"")",0:03.500

• time is mm:ss.0000

Licence

• New code: Not known...
• Portions written by oncletom under unknown licence

References

d3

• http://d3js.org

charts

• https://github.com/PMSI-AlignAlytics/dimple/wiki/dimple
• http://dc-js.github.io/dc.js/ (alternative, not used)

data processing

• https://github.com/mbostock/d3/wiki/CSV#parse
• http://misoproject.com/dataset/examples.html (alternative, not used)

time formats

• http://en.wikipedia.org/wiki/ISO_8601
• https://github.com/mbostock/d3/wiki/Time-Formatting
• https://github.com/mbostock/d3/wiki/Time-Intervals

js range sliders

• http://ionden.com/a/plugins/ion.rangeSlider/demo.html
• http://refreshless.com/nouislider/ (alternative, not used)

waveform-view

• https://github.com/bbcrd/waveform-data.js
• http://bl.ocks.org/oncletom/5822102
• http://waveform.prototyping.bbc.co.uk

html5 audio playback

• https://developer.mozilla.org/en-US/docs/Web/Guide/HTML/Using_HTML5_audio_and_video

improv-analysis's Issues

trend lines wiggly/jiggly when events are within milliseconds of each other

Trend chart in standalone and plugin version has angled line in trend charts:

http://rodrigoconstanzo.com/analyses/?q=pa1
http://rodrigoconstanzo.com/analyses/?q=otto1

Time display is incorrect

Zoom bars & waveform hover both display incorrectly calculated timestamp. Probably due to calculation being hardcoded for old 960px wide display & not adjusted for new 500px wide display.

wget should grab all necessary resources

Necessary resources (mp3/csv) files are loaded by javascript, which works ok in a browser but if you wget an analysis page it does not execute the javascript so does not archive these files.

Zoom bar time display is incorrect

Better time marker spacing on bubble chart

eg. https://madwort.co.uk/wp-content/plugins/improv-analysis-2.0/?id=cath1
should not be every 10sec - maybe a set number of markers?

Migrate from bower to ??

Seems bower is old hat now, figure out a new way to collect the JS files we depend on

zoom=true does not display correct file/data

zoom=true displays default (Everything (1a)) play/zoom bar no matter what data is loaded.

[improv-analysis unique_name="analysis2" audio_url="http://www.rodrigoconstanzo.com/analyses/Everything 1b.mp3" data_url="http://www.rodrigoconstanzo.com/analyses/Everything 1b.csv" audio_length="165.887" left_bound="0" right_bound="165.887" bubble_chart=true waveform=true zoom=true]

Waveform rending bug in safari - analysis rod1

For some reason this analysis:
http://rodrigoconstanzo.com/analyses/?q=rod1

Only renders the first 40seconds of the image in Safari 9.02, whereas Firefox 39 renders the whole thing correctly.

I've emptied cache, and tried it on multiple computers, and still nothing.

long text doesn’t wrap right in bubble display

comedy improv (http://rodrigoconstanzo.com/analyses/?q=ucb) - material event at 2:04

Possibly deprecated by new bubble hover display design (issue tbc)

still some trend line funny business in one analysis

for some reason the trend line here still goes odd:
http://www.rodrigoconstanzo.com/analyses/?q=ucb

at 1:30 and 1:38 or thereabouts. looking through the csv there isn't anything weird in the data, other than it being higher granularity than other timings:
01:29.994->01:30.560->01:33.286
01:37.895->01:38.654->01:45.740

add spectogram view

https://github.com/vlandham/spectrogramJS

requires #22

Re-build wordpress shortcode plugin on v2 branch

• Replaces #10
• Use diff version-1.0..wordpress-plugin-1.0 for ideas
• also want to do somethings slightly differently

trend line showing value for PREVIOUS duration vs current one

possibly deprecated by #9

Create decision event data replacement link for existing analyses

Supplements #25

Draw regression lines using d3 rather than dimple

Drawing them with dimple is buggy #8 so do it directly.

(Low priority)

Merge master & wordpress-plugin branches

A few minor API changes between the two branches that need reconciling.

Implement support for uploading Reaper CSV files

waveform zoom not working with left/right bound

Using following shortcode still shows complete waveform display.

[improv-analysis unique_name="analysis13" audio_url="http://www.rodrigoconstanzo.com/analyses/PA 1.mp3" data_url="http://www.rodrigoconstanzo.com/analyses/PA 1.csv" audio_length="363.408" left_bound="82" right_bound="96" waveform=true bubble_chart=true activity_log=true]

Waveform hover time display is incorrect

Create bulk upload for analysis database

id	name	title	display title	date filmed	date analyzed	duration	id	instruments	performers	analysis linked to	type	stream meth.	comments	keywords	media url	direct link
	Rodrigo Constanzo	Everything. Everything at once. Once. (1a)	Constanzo - Everything at once. (1a)	28 October 2013	29 October 2013	209.629	1a	drums + electronics	1		improvisation	1	Analysis created before system conceived.	ciat-lonbarde, drums, percussion, synth, dmx, light	https://www.youtube.com/watch?v=i3tYa2N9fm4	http://rodrigoconstanzo.com/analyses/?q=1a
	Rodrigo Constanzo	Everything. Everything at once. Once. (1b)	Constanzo - Everything at once. (1b)	28 October 2013	30 October 2013	165.887	1b	drums + electronics	1		improvisation	1	Analysis created before system conceived.	ciat-lonbarde, drums, percussion, synth, dmx, light	https://www.youtube.com/watch?v=1FKE3D7swWY	http://rodrigoconstanzo.com/analyses/?q=1b

Rename streamid to stream_id

To better fit the naming scheme...

trend line ‘corners’ have blue lines that point to edges but give no values (there are blue points along the whole line)

Possibly deprecated by #9

“stream recession” text in trend chart gets cut off (on Firefox)

Upgrade dependencies

• d3 to v5
• waveform-js to v2
• ...?

may require #23

activity log not working with left/right bound

The following shortcode shows complete activity log regardless of the bounding.

[improv-analysis unique_name="analysis13" audio_url="http://www.rodrigoconstanzo.com/analyses/PA 1.mp3" data_url="http://www.rodrigoconstanzo.com/analyses/PA 1.csv" audio_length="363.408" left_bound="82" right_bound="96" waveform=true bubble_chart=true activity_log=true]