uvavision / chat-crowd

[NAACL 2019] A web interface for collecting dialog data for interactive drawing of 2D shapes

chat-crowd

How to run?

1. create a virtual environment with Python 3.6
2. pip install -r requirements.txt
3. cd main
4. python run.py
5. visit http://localhost:8080.

2D Shape Dialog

Painter's View

Instructor's View

COCO Image Layout Dialog

Painter's View

Instructor's View

chat-crowd's Issues

reset canvas

add button to reset the canvas?

clean up html

once we thoroughly test the combined version, let's remove all the commented (old) code in the html files.

2D shape synthetic data generation

• images - reference
  https://github.com/alsuhr-c/nlvr-baselines

• instruction patterns / dialog acts - randomly generated instructions with(out) image references?
  TEXT PATTERN || ACTIONS || RESULTED LAYOUT
  draw a {color} {shape} // new // obj1-(x, y)
  place a {color} {shape} to the left of obj1 // new // obj1-(x,y), obj2-(x-1, y)

• added gold and noise - evaluate painters' actions
  e.g., add {obj1} above {obj2} while {obj2} is missing

painter tool is not showing

html

• history.html is missing?

• instruction_agent.html and instruction_use.html to be removed?

py file refactor

• move coco2db*.py to core folder ?

• rename "coco2db_2Dshape.py" (e.g., "layout2db" ?) and the variables in it, since it has nothing to do with coco data?

post processing

• rename folder "crowdflower" to "crowdsourcing"

• add code to "crowdsourcing" module - for downloading the collected data from remote mongoDB server? backups shouldn't be only on the same server.

• commit add other data post processing code (analysis.py) somewhere, which may not be included for open source version.

update config

• remove all hardcoded "deep.cs.virginia.edu" CF api key, CF job id etc. to config file

re-position the 2D shapes in instructor's task

so that the instructors wouldn't guess the position by (x, y)

update image collection

• update config files - "coll_coco_anno" --> "coll_image_anno" and rename the collection (remove coco)

• update or remove the collection "coll_coco_anno_test", currently, "coll_coco_anno_test" is not working