GithubHelp home page GithubHelp logo

reactalk's People

Contributors

alyu201 avatar meganlim97 avatar

Watchers

 avatar

reactalk's Issues

Command processor: editing commands #2

Is your feature request related to a problem? Please describe.
Editing commands need to be implemented.

Describe the solution you'd like
Each user input command needs to be mapped to the corresponding action.

Checklist for the issue creation
Commands to be implemented:

  • delete constant
  • delete variable
  • delete let
  • delete function
  • copy function
  • copy constant
  • copy variable
  • copy let
  • paste
  • rename constant
  • rename let
  • rename variable
  • rename function
  • rename element

Navigation processor: navigation commands #3

Is your feature request related to a problem? Please describe.
Navigation commands are needed for the user to navigate around VScode.

Describe the solution you'd like
For the user to intuitively and easily navigate around VScode.

Checklist for the issue creation

  • Completed all the planned navigation commands
  • Went through a test run of these commands to see if they are good enough to be used in the evaluation.

Command processor: system commands

Is your feature request related to a problem? Please describe.
All system commands need to be implemented.

Describe the solution you'd like
The voice inputs should be defined and mapped to associated actions.

Checklist for the issue creation
The current commands to implement:

  • Save file

System processor: system commands #3

Is your feature request related to a problem? Please describe.
System commands are needed for the user to handle files, terminals and terminal commands.

Describe the solution you'd like
The user can intuitively and easily use these commands to help them program using voice.

Checklist for the issue creation

  • Completed all the planned system commands
  • Went through a test run of these commands to see if they are good enough to be used in the evaluation.

MVP command processor: map inputs to defined actions

Is your feature request related to a problem? Please describe.
Text transcriptions received from Google Speech API needs to be mapped to a defined action in the system.

Describe the solution you'd like
Input as text transcriptions from Google should be analysed and mapped to the correct command action or code snippet to be executed.

Checklist for the issue creation

  • A way to access and execute the command processor with inputs
  • Mapping logic for different command categories
  • Output generation to VSCode
  • One command from each category
    • Composition: For loop
    • Editing: Delete line
    • Navigation: Go to start/end of line
    • System: undo/redo

Command processor: navigation commands #2

Is your feature request related to a problem? Please describe.
Navigation commands need to be implemented.

Describe the solution you'd like
Each user input command needs to be mapped to the corresponding action.

Checklist for the issue creation
Commands to be implemented:

  • TBD

Command processor: composition commands #3

Is your feature request related to a problem? Please describe.
Some additional composition commands considered core need to be implemented.

Describe the solution you'd like
The code composition commands specified by the user should be mapped to the corresponding code snippets.

Checklist for the issue creation

  • add string
  • add keyword (gives the user more flexibility in the command to say)
  • add array

Command processor: navigation commands

Is your feature request related to a problem? Please describe.
All navigation commands need to be implemented.

Describe the solution you'd like
The voice inputs should be defined and mapped to associated actions.

Checklist for the issue creation
Current commands to implement:

  • Go up | down | left | right

2-word Nav commands not working

Describe the bug
Nav commands that only contain 2-words are not working. E.g. Focus editor, Focus up/down

To Reproduce
Steps to reproduce the behavior:

  1. Say a 2-word Nav command

Expected behavior

  • The 2-word Nav commands are supposed to work as expected.

Command processor: system commands #2

Is your feature request related to a problem? Please describe.
System commands need to be implemented.

Describe the solution you'd like
Each user input command needs to be mapped to the corresponding action.

Checklist for the issue creation
Commands to be implemented:

  • TBD

Command processor: composition commands #2

Is your feature request related to a problem? Please describe.
Composition commands need to be implemented.

Describe the solution you'd like
The code composition commands specified by the user should be mapped to the corresponding code snippets.

Checklist for the issue creation
Composition commands to be implemented:

  • add constant
  • add variable
  • add let
  • add function
  • add comment
  • add conditional
  • add indent
  • add newline
  • add while
  • add switch/case
  • add symbol
  • add else if/else
  • add condition

Input processor: Integrate Google Speech API

Is your feature request related to a problem? Please describe.
Our solution needs to use Google Speech API to convert the voice into text.

Describe the solution you'd like
Integrating Google Speech API into the Input processor.

Checklist for Issue Creation

  • Add label(s) to this issue
  • Add issue to project

System commands #4

Is your feature request related to a problem? Please describe.
Adding the final system commands needed for evaluations.

Describe the solution you'd like
All the current system commands should be working and sufficient for evaluations.

Composition processor: composition commands #4

Is your feature request related to a problem? Please describe.
There should be support for React state management and imports.

Describe the solution you'd like

  • Commands for useState and useEffect React hooks (the more commonly used ones).
  • All required imports should be automatically added.
  • There should also be the option for manual adding of import statements.

Checklist for the issue creation

  • add use state
  • add use effect
  • add arrow function
  • add component (functional component)
  • add element button (name)
  • add javascript expression

Editing processor: editing commands #3

Is your feature request related to a problem? Please describe.
Editing commands need to be implemented.

Describe the solution you'd like
Each user input command needs to be mapped to the corresponding action.

Checklist for the issue creation
Commands to be implemented:

  • delete right
  • delete left

Composition & editing command fixes

Is your feature request related to a problem? Please describe.
Composition commands need some fixing

Describe the solution you'd like
All composition issues fixed

Checklist for the issue creation

  • Change add indent to add tab
  • Add/use components need to have PascalCase names
  • Use state should have set automatically
  • Name of constants of use states needs to be camelCase
  • Might be good to have a ‘add space’ command
  • Need to consider comma-separated inputs - temporary fix to make the command be picked up by the inputProcessor

Navigation commands #4

Is your feature request related to a problem? Please describe.
Adding the final navigation commands needed for evaluations.

Describe the solution you'd like
All the current navigation commands should be working and sufficient for evaluations.

Command processor: composition commands

Is your feature request related to a problem? Please describe.
All composition commands need to be implemented.

Describe the solution you'd like
The voice inputs should be defined and mapped to associated code snippets.

Checklist for the issue creation
Current commands to implement:

  • Add element with no attributes:
    • <div> = "container"
    • <p> = "paragraph"
    • <h1-6> = "heading 1-6"
    • <ul><li> = "unordered list"
    • <ol><li> = "ordered list"
  • Add element with one attribute (implicitly requires "add text" command):
    • <a href> = "anchor"
    • <img src> = "image"

Select line <num> bug issue

Describe the bug
"select line " command was not working.

To Reproduce
Steps to reproduce the behavior:

  1. Say 'select line ' and it will not work.

Expected behavior
It is suppose to select line

Command processor: editing commands

Is your feature request related to a problem? Please describe.
All editing commands need to be implemented.

Describe the solution you'd like
The voice inputs should be defined and mapped to associated actions.

Checklist for the issue creation
Current commands to implement:

  • Delete element:
    • <div> = "container"
    • <p> = "paragraph"
    • <h1-6> = "heading 1-6"
    • <ul><li> = "unordered list"
    • <ol><li> = "ordered list"
    • <a href> = "anchor"
    • <img src> = "image"

Extension configurations and setup

Is your feature request related to a problem? Please describe.
A UI for the extension will help with the usability of the extension

Describe the solution you'd like
Configure and setup the extension on the activity bar for users to access

image
image

Checklist for the issue creation

  • An icon on the activity bar to show a primary sidebar
  • A button to start Reactalk (pause/stop are voice commands)
  • Show a list of possible commands to execute for the user
  • Indicator light to indicate the status of Reactalk (started/paused/stopped)
  • The command transcription should be shown
  • A list of possible symbols

System processor: system commands #3

Is your feature request related to a problem? Please describe.
Finish the core system commands.

Describe the solution you'd like
It should have all the core system commands that we have planned.

Checklist for the issue creation

  • retitle file
  • start listening
  • pause listening
  • stop listening

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.