fossee / online_test Goto Github PK

In yaksh/bash_code_evaluator.py

18| def init(self, metadata, test_case_data):

In the next refactor you could actually refactor this to use all keyword args like init(self, user_answer, file_paths, ...) and use **metadata when instantiating it?

This should allow an instructor to create a quiz where users cannot skip a question and can proceed to the next question only when they finish the current question.

Add an field which checks if a given string is not in the submitted code to make sure user is not just returning the answer directly and warn user (and moderator) suitably.

i used "pip install yaksh" it throws a error
Could not find a version that satisfies the requirement yaksh (from versions: )
No matching distribution found for yaksh
please reply asap

This is clearly nonsensical. If I did not finish a problem, it should not say you didn't attempt it, but say you didn't complete it or something more correct.

Proper sphinx documentation and better install + usage instructions.

1. Moderator should be allowed to create a grading scheme for a particular course.
2. Each quiz within a course should have a quiz weightage.

There are reports that this is not working correctly for users.

Currently it seems you can only have one demo instance to play with. Instead of writing the NAME and PATH to the project_details.py it should either write a config file, or expect an additional argument to the path which should be used as the directory with the NAME as the basename of the dir.

The cli.py also does not satisfy PEP 8 and has other issues such as:

1. It does not pass any additional command line args to run_code_server.
2. The demo_settings.py seem to use an older django version. This should be updated.

Moderator testing a particular Trial Quiz is unable to check if Prerequisite is passed or not

Need to change download feature. Instead of separate links give a add a button to download files as zip file.
Need to add validation to check if moderator uploads two files with same name
Add testcase if file does not exists.

We can have a method for error handling, which will produce error in a proper format.

Styling parameters added directly in HTML templates have to be removed and put in respective CSS of the templates.

Need to add support for multiple test case scenarios for each language (Python, C, C++ etc)

Should make it easy to add formulae to questions.

• Add a fill in the blanks style question
• Add an integer answer question
• Add a floating point number answer based question

A course can set prerequisites using this course code. Now instead of implementing this with strings, which is very fragile. We should create a course template which is simply referred to in this particular course. A moderator should be able to then edit and modify this course if needed by adding/removing quizzes, editing quizzes etc.

We should cleanup the project and make it installable via pip/easy_install.

• When filling form to create new Question, add javascript validation to hide/show partial_grading field based on the type of question.
• Add javascript validation to check partial grade total marks should be equal to 1

Questions that are deleted are actually hidden. However even after pseudo-deletion these questions keep showing up when User is trying to add questions to a new QuestionPaper or when filtering Questions.

Also, rejected folks show up all the time, maybe they should not be listed on the right?

This will make it easy to add new questions. It would be nice if the questions could also be saved into a yaml file.

Currently the StdIO evaluator functions properly by using an instance of a generic class. We need to make the following changes;

• Need to create a generic Standard Input/Output evaluator class that can be sub classed for various languages.
• Need to re-factor code in order to eliminate any possible redundancies.

Selenium tests are not being executed for travis CI.

In MCQ type questions, the options should be displayed in html rendered format for multiple line options.

This common function should go into a header file and be included. I think these main files can be actually auto-generated from the test cases desired.

The upload functionality assumes that the questions are saved in questions_dump.json.
I couldn't find any documentation specifying this and the upload page also did not show any errors when I tried to upload the JSON file with a different file name.

For better UI, it would be nice if the upload button is disabled or hidden until the user selects a file to upload or clicking it should directly open up the upload file dialog.

• Checkout source code master
• Step into online_test directory and execute docker build -t yaksha:v1 -f Dockerfile .
• docker images will show the docker image successfully created
• docker run -d -p 8001:8001 -p 53579:53579 yaksha:v1 - start the server

Actual: The container immediately dies. docker logs -f <container_id> shows the following error stack trace. Traceback (most recent call last): File "/src/yaksh/code_server.py", line 51, in <module> from tornado.ioloop import IOLoop ImportError: No module named tornado.ioloop

Expected: Server starts without error inside container and able to access the web ui on :8001

It would be nice if the ordering of the questions was as chosen in the question paper instead of it being based on the key.

Complex test cases . Test case to be simplified

Each course will have a particular access code . The institute or organisation willing to enroll for a particular course, will be given the course code in advance. Once the student logs in, he/she would be asked for a course code on the landing page. On entering the correct course code, the student will be enrolled for that course and the student will only be able to see all the courses that they have enrolled for.

Try setting up a question like so:

Expected input: 55
Expected output:
5
5

Write the solution with Python and the error message is poorly formatted and not at all helpful. Worse, I can't seem to get the right answer no matter what I try. Why is this so difficult?

Or something better could be done.

On a simple test demo instance, if you run sudo yaksh run_code_server, it is unable to create the temporary directory or so leading to an exception like so:

 File "envs/yaksh/lib/python3.5/xmlrpc/client.py", line 1322, in parse_response
    return u.close()
  File "envs/yaksh/lib/python3.5/xmlrpc/client.py", line 655, in close
    raise Fault(**self._stack[0])
xmlrpc.client.Fault: <Fault 1: "<class 'PermissionError'>:[Errno 13] Permission denied: '/var/folders/tr/pfk3lcgd4dndrbppzjwp_tp40000gn/T/output'">

pip installable etc.

The first line must be from testapp.settings import *

Setting database details is different in Django 1.3.
It must be

DATABASES["default"]["ENGINE"] = 'django.db.backends.mysql'
DATABASES["default"]["NAME"] = 'online_test'
DATABASES["default"]["USER"] = 'online_test_user'

from testapp.local import DATABASE_PASSWORD
DATABASES["default"]["PASSWORD"] = DATABASE_PASSWORD

The institute, college, department, email etc. this makes it easy to reject/enroll students.

Right now if it is not an assertion error it doesn't even show the test case. It should really give the user a lot more information so they can debug.

It is annoying to have a useless field when setting a Python question -- the bash command line args field shows up always and this is not nice at all.

This has failed multiple times and no tests catch this. It should be tested.

When a file submission assignment is made it should be possible to run hook code to check it -- this should basically ensure that all the files are made available before the hook code runs.

Please refer to PR #152

• File not found and Default arguments missing should raise an exception in the evaluator
• Code evaluator should return a list of errors
• Evaluators should return a HTML error instead of string blobs

• The application should provide two different Sign Up screens and forms for Students and Moderators
• Creation of a Moderator profileshould automatically assign relevant permission to that profile