educloudalliance / eca-test Goto Github PK

Travis uses Saucelabs to run the actual browser. Saucelabs provides videos of each test run. URL to the video should be accessible somewhere publicly. The Saucelabs test run page is already public, if you know the direct URL, but it is impossible to match Travis build to Saucelabs test run page.

Currently Dreamschool login url is hardcoded into test. This should be changed so that one travis-ci -run tests both test and production systems.

DoD: travis-ci tests ds.fi/login/educloud-test/ and ds.fi/login/educloud/

Readers aren't necessarily fluent in python code or Selenium testing in general. We should have clear descriptions what the tests are doing and why they are written as they are.

Even better would be to have annotations in the videos!

Goal: We want to continuously test that MPASS login flow works both in testing and production.

Problem: When using Sauce Labs for testing the selenium tool logs key strokes. It doesn't know it is writing key presses to input form that is a password field. For this reason based on the information available in travis-ci logs anyone can access Sauce Labs and see the password entered in testing.

At the moment Sauce Labs does not have support for hiding this information:

• https://saucelabs.ideas.aha.io/ideas/SLIDEA-I-135
• https://support.saucelabs.com/customer/portal/questions/15900681-visibilty-of-tests-and-logs
• https://support.saucelabs.com/customer/portal/questions/14364679-disabling-log-recording-not-working

Even if recodLogs is set to False in selenium browser capabilities it is still possible to see the password from logs.

It is important to keep in mind now and in the future that all keystrokes are logged by Sauce Labs.