ckenst / selenium-rspec.rb

Front-end automation using Ruby, RSpec and Selenium

Hi there, I'm Chris 👋

• 🤖 Engineering Director
• 🔭 Maintainer of Testing Conferences
• 📫 Find me on: Twitter or LinkedIn
• ✍️ Writing at Kenst.com

A little more about me 👇:

let chriskenst = {
  workRole: "Engineering Director",
  otherRoles: [
    "President of the Association for Software Testing",
    "Writer",
    "Occasional Speaker",
    "Built and Maintains an OSS list of testing conferences and workshops",
  ],
  Interests: ["Systems Thinking", "Test Design", "Teaching", "Bias in AI"],
  Tools: ["VS Code", "Git", "Docker", "Cypress", "WebDriverIO"],
  Websites: {
    Blog: "https://www.kenst.com",
    Conferences: "https://testingconferences.org",
    AST: "https://www.associationforsoftwaretesting.org/"
  },
};

selenium-rspec.rb's Issues

Use examples of commented code vs documenting code

https://softwareengineering.stackexchange.com/questions/51307/self-documenting-code-vs-commented-code

Are there ways to create examples using both

• commented code
• documented code
• Is there a real difference?

Update or remove Vendor files

We have a few options:

1. Update the vendor files
2. Remove them and figure how to use the gem-helpers

Write better specs

Try these examples: http://www.betterspecs.org/

1. describe -> I think we now use RSpec.describe
2. context -> adds more context around the tests
3. it -> contains the test

Failed test: Run the Frequency Report

Description:

Describe your test result, describe what you were trying to do.

Steps to reproduce issue:
Open the Frequency Report on Staging for Statins.
Go through each tab / view.

Expected result (optional):
Data is present for each view

Details:
T6: Run the Frequency Report
https://dre.testrail.net/index.php?/tests/view/6

Create an example test that pulls from ENV file

Create an example test that has a few secret / special ENV variables, stored in an ENV file that we load using this library: https://github.com/bkeepers/dotenv

Run FR failed?

Yes that's the report

Failed test: Run the Frequency Report

%tests:comment

%

T6: Run the Frequency Report
https://dre.testrail.net/index.php?/tests/view/6

Is this how we file a bug with HipTest?

Try to upload a file

let's see how well file uploads work (if they do at all):

• http://elementalselenium.com/tips/1-upload-a-file
• http://the-internet.herokuapp.com/upload
• https://saucelabs.com/resources/articles/best-practices-tips-selenium-file-upload
• https://gist.github.com/santiycr/1508946#file-testing_upload_se2_sauce-rb

Many / most tests are failing

I think the inclusion of spec_helper, et. al. created conflicts and now many / most tests fail.

Some exploratory bug

T4: Exploratory Session
https://dre.testrail.net/index.php?/tests/view/4

Pull out the Docker example

The docker example should live in it's own repo. It can't be run with all of the rest of these.

Blocked test: Run the Frequency Report

Description:

Describe your test result, describe what you were trying to do.

Steps to reproduce issue:

Open the Frequency Report on Staging for Statins.
Go through each tab / view.

Details:

T6: Run the Frequency Report
https://dre.testrail.net/index.php?/tests/view/6

Update Base page object

Make sure we have refactored this to:

• wait & display at the same time as part of the same method
• identify similar ways to reduce methods

Try out Zalenium

• Maybe this is for it's own repo?
• https://github.com/zalando/zalenium -> try this out

Move more of the tests into page objects

• Split Test(s)
• Load Test

Update all gems

Add a headless chrome example

Add a separate test using chrome headlessly

Add Gems for drivers

• https://github.com/flavorjones/chromedriver-helper
• https://github.com/DevicoSolutions/geckodriver-helper

Take A Screenshot On Failure

• http://elementalselenium.com/tips/16-take-screenshot-on-failure
• Add more examples where we take screenshots if the tests fail

Refactor tests to start referencing base page object methods

• Refactor tests to start referencing base page object methods
• Remove references to initialize method

Failed test: Run the Frequency Report

Comments:
This is my comment

Details:
T6: Run the Frequency Report
https://dre.testrail.net/index.php?/tests/view/6

Open the Frequency Report on Staging for Statins.
Go through each tab / view.

Data is present for each view

Update gemfile.lock without installing gems

• Run bundle lock --update
• https://stackoverflow.com/questions/26335777/updating-gemfile-lock-without-installing-

Bug reported from test: Login

My actions were as follows:

1. Login: Username

Get the URL of the current page

Add a test that uses an assertion on the current url of the page.

• http://www.rubydoc.info/gems/selenium-webdriver/0.0.28/Selenium/WebDriver/Driver#current_url-instance_method
• https://stackoverflow.com/questions/27775466/assert-command-for-checking-the-url-in-selenium-webdriver

Test: Run the Frequency Report

Description:

Describe your test result, describe what you were trying to do.

Steps to reproduce issue:

Open the Frequency Report on Staging for Statins.
Go through each tab / view.

Expected result (optional):

Data is present for each view

Details:

T6: Run the Frequency Report
https://dre.testrail.net/index.php?/tests/view/6

Failed test: Run the Frequency Report

Comment / Description:
This doesn't sound like much for a description.

Details:
T6: Run the Frequency Report
https://dre.testrail.net/index.php?/tests/view/6

Steps to reproduce issue:
Open the Frequency Report on Staging for Statins.
Go through each tab / view.

Data is present for each view

Failed test: Run the Frequency Report

Comment / Description:
This doesn't sound like much

Steps to reproduce issue:
Open the Frequency Report on Staging for Statins.
Go through each tab / view.

Expected result (optional):
Data is present for each view

Details:
T6: Run the Frequency Report
https://dre.testrail.net/index.php?/tests/view/6

Failed test: Run the Frequency Report

Nooo!

T2: Run the Frequency Report
https://dre.testrail.net/index.php?/tests/view/2

Move TODO items here

Take things out of the README file, under the TODO section and add them as issues.

Test for Broken images

• https://elementalselenium.com/tips/67-broken-images

Test setup with REST APIs

• https://elementalselenium.com/tips/24-rest-apis

Update directory structure

1. Forms directory for login form page objects
2. What other examples?

Failed test: Run the Frequency Report

Not again!

T2: Run the Frequency Report
https://dre.testrail.net/index.php?/tests/view/2

Testing more styling updates

Description:

Describe your test result, describe what you were trying to do.

Steps to reproduce issue:

Open the Frequency Report on Staging for Statins.
Go through each tab / view.

Expected result (optional):

Data is present for each view

Details:

T6: Run the Frequency Report
https://dre.testrail.net/index.php?/tests/view/6

Pull out the Headless example

We already have this as a gist. We can probably keep it as that. Add link from README to GIST.

remove visual testing examples

port them to our visual testing repo

Update dir structure as necessary

1. Forms directory for login form page objects
2. What other examples?

Update README

• Remove references to being able to run at Sauce Labs
• Eventually make note that Sauce Labs credentials are in .env file.

Update to Selenium 3.0

Update the gems / tests in this folder to Selenium 3.

Set localStorage for navigating a page with AB Tests

• http://www.rubydoc.info/gems/selenium-webdriver/Selenium/WebDriver/HTML5/LocalStorage
• http://www.rubydoc.info/gems/selenium-webdriver/Selenium/WebDriver/Driver#capabilities-instance_method
• This is what we ended up doing: http://stackoverflow.com/questions/36344137/how-to-start-browser-in-webdriver-with-custom-localstorage-set

Login

Description

Log in to the application

Steps to reproduce issue

1. Load https://thisfakeurl.com
2. Login using my user + my password
3. Dashboard displayed!

Actual result

there was no dashboard!

Other information

Reported by: Chris Kenst

Test case number: TC01

Test run: https://dre.testlodge.com/projects/17787/runs/212219?tab=2&run_section_id=209539&executed_case_id=10031345#executed_case_10031345

Run against multiple browsers

http://elementalselenium.com/tips/41-one-test-multiple-browsers

Can I write a better example of this using a ruby loop and one that runs & updates the name of each test accordingly?

Continue to experiment with Container

1. Can we run tests from container? Update docker file to also download the selenium chrome/standalone container for running
2. What else?