getgauge / flash Goto Github PK

It would be good to update readme doc with following information

A) After flash installation ensure that you project's manifest.json file contains flash in the Plugins list.
Something like :
{
"Language": "java",
"Plugins": [
"html-report",
"flash"
]
}

B) Where it find the flash report url

• you can execute the specs using gauge run specs and open the URL shown in console output in browser.

C) How to make url static

• Using FLASH_SERVER_PORT in flash.properties file

Expected behavior
Should be able to install flash

Actual behavior
Getting

Failed to install plugin 'flash'.
Reason: Invalid plugin. Could not download flash-install.json file.

Steps to replicate

• gauge install flash

Version

Gauge version: 0.9.5.nightly-2017-11-23
Commit Hash: 51cfe8d

Plugins
-------
js (2.0.3.nightly-2017-11-23)
screenshot (0.0.1)

Dependabot can't resolve your Go dependency files.

As a result, Dependabot couldn't update your dependencies.

The error Dependabot encountered was:

github.com/getgauge/flash/event: cannot find module providing package github.com/getgauge/flash/event
	github.com/getgauge/flash/gauge_messages: cannot find module providing package github.com/getgauge/flash/gauge_messages
	github.com/getgauge/flash/listener: cannot find module providing package github.com/getgauge/flash/listener

If you think the above is an error on Dependabot's side please don't hesitate to get in touch - we'll do whatever we can to fix it.

View the update logs.

$ gauge -v

Gauge version: 1.0.7
Commit Hash: ed7b4fd6

Plugins

flash (0.0.2)
html-report (4.0.9)
python (0.3.7)
screenshot (0.0.1)
spectacle (0.1.4)
xml-report (0.2.3)

FLASH_SERVER_PORT = 5678

Steps to reproduce:

1. Start running some tests
2. While the first run is in progress, run another tests

Expected results:

Flash should silently fail that the port is used and the execution should continue

Actual results:

Run execution fails when flash tries to access port
gauge run specs/sanity/login/login.spec --log-level debug --machine-readable --fail-safe {"type":"out","message":"gauge run specs/sanity/login/login.spec"} {"type":"out","message":"fail-safe : [true]"} {"type":"out","message":"log-level : [debug]"} {"type":"out","message":"machine-readable : [true]"} {"type":"out","message":"'gauge_environment' set to 'default'"} {"type":"out","message":"Created gauge_screenshots_dir at /home/marius/workspace/auto/figtesting/website_sanity_tests/.gauge/screenshots"} {"type":"out","message":"Plugin flash is already installed."} {"type":"out","message":"Plugin xml-report is already installed."} {"type":"out","message":"Plugin python is already installed."} {"type":"out","message":"Plugin html-report is already installed."} {"type":"out","message":"Plugin spectacle is already installed."} {"type":"out","message":"Parsing started."} {"type":"out","message":"Started concepts parsing."} {"type":"out","message":"102 concepts parsing completed."} {"type":"out","message":"Started specifications parsing."} {"type":"out","message":"1 specifications parsing completed."} {"type":"out","message":"Parsing completed."} {"type":"out","message":"Staring python runner"} {"type":"out","message":"Checking updates..."} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/flash?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} {"type":"out","message":"Python: 3.5.3"} {"type":"out","message":"Loading step implemetations from /home/marius/workspace/auto/figtesting/website_sanity_tests/step_impl dirs."} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/html-report?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/python?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/screenshot?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/spectacle?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/xml-report?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} {"type":"out","message":"Starting TCP server.."} {"type":"out","message":"Connecting to port 40515"} {"type":"out","message":"Established connection to runner."} {"type":"out","message":"Validation started."} {"type":"out","message":"Validation completed."} {"type":"out","message":"Run started"} {"type":"suiteStart"} {"type":"out","message":"Starting Html Report plugin"} {"type":"out","message":"Attempting to connect to grpc server at port: 41105"} {"type":"out","message":"Successfully made the connection with plugin with port: 41105"} {"type":"out","message":"Starting Flash plugin"} {"type":"out","message":"[Flash] Starting progress reporting at http://127.0.0.1:5678"} {"type":"out","message":"2020/02/24 09:13:22 listen tcp 127.0.0.1:5678: bind: address already in use"} {"type":"out","message":"Error occurred while waiting for plugin process to finish."} {"type":"out","message":"Error : exit status 1"}

Notes:

Execution continues successfully when using flash version 0.0.1
See output:
$ gauge run specs/sanity/login/login.spec --log-level debug --machine-readable --fail-safe {"type":"out","message":"gauge run specs/sanity/login/login.spec"} {"type":"out","message":"fail-safe : [true]"} {"type":"out","message":"log-level : [debug]"} {"type":"out","message":"machine-readable : [true]"} {"type":"out","message":"'gauge_environment' set to 'default'"} {"type":"out","message":"Created gauge_screenshots_dir at /home/marius/workspace/auto/figtesting/website_sanity_tests/.gauge/screenshots"} {"type":"out","message":"Plugin flash is already installed."} {"type":"out","message":"Plugin xml-report is already installed."} {"type":"out","message":"Plugin python is already installed."} {"type":"out","message":"Plugin html-report is already installed."} {"type":"out","message":"Plugin spectacle is already installed."} {"type":"out","message":"Parsing started."} {"type":"out","message":"Started concepts parsing."} {"type":"out","message":"102 concepts parsing completed."} {"type":"out","message":"Started specifications parsing."} {"type":"out","message":"1 specifications parsing completed."} {"type":"out","message":"Parsing completed."} {"type":"out","message":"Staring python runner"} {"type":"out","message":"Checking updates..."} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/flash?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} {"type":"out","message":"Python: 3.5.3"} {"type":"out","message":"Loading step implemetations from /home/marius/workspace/auto/figtesting/website_sanity_tests/step_impl dirs."} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/html-report?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/python?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} marius@debian:~/workspace/auto/figtesting/website_sanity_tests$ gauge run specs/sanity/login/login.spec --log-level debug --machine-readable --fail-safe {"type":"out","message":"gauge run specs/sanity/login/login.spec"} {"type":"out","message":"fail-safe : [true]"} {"type":"out","message":"log-level : [debug]"} {"type":"out","message":"machine-readable : [true]"} {"type":"out","message":"'gauge_environment' set to 'default'"} {"type":"out","message":"Created gauge_screenshots_dir at /home/marius/workspace/auto/figtesting/website_sanity_tests/.gauge/screenshots"} {"type":"out","message":"Plugin spectacle is already installed."} {"type":"out","message":"Plugin flash is already installed."} {"type":"out","message":"Plugin xml-report is already installed."} {"type":"out","message":"Plugin python is already installed."} {"type":"out","message":"Plugin html-report is already installed."} {"type":"out","message":"Parsing started."} {"type":"out","message":"Started concepts parsing."} {"type":"out","message":"102 concepts parsing completed."} {"type":"out","message":"Started specifications parsing."} {"type":"out","message":"1 specifications parsing completed."} {"type":"out","message":"Parsing completed."} {"type":"out","message":"Staring python runner"} {"type":"out","message":"Checking updates..."} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/flash?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} {"type":"out","message":"Python: 3.5.3"} {"type":"out","message":"Loading step implemetations from /home/marius/workspace/auto/figtesting/website_sanity_tests/step_impl dirs."} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/html-report?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/python?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/screenshot?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/spectacle?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} {"type":"out","message":"Downloading https://downloads.getgauge.io/plugin/xml-report?l=python\u0026p=flash,html-report,python,screenshot,spectacle,xml-report\u0026o=linux\u0026a=amd64"} {"type":"out","message":"Starting TCP server.."} {"type":"out","message":"Connecting to port 36927"} {"type":"out","message":"Established connection to runner."} {"type":"out","message":"Validation started."} {"type":"out","message":"Validation completed."} {"type":"out","message":"Run started"} {"type":"suiteStart"} {"type":"out","message":"Starting Html Report plugin"} {"type":"out","message":"Attempting to connect to grpc server at port: 44503"} {"type":"out","message":"Successfully made the connection with plugin with port: 44503"} {"type":"out","message":"Starting Flash plugin"} {"type":"out","message":"Established connection to Flash plugin"} {"type":"out","message":"[Flash] Starting progress reporting at http://127.0.0.1:5678"} {"type":"out","message":"2020/02/24 09:14:54 listen tcp :5678: bind: address already in use"} {"type":"out","message":"Starting Xml Report plugin"} {"type":"out","message":"Attempting to connect to grpc server at port: 45711"} {"type":"out","message":"Successfully made the connection with plugin with port: 45711"} {"type":"out","message":"Initialising suite data store."} {"type":"out","message":"Unable to connect to plugin Flash 0.0.1. [Warning] Failed to send message to plugin: flash write tcp 127.0.0.1:44723-\u003e127.0.0.1:50318: write: broken pipe"} {"type":"out","message":""} {"type":"out","message":"Killing Plugin Flash 0.0.1"} {"type":"out","message":""} {"type":"out","message":"Failed to kill plugin Flash 0.0.1. os: process already finished"} {"type":"out","message":""} {"type":"specStart"

Dependabot can't resolve your Go dependency files.

As a result, Dependabot couldn't update your dependencies.

The error Dependabot encountered was:

github.com/getgauge/flash/event: cannot find module providing package github.com/getgauge/flash/event
github.com/getgauge/flash imports
	github.com/getgauge/flash/gauge_messages: cannot find module providing package github.com/getgauge/flash/gauge_messages
github.com/getgauge/flash imports
	github.com/getgauge/flash/listener: cannot find module providing package github.com/getgauge/flash/listener

If you think the above is an error on Dependabot's side please don't hesitate to get in touch - we'll do whatever we can to fix it.

View the update logs.

In Gauge, we have the the following import:

from getgauge.python import Messages

When we use messages, everything gets logged into the HTML log file. This however "only" gets logged in the index.html file. It would be nice if all the messages that got directed to the console also get re-directed to the flash plugin allowing us to see the messages on the webpage.

All we see currently is:

# spec name
## test case name
* step 1
* step 2

but it would be nice if we can add all the messages as well. I.e.,

# spec name
## test case name
* step 1
User loaded url
User asserted xyz.
* step 2
User clicked button
User inputted text box

DESCRIPTION:
User attempted to execute a single spec filled titled "search.spec" but Flash reports that 2 specifications/2 Scenarios are running/ran.

SCREENSHOT:

Currently, the flash report indicates pass/fail status with text color. Red-Green colorblind people might have trouble distinguishing the results unless a character is added indicating pass fail.
For example: gauge-plugin for VSCode uses an X character for failures: ✘
for pass results it a check mark: ✔

Tried using flash on our project, on local it was working fine but when I tried to run the tests on our kubernetes pod, the data on page was not updating, on further debugging, saw that the localhost ip (127.0.0.1) was hardcoded in listener/http.go, in which the data is fetched from /progress route.

Then I tried to replace that local ip with our internal ip, made a distro, installed the plugin, but during runtime getting this error.

Compatible version of plugin flash not found. Installing plugin flash...
........................
Successfully installed plugin 'flash' version 0.0.1
Compatible Flash plugin version to current Gauge version 1.0.6 not found

Used this command to install flash

# Install Gauge Flash
RUN gauge install flash --file lib/flash-0.0.2-linux.x86_64.zip

Environment

• lang: python3
• gauge 1.1.7
• flash 0.0.3

Note: I had to install version 0.0.3 manually because the normal method is not functional

Test immediately fails and I get the following result:
Specifications: 1 passed, 1 failed, -1 running | Scenarios: 1 passed, 1 failed, -1 running