Comments (13)
Could you try without the flaky
plugin? From a quick look at your logs, it looks like it's interfering in some way:
E nomatch: '*stdout*'
E and: '------------------------------- captured stderr --------------------------------'
E and: '/usr/lib/python3.8/site-packages/flaky/flaky_pytest_plugin.py:139: KeyError: <Function test_function>'
from pytest-forked.
Not sure what you're complaining about: is it that when you use a pytest version that is not in the test matrix and it fails? Feel free to update tox.ini
and .travis.yml
with that.
from pytest-forked.
I'm not complaining abouurt abything,
I'me reporting some exact results of the tox and pytest in exact build env.
I don't know the pytest-forked code and by this I'm not able to evaluete impact of what is reported. Only this and nothing more ..
from pytest-forked.
i wonder if we should add a mode to pytester where only whitelisted plugins are available, to ensure unit-tests don't break in unexpected install situations
currently the reported issue is not a bug, but rather a missing feature/global interaction
from pytest-forked.
Just tested without flaky and tox finished with exit 0.
+ /usr/bin/python3 -Bm tox --skip-missing-interpreters
.package create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/.package
.package installdeps: setuptools ~= 41.4, setuptools_scm ~= 3.3, wheel ~= 0.33.6
py27-pytest310 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py27-pytest310
SKIPPED: InterpreterNotFound: python2.7
py27-pytest46 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py27-pytest46
SKIPPED: InterpreterNotFound: python2.7
py27-pytest54 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py27-pytest54
SKIPPED: InterpreterNotFound: python2.7
py27-pytestlatest create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py27-pytestlatest
SKIPPED: InterpreterNotFound: python2.7
py35-pytest310 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py35-pytest310
SKIPPED: InterpreterNotFound: python3.5
py35-pytest46 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py35-pytest46
SKIPPED: InterpreterNotFound: python3.5
py35-pytest54 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py35-pytest54
SKIPPED: InterpreterNotFound: python3.5
py35-pytestlatest create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py35-pytestlatest
SKIPPED: InterpreterNotFound: python3.5
py36-pytest310 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py36-pytest310
SKIPPED: InterpreterNotFound: python3.6
py36-pytest46 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py36-pytest46
SKIPPED: InterpreterNotFound: python3.6
py36-pytest54 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py36-pytest54
SKIPPED: InterpreterNotFound: python3.6
py36-pytestlatest create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py36-pytestlatest
SKIPPED: InterpreterNotFound: python3.6
py37-pytest310 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py37-pytest310
SKIPPED: InterpreterNotFound: python3.7
py37-pytest46 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py37-pytest46
SKIPPED: InterpreterNotFound: python3.7
py37-pytest54 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py37-pytest54
SKIPPED: InterpreterNotFound: python3.7
py37-pytestlatest create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py37-pytestlatest
SKIPPED: InterpreterNotFound: python3.7
py38-pytest310 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py38-pytest310
py38-pytest310 installdeps: pycmd, setuptools_scm, pytest~=3.10
py38-pytest310 inst: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/.tmp/package/1/pytest-forked-1.3.0.tar.gz
py38-pytest310 installed: atomicwrites==1.4.0,attrs==20.3.0,more-itertools==8.7.0,pluggy==0.13.1,py==1.10.0,pycmd==1.2,pytest==3.10.1,pytest-forked==1.3.0,setuptools-scm==6.0.1,six==1.15.0
py38-pytest310 run-test-pre: PYTHONHASHSEED='432006169'
py38-pytest310 run-test: commands[0] | pytest
=========================================================================== test session starts ============================================================================
platform linux -- Python 3.8.9, pytest-3.10.1, py-1.10.0, pluggy-0.13.1
rootdir: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0, inifile: tox.ini
plugins: forked-1.3.0
collected 10 items
testing/test_boxed.py ...xx. [ 60%]
testing/test_xfail_behavior.py .... [100%]
========================================================================= short test summary info ==========================================================================
XFAIL testing/test_boxed.py::test_functional_boxed_capturing[sys]
capture cleanup needed
XFAIL testing/test_boxed.py::test_functional_boxed_capturing[fd]
capture cleanup needed
=================================================================== 8 passed, 2 xfailed in 0.86 seconds ====================================================================
py38-pytest46 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py38-pytest46
py38-pytest46 installdeps: pycmd, setuptools_scm, pytest~=4.6
py38-pytest46 inst: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/.tmp/package/1/pytest-forked-1.3.0.tar.gz
py38-pytest46 installed: atomicwrites==1.4.0,attrs==20.3.0,more-itertools==8.7.0,packaging==20.9,pluggy==0.13.1,py==1.10.0,pycmd==1.2,pyparsing==2.4.7,pytest==4.6.11,pytest-forked==1.3.0,setuptools-scm==6.0.1,six==1.15.0,wcwidth==0.2.5
py38-pytest46 run-test-pre: PYTHONHASHSEED='432006169'
py38-pytest46 run-test: commands[0] | pytest
=========================================================================== test session starts ============================================================================
platform linux -- Python 3.8.9, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
cachedir: .tox/py38-pytest46/.pytest_cache
rootdir: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0, inifile: tox.ini
plugins: forked-1.3.0
collected 10 items
testing/test_boxed.py ...xx. [ 60%]
testing/test_xfail_behavior.py .... [100%]
========================================================================= short test summary info ==========================================================================
XFAIL testing/test_boxed.py::test_functional_boxed_capturing[sys]
capture cleanup needed
XFAIL testing/test_boxed.py::test_functional_boxed_capturing[fd]
capture cleanup needed
=================================================================== 8 passed, 2 xfailed in 0.58 seconds ====================================================================
py38-pytest54 create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py38-pytest54
py38-pytest54 installdeps: pycmd, setuptools_scm, pytest~=5.4
py38-pytest54 inst: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/.tmp/package/1/pytest-forked-1.3.0.tar.gz
py38-pytest54 installed: attrs==20.3.0,more-itertools==8.7.0,packaging==20.9,pluggy==0.13.1,py==1.10.0,pycmd==1.2,pyparsing==2.4.7,pytest==5.4.3,pytest-forked==1.3.0,setuptools-scm==6.0.1,wcwidth==0.2.5
py38-pytest54 run-test-pre: PYTHONHASHSEED='432006169'
py38-pytest54 run-test: commands[0] | pytest
=========================================================================== test session starts ============================================================================
platform linux -- Python 3.8.9, pytest-5.4.3, py-1.10.0, pluggy-0.13.1
cachedir: .tox/py38-pytest54/.pytest_cache
rootdir: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0, inifile: tox.ini
plugins: forked-1.3.0
collected 10 items
testing/test_boxed.py ...xx. [ 60%]
testing/test_xfail_behavior.py .... [100%]
============================================================================= warnings summary =============================================================================
testing/test_boxed.py::test_functional_boxed
testing/test_boxed.py::test_functional_boxed_per_test
testing/test_boxed.py::test_functional_boxed_capturing[no]
testing/test_boxed.py::test_functional_boxed_capturing[sys]
testing/test_boxed.py::test_functional_boxed_capturing[fd]
testing/test_xfail_behavior.py::test_xfail[strict xfail]
testing/test_xfail_behavior.py::test_xfail[strict xpass]
testing/test_xfail_behavior.py::test_xfail[non-strict xfail]
testing/test_xfail_behavior.py::test_xfail[non-strict xpass]
/home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py38-pytest54/lib/python3.8/site-packages/_pytest/compat.py:333: PytestDeprecationWarning: The TerminalReporter.writer attribute is deprecated, use TerminalReporter._tw instead at your own risk.
See https://docs.pytest.org/en/latest/deprecations.html#terminalreporter-writer for more information.
return getattr(object, name, default)
-- Docs: https://docs.pytest.org/en/latest/warnings.html
========================================================================= short test summary info ==========================================================================
XFAIL testing/test_boxed.py::test_functional_boxed_capturing[sys]
capture cleanup needed
XFAIL testing/test_boxed.py::test_functional_boxed_capturing[fd]
capture cleanup needed
================================================================= 8 passed, 2 xfailed, 9 warnings in 0.60s =================================================================
py38-pytestlatest create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/py38-pytestlatest
py38-pytestlatest installdeps: pycmd, setuptools_scm, pytest
py38-pytestlatest inst: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/.tmp/package/1/pytest-forked-1.3.0.tar.gz
py38-pytestlatest installed: attrs==20.3.0,iniconfig==1.1.1,packaging==20.9,pluggy==0.13.1,py==1.10.0,pycmd==1.2,pyparsing==2.4.7,pytest==6.2.3,pytest-forked==1.3.0,setuptools-scm==6.0.1,toml==0.10.2
py38-pytestlatest run-test-pre: PYTHONHASHSEED='432006169'
py38-pytestlatest run-test: commands[0] | pytest
=========================================================================== test session starts ============================================================================
platform linux -- Python 3.8.9, pytest-6.2.3, py-1.10.0, pluggy-0.13.1
cachedir: .tox/py38-pytestlatest/.pytest_cache
rootdir: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0, configfile: tox.ini
plugins: forked-1.3.0
collected 10 items
testing/test_boxed.py ...xx. [ 60%]
testing/test_xfail_behavior.py .... [100%]
========================================================================= short test summary info ==========================================================================
XFAIL testing/test_boxed.py::test_functional_boxed_capturing[sys]
capture cleanup needed
XFAIL testing/test_boxed.py::test_functional_boxed_capturing[fd]
capture cleanup needed
======================================================================= 8 passed, 2 xfailed in 0.60s =======================================================================
flakes create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/flakes
flakes installdeps: flake8
flakes inst: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/.tmp/package/1/pytest-forked-1.3.0.tar.gz
flakes installed: attrs==20.3.0,flake8==3.9.1,iniconfig==1.1.1,mccabe==0.6.1,packaging==20.9,pluggy==0.13.1,py==1.10.0,pycodestyle==2.7.0,pyflakes==2.3.1,pyparsing==2.4.7,pytest==6.2.3,pytest-forked==1.3.0,toml==0.10.2
flakes run-test-pre: PYTHONHASHSEED='432006169'
flakes run-test: commands[0] | flake8 setup.py testing src/pytest_forked/
build-dists create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/build-dists
build-dists installdeps: pep517 >= 0.7.0
build-dists installed: pep517==0.10.0,toml==0.10.2
build-dists run-test-pre: PYTHONHASHSEED='432006169'
build-dists run-test: commands[0] | rm -rfv /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/dist/
build-dists run-test: commands[1] | /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/build-dists/bin/python -m pep517.build --source --binary --out-dir /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/dist/ /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0
pep517.build is deprecated. Consider switching to https://pypi.org/project/build/
WARNING: You are using pip version 19.3.1; however, version 21.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
WARNING: You are using pip version 19.3.1; however, version 21.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
running sdist
running egg_info
writing src/pytest_forked.egg-info/PKG-INFO
writing dependency_links to src/pytest_forked.egg-info/dependency_links.txt
writing entry points to src/pytest_forked.egg-info/entry_points.txt
writing requirements to src/pytest_forked.egg-info/requires.txt
writing top-level names to src/pytest_forked.egg-info/top_level.txt
adding license file 'LICENSE' (matched pattern 'LICEN[CS]E*')
reading manifest file 'src/pytest_forked.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'README.txt'
no previously-included directories found matching '.git'
writing manifest file 'src/pytest_forked.egg-info/SOURCES.txt'
running check
creating pytest-forked-1.3.0
creating pytest-forked-1.3.0/example
creating pytest-forked-1.3.0/src
creating pytest-forked-1.3.0/src/pytest_forked
creating pytest-forked-1.3.0/src/pytest_forked.egg-info
creating pytest-forked-1.3.0/testing
creating pytest-forked-1.3.0/testing/__pycache__
copying files to pytest-forked-1.3.0...
copying .gitignore -> pytest-forked-1.3.0
copying .travis.yml -> pytest-forked-1.3.0
copying CHANGELOG -> pytest-forked-1.3.0
copying LICENSE -> pytest-forked-1.3.0
copying MANIFEST.in -> pytest-forked-1.3.0
copying README.rst -> pytest-forked-1.3.0
copying pyproject.toml -> pytest-forked-1.3.0
copying setup.cfg -> pytest-forked-1.3.0
copying setup.py -> pytest-forked-1.3.0
copying tox.ini -> pytest-forked-1.3.0
copying example/boxed.txt -> pytest-forked-1.3.0/example
copying src/pytest_forked/__init__.py -> pytest-forked-1.3.0/src/pytest_forked
copying src/pytest_forked.egg-info/PKG-INFO -> pytest-forked-1.3.0/src/pytest_forked.egg-info
copying src/pytest_forked.egg-info/SOURCES.txt -> pytest-forked-1.3.0/src/pytest_forked.egg-info
copying src/pytest_forked.egg-info/dependency_links.txt -> pytest-forked-1.3.0/src/pytest_forked.egg-info
copying src/pytest_forked.egg-info/entry_points.txt -> pytest-forked-1.3.0/src/pytest_forked.egg-info
copying src/pytest_forked.egg-info/not-zip-safe -> pytest-forked-1.3.0/src/pytest_forked.egg-info
copying src/pytest_forked.egg-info/requires.txt -> pytest-forked-1.3.0/src/pytest_forked.egg-info
copying src/pytest_forked.egg-info/top_level.txt -> pytest-forked-1.3.0/src/pytest_forked.egg-info
copying testing/conftest.py -> pytest-forked-1.3.0/testing
copying testing/test_boxed.py -> pytest-forked-1.3.0/testing
copying testing/test_xfail_behavior.py -> pytest-forked-1.3.0/testing
copying testing/__pycache__/conftest.cpython-38-PYTEST.pyc -> pytest-forked-1.3.0/testing/__pycache__
copying testing/__pycache__/conftest.cpython-38-pytest-5.4.3.pyc -> pytest-forked-1.3.0/testing/__pycache__
copying testing/__pycache__/conftest.cpython-38-pytest-6.2.3.pyc -> pytest-forked-1.3.0/testing/__pycache__
copying testing/__pycache__/test_boxed.cpython-38-PYTEST.pyc -> pytest-forked-1.3.0/testing/__pycache__
copying testing/__pycache__/test_boxed.cpython-38-pytest-5.4.3.pyc -> pytest-forked-1.3.0/testing/__pycache__
copying testing/__pycache__/test_boxed.cpython-38-pytest-6.2.3.pyc -> pytest-forked-1.3.0/testing/__pycache__
copying testing/__pycache__/test_xfail_behavior.cpython-38-PYTEST.pyc -> pytest-forked-1.3.0/testing/__pycache__
copying testing/__pycache__/test_xfail_behavior.cpython-38-pytest-5.4.3.pyc -> pytest-forked-1.3.0/testing/__pycache__
copying testing/__pycache__/test_xfail_behavior.cpython-38-pytest-6.2.3.pyc -> pytest-forked-1.3.0/testing/__pycache__
Writing pytest-forked-1.3.0/setup.cfg
Creating tar archive
removing 'pytest-forked-1.3.0' (and everything under it)
WARNING: You are using pip version 19.3.1; however, version 21.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
WARNING: You are using pip version 19.3.1; however, version 21.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
running bdist_wheel
running build
running build_py
installing to build/bdist.linux-x86_64/wheel
running install
running install_lib
creating build/bdist.linux-x86_64
creating build/bdist.linux-x86_64/wheel
creating build/bdist.linux-x86_64/wheel/pytest_forked
copying build/lib/pytest_forked/__init__.py -> build/bdist.linux-x86_64/wheel/pytest_forked
running install_egg_info
running egg_info
writing src/pytest_forked.egg-info/PKG-INFO
writing dependency_links to src/pytest_forked.egg-info/dependency_links.txt
writing entry points to src/pytest_forked.egg-info/entry_points.txt
writing requirements to src/pytest_forked.egg-info/requires.txt
writing top-level names to src/pytest_forked.egg-info/top_level.txt
adding license file 'LICENSE' (matched pattern 'LICEN[CS]E*')
reading manifest file 'src/pytest_forked.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'README.txt'
no previously-included directories found matching '.git'
writing manifest file 'src/pytest_forked.egg-info/SOURCES.txt'
Copying src/pytest_forked.egg-info to build/bdist.linux-x86_64/wheel/pytest_forked-1.3.0-py3.8.egg-info
running install_scripts
adding license file "LICENSE" (matched pattern "LICEN[CS]E*")
creating build/bdist.linux-x86_64/wheel/pytest_forked-1.3.0.dist-info/WHEEL
creating '/tmp/tmpp0brqczb/tmp6vlah57l/pytest_forked-1.3.0-py2.py3-none-any.whl' and adding 'build/bdist.linux-x86_64/wheel' to it
adding 'pytest_forked/__init__.py'
adding 'pytest_forked-1.3.0.dist-info/LICENSE'
adding 'pytest_forked-1.3.0.dist-info/METADATA'
adding 'pytest_forked-1.3.0.dist-info/WHEEL'
adding 'pytest_forked-1.3.0.dist-info/entry_points.txt'
adding 'pytest_forked-1.3.0.dist-info/top_level.txt'
adding 'pytest_forked-1.3.0.dist-info/RECORD'
removing build/bdist.linux-x86_64/wheel
metadata-validation create: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/.tox/metadata-validation
metadata-validation installdeps: twine
metadata-validation installed: bleach==3.3.0,certifi==2020.12.5,cffi==1.14.5,chardet==4.0.0,colorama==0.4.4,cryptography==3.4.7,docutils==0.17.1,idna==2.10,importlib-metadata==4.0.1,jeepney==0.6.0,keyring==23.0.1,packaging==20.9,pkginfo==1.7.0,pycparser==2.20,Pygments==2.9.0,pyparsing==2.4.7,readme-renderer==29.0,requests==2.25.1,requests-toolbelt==0.9.1,rfc3986==1.4.0,SecretStorage==3.3.1,six==1.15.0,tqdm==4.60.0,twine==3.4.1,urllib3==1.26.4,webencodings==0.5.1,zipp==3.4.1
metadata-validation run-test-pre: PYTHONHASHSEED='432006169'
metadata-validation run-test: commands[0] | twine check '/home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/dist/*'
Checking /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/dist/pytest_forked-1.3.0-py2.py3-none-any.whl: PASSED
Checking /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0/dist/pytest-forked-1.3.0.tar.gz: PASSED
_________________________________________________________________________________ summary __________________________________________________________________________________
SKIPPED: py27-pytest310: InterpreterNotFound: python2.7
SKIPPED: py27-pytest46: InterpreterNotFound: python2.7
SKIPPED: py27-pytest54: InterpreterNotFound: python2.7
SKIPPED: py27-pytestlatest: InterpreterNotFound: python2.7
SKIPPED: py35-pytest310: InterpreterNotFound: python3.5
SKIPPED: py35-pytest46: InterpreterNotFound: python3.5
SKIPPED: py35-pytest54: InterpreterNotFound: python3.5
SKIPPED: py35-pytestlatest: InterpreterNotFound: python3.5
SKIPPED: py36-pytest310: InterpreterNotFound: python3.6
SKIPPED: py36-pytest46: InterpreterNotFound: python3.6
SKIPPED: py36-pytest54: InterpreterNotFound: python3.6
SKIPPED: py36-pytestlatest: InterpreterNotFound: python3.6
SKIPPED: py37-pytest310: InterpreterNotFound: python3.7
SKIPPED: py37-pytest46: InterpreterNotFound: python3.7
SKIPPED: py37-pytest54: InterpreterNotFound: python3.7
SKIPPED: py37-pytestlatest: InterpreterNotFound: python3.7
py38-pytest310: commands succeeded
py38-pytest46: commands succeeded
py38-pytest54: commands succeeded
py38-pytestlatest: commands succeeded
flakes: commands succeeded
build-dists: commands succeeded
metadata-validation: commands succeeded
congratulations :)
Question only is what flaky
reports is important/relevant?🤔
from pytest-forked.
If you run inside tox, your locally installed flaky
plugin is irrelevant - tox already exited with status 0 in your original command.
from pytest-forked.
Oh, I was under impression that Tomasz implied that using pytest 6.2 causes the issue (tox still has 6.0rc set). But IIUC the issue is that the plugin installed in the outer env leaks into the pytester fixture invocation, is that right?
from pytest-forked.
@The-Compiler sorry for maybe dumb question ..
E nomatch: '*stdout*'
E and: '------------------------------- captured stderr --------------------------------'
E and: '/usr/lib/python3.8/site-packages/flaky/flaky_pytest_plugin.py:139: KeyError: <Function test_function>'
Does it mean that it is some issue with flaky 3.7.0?🤔
from pytest-forked.
Looks like it.
from pytest-forked.
Could you try without the
flaky
plugin? From a quick look at your logs, it looks like it's interfering in some way:E nomatch: '*stdout*' E and: '------------------------------- captured stderr --------------------------------' E and: '/usr/lib/python3.8/site-packages/flaky/flaky_pytest_plugin.py:139: KeyError: <Function test_function>'
pytest passes without flaky
.
However I fould yet another pytest extension which produces errors:
+ /usr/bin/pytest -ra -p no:flaky
=========================================================================== test session starts ============================================================================
platform linux -- Python 3.8.11, pytest-6.2.4, py-1.10.0, pluggy-0.13.1
benchmark: 3.4.1 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0, configfile: tox.ini
plugins: forked-1.3.0, shutil-1.7.0, virtualenv-1.7.0, expect-1.1.0, flake8-1.0.7, timeout-1.4.2, betamax-0.8.1, freezegun-0.4.2, case-1.5.3, isort-1.3.0, aspectlib-1.5.2, toolbox-0.5, mock-3.6.1, rerunfailures-9.1.1, requests-mock-1.9.3, cov-2.12.1, pyfakefs-4.5.0, benchmark-3.4.1, xdist-2.3.0, pylama-7.7.1, datadir-1.3.1, regressions-2.2.0, cases-3.6.3, hypothesis-6.14.4, xprocess-0.18.1, black-0.3.12, checkdocs-2.7.1, anyio-3.3.0, Faker-8.11.0, asyncio-0.15.1, trio-0.7.0, httpbin-1.0.0, subtests-0.5.0, relaxed-1.1.5
collected 0 items / 1 error
================================================================================== ERRORS ==================================================================================
______________________________________________________________________ ERROR collecting test session _______________________________________________________________________
Direct construction of SpecModule has been deprecated, please use SpecModule.from_parent.
See https://docs.pytest.org/en/stable/deprecations.html#node-construction-changed-to-node-from-parent for more details.
========================================================================= short test summary info ==========================================================================
ERROR
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
============================================================================= 1 error in 0.26s =============================================================================
pytest-xprocess reminder::Be sure to terminate the started process by running 'pytest --xkill' if you have not explicitly done so in your fixture with 'xprocess.getinfo(<process_name>).terminate()'.
I've added both extension to
from pytest-forked.
bitprophet/pytest-relaxed#10 fixes pytest-relaxed for modern pytest
pytest-relaxed seems unmaintained
pytest-flaky is uncompatible with pytest-forked and needs to get support
from pytest-forked.
bitprophet/pytest-relaxed#10 fixes pytest-relaxed for modern pytest
pytest-relaxed seems unmaintained
pytest-flaky is uncompatible with pytest-forked and needs to get support
Something is wrong with that PR.
After patch pytest-relaxed and install updated package pytest is failing
+ /usr/bin/pytest -ra -p no:flaky
=========================================================================== test session starts ============================================================================
platform linux -- Python 3.8.11, pytest-6.2.4, py-1.10.0, pluggy-0.13.1
benchmark: 3.4.1 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /home/tkloczko/rpmbuild/BUILD/pytest-forked-1.3.0, configfile: tox.ini
plugins: forked-1.3.0, shutil-1.7.0, virtualenv-1.7.0, expect-1.1.0, flake8-1.0.7, timeout-1.4.2, betamax-0.8.1, freezegun-0.4.2, case-1.5.3, aspectlib-1.5.2, toolbox-0.5, mock-3.6.1, rerunfailures-9.1.1, requests-mock-1.9.3, cov-2.12.1, pyfakefs-4.5.0, benchmark-3.4.1, xdist-2.3.0, pylama-7.7.1, datadir-1.3.1, regressions-2.2.0, cases-3.6.3, xprocess-0.18.1, black-0.3.12, checkdocs-2.7.1, anyio-3.3.0, Faker-8.11.0, asyncio-0.15.1, trio-0.7.0, httpbin-1.0.0, subtests-0.5.0, relaxed-1.1.5, isort-2.0.0, hypothesis-6.14.6
collected 13 items / 1 error / 12 selected
================================================================================== ERRORS ==================================================================================
________________________________________________________________________ ERROR collecting setup.py _________________________________________________________________________
/usr/lib64/python3.8/distutils/fancy_getopt.py:233: in getopt
opts, args = getopt.getopt(args, short_opts, self.long_opts)
/usr/lib64/python3.8/getopt.py:95: in getopt
opts, args = do_shorts(opts, args[0][1:], shortopts, args[1:])
/usr/lib64/python3.8/getopt.py:195: in do_shorts
if short_has_arg(opt, shortopts):
/usr/lib64/python3.8/getopt.py:211: in short_has_arg
raise GetoptError(_('option -%s not recognized') % opt, opt)
E getopt.GetoptError: option -r not recognized
During handling of the above exception, another exception occurred:
/usr/lib64/python3.8/distutils/core.py:134: in setup
ok = dist.parse_command_line()
/usr/lib64/python3.8/distutils/dist.py:475: in parse_command_line
args = parser.getopt(args=self.script_args, object=self)
/usr/lib64/python3.8/distutils/fancy_getopt.py:235: in getopt
raise DistutilsArgError(msg)
E distutils.errors.DistutilsArgError: option -r not recognized
During handling of the above exception, another exception occurred:
setup.py:3: in <module>
setup(
/usr/lib/python3.8/site-packages/setuptools/__init__.py:144: in setup
return distutils.core.setup(**attrs)
/usr/lib64/python3.8/distutils/core.py:136: in setup
raise SystemExit(gen_usage(dist.script_name) + "\nerror: %s" % msg)
E SystemExit: usage: pytest [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
E or: pytest --help [cmd1 cmd2 ...]
E or: pytest --help-commands
E or: pytest cmd --help
E
E error: option -r not recognized
========================================================================= short test summary info ==========================================================================
ERROR setup.py - SystemExit: usage: pytest [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
============================================================================= 1 error in 0.47s =============================================================================
from pytest-forked.
pytest-relaxed seems unmaintained
Yes: http://bitprophet.org/blog/2020/07/02/help-wanted/ / http://bitprophet.org/blog/2020/09/18/project-updates-2020-09/ / sphinx-doc/alabaster#179 (comment).
So I wouldn't care about it until it gets a new maintainer.
from pytest-forked.
Related Issues (20)
- Build failure due to setuptools in pyproject.toml HOT 2
- Pytest hangs when using faulthandler_timeout with pytest-forked HOT 1
- v1.3.0 not available on conda-forge HOT 2
- test suite fails `hypothesis` is in the environment (a test dependency of pytest) HOT 8
- crashing test hangs `pytest` HOT 5
- Alternative to fork in Windows HOT 2
- next release ETA HOT 1
- Missing warnings with pytest --forked option HOT 1
- tests work in 6.2.5 but fail in 7.x.x HOT 12
- Update requirements HOT 7
- Mac: Bad file descriptor HOT 3
- test_xfail[strict_xfail|non_strict_xfail] fail with pytest 7.2.0 HOT 2
- py==1.11.0 vulnerability HOT 3
- Testing support for OpenIndiana (sunos5)
- Test failures with Python 3.12 due to warnings (from pytest) HOT 3
- xdist master cant see workers' workeroutput when using --forked
- AttributeError: module 'py' has no attribute 'process' HOT 7
- [tests] test_xfail fails against Pytest 8
- Forked mode by default HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pytest-forked.