Comments (5)
Where and how are you running the tests? CircleCI seems happy, which suggests you're doing something different.
from sybil.
I think what makes the difference is that I'm running them on tmpfs
which just happens to order files differently here.
cd /tmp
git clone https://github.com/simplistix/sybil
cd sybil
PYTHONPATH=. pytest
from sybil.
Okay, and why are you doing that?
My inclination here is just to close this ticket with "sorry, run the tests like the CI does", they also pass for me fine on macOS for local dev, so please try and provide a compelling reason for what you're doing...
from sybil.
Gentoo's purpose in running tests on production systems is to ensure that packages that are installed on production systems actually work and potential issues that aren't trivially reproducible are caught before they explode in users' face.
In this case, it's not "me being wrong vs CI being right". It's just a case of unpredictable ordering that can be influenced by random factors (like files being extracted/checked out in specific order). FWICS the file list was sorted prior to the mentioned commit and the mentioned commit removed sorting for some reason.
Would it be of any help if I created a PR to fix that? As I said, one of the failures can be trivially resolved by restoring sort. I'm working on the other one still.
from sybil.
As I suspected, the fix is trivial and does not have any downsides. I've filed #35 with it.
from sybil.
Related Issues (20)
- How can I control the module that classes and functions are created in? HOT 13
- Allow tabs in DocTestParser HOT 5
- Parse content from docstrings? HOT 6
- Failed tests against CPython-3.10 HOT 1
- Numerours PytestDeprecationWarning raised when using Sybil HOT 6
- REPL functionality in code blocks HOT 2
- 3.0.0: pytest is failing in `tests/test_functional.py::test_modules_not_importable_unittest`unit HOT 4
- Incompatibility with Pytest 7.0 HOT 3
- Skip comments do not skip next pieces of code HOT 3
- Namespace spanning examples HOT 11
- Question to test set up: Is it possible that CI is testing the coverage of tests? HOT 1
- "skip" in MyST parser markdown documents HOT 2
- Doctest with MyST may be broken or incorrectly documented HOT 14
- Unexpected whitespace error HOT 4
- Provide a way to isolate tests within one document HOT 10
- AttributeError: 'NoneType' object has no attribute 'end' HOT 5
- isinstance with `Protocol` fails in doctest HOT 3
- Codeblock Lexer pattern doesn't work if codeblock ends with close comment (end of input to the lexer) HOT 2
- Markdown forces an empty line at the end HOT 9
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sybil.