Comments (5)
This error happens when you set pi to be smaller than the observed fraction of positives. That is, you have more labeled particles per micrograph (on average) than you are telling topaz you expect to have.
For example, if you have 100 labeled particles per micrograph and set n=50, it wouldn't make any sense, because you already know there must be at least 100 particles per micrograph!
from topaz.
Ah got it! Does it do this on a per micrograph basis or does it average the pi value for all of them?
from topaz.
It's averaged over all micrographs.
from topaz.
Sorry to bring this back up, but a labmate just ran into this same issue, and I noticed something weird
source split p_observed num_positive_regions total_regions
0 train 0.0244 5738886 235065600
0 test 0.0249 1462512 58766400
Specified expected number of particle per micrograph = 50.0
With radius = 8
Setting pi = 0.04441738816738817
So the p_observed for test and train is 0.02, and it set pi to 0.04. So the set pi is higher than the observed pi, which is good. But they still got that error. Am I missing something?
from topaz.
Yep, there was a bug in the code for this. To adjust pi to only apply to the unlabeled data, the training script sets pi = pi - p_observed, because the user defined pi is for all data. The check was being done after the adjustment, as well as before, leading to this error. You can install from the latest master branch where I just fixed this. As a workaround, though, just set -n/--pi even larger to compensate.
Fixed in 79e38bf
from topaz.
Related Issues (20)
- Importing particle star file to cryosparc
- Git checkout errors HOT 2
- Topaz filament picking HOT 7
- topaz denoise crashes with RuntimeError: CUDA out of memory HOT 4
- denoise training using tif format movie file HOT 5
- How to Reproduce the Full Pretraining
- ImportError: (...)/libmkldnn.so.0: undefined symbol: cblas_sgemm_alloc HOT 1
- CudaWarning: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx HOT 3
- Topaz Train/Cross-Validation failed with AssertionError: Subprocess exited with status -9. HOT 1
- Singulairty container should be updated to 0.2.5
- Plot training metrics by default?
- topaz is not using gpu HOT 7
- from topaz.utils.data.loader import load_image ModuleNotFoundError: No module named 'topaz.utils'; 'topaz' is not a package HOT 1
- 0.2.5 vs 0.2.5a HOT 1
- MRC library version incompatible HOT 5
- Topaz training error in multiprocessing data loader
- topaz convert: when image_name is numbers like "001", one error HOT 2
- RuntimeError: Could not infer dtype of numpy.int64 HOT 3
- Version string rejected by cryoSPARC HOT 2
- PyTorch confilct with NumPy HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from topaz.