Comments (4)
This is something related with the latest accelerate version... I can't do much about it until kohya upgrade accelerate to another version as part of his supported code base... but glad you raised it so others are not taken aback by it ;-)
from kohya_ss.
I definitely agree. I also do not want to use repeats as epochs is a better measurement of progress, and repeats produce different results than just using epochs. It almost seems like a workaround for whatever is wrong with the code.
from kohya_ss.
So I'm a bit confused. The latest version of accelerate
is 0.15.0
(https://pypi.org/project/accelerate/). What do you mean by upgrading to another version when this is the latest version? I feel this might not be an accelerate issue.
from kohya_ss.
It is using the CPU far too much as the memory usage ramps up, slowly, then it dumps to CUDA, then epoch where the cycle starts over. Considering Automatic1111 works fine, and is using the GPU (1 gig more of it) I can say it is something in Kohya's code.
from kohya_ss.
Related Issues (20)
- SD3 into main branch HOT 1
- requirements_linux.sh should have one line per requirement HOT 3
- SDXL Training Error - RuntimeError: NaN detected in latents HOT 7
- After Installation Memory Leak HOT 1
- Parse safetensors files into a JSON configuration file
- is it possible to stop text encoder training after a certain amount of steps or epochs for sdxl dreambooth.
- Please adopt conda instead of env HOT 2
- Running tensorboard prompts Error: logging folder does not exist or does not contain logs. HOT 7
- returned non-zero exit status 3221225477. HOT 3
- BLIP 2 Caption Issue
- Problem while installing: error: metadata-generation-failed HOT 6
- Docker Compose not functional HOT 1
- Can't install - Gradio won't install HOT 3
- Subject: Issue with Loading State Dictionary for UNet2DConditionModel HOT 2
- Having problems training with Error: ValueError: torch.cuda.is_available() HOT 6
- How do i fix this error?
- "Stop TE (% of total steps)" being passed as-is (dreambooth SD1)
- Cant open bat file HOT 11
- Training issues HOT 1
- Model train causes TypeError issue HOT 10
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kohya_ss.