Comments (10)
2 things:
- I don't know much about Arch, but you're sure that's reporting resident memory usage, and not just virtual memory usage, right? Our programming language Go has an issue releasing the latter I think, but it wouldn't actually affect available memory.
- I think I just found and fixed a memory leak, the PR is still in review: #1956. I see a bunch of prefetcher stuff in your logs so it could very much be related.
from kbfs.
- I'm not entirely certain which, but my system is definitely short on available memory as a result. This is the first time in years that it's actually started using swap storage.
- That could explain things. Thanks.
from kbfs.
This issue just appeared in the latest update on an Ubuntu 18.04 system as well. Computer slowed down to a halt, couldn't even send a Slack message until I killed the main kbfsfuse
process. See screenshot:
from kbfs.
I'm very confused, there should only be one kbfsfuse
process running at a time. Where are the other ones coming from? cc: @heronhaye
Anyway @DonaldKBrown please run keybase log send
, and if you're still having the issue while kbfs is running and mounted, please also save the contents of the /keybase/.kbfs_profiles
directory.
from kbfs.
I believe it's the different threads, you can turn off hide userland process threads
in F2
.
from kbfs.
@strib : My log id is b3e1deb590f3212f0f10411c
. Thank you for looking into this.
@heronhaye : I like to keep them displayed to see if anything is spawning more than it should. It sometimes makes it difficult to find what I'm looking for, but I've gotten used to it 😉
from kbfs.
Agreed almost certainly the same process, since the memory stats all line up. Also note slack showing the same thing.
from kbfs.
Ok thanks. @DonaldKBrown are you still having the high memory usage? If so, can you share the contents of /keybase/.kbfs_profiles/
with me? Like cp -r /keybase/.kbfs_profiles/{block,goroutine,heap,mutex} /keybase/private/strib,donaldkbrown
. Thanks!
From the log it seems busy prefetching a big file from one of your team folders into your local disk cache, to give you fast access to it if you want it. This is a new feature with this release so it must have a few bugs. It's obviously not supposed to slam your CPU or cause a memory leak, so I'll look into it. But it'd be helpful to get a memory profile so I can tell where the leak is.
from kbfs.
@strib After killing the main thread, I initially wasn't able to access KBFS through Nautilus; it gave a "Software caused connection abort" error. I opened the Keybase desktop app and selected the "Files" tab, which reconnected me to KBFS. Memory usage appears normal now, I've shared those files with you.
from kbfs.
Ok thanks. If you see that again, please capture those profile files before you kill it, if possible. Inspecting the code I do see one more possible leak, so I'll fix it soon and we'll go from there...
from kbfs.
Related Issues (20)
- Ability to Nuke Database HOT 1
- KBFS file size limit of 512 KiB breaks git-remote-keybase HOT 9
- /keybase "resets" at random times HOT 15
- kbfs team folder "split" HOT 4
- fusermount: entry for /run/user/1000/keybase/kbfs not found in /etc/mtab HOT 13
- CreateFile not call when file name contains colon? HOT 5
- Removing "files before account reset" folder fails HOT 8
- android: git-remote-keybase stderr dup error HOT 12
- Keybase folder is empty HOT 2
- Question: How to use kbfs directly with snap applications? (Ubuntu 18.04.1 LTS) HOT 4
- Truncate file on Linux dosn't always work HOT 6
- Relative paths error on MacOS HOT 2
- keybase chat commands get slower and slower HOT 24
- Latest update of KBFS eating up a bunch of memory on macOS again. HOT 10
- dokan: path does not exist HOT 7
- Is there an obvious reason why I'm having trouble monitoring kbfs with incrond? HOT 8
- Oops. HOT 1
- Extremely slow startup with VPN HOT 5
- incorrect quota state HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kbfs.