GithubHelp home page GithubHelp logo

Memory issue with many users about monster HOT 8 CLOSED

jakthra avatar jakthra commented on June 9, 2024
Memory issue with many users

from monster.

Comments (8)

fedech avatar fedech commented on June 9, 2024

We could reduce the resolution of the user mobility, and only move once every 10 or 100 ms. At a normal speed, that would cause no problem and reduce memory occupation by 90%. I can do a pull request and try to fix it

from monster.

jakthra avatar jakthra commented on June 9, 2024

symMatrix need 4GB of memory with 50 users.

However. Reducing the size of trajectory would be nice, @fedech that would be fantastic.

@artuso0matteo Any idea when it comes to the size of symMatrix? With 50 users it's of size 5x50x1000000 image

from monster.

artuso0matteo avatar artuso0matteo commented on June 9, 2024

@fedech thanks for the fix in #27 I'll fix the conflict and merge it into master.
@jakthra for the symMatrix I'll do some digging as right now we use it to compile all the symbols the different stations are going to use and we kind of do padding to pre-allocate the structure in matlab for speed-up. It ends up scaling linearly with the number of users then.
I'll submit a pull request if something smart comes up.

from monster.

fedech avatar fedech commented on June 9, 2024

By the way, when I have time (probably next week) I want to fix the mobility codebase, it's a bit of a mess right now. I have a better model in the fork I'm using for the tierless paper, but I can make it easier to integrate other mobility models by putting everything in one place (so that you only have to write a new function to implement a new model instead of making changes in 5 different places)

from monster.

artuso0matteo avatar artuso0matteo commented on June 9, 2024

Cool! Ok, so i looked into the symMatrix and we use it pretty much only for recording the SER, which we don't really have a use for, considering that we can just rely on the BER. I will then get rid of it and refactor a bit the code in a way that is not needed at all

from monster.

jakthra avatar jakthra commented on June 9, 2024

Two fixes has been completed. See #29 #27
@mychele @fedech can you verify this fixed some of the memory issues?

from monster.

mychele avatar mychele commented on June 9, 2024

No more out of memory error, and stable memory consumption at 7% out of 16GB for 100 users.

from monster.

artuso0matteo avatar artuso0matteo commented on June 9, 2024

Closing the issue, #29 and #27 solves the problems reported

from monster.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.