GithubHelp home page GithubHelp logo

Comments (7)

ZichaoHuang avatar ZichaoHuang commented on May 30, 2024

用的是CPU版本的tf吗?

from transe.

clpl avatar clpl commented on May 30, 2024

是GPU版本的,我又试着在CPU版本上跑了一下,也有这个问题

按照我的理解,初始化后程序的内存使用量应该会保持稳定,可是似乎每次eval都会增加

from transe.

ZichaoHuang avatar ZichaoHuang commented on May 30, 2024

有可能是多进程导致的,我有时间看看。不过我没在1.13版本的tf上测试过,也不排除是tf的问题。

from transe.

ZichaoHuang avatar ZichaoHuang commented on May 30, 2024

@clpl 我这边跑了一下train_wn18.sh,eval_freq设置为2。eval时占用的物理内存确实会比训练时要大,但是eval一次之后,程序占用的物理内存就一直稳定在1907M了,并没有出现你所描述的内存会增加的情况。

环境是Ubuntu 16.04.4 + tensorflow-gpu 1.8.0

from transe.

clpl avatar clpl commented on May 30, 2024

我也重跑了一下,还是会增加,而且是指数型增长的,可能就是tf的问题

tensorflow 1.13.0-rc0 GPU版

from transe.

ZichaoHuang avatar ZichaoHuang commented on May 30, 2024

@clpl 我在tensorflow-gpu 1.12版本下也测试过,自首次eval后,物理内存占用都稳定在2039M,没有出现内存持续增长的情况。

from transe.

ZichaoHuang avatar ZichaoHuang commented on May 30, 2024

这个issue我先关了,有其他进展再重新开。

from transe.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.