GithubHelp home page GithubHelp logo

patientez / keras-attention-mechanism Goto Github PK

View Code? Open in Web Editor NEW
73.0 73.0 33.0 1.14 MB

the extension of https://github.com/philipperemy/keras-attention-mechanism , create a new scipt to add attetion to input dimensions rather than timesteps in the origin project。

Home Page: https://blog.csdn.net/qq_35649669/article/details/103807915

License: Apache License 2.0

Python 100.00%

keras-attention-mechanism's People

Contributors

patientez avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

keras-attention-mechanism's Issues

老师好,请教关于LSTM注意力机制的问题

老师好,我是一名研究生三年级的在校生,最近有幸阅读到您在github上面关于LSTM和注意力机制的文章(https://github.com/PatientEz/keras-attention-mechanism#dense-layer)。有个疑问想向您请教。主要是关于LSTM后面使用注意力机制后,要观察如何抓到维度的注意力机制的问题,我举个例子:
有个数据维度是(1000,20,30) 20个时间步,30个维度的。
经过LSTM层后,假设设置的隐藏层数是32,那么经过LSTM,维度就会变成(20,32)了,这个时候再输入您的注意力机制层,提取出来的维度注意力概率的就会变成32维,而不再是输入时候的30维了,请问遇到这种现象怎么处理呢?
盼望得到您的指导和解答,不胜感激!
张书韵([email protected]
2020年12月14日

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.