Comments (4)
you could just comment out the related code: line 68~73 of attention_seq2seq.py and "if self.use_beam_search: **" of basic_seq2seq.py to avoid using beam search since the related code almost based in pyhton.
I could manage to implement that py_func
as a Custom Operator.
For those of you interested with the code for Custom Operation, see here
from seq2seq.
you could just comment out the related code: line 68~73 of attention_seq2seq.py and "if self.use_beam_search: **" of basic_seq2seq.py to avoid using beam search since the related code almost based in pyhton.
from seq2seq.
If so, could some one point out which function exactly should I convert to TF Ops (the above error message could possibly help)?
py_func
is used here
from seq2seq.
I have been trying to implement this function in pure TF ops,
def gather_tree_py(values, parents):
beam_length = values.shape[0]
num_beams = values.shape[1]
res = np.zeros_like(values)
res[-1, :] = values[-1, :] # Point 1
for beam_id in range(num_beams):
parent = parents[-1][beam_id]
for level in reversed(range(beam_length - 1)):
res[level, beam_id] = values[level][parent] # Point 2
parent = parents[level][parent]
return np.array(res).astype(values.dtype)
However, I'm stuck in converting lines mentioned as Point 1
& Point 2
They're numpy based array operations.
Is that possible to do that in native TF ops?
If not, any alternate solutions possible?
Will writing a Custom Operation in C++ suffice the scenario?
Tensorflow based Code so far,
beam_length = tf.shape(values)[0]
num_beams = tf.shape(values)[1]
res = tf.zeros_like(values)
beam_id = tf.constant(0)
while_condition = lambda beam_id: tf.less(beam_id, num_beams)
def body(beam_id):
parent = parents[-1][beam_id]
# internal while loop
level = tf.subtract(beam_length, 2)
while_condition2 = lambda level, beam_id, parent: tf.greater(level, -1)
def body2(level, beam_id, parent):
res[level, beam_id] = values[level][parent] # Point 2
parent.assign(parents[level][parent])
return[tf.subtract(level, 1), beam_id, parent]
tf.while_loop(while_condition2, body2, [level, beam_id, parent])
# internal while loop
return [tf.add(beam_id, 1)]
# do the loop:
tf.while_loop(while_condition, body, [beam_id])
from seq2seq.
Related Issues (20)
- speeding up inference nmt chatbot nlp
- InvalidArgumentError, Found Inf or NaN gradient(global norm). HOT 2
- ValueError: Can not provide both every_secs and every_steps
- seq2seq checkpoint restore for transfer learning
- num_units is not a valid argument for BasicLSTMCell class tf 1.14 HOT 3
- KeyErrors when running pipeline test HOT 8
- Fix Google seq2seq Installation Errors
- AttributeError: module 'tensorflow.python.platform.flags' has no attribute '_FlagValues' HOT 4
- Error while executing
- tensorflow.python.framework.errors_impl.NotFoundError : Key not found HOT 2
- Error while making predictions (Testing).
- Deprecate non-standard BLEU scripts
- How to build a character based seq2seq tensorflow model for spell correction?
- Error On Setup HOT 1
- WMT 2016 En-De Download Link is broken HOT 1
- python -m unittest seq2seq.test.pipeline_test -> ModuleNotFoundError: No module named 'seq2seq' HOT 2
- ModuleNotFoundError: No module named 'tensorflow.contrib' HOT 2
- ModuleNotFoundError: No module named 'tensorflow' HOT 1
- Can I decode embedings to sequences using seq2seq? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from seq2seq.