Label probabilities for the CRF layer about tf_ner

[guillaumegenthial]

Hi @ashim95,
This is a very good point, to compute the marginals (per token tag probability) you would indeed need to modify the tensorflow CRF implementation and use the Foward / Backward algorithm.
I did not do it, so I cannot give you estimate of the complexity of the task, but it seems like the Forward cell is already implemented in tensorflow.

For reference, the crfsuite uses the F/B approach to compute the marginals it seems https://github.com/chokkan/crfsuite/blob/dc5b6c7b726de90ca63cbf269e6476e18f1dd0d9/lib/crf/src/crf1d_context.c

If you're up to it, we could collaborate and open a PR in Tensorflow adding this support.

Let me know.

[agarwalishan]

I have requested this feature on issues page of tensorflow.
https://github.com/tensorflow/tensorflow/issues/42178
Please comment there and try to upvote it so that they can add this functionality.

[ashim95]

Hi @agarwalishan
I would suggest you look into pytorch based implementations of CRF. Many of these output marginal probabilities. Even if you can not find such an implementation on github, it should be much easier to implement in pytorch than tensorflow.

[agarwalishan]

Thanks for the reply but I want tensorflow implementation only.