Add option for outputting text (t) on deepest level (w) only about ucto

[kosloot]

OK, this seems very reasonable.
This option is now implemented. But with a default of 'full' for now, because i want to investigate the impact of changing that first.

[kosloot]

seems reasonable, and easy to do

[kosloot]

I added a --noredundanttext option to ucto.
a better name is welcome
please test!

[proycon]

Test seems to work fine.

[kosloot]

One important remark about this option:
When an incoming FoLiA already has some text on <p> or <s> nodes this text is left 'as-is' AND
from FoLiA v1.5 text compatibility rules will be enforced. (the normalized deeper text must equal the normalized text of the nodes)
We could decide on REMOVING the text on <p> or <s> nodes on the fly....

[proycon]

Perhaps change it into a --textredundancy/-T parameter that takes one of three modes?

• full - Add full text redundancy (currently the default)
• minimal - Do not introduce extra redundancy, but do not remove any input text
• none - No text redundancy (actively strip and only keep the deepest level (w by definition)

I'd also propose changing the default to minimal then. Full text redundancy is not necessary usually.

[proycon]

Is this option accessible already from the frog configuration?

[kosloot]

no.
I assume this is a wish :P

[proycon]

yep ;)

[kosloot]

your wish is our command. So a -T / --textredundancy option is added now.
Also the default is set to 'minimal'