alexerdmann / her Goto Github PK

Hello,

In the step 5, we have to use files with fts extension but I don"t understand how can I get these files. How to do it? Thank you.
The line command:

sh Scripts/tag_and_rank.sh Models/CRF/best_seed.cls Data/Splits/fullCorpus.seed-$seed_size.unannotated.fts Data/Splits/fullCorpus.seed-$seed_size.unannotated.probs Data/Splits/fullCorpus.seed-$seed_size.unannotated.fts Data/Splits/fullCorpus.seed-$seed_size.seed.fts $sortMethod Models/RankedSents/fullCorpus.seed-$seed_size.$sortMethod None $entities

@alexerdmann In Prerequisites.md you advise new users to try installing CRF with Homebrew:

With Homebrew installed, CRFsuite can be installed as follows:

brew tap brewsci/science
brew install crfsuite

But Homebrew isn't supporting the brewsci/science tap any more, apparently not since 2018. Probably best to remove this info from your guide.

(base) zhenshengli@ZhenshengdeMacBook-Pro her % python Scripts/cross_validation.py -testable Data/Splits/fullCorpus.seed-$seed_size.seed -fullCorpus Data/Prepared/fullCorpus.txt -identify_best_feats True -train_best True -unannotated Data/Splits/fullCorpus.seed-$seed_size.unannotated

Scripts/getFeatures_train_test.sh: line 15: crfsuite: command not found
Scripts/getFeatures_train_test.sh: line 19: crfsuite: command not found
Traceback (most recent call last):
File "Scripts/cross_validation.py", line 154, in
bestSet, bestScore = get_best_feature_set(number_of_folds, alwaysTrain, testable, POSSIBLE_FEATS, fullCorpus)
File "Scripts/cross_validation.py", line 123, in get_best_feature_set
score = n_way_cross_validation(feature_set, alwaysTrain, number_of_folds, testable, fullCorpus)
File "Scripts/cross_validation.py", line 99, in n_way_cross_validation
F, total = custom_eval_biased_recall_exclusive(test, predictions)
File "/Users/zhenshengli/Downloads/HER-master/her/Scripts/customEval.py", line 414, in custom_eval_biased_recall_exclusive
list_recall = custom_list_eval_exclusive(test, predictions)
File "/Users/zhenshengli/Downloads/HER-master/her/Scripts/customEval.py", line 118, in custom_list_eval_exclusive
predLine = predictions[index+predDiff]
IndexError: list index out of range
(base) zhenshengli@ZhenshengdeMacBook-Pro her % python Scripts/cross_validation.py -testable Data/Splits/fullCorpus.seed-$seed_size.seed -fullCorpus Data/Prepared/fullCorpus.txt -identify_best_feats True -train_best True -unannotated Data/Splits/fullCorpus.seed-$seed_size.unannotated

Scripts/getFeatures_train_test.sh: line 15: crfsuite: command not found
Scripts/getFeatures_train_test.sh: line 19: crfsuite: command not found
Traceback (most recent call last):
File "Scripts/cross_validation.py", line 154, in
bestSet, bestScore = get_best_feature_set(number_of_folds, alwaysTrain, testable, POSSIBLE_FEATS, fullCorpus)
File "Scripts/cross_validation.py", line 123, in get_best_feature_set
score = n_way_cross_validation(feature_set, alwaysTrain, number_of_folds, testable, fullCorpus)
File "Scripts/cross_validation.py", line 99, in n_way_cross_validation
F, total = custom_eval_biased_recall_exclusive(test, predictions)
File "/Users/zhenshengli/Downloads/HER-master/her/Scripts/customEval.py", line 414, in custom_eval_biased_recall_exclusive
list_recall = custom_list_eval_exclusive(test, predictions)
File "/Users/zhenshengli/Downloads/HER-master/her/Scripts/customEval.py", line 118, in custom_list_eval_exclusive
predLine = predictions[index+predDiff]
IndexError: list index out of range
(base) zhenshengli@ZhenshengdeMacBook-Pro her % python Scripts/cross_validation.py -testable Data/Splits/fullCorpus.seed-$seed_size.seed -fullCorpus Data/Prepared/fullCorpus.txt -identify_best_feats True -train_best True -unannotated Data/Splits/fullCorpus.seed-$seed_size.unannotated

Scripts/getFeatures_train_test.sh: line 15: crfsuite: command not found
Scripts/getFeatures_train_test.sh: line 19: crfsuite: command not found
Traceback (most recent call last):
File "Scripts/cross_validation.py", line 154, in
bestSet, bestScore = get_best_feature_set(number_of_folds, alwaysTrain, testable, POSSIBLE_FEATS, fullCorpus)
File "Scripts/cross_validation.py", line 123, in get_best_feature_set
score = n_way_cross_validation(feature_set, alwaysTrain, number_of_folds, testable, fullCorpus)
File "Scripts/cross_validation.py", line 99, in n_way_cross_validation
F, total = custom_eval_biased_recall_exclusive(test, predictions)
File "/Users/zhenshengli/Downloads/HER-master/her/Scripts/customEval.py", line 414, in custom_eval_biased_recall_exclusive
list_recall = custom_list_eval_exclusive(test, predictions)
File "/Users/zhenshengli/Downloads/HER-master/her/Scripts/customEval.py", line 118, in custom_list_eval_exclusive
predLine = predictions[index+predDiff]
IndexError: list index out of range