Question about fine-tuning on squad dataset about electra

[clarkkev]

Huh, that is strange for it to exit with no error message. Can you add some print statements to find exactly at which point it exits?

[curtis0982]

I add some print statements in preprocessing.py to see what's going on:
` utils.log("Loading dataset", dataset_name)

n_examples = None

if (self._config.use_tfrecords_if_existing and

    tf.io.gfile.exists(metadata_path)):

  n_examples = utils.load_json(metadata_path)["n_examples"]

print("      n_examples = utils.load_json(metadata_path)[n_examples]\n")

if n_examples is None:

  utils.log("Existing tfrecords not found so creating")

  examples = []

  print("\n examples = [] \n")

  for task in tasks:
    print("\ntask:",task,"\n")

    task_examples = task.get_examples(split)

    print("\n task_examples = task.get_examples(split)\n")

    examples += task_examples

    print("\nexamples += task_examples\n")

  if is_training:
    random.shuffle(examples)

    print("\n random.shuffle(examples) \n")

  utils.mkdir(tfrecords_path.rsplit("/", 1)[0])

  print("\n utils.mkdir(tfrecords_path.rsplit("/", 1)[0]) \n")

  n_examples = self.serialize_examples(
      examples, is_training, tfrecords_path, batch_size)

  print("\n n_examples = self.serialize_examples( \n")

  utils.write_json({"n_examples": n_examples}, metadata_path)`

The output is like this:
Loading dataset squad_train
n_examples = utils.load_json(metadata_path)[n_examples]

Existing tfrecords not found so creating

examples = []

task: Task(squad)

(env_tf115) D:\python_code\NLP\electra>

It seems that what is not working properly is "task_examples = task.get_examples(split)"
I'm trying to figure it out.

To see what is going on with .get_examples method
I checked qa_tasks.py
I found out that this line is not working:
input_data = json.load(f)["data"]

[curtis0982]

Updated:
In my case
Some code in finetune/qa/qa_tasks.py is not functioning properly.
'with tf.io.gfile.GFile(os.path.join(
self.config.raw_data_dir(self.name),
split + ("-debug" if self.config.debug else "") + ".json"), "r") as f:'
I printed
os.path.join(self.config.raw_data_dir(self.name),split + ("-debug" if self.config.debug else "") + ".json
to see if the path is right.

My squad datadir located "D:\python_code\NLP\electra\datadir\finetuning_data\squad"
,so the squad training set path should be
"D:\python_code\NLP\electra\datadir\finetuning_data\squad\train.json"
But it is actually "squad\train.json"
So I changed this line
self.config.raw_data_dir(self.name)
to my data_dir path.
The program started making tfrecord files, so I think this issue has been solved.