Where is normalized code? about codexglue

[guody5]

Normalized Code is provided here:
https://github.com/microsoft/CodeXGLUE/blob/main/Text-Code/NL-code-search-Adv/dataset.zip.

You can find the normalized code in "function_tokens" field of test_code.jsonl. I list one line here:

{"url": "https://github.com/soimort/you-get/blob/b746ac01c9f39de94cac2d56f665285b0523b974/src/you_get/extractors/miomio.py#L41-L51", "sha": "b746ac01c9f39de94cac2d56f665285b0523b974", "docstring_summary": "str->list\n    Convert XML to URL List.\n    From Biligrab.", "language": "python", "parameters": "(xml_data)", "return_statement": "return rawurl", "argument_list": "", "function_tokens": ["def", "Func", "(", "arg_0", ")", ":", "arg_1", "=", "[", "]", "arg_2", "=", "parseString", "(", "arg_0", ")", "for", "arg_3", "in", "arg_2", ".", "getElementsByTagName", "(", "'durl'", ")", ":", "arg_4", "=", "arg_3", ".", "getElementsByTagName", "(", "'url'", ")", "[", "0", "]", "arg_1", ".", "append", "(", "arg_4", ".", "childNodes", "[", "0", "]", ".", "data", ")", "return", "arg_1"], "function": "def Func(arg_0):\n    \"\"\"str->list\n    Convert XML to URL List.\n    From Biligrab.\n    \"\"\"\n    arg_1 = []\n    arg_2 = parseString(arg_0)\n    for arg_3 in arg_2.getElementsByTagName('durl'):\n        arg_4 = arg_3.getElementsByTagName('url')[0]\n        arg_1.append(arg_4.childNodes[0].data)\n    return arg_1", "path": "src/you_get/extractors/miomio.py", "identifier": "sina_xml_to_url_list", "docstring": "str->list\n    Convert XML to URL List.\n    From Biligrab.", "docstring_tokens": ["str", "-", ">", "list", "Convert", "XML", "to", "URL", "List", ".", "From", "Biligrab", "."], "nwo": "soimort/you-get", "score": 0.9997601519430084}