Output HTML contains NULL chracters in at least CJK languages about docusaurus

[tats-u]

can you tell me if you see anything weird in these input MD files?

No NULL characters are found in html, md, mdx, json, or css files in your ZIP archive.

I was just wondering, couldn't this be a Crowdin translation issue?

I found this issue in my (our) site where i18n is not applied, so I am convinced that Crowdin is not concerned with it.

[Josh-Cena]

Have you checked if it's an MDX issue? Hard to believe Docusaurus has anything to do here. I can also test later.

[tats-u]

I will check other CJK sites built with other software (e.g. Astro & Nextra).

[Josh-Cena]

When I'm debugging this, I usually isolate an MDX compiler with the same setup as Docusaurus, and invoke it programmatically.

[tats-u]

None of Astro & Nextra sites seem to be affected.

• https://swr.vercel.app/ja/docs/getting-started (Nextra)
• https://biomejs.dev/ja/guides/getting-started/ (Astro)
• https://docs.astro.build/ja/guides/view-transitions/ (Astro)

Rspress, which also uses MDX (maybe uses mdxjs-rs or markdown-rs instead), is not affected.

• https://rspress.dev/zh/plugin/system/plugin-api.html

However, The document of Ant Design is affected. (They do not use Docusaurus or MDX but only remark.

• https://ant.design/docs/blog/line-ellipsis-cn

Also, the demo of @easyops-cn/docusaurus-search-local is affected only when the UI language is Chinese despite the fact that the page content is the same one written in Chinese. This is strange and interesting.

• https://easyops-cn.github.io/docusaurus-search-local/blog/ (not contaminated)
• https://easyops-cn.github.io/docusaurus-search-local/zh-CN/blog/ (contaminated)

[slorber]

Hey

To be honest I'm not super familiar with any of those concepts and won't have the bandwidth to investigate much 😅

I was just wondering, couldn't this be a Crowdin translation issue?

I'm not super skilled in rg and perl, can you tell me if you see anything weird in these input MD files?

zh-CN.zip

[slorber]

Thanks for investigating.

Also worth giving a try to use this env variable on your site when building: process.env.SKIP_HTML_MINIFICATION === 'true'

[tats-u]

Neither of $env:SKIP_HTML_MINIFICATION = "true" (I am using PowerShell) nor --no-minify helped.
MDX part was still minified.
Also, changing the locale from "ja" to "en" did not, either.

[tats-u]

https://typescriptbook.jp/ (https://github.com/yytypescript/book)

This site uses Docusaurus 2.4.1, and NULL chars are not found there.

[Josh-Cena]

I will check this afternoon. There's a chance that there's something environment specific.