Russian filenames are corrupt in Windows GUI about bleachbit

[az0]

To test this, how do you force Python to show localized exceptions? On my Windows system I tried environment variables and settings in the Windows Control Panel, but the exceptions are in English.

[vovkkk]

I do not know, it seems very inconsistent: sometimes exseption contains actual message, sometimes message is an empty string.

For example, I can get following weirdness in IDLE 2.7.8:

In first case it properly say that there is sintax error in filename (since backslashes are not escaped)
in second case it say nothing, while should complain that directory is not empty.

Also, I’m not really familiar with codebase of BleachBit, but I have a feeling that MoveFileEx has some relation to pywin or ctypes, no?

[vovkkk]

How to reproduce for pywin:

1. Make sure that you use some language that contains non-ascii characters (Greek, Russian, etc.) as a GUI language (set it in Control panel) and choose that language for application that do not support Unicode:

   
   

2. Create some file and make it unaccessible for current user (Properties → Security).

3. Try to use MoveFileEx on that file.

   import win32api, win32con
   
   win32api.MoveFileEx('C:\\Users\\vova\\Desktop\\1', None, win32con.MOVEFILE_DELAY_UNTIL_REBOOT)

Results

• Russian: error: (5, 'MoveFileEx', '\xce\xf2\xea\xe0\xe7\xe0\xed\xee \xe2 \xe4\xee\xf1\xf2\xf3\xef\xe5.')

  

• Greek: error: (5, 'MoveFileEx', '\xc4\xe5\xed \xe5\xf0\xe9\xf4\xf1\xdd\xf0\xe5\xf4\xe1\xe9 \xe7 \xf0\xf1\xfc\xf3\xe2\xe1\xf3\xe7.')

  

[az0]

Is this still an issue with BleachBit 2.0 or greater? There were many fixes for encoding in BleachBit 2.0

[vovkkk]

Apparently it is not an issue in 2.0, but there is a similar issue with paths:

Новая папка (2)\Новый текстовый документ.txt

[az0]

Thank you for the screenshot. I change the title of this ticket to: Russian filenames are corrupt in Windows GUI

I will try your instructions to change the Windows settings to reproduce this issue

[az0]

I've had trouble reproducing this. I might just need mor eitme. I'll re-target to another milestone to allow more time.

[az0]

@vovkkk I still have not been able to reproduce this, but there have been many related fixes and changes. Would you please test build 1237? This build has some special encoding fixes developed by a contractor focusing on encoding issues. These fixes are not yet merged into the master branch, so they are not in most of the CI builds yet. In other words, please don't test a newer build at this time: please test build 1237.

[vovkkk]

There are still issue in recognizing custom paths, even with Latin letters:

Новая папка (2)
pasgan ùr

Messages are improved

[az0]

Recently there was much work to update from Python 2.7 to Python 3 on Windows. While this wasn't directly targeted at this bug, it did have a major impact on how the system handles Unicode, so it might have helped.

Would you please test build 3.9.0.1540 or newer?

[az0]

I am closing because (1) no response after some time and (2) it is likely there is an improvement.

If you have the same bug with BleachBit 3.9 or higher, re-open this bug. If the symptoms are different, open a new bug ticket.

[az0]

The digitally-signed Windows installer is now available from the page BleachBit 3.9.0 beta