[issue44170] ShareableList cannot safely handle multibyte utf-8 characters

Andrei Kulakov added the comment: I've confirmed this issue is still present in 3.11. -- ___ Python tracker ___ ___ Python-bugs-lis

[issue44170] ShareableList cannot safely handle multibyte utf-8 characters

Andrei Kulakov added the comment: We classify 'crash' type as seg faults etc, so changing this to 'behavior' type. -- nosy: +andrei.avk type: crash -> behavior ___ Python tracker

[issue44170] ShareableList cannot safely handle multibyte utf-8 characters

Change by Roundup Robot : -- keywords: +patch nosy: +python-dev nosy_count: 1.0 -> 2.0 pull_requests: +24920 stage: -> patch review pull_request: https://github.com/python/cpython/pull/26328 ___ Python tracker _

[issue44170] ShareableList cannot safely handle multibyte utf-8 characters

Huw Jones added the comment: The workaround I am using is to manually encode/decode. For the MWE, this means encoding on the creation side ``` shared_list = smm.ShareableList([s.encode() for s in strings]) ``` and decoding before using the string ``` for enc_str in shared_list: string = enc

[issue44170] ShareableList cannot safely handle multibyte utf-8 characters

New submission from Huw Jones : I've experienced a UnicodeDecodeError when adding unicode strings that contain multibye utf-8 characters into a shareable list. My observation is that ShareableList chunks the list of strings before sending it over the process boundary, however this chunking proc