Subject: bug#104: devuan-i18n: Utf8 problems in X vs console for file names and others

From: PICCORO McKAY Lenz <[email-masked]>
Date: Tue, 6 Jun 2017 11:57:22 -0400

Package: debian-i18n
Severity: important

Dear Maintainer,

there some problems with utf8 files...

i not use recent Debian versions, i used directly Devuan,
and respect Debian squeeze i noted that by example the file:
@El universo últimos descubrimientos.mp4@
are displayed as
@El universo ?@ltimos descubrimientos.mp4@

ok that not so bad.. but the problerm not end here,
if i try to added that file to smplayer, smplayer :
1) if the file name are added to list or opened, does not play
2) sometimes file name are not displayed in file browser event i
specified "all files" in filter

this NOT HAPPENED in Debin squeeze, but i noted happened in Debian jeesie
(i never used the wheeze and i now use only the Devuan)

i set correctly the locales to es_VE.utf8 and also generated
en_US.utf8 and es_ES.utf8,
also install all related packages for Spanish including dictionaries

IMPORTANT: i later switch to en_US.utf8 and problems still persis,
i used devuan 1.0.0 final stable but due seems are this problem
inherits from Debian
maybe in the final 1.0.0 stable still persist

-- System Information:
Distributor ID: Devuan
Description: Devuan GNU/Linux 1.0 (jessie)
Release: 1.0
Codename: jessie
Architecture: i686

Kernel: Linux 3.16.0-4-686-pae (SMP w/4 CPU cores)
Locale: LANG=es_VE.UTF-8, LC_CTYPE=es_VE.UTF-8 (charmap=ANSI_X3.4-1968)
Shell: /bin/sh linked to /bin/dash
Init: sysvinit (via /sbin/init)

Lenz McKAY Gerardo (PICCORO)
http://qgqlochekone.blogspot.com

---

From: Mark Hindley <[email-masked]>
Date: Fri, 3 Feb 2023 12:43:59 +0000

> there some problems with utf8 files...

Is this still an issue?

Mark

---

From: PICCORO McKAY Lenz <[email-masked]>
Date: Fri, 3 Feb 2023 10:45:17 -0400

Yes, it is. a long issue.. i am surprised that after many years becoming to
pay attention to users

--

---

From: PICCORO McKAY Lenz <[email-masked]>
Date: Fri, 3 Feb 2023 10:45:47 -0400

---

From: Mark Hindley <[email-masked]>
Date: Fri, 3 Feb 2023 15:25:16 +0000

> Locale: LANG=es_VE.UTF-8, LC_CTYPE=es_VE.UTF-8 (charmap=ANSI_X3.4-1968)

You appear to have a mismatched locale setting. Where is the ANSI_X3.4-1968
charmap coming from? What is the output of `locale' and `locale charmap'?

I have no problems with this either in the console or GUI:

/tmp% touch últimos
/tmp% ls -l últimos
-rw-r--r-- 1 mark mark 0 Feb  3 15:12 últimos
/tmp% locale
LANG=en_GB.UTF-8
LANGUAGE=en_GB:en
LC_CTYPE="en_GB.UTF-8"
LC_NUMERIC="en_GB.UTF-8"
LC_TIME="en_GB.UTF-8"
LC_COLLATE="en_GB.UTF-8"
LC_MONETARY="en_GB.UTF-8"
LC_MESSAGES="en_GB.UTF-8"
LC_PAPER="en_GB.UTF-8"
LC_NAME="en_GB.UTF-8"
LC_ADDRESS="en_GB.UTF-8"
LC_TELEPHONE="en_GB.UTF-8"
LC_MEASUREMENT="en_GB.UTF-8"
LC_IDENTIFICATION="en_GB.UTF-8"
LC_ALL=
/tmp% locale charmap
UTF-8

Mark

---

From: PICCORO McKAY Lenz <[email-masked]>
Date: Mon, 6 Feb 2023 16:55:18 -0400

in the current devuan i dont know were such key raised. the `locale
charmap` command outputs
the same that is another name for USAS X3.4-1968, a revision of ASCII that
is distinguished first revision
to allow a linefeed (LF) to occur on its own (i.e. not preceded by or
followed by a carriage return (CR)).

 iguess is something related to windosers, my current env have mixed
russian and english maybe
due that i have such locale charmap due that revision introduced the common
name of (US-)ASCII.

This is basically ASCII as we think of it, although there were two minor
revisions that followed it.
also desktop in devuan when i set to russian with spanish as default just
dont follow the encoding

---

From: Mark Hindley <[email-masked]>
Date: Tue, 7 Feb 2023 12:22:15 +0000

I still can't reproduce this. What terminal emulator are you using?

Mark

---

From: PICCORO McKAY Lenz <[email-masked]>
Date: Tue, 7 Feb 2023 11:29:48 -0400

maybe cos you dont have mixed lang env.. i was using xterm and sakura but
both build by myself

also i am using devuan 1 and devuan 2, devuan 3 tested and seems if you
install mixed env with chinese , russian and spanish .. it happened..

more users already report this but only in telegram chats from latam, somne
years ago pre covid.. but of course devuan bla bla bla conclaves just said
"it works for me" and later banned those users

---

From: Mark Hindley <[email-masked]>
Date: Tue, 7 Feb 2023 16:57:27 +0000

Control: tags -1 unreproducible

On Tue, Feb 07, 2023 at 11:29:48AM -0400, PICCORO McKAY Lenz wrote:
>    maybe cos you dont have mixed lang env.. i was using xterm and sakura
>    but both build by myself

I have setup a mixed landuage environment and still can't reproduce.

Can you try to with the stock xterm, rather than your recompilation please? It
is going to be impossible to debug if I can't replicate it.

Thanks.

Mark

---

From: PICCORO McKAY Lenz <[email-masked]>
Date: Tue, 7 Feb 2023 22:33:31 -0400

Ok, I will try.  but i must do at the 15 or 16 of the Feb,.., due currently
i am over traveling and busy,  i will feedback thanks for your interest