SQLSTATE[HY000]: [Microsoft][ODBC Driver 18 for SQL Server]Unicode conversion failed about msphpsql

[v-makouz]

What does the server give when running select @@version? I tried to reproduce this, but the table query gives errors on every SQL server I tried.

[v-makouz]

I can't seem to reproduce this one. I can execute the select query just fine with no errors. Also the table create query appears to be incorrect, the default values and NULL settings have to come after COLLATE, did it actually work as is?

[v-makouz]

Probably that type of conversion isn't available by default on Alma Linux, I'm not sure since that's not an officially supported OS.

[v-makouz]

Alpine's iconv does not have encodings for Japanese (among others). There is a gnu-libiconv package that contains a lot of the missing code pages, including Japanese ones. I've never used it myself, but apparently this is how you do it:
apk add --no-cache gnu-libiconv to install
ENV LD_PRELOAD /usr/lib/preloadable_libiconv.so before running the app

Here's the page for it, with more info: https://www.gnu.org/software/libiconv/

[ngochangngo52]

select @@Version

Microsoft SQL Server 2016 (SP3-GDR) (KB5021129) - 13.0.6430.49 (X64) 
Jan 22 2023 17:38:22 
Copyright (c) Microsoft Corporation
Standard Edition (64-bit) on Windows Server 2012 R2 Standard 6.3 <X64> (Build 9600: )

[ngochangngo52]

I can't seem to reproduce this one. I can execute the select query just fine with no errors. Also the table create query appears to be incorrect, the default values and NULL settings have to come after COLLATE, did it actually work as is?

It's OCRD table for SAP B1 database, you can find it here https://sap.erpref.com/?schema=BusinessOne9.3&module_id=3&table=OCRD
My app connected to existing SAP B1 database, I don't create new one.
Above creation SQL is just my extraction of structure using Heidi SQL so that can let you know the structure, I don't know the statement is weird to SQL Server :) It's sort of "reverse" from existing database, using Heidi SQL as tool.

The query can run in HeidiSQL, MS Azure Data Studio... but if I run in SqlCmd in the environment above, the error will throw.

[ngochangngo52]

Also the table create query appears to be incorrect, the default values and NULL settings have to come after COLLATE, did it actually work as is?

I just updated the table creation, generate from MS Azure Data Studio should be correct one.

[ngochangngo52]

Run in Laravel via sqlsrv extension

Run directly in sqlcmd utility

Expected result (run in Azure Data Studio, on Windows, it works)

[ngochangngo52]

If I run sqlcmd utility on Windows it will also work

The error is only happened with the sqlcmd on Linux (Alma 9.2) as above

[ngochangngo52]

Just found this https://stackoverflow.com/a/77140830/223934
Basically installing glibc-gconv-extra solve my problem.
sudo dnf install glibc-gconv-extra

But the problem doesn't exist if I don't update. Do you have any idea?

[ngochangngo52]

Probably that type of conversion isn't available by default on Alma Linux, I'm not sure since that's not an officially supported OS.

Not only Alma Linux, but the entire Fedora family (including RHEL, Oracle Linux, Centos). For some distros, glibc already includes gconv, but for Fedora family, the gconv has been splitted in to a separate package glibc-gconv-extra
https://fedoraproject.org/wiki/Changes/Gconv_package_split_in_glibc

I think the ODBC should verify the dependency when installing.

[mtovmassian]

If installing glibc-gconv-extra on Red Hat x glibc systems solve the problem, does a solution exist on Alpine Linux x musl systems?

[v-maximko]

I don't believe that package is available on Alpine, but what encodings are you looking for?

[mtovmassian]

My question is related to this stackoverflow question where the error could be a lack of enconding support for Japanese.