Integrate the semantic kernel via API about llamasharp

[AsakusaRinne]

Thank you for your suggestion, that means a lot. I'll ask about that in semantic kernel.

[geffzhang]

You can encapsulate a connector package here, similar to https://github.com/microsoft/semantic-kernel/tree/main/dotnet/src/Connectors/Connectors.AI.HuggingFace . This way we can iterate freely

[AsakusaRinne]

You can encapsulate a connector package here, similar to https://github.com/microsoft/semantic-kernel/tree/main/dotnet/src/Connectors/Connectors.AI.HuggingFace . This way we can iterate freely

Thank you. I've opened an issue in semantic-kernel to ask if the integration could be added to the repo (I'll work for it). I'll made a package ourselves if the proposal is not supported.

[KKD4Soei]

请问是否有量化成功的经验，ggml-vic13b-q5_1.bin 模型本地量化时失败了。

[geffzhang]

use LLamaSharp to implement the Completion and Embedding interfaces of the semantic kernel
https://github.com/xbotter/semantic-kernel-LLamaSharp

[AsakusaRinne]

请问是否有量化成功的经验，ggml-vic13b-q5_1.bin 模型本地量化时失败了。

q5_1已经是量化过后的了，可以试一下量化fp32或者fp16模型，或者切换一下LLamaSharp的版本