[Feature]: Support for Function Calling or Tools about llamasharp

[AsakusaRinne]

Yes, it is important for using LLM to handling complex works. I'll start making this feature after about 1 month. :)

[abhiaagarwal]

Not yet! I'm currently working out kinks, but I hope to get it done ASAP

[abhiaagarwal]

It's pretty easy to hack together your own function calling. I used Hermes-2-Theta-LLama-3-8B and got acceptable results. What would be nice is C# native annotations that translate functions into OpenAI JSON, which the "function calling method" meta seems to have standardized around. Semantic Kernel also provides this feature if you really need it with their "planner" functionality, I chose to roll my own for resource constraint reasons

[AsakusaRinne]

It's pretty easy to hack together your own function calling. I used Hermes-2-Theta-LLama-3-8B and got acceptable results. What would be nice is C# native annotations that translate functions into OpenAI JSON, which the "function calling method" meta seems to have standardized around.

That's inspiring! May I ask whether you work is open-source? I wonder if I can take a look of your implementation if it's possible. :)