Is your feature request related to a problem? Please describe.
I am using Nginx as a proxy for my LLM providers. There is LiteLLM proxy, that I run on same nginx server, having this in the UI would be fantastic.
Describe the solution you'd like
A menu on the left for LLM Proxy where I could select among the major LLM vendor and my nginx could support the OPENAI Api to route the traffic toward that particular vendor.
Describe alternatives you've considered
Manual and separate configuration for both nginx and LiteLLm on same VM.
Is your feature request related to a problem? Please describe.
I am using Nginx as a proxy for my LLM providers. There is LiteLLM proxy, that I run on same nginx server, having this in the UI would be fantastic.
Describe the solution you'd like
A menu on the left for LLM Proxy where I could select among the major LLM vendor and my nginx could support the OPENAI Api to route the traffic toward that particular vendor.
Describe alternatives you've considered
Manual and separate configuration for both nginx and LiteLLm on same VM.