LLM API keys Management Improvement

[stephaneminisini]

Describe the feature or potential improvement

A few things I would love to see in a future release related to LLM API keys management:

• Hierarchical API keys management. Right now we can set the LLM API keys per project, it would be very useful to have it at the organization level and being able to overwrite / change the models in the project.
• Being able to change the list of custom models used. Currently if I use a proxy (LiteLLM for example), I can enter the model names at config time but If I want to add a new model, I have to delete the config and recreate (which with my first point becomes very painful if you have several projects)
• Being able to get the list of models from LiteLLM rather than typing it as custom models.
  Thanks

Additional information

No response