Large Language Model Services
Assistants
About
Welcome to the LLM (Large Language Model) services provided by ScaDS.AI. Our API offers flexibility and efficiency, enabling you to seamlessly integrate sophisticated LLMs into your applications.
For an overview, check out our poster.
How Can I Chat With an LLM?
The easiest way to use our LLMs is the ScaDS.AI Chatbot on Slack (ScaDS.AI employees only). Alternatively, you might try our Chat Web Interface, where you can log in with your university account and start chatting in multiple languages.
How to Get Access to the API?
Our services are compatible with the OpenAI API and can even be integrated into your text editor or IDE.
Please see our repository
of usage examples for further information what is possible.
To access our services, you need an API key. To get one, please send an email to scadscat@tu-dresden.de
with the following information:
Could you please give me an API key to access the services?
I work on <put_your_topic_or_interest> in <put_name_of_your_group_leader>'s group.
Best regards,
⚠ Please don't share the API key with other people.
Available Models via API
We retain the right to change models, so that we can provide models that suits your applications and our infrastructure best. You can, however, use one of the following model aliases for more reliable applications:
- alias-ha (general model, high availability)
- alias-code (coding support)
- alias-reasoning
- alias-image-generation (to generate images from text)
- alias-vision (to ask questions about images)
⚠ Behind each alias, there is a default model and a chain of fallback models that are tried if the default model is unhealthy.
The exact model that provided the output is mentioned in the response. If you want to avoid using fallbacks, use "disable_fallbacks": true as described on the LiteLLM documentation. If you use the openai Python library, add parameter extra_body={"disable_fallbacks": true} to the client.chat.completions.create call.
Usage Policies
Please review the usage policies and rules of this service before using it. By using the service, you agree to comply with these policies and rules.
Want to Contribute?
Please contact scadscat@tu-dresden.de