MattGPT
That's right everyone, I have set up a LLM on my server that is accessible to select matt-cloud users. Remember you can check your group membership at the groups site - look for mattgpt-access. MattGPT is located at https://gpt.matt-cloud.com. The source code for this can be found here.
When you get there, you can log in with the trusty Continue with Matt-Cloud button.
When you login, you will be greeted with the default model of deepseek-coder-v2 because I usually use LLM's as a computer science intern. In the top corner you can change between models. If there's a model you'd like to try, you can search for it here and send Matt an email or text or whatever and ask if it can be installed. Answer is much more likely to be yes than no assuming the system is operating properly.
I currently have 12 models installed here. Default is deepseek-coder-v2 because it's a decent computer science intern, but I believe you can configure your own default model.
This is actually a pretty advanced system and I don't know exactly what its full capabilities are, so if you find something powerful or scary be gentle and let me know. This is AI here, and while these are "just LLM's" if those LLMs have certain access or information they can get spicy.


No Comments