Custom interface for Hy-MT2-30B-A3B-Q4_K_M, hopefully mogging DeepL.
Hy-MT2-30B-A3B-Q4_K_M
0/500 characters
Status: Ready.
Shout out to LTEngine for the idea, fuck it we're also running on blazing fast rust 🚀🚀🚀.Perhaps I'll open source this one day. (Currently running on a EPYC 7K62)