Fine-tuning Experience with Different Model Types
Model | Compatibility | Test Results |
---|---|---|
Qwen3 Series (Non-MOE) | Compatible | Tested and passed |
Qwen3 Series (MOE) | Possibly compatible | Not tested (insufficient VRAM) |
Llama3 Series | Compatible | Tested and passed |
Gemma3 Series | Compatible | Tested and passed |
OpenAI OSS Models | Code may be compatible | Testing failed |
If you need support for additional models, please submit an issue in the project repository or contact me through the personal information in the introduction
I will definitely work hard to adapt them for everyone!