@microsoft_worm @TomboyTesting 3.1-405 is far & away the best open base model available imo so 👍
the chinese ones are interesting bc of the language mix & they tend to do coder/non-coder vers so you can try diff data mixes. and then mixtral (or 4base if you can swing it) if you want to try MoE. but 405👍
the chinese ones are interesting bc of the language mix & they tend to do coder/non-coder vers so you can try diff data mixes. and then mixtral (or 4base if you can swing it) if you want to try MoE. but 405👍