Favicon for huggingfaceh4

Zephyr 141B-A35B

huggingfaceh4/zephyr-orpo-141b-a35b

Model weights

Zephyr 141B-A35B is A Mixture of Experts (MoE) model with 141B total parameters and 35B active parameters. Fine-tuned on a mix of publicly available, synthetic datasets.

It is an instruct finetune of Mixtral 8x22B.

#moe

Modalities
Context
66K
Released
Apr 12, 2024
Knowledge cutoff
Jan 2024

Activity

Token volume and request traffic to this model over time.

Not currently available through EU in-region routing. In-region routing docs

Frequently asked questions

Explore more models