OpenHermes 2.5 Mistral 7B

OpenHermes 2.5 Mistral 7B is Teknium's March 2024 continuation of the OpenHermes line, fine tuning Mistral 7B on roughly one million entries of primarily GPT-4 generated data plus high quality open datasets, with a notable share of code instruction data. It improved on OpenHermes 2 across GPT4All, AGIEval, TruthfulQA, and HumanEval.

The dataset became the foundation for Nous Research's Hermes 2 family, which trained its flagship Mixtral DPO model on the OpenHermes 2.5 collection. Released under Apache 2.0, it remains a reference point for the 2024 wave of synthetic data fine tunes.