--- base_model: - aixonlab/Zara-14b-v1.2 - sthenno-com/miscii-14b-0218 - Sakalti/Saka-14B - Qwen/Qwen2.5-14B-Instruct - prithivMLmods/Galactic-Qwen-14B-Exp2 - Cran-May/tempmotacilla-cinerea-0308 - suayptalha/Lamarckvergence-14B - deepcogito/cogito-v1-preview-qwen-14B - mergekit-community/mergekit-task_arithmetic-yxycruu library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Qwen/Qwen2.5-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-14B-Instruct) as a base. ### Models Merged The following models were included in the merge: * [aixonlab/Zara-14b-v1.2](https://huggingface.co/aixonlab/Zara-14b-v1.2) * [sthenno-com/miscii-14b-0218](https://huggingface.co/sthenno-com/miscii-14b-0218) * [Sakalti/Saka-14B](https://huggingface.co/Sakalti/Saka-14B) * [prithivMLmods/Galactic-Qwen-14B-Exp2](https://huggingface.co/prithivMLmods/Galactic-Qwen-14B-Exp2) * [Cran-May/tempmotacilla-cinerea-0308](https://huggingface.co/Cran-May/tempmotacilla-cinerea-0308) * [suayptalha/Lamarckvergence-14B](https://huggingface.co/suayptalha/Lamarckvergence-14B) * [deepcogito/cogito-v1-preview-qwen-14B](https://huggingface.co/deepcogito/cogito-v1-preview-qwen-14B) * [mergekit-community/mergekit-task_arithmetic-yxycruu](https://huggingface.co/mergekit-community/mergekit-task_arithmetic-yxycruu) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: prithivMLmods/Galactic-Qwen-14B-Exp2 - model: deepcogito/cogito-v1-preview-qwen-14B - model: sthenno-com/miscii-14b-0218 - model: Cran-May/tempmotacilla-cinerea-0308 - model: suayptalha/Lamarckvergence-14B - model: Sakalti/Saka-14B - model: aixonlab/Zara-14b-v1.2 - model: mergekit-community/mergekit-task_arithmetic-yxycruu merge_method: model_stock base_model: Qwen/Qwen2.5-14B-Instruct dtype: bfloat16 tokenizer_source: base ```