File size: 4,701 Bytes
73f8e2b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4c5ae46
73f8e2b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4c5ae46
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
---
base_model:
- allknowingroger/Qwenslerp4-14B
- djuna/Q2.5-Veltha-14B-0.5
- jpacifico/Chocolatine-2-14B-Instruct-v2.0b3
- JungZoona/T3Q-qwen2.5-14b-v1.0-e3
- deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
- Triangle104/Herodotos-14B
- arcee-ai/Virtuoso-Small-v2
- suayptalha/Lamarckvergence-14B
- allknowingroger/QwenStock3-14B
- tanliboy/lambda-qwen2.5-14b-dpo-test
- CultriX/Qwen2.5-14B-Verged
- prithivMLmods/Galactic-Qwen-14B-Exp2
- sometimesanotion/Qwen2.5-14B-Vimarckoso-v3
- deepcogito/cogito-v1-preview-qwen-14B
- mergekit-community/VirtuosoSmall-InstructModelStock
- spacematt/Qwen2.5-Casual-Coder-14B-Instruct
- sometimesanotion/Lamarck-14B-v0.7
- sometimesanotion/Qwenvergence-14B-v13-Prose-DS
- YOYO-AI/Qwen2.5-14B-YOYO-V5
- CultriX/Qwen2.5-14B-Wernicke
- CultriX/Qwen2.5-14B-Ultimav2
- allura-org/TQ2.5-14B-Aletheia-v1
- wanlige/li-14b-v0.4
library_name: transformers
tags:
- mergekit
- merge
license: apache-2.0
---
# merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [spacematt/Qwen2.5-Casual-Coder-14B-Instruct](https://huggingface.co/spacematt/Qwen2.5-Casual-Coder-14B-Instruct) as a base.

### Models Merged

The following models were included in the merge:
* [allknowingroger/Qwenslerp4-14B](https://huggingface.co/allknowingroger/Qwenslerp4-14B)
* [djuna/Q2.5-Veltha-14B-0.5](https://huggingface.co/djuna/Q2.5-Veltha-14B-0.5)
* [jpacifico/Chocolatine-2-14B-Instruct-v2.0b3](https://huggingface.co/jpacifico/Chocolatine-2-14B-Instruct-v2.0b3)
* [JungZoona/T3Q-qwen2.5-14b-v1.0-e3](https://huggingface.co/JungZoona/T3Q-qwen2.5-14b-v1.0-e3)
* [deepseek-ai/DeepSeek-R1-Distill-Qwen-14B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-14B)
* [Triangle104/Herodotos-14B](https://huggingface.co/Triangle104/Herodotos-14B)
* [arcee-ai/Virtuoso-Small-v2](https://huggingface.co/arcee-ai/Virtuoso-Small-v2)
* [suayptalha/Lamarckvergence-14B](https://huggingface.co/suayptalha/Lamarckvergence-14B)
* [allknowingroger/QwenStock3-14B](https://huggingface.co/allknowingroger/QwenStock3-14B)
* [tanliboy/lambda-qwen2.5-14b-dpo-test](https://huggingface.co/tanliboy/lambda-qwen2.5-14b-dpo-test)
* [CultriX/Qwen2.5-14B-Verged](https://huggingface.co/CultriX/Qwen2.5-14B-Verged)
* [prithivMLmods/Galactic-Qwen-14B-Exp2](https://huggingface.co/prithivMLmods/Galactic-Qwen-14B-Exp2)
* [sometimesanotion/Qwen2.5-14B-Vimarckoso-v3](https://huggingface.co/sometimesanotion/Qwen2.5-14B-Vimarckoso-v3)
* [deepcogito/cogito-v1-preview-qwen-14B](https://huggingface.co/deepcogito/cogito-v1-preview-qwen-14B)
* [mergekit-community/VirtuosoSmall-InstructModelStock](https://huggingface.co/mergekit-community/VirtuosoSmall-InstructModelStock)
* [sometimesanotion/Lamarck-14B-v0.7](https://huggingface.co/sometimesanotion/Lamarck-14B-v0.7)
* [sometimesanotion/Qwenvergence-14B-v13-Prose-DS](https://huggingface.co/sometimesanotion/Qwenvergence-14B-v13-Prose-DS)
* [YOYO-AI/Qwen2.5-14B-YOYO-V5](https://huggingface.co/YOYO-AI/Qwen2.5-14B-YOYO-V5)
* [CultriX/Qwen2.5-14B-Wernicke](https://huggingface.co/CultriX/Qwen2.5-14B-Wernicke)
* [CultriX/Qwen2.5-14B-Ultimav2](https://huggingface.co/CultriX/Qwen2.5-14B-Ultimav2)
* [allura-org/TQ2.5-14B-Aletheia-v1](https://huggingface.co/allura-org/TQ2.5-14B-Aletheia-v1)
* [wanlige/li-14b-v0.4](https://huggingface.co/wanlige/li-14b-v0.4)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: sometimesanotion/Qwen2.5-14B-Vimarckoso-v3
  - model: JungZoona/T3Q-qwen2.5-14b-v1.0-e3
  - model: deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
  - model: prithivMLmods/Galactic-Qwen-14B-Exp2
  - model: CultriX/Qwen2.5-14B-Wernicke
  - model: CultriX/Qwen2.5-14B-Ultimav2
  - model: allknowingroger/Qwenslerp4-14B
  - model: wanlige/li-14b-v0.4
  - model: allknowingroger/QwenStock3-14B
  - model: tanliboy/lambda-qwen2.5-14b-dpo-test
  - model: CultriX/Qwen2.5-14B-Verged
  - model: arcee-ai/Virtuoso-Small-v2
  - model: mergekit-community/VirtuosoSmall-InstructModelStock
  - model: sometimesanotion/Lamarck-14B-v0.7
  - model: suayptalha/Lamarckvergence-14B
  - model: allura-org/TQ2.5-14B-Aletheia-v1
  - model: YOYO-AI/Qwen2.5-14B-YOYO-V5
  - model: deepcogito/cogito-v1-preview-qwen-14B
  - model: sometimesanotion/Qwenvergence-14B-v13-Prose-DS
  - model: Triangle104/Herodotos-14B
  - model: jpacifico/Chocolatine-2-14B-Instruct-v2.0b3
  - model: djuna/Q2.5-Veltha-14B-0.5
merge_method: model_stock
base_model: spacematt/Qwen2.5-Casual-Coder-14B-Instruct
normalize: true
int8_mask: true
dtype: bfloat16
```