Just a quick slerp merge of 2 Yi 200K models.

Tess20-RPMerge-Merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

migtissera_Tess-2.0-Yi-34B-200K
brucethemoose_Yi-34B-200K-RPMerge

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: /home/alpha/Models/Raw/brucethemoose_Yi-34B-200K-RPMerge
  - model: /home/alpha/Models/Raw/migtissera_Tess-2.0-Yi-34B-200K
merge_method: slerp
base_model: /home/alpha/Models/Raw/migtissera_Tess-2.0-Yi-34B-200K
parameters:
  int8_mask: false
  t:
    - value: 0.5
dtype: bfloat16
tokenizer_source: model:/home/alpha/Models/Raw/brucethemoose_Yi-34B-200K-RPMerge