benchang1110
/

Taiwan-tinyllama-v1.1-base

Text Generation

text-generation-inference

Model card Files Files and versions Community

benchang1110 commited on Jan 25

Commit

1b0e126

·

verified ·

1 Parent(s): f887842

Update README.md

Files changed (1) hide show

README.md +0 -2

README.md CHANGED Viewed

@@ -56,8 +56,6 @@ if __name__ == '__main__':
 The following training hyperparameters are used:
-- **Feature Alignment**
 | Data size    | Global Batch Size | Learning Rate | Epochs | Max Length | Weight Decay |
 |--------------|-------------------|---------------|--------|------------|--------------|
 | 10B        | 32               | 5e-5          | 1      | 2048       | 1e-4            |

 The following training hyperparameters are used:
 | Data size    | Global Batch Size | Learning Rate | Epochs | Max Length | Weight Decay |
 |--------------|-------------------|---------------|--------|------------|--------------|
 | 10B        | 32               | 5e-5          | 1      | 2048       | 1e-4            |