nde-dilan commited on
Commit
cd23725
·
verified ·
1 Parent(s): 4273cfe

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +70 -0
README.md ADDED
@@ -0,0 +1,70 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - bible-translation
4
+ - custom-corpus
5
+ language:
6
+ - bbj
7
+ - en
8
+ library_name: transformers
9
+ license: apache-2.0
10
+ metrics:
11
+ - sacrebleu
12
+ model_name: DS4H-ICTU/english-ghomala-translation-model-encoderdecoder
13
+ pipeline_tag: translation
14
+ tags:
15
+ - translation
16
+ - seq2seq
17
+ - low-resource
18
+ - ghomala
19
+ - encoder-decoder
20
+ model_type: encoder-decoder
21
+ ---
22
+ # Ghomala Translation Model
23
+
24
+ This is a neural machine translation model fine-tuned to translate from **English to Ghomala**, a Bantu language spoken in Cameroon.
25
+
26
+ ## 🚀 Architecture
27
+ - **Encoder**: `UBC-NLP/serengeti-E250`
28
+ - **Decoder**: `gpt2`
29
+
30
+ ## 🏋️ Training Details
31
+ - Fine-tuned on custom parallel Bible + text data
32
+ - Epochs: 10
33
+ - Learning rate: 2e-5
34
+ - BLEU score tracked with `evaluate`
35
+ - Batch size: 2 (with gradient accumulation)
36
+ - Optimizer: AdamW
37
+
38
+ ## 📌 Usage Example
39
+
40
+ ```python
41
+ from transformers import pipeline
42
+
43
+ translator = pipeline("translation", model="DS4H-ICTU/english-ghomala-translation-model-encoderdecoder")
44
+ result = translator("The woman gave water to the prophet.")
45
+ print(result)
46
+ ````
47
+
48
+ ## 🎯 Intended Use
49
+
50
+ * Cultural and educational preservation
51
+ * Language learning and community translation tools
52
+
53
+ ## ⚠️ Limitations
54
+
55
+ * Still learning with limited Ghomala data
56
+ * May hallucinate or repeat translations
57
+ * Works only in English → Ghomala direction for now
58
+
59
+ ## 📚 Citation
60
+
61
+ ```
62
+ @misc{ghomala_translation_model,
63
+ title={Ghomala Translation Model},
64
+ author={Group 2},
65
+ howpublished={\url{https://huggingface.co/DS4H-ICTU/english-ghomala-translation-model-encoderdecoder}},
66
+ year={2025}
67
+ }
68
+ ```
69
+
70
+ ---