kobert / README.md
monologg's picture
docs: add original model link
a07e96a
|
raw
history blame
515 Bytes
metadata
license: apache-2.0
language:
  - ko
mask_token: '[MASK]'
widget:
  - text: ๋Œ€ํ•œ๋ฏผ๊ตญ์˜ ์ˆ˜๋„๋Š” [MASK] ์ž…๋‹ˆ๋‹ค.

KoBERT

How to use

If you want to import KoBERT tokenizer with AutoTokenizer, you should give trust_remote_code=True.

from transformers import AutoModel, AutoTokenizer

model = AutoModel.from_pretrained("monologg/kobert")
tokenizer = AutoTokenizer.from_pretrained("monologg/kobert", trust_remote_code=True)

Reference