fauxpilot/copilot_proxy/cgtok/special_tokens_map.json
Brendan Dolan-Gavitt a23a1478f7 Initial commit
2022-08-02 21:47:27 -04:00

6 lines
99 B
JSON

{
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"unk_token": "<|endoftext|>"
}