codeparrot-small

CodeParrot 🦜 is a GPT-2 model (110M parameters) trained to generate Python code. The model was trained on the cleaned CodeParrot 🦜 dataset with the following settings: The training was executed on 16 x A100 (40GB) GPUs. This setting amounts to roughly 29 billion tokens.

번역 준비 중입니다. 원문을 표시합니다.