bagel-dpo-34b-v0.2
This version also includes the toxic DPO dataset, and should have less censorship than it's counterparts. You may want to use a system prompt like: 1) For this model, create an account in Massed Compute. When renting a Virtual Machine use the code 'JonDurbin' for 50% your rental. 2) After you created your account update your billing and navigate to the deploy page. 3) Select the following - GPU Type: A6000 - GPU Quantity: 2 - Category: Creator - Image: Jon Durbin - Coupon Code: JonDurbin 4) Deploy the VM! 5) Navigate to 'Running Instances' to retrieve instructions to login to the VM 6) Once inside the VM, open the terminal and run `volume=$PWD/data` 7) Run `model=jondurbin/bagel-dpo-34b-v0.2` 8) `sudo docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:1.3 --model-id $model` 9) The model will take some time to load... 10) Once loaded the model will be available on port 8080 *Yes, you will see benchmark names in the list, but this only uses the train splits, and a decontamination by cosine similarity is performed at the end as a sanity check*
译文尚未就绪,显示来源原文
This version also includes the toxic DPO dataset, and should have less censorship than it's counterparts. You may want to use a system prompt like: 1) For this model, create an account in Massed Compute. When renting a Virtual Machine use the code 'JonDurbin' for 50% your rental. 2) After you created your account update your billing and navigate to the deploy page. 3) Select the following - GPU Type: A6000 - GPU Quantity: 2 - Category: Creator - Image: Jon Durbin - Coupon Code: JonDurbin 4) Deploy the VM! 5) Navigate to 'Running Instances' to retrieve instructions to login to the VM 6) Once inside the VM, open the terminal and run `volume=$PWD/data` 7) Run `model=jondurbin/bagel-dpo-34b-v0.2` 8) `sudo docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:1.3 --model-id $model` 9) The model will take some time to load... 10) Once loaded the model will be available on port 8080 *Yes, you will see benchmark names in the list, but this only uses the train splits, and a decontamination by cosine similarity is performed at the end as a sanity check*
AI正在发生 未来正在更新