Update config.json

#36

by ildodeltaRule - opened Apr 8, 2024

←

Updating config.json to include right max_position_embeddings size of 512, instead of 514. When using more then 512 tokens a error is generated.

--> Libaries like FastChat use the max_position_embeddings to define the number of tokens that can be used. In this case it should be 512.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Ready to merge

This branch is ready to get merged automatically.

· Sign up or log in to comment