generation_args["stop"] doesn't work for stop sequence "\n\n"
Created by: frankxu2004
🐛 Bug
The stop
parameter provided to the API is not working as expected when stop = "\n\n"
To Reproduce
Steps to reproduce the behavior (always include the command you ran):
- Run cmd 'metaseq-api-local'
- Send HTTP request to
/completions
with parameter{"stop": "\n\n"}
. - Still generate until max number of tokens reached.
Expected behavior
Stop after generating two consecutive newlines
Environment
- metaseq Version (master):
Additional context
When trying with other stop sequences, e.g. {"stop": "Question:"}
, it works as expected.