TLDR Tech / AI
I Tried to Make AI Writing Sound Human by Banning AI Words Through logit_bias
logit_bias is an API setting that changes how likely a model is to select specific tokens. A researcher created a blacklist of words, converted the words into token IDs, and assigned those IDs a negative value to try to reduce the chances of a model using those words at an API level. This didn't work - it just made it harder for the model to select the next token, making resulting sentences sometimes look like they came from a less capable model.
Read the full story