gregoryw3@lemmy.mltoTechnology@lemmy.world•Microsoft has gone too far: including a Game Pass ad in the Settings app ushers in a whole new age of ridiculous over-advertisingEnglish
3·
7 months agoIt doesn’t make sense which is why people believe Google has ulterior motives. I haven’t seen any real reason not to use jxl as the new format; but I also haven’t looked that far into it. ¯\(ツ)/¯
Attention Is All You Need: https://arxiv.org/abs/1706.03762
https://en.wikipedia.org/wiki/Attention_Is_All_You_Need
From my understanding all of these language models can be simplified down to just: “Based on all known writing what’s the most likely word or phrase based on the current text”. Prompt engineering and other fancy words equates to changing the averages that the statistics give. So by threatening these models it changes the weighting such that the produced text more closely resembles threatening words and phrases that was used in the dataset (or something along those lines).
https://poloclub.github.io/transformer-explainer/