Player FMアプリでオフラインにしPlayer FMう!
Token Erasure as a Footprint of Implicit Vocabulary Items in LLMs
Manage episode 426507868 series 3524393
LLMs process text with tokens, but individual tokens may not relate to word meanings. This study explores how LLMs convert tokens into higher-level representations, revealing an "erasure" effect.
https://arxiv.org/abs//2406.20086
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1236 つのエピソード
Manage episode 426507868 series 3524393
LLMs process text with tokens, but individual tokens may not relate to word meanings. This study explores how LLMs convert tokens into higher-level representations, revealing an "erasure" effect.
https://arxiv.org/abs//2406.20086
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1236 つのエピソード
Wszystkie odcinki
×プレーヤーFMへようこそ!
Player FMは今からすぐに楽しめるために高品質のポッドキャストをウェブでスキャンしています。 これは最高のポッドキャストアプリで、Android、iPhone、そしてWebで動作します。 全ての端末で購読を同期するためにサインアップしてください。