Fique off-line com o app Player FM !
[QA] Learning Syntax Without Planting Trees: Understanding When and Why Transformers Generalize Hierarchically
Manage episode 414652796 series 3524393
The paper explores inductive bias in transformer models, showing language modeling training leads to hierarchical generalization, supported by pruning experiments and Bayesian analysis.
https://arxiv.org/abs//2404.16367
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1013 episódios
Manage episode 414652796 series 3524393
The paper explores inductive bias in transformer models, showing language modeling training leads to hierarchical generalization, supported by pruning experiments and Bayesian analysis.
https://arxiv.org/abs//2404.16367
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1013 episódios
Todos os episódios
×Bem vindo ao Player FM!
O Player FM procura na web por podcasts de alta qualidade para você curtir agora mesmo. É o melhor app de podcast e funciona no Android, iPhone e web. Inscreva-se para sincronizar as assinaturas entre os dispositivos.