Artwork

Conteúdo fornecido por Everyday AI. Todo o conteúdo do podcast, incluindo episódios, gráficos e descrições de podcast, é carregado e fornecido diretamente por Everyday AI ou por seu parceiro de plataforma de podcast. Se você acredita que alguém está usando seu trabalho protegido por direitos autorais sem sua permissão, siga o processo descrito aqui https://pt.player.fm/legal.
Player FM - Aplicativo de podcast
Fique off-line com o app Player FM !

EP 336: A Complete Guide to Tokens Inside of ChatGPT

47:33
 
Compartilhar
 

Manage episode 434204087 series 3470198
Conteúdo fornecido por Everyday AI. Todo o conteúdo do podcast, incluindo episódios, gráficos e descrições de podcast, é carregado e fornecido diretamente por Everyday AI ou por seu parceiro de plataforma de podcast. Se você acredita que alguém está usando seu trabalho protegido por direitos autorais sem sua permissão, siga o processo descrito aqui https://pt.player.fm/legal.

Send Everyday AI and Jordan a text message

Win a free year of ChatGPT or other prizes! Find out how.
Wait.... tokens? When using a large language model like ChatGPT, tokens really matter. But hardly no one understands them. And NOT knowing how tokens work is causing your ChatGPT output to stink. We'll help you fix it.

Newsletter: Sign up for our free daily newsletter
More on this Episode: Episode Page
Join the discussion: Ask Jordan questions on ChatGPT
Related Episodes: Ep 253: Custom GPTs in ChatGPT – A Beginner’s Guide
Ep 318: GPT-4o Mini: What you need to know and what no one’s talking about
Upcoming Episodes: Check out the upcoming Everyday AI Livestream lineup
Website: YourEverydayAI.com
Email The Show: info@youreverydayai.com
Connect with Jordan on LinkedIn
Topics Covered in This Episode:
1. Tokenization in ChatGPT
2. Comparison of Different AI Models
3. Importance of Tokenization and Memory in AI Models
4. Limitations of ChatGPT
5. Explanation of Tokenization Process
Timestamps:
02:10 Daily AI news
07:00 Introduction to tokens
10:08 Large language models understand words through tokens.
12:05 Understanding tokenization in generative AI language models.
16:35 Contextual analysis of words for language understanding.
19:15 Different models have varying context window sizes.
23:57 Misconception about GPT-4. Detailed explanation follows.
26:38 Promotion of PPP course, common language mistakes.
28:57 Excess text to exceed word limit intentionally.
33:19 Keeping up with ever-changing AI rules.
36:50 Recall important information by prompting chat GPT.
40:37 Highlight information, use quotation button, request summary.
43:41 Clear communication is crucial for ChatGPT.
Keywords:
Jordan Wilson, Bears football team, personal information, Carolina blue, deep dish pizza, token counts, memory limitations, ChatGPT, tokenization, language models, generative AI, controlling response, token range, memory recall, AI models, GPT, anthropic Claude, Google Gemini, context window, book interaction, large language models, OpenAI's GPT 4.0, transcript summary, Everyday AI, Google's Gemini Live AI assistant, new Pixel 9 series, XAI's Grok 2, OpenAI's GPT 4 update, importance of tokens in chatbots, podcast promotion.
Learn how work is changing on WorkLab, available wherever you get your podcasts.

  continue reading

394 episódios

Artwork
iconCompartilhar
 
Manage episode 434204087 series 3470198
Conteúdo fornecido por Everyday AI. Todo o conteúdo do podcast, incluindo episódios, gráficos e descrições de podcast, é carregado e fornecido diretamente por Everyday AI ou por seu parceiro de plataforma de podcast. Se você acredita que alguém está usando seu trabalho protegido por direitos autorais sem sua permissão, siga o processo descrito aqui https://pt.player.fm/legal.

Send Everyday AI and Jordan a text message

Win a free year of ChatGPT or other prizes! Find out how.
Wait.... tokens? When using a large language model like ChatGPT, tokens really matter. But hardly no one understands them. And NOT knowing how tokens work is causing your ChatGPT output to stink. We'll help you fix it.

Newsletter: Sign up for our free daily newsletter
More on this Episode: Episode Page
Join the discussion: Ask Jordan questions on ChatGPT
Related Episodes: Ep 253: Custom GPTs in ChatGPT – A Beginner’s Guide
Ep 318: GPT-4o Mini: What you need to know and what no one’s talking about
Upcoming Episodes: Check out the upcoming Everyday AI Livestream lineup
Website: YourEverydayAI.com
Email The Show: info@youreverydayai.com
Connect with Jordan on LinkedIn
Topics Covered in This Episode:
1. Tokenization in ChatGPT
2. Comparison of Different AI Models
3. Importance of Tokenization and Memory in AI Models
4. Limitations of ChatGPT
5. Explanation of Tokenization Process
Timestamps:
02:10 Daily AI news
07:00 Introduction to tokens
10:08 Large language models understand words through tokens.
12:05 Understanding tokenization in generative AI language models.
16:35 Contextual analysis of words for language understanding.
19:15 Different models have varying context window sizes.
23:57 Misconception about GPT-4. Detailed explanation follows.
26:38 Promotion of PPP course, common language mistakes.
28:57 Excess text to exceed word limit intentionally.
33:19 Keeping up with ever-changing AI rules.
36:50 Recall important information by prompting chat GPT.
40:37 Highlight information, use quotation button, request summary.
43:41 Clear communication is crucial for ChatGPT.
Keywords:
Jordan Wilson, Bears football team, personal information, Carolina blue, deep dish pizza, token counts, memory limitations, ChatGPT, tokenization, language models, generative AI, controlling response, token range, memory recall, AI models, GPT, anthropic Claude, Google Gemini, context window, book interaction, large language models, OpenAI's GPT 4.0, transcript summary, Everyday AI, Google's Gemini Live AI assistant, new Pixel 9 series, XAI's Grok 2, OpenAI's GPT 4 update, importance of tokens in chatbots, podcast promotion.
Learn how work is changing on WorkLab, available wherever you get your podcasts.

  continue reading

394 episódios

Todos os episódios

×
 
Loading …

Bem vindo ao Player FM!

O Player FM procura na web por podcasts de alta qualidade para você curtir agora mesmo. É o melhor app de podcast e funciona no Android, iPhone e web. Inscreva-se para sincronizar as assinaturas entre os dispositivos.

 

Guia rápido de referências