185: Workflow Orchestrators Programming Throwdown podcast

Conteúdo fornecido por Patrick Wheeler and Jason Gauci, Patrick Wheeler, and Jason Gauci. Todo o conteúdo do podcast, incluindo episódios, gráficos e descrições de podcast, é carregado e fornecido diretamente por Patrick Wheeler and Jason Gauci, Patrick Wheeler, and Jason Gauci ou por seu parceiro de plataforma de podcast. Se você acredita que alguém está usando seu trabalho protegido por direitos autorais sem sua permissão, siga o processo descrito aqui https://pt.player.fm/legal.

Programming Throwdown »
185: Workflow Orchestrators

1M ago 1:32:02

MP3•Home de episódios

Fetch error

Hmmm there seems to be a problem fetching this series right now. Last successful fetch was on November 04, 2025 16:17 (1M ago)

What now? This series will be checked again in the next day. If you believe it should be working, please verify the publisher's feed link below is valid and includes actual episode links. You can contact support to request the feed be immediately fetched.

Intro topic: Asymmetric Returns

News/Links:

NanoChat by Andrej Karpathy
- https://github.com/karpathy/nanochat
Pydantic AI
- https://www.marktechpost.com/2025/03/25/pydanticai-advancing-generative-ai-agent-development-through-intelligent-framework-design/
1000th Starlink this year
- https://spaceflightnow.com/2025/05/16/live-coverage-spacex-plans-morning-launch-of-starlink-satellites-from-california/
ChatGPT Apps SDK
- https://openai.com/index/introducing-apps-in-chatgpt/

Book of the Show

Patrick
- The Will of the Many by James Islington
  - https://amzn.to/43IfU8Q
Jason
- Interview with DHH (Founder of Ruby on Rails)
  - https://www.youtube.com/watch?v=vagyIcmIGOQ

Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h

Tool of the Show

Patrick
- Factorio
  - https://www.factorio.com/
Jason
- nip.io

Topic: Workflow Orchestrators

Why
- Batch jobs (embarrassingly parallel)
- Long-running tasks (e.g. transcoding video)
- Checkpointing/resuming
How
- Message Queues
- Containerization
- Worker Pools & Autoscaling
- History & Backfill
Steps to run workflows:
- Containerize the workflow definition and send to the cloud
- Containerize all the individual tasks
- Submit job(s)
Examples
- Airflow
  - Legacy but dominant
- Dagster
  - Great UX for python developers
- Temporal: https://temporal.io/
  - The new hotness
- Ray
  - Low-level but very powerful
- Kubeflow
  - Designed for ML workflows, integrated dashboard

★ Support this podcast on Patreon ★

186 episódios

#Programming #Software Development #Java #Python #Patrick Wheeler and Jason Gauci #Jason Gauci #Patrick Wheeler #Tech #Podcasting Education #News #Tech News #Programming Language #Objective-c