Home
Notes
Archive
About
Home
Notes
Archive
About
Subscribe
Sign in
Ayaz on Tech & AI
Latest
Top
Discussions
Is Moore's law dead?
And some thoughts on the Straggler Effect during model training, and why xAI's Colossus 1 cluster was at 11% GPU utilization for training.
May 9
•
Ayaz
Some thoughts on SubQ's Subquadratic LLM
What is subquadratic sparse attention and how does that compare with DeepSeek's V4 improvements.
May 7
•
Ayaz
1
April 2026
My thoughts on Amazon's letter to their shareholders
Andy Jassy’s Letter Is the Closest Thing to a Bubble Deflation We’ve Had
Apr 12
•
Ayaz
3
March 2026
A few take-aways from GTC 2026 Keynote
What I think was significant in Jensen's keynote address at GTC 2026
Mar 23
•
Ayaz
3
Is recursive self improvement closer than we think?
How OpenAI's Codex 5.3 and MiniMax's M2.7 built their own successors.
Mar 19
•
Ayaz
3
The Repo Frontier
An alternative, hypothetical look at the Middle East conflict.
Mar 17
•
Ayaz
3
Second-Order Effects: How Hormuz Threatens AI Infrastructure
A look at the second and third-order effects of the closure of the Strait of Hormuz has on AI infrastructure buildout.
Mar 11
•
Ayaz
3
2
February 2026
Some thoughts on DeepSeek’s DualPath improvement
Exploring bottlenecks in Agentic inference.
Feb 28
•
Ayaz
Some thoughts on Interleaved and Preserved thinking modes in GLM
A path to better, more efficient multi-step agentic tool calling at the model layer.
Feb 19
•
Ayaz
1
Recursive self-improvement loops
Is continual learning for AI the final frontier?
Feb 11
•
Ayaz
1
Some thoughts on building a god
My notes from a podcast I saw that talked about what these AI companies are doing in private.
Feb 10
•
Ayaz
What's inside Microsoft's Maia 200 AI Chip
A look at the new AI Accelerator ASIC from Microsoft.
Feb 3
•
Ayaz
2
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
