Nick Heiner's Substack
Subscribe
Sign in
Home
Notes
About
[AI Engineer Summit Talk] When Will The Benchmaxxing Plague End?
Most benchmarks don’t deserve the trust we place in them
Sep 10
•
Nick Heiner
1
1
Latest
Top
Discussions
Slop is Deeper Than Cringe Word Choice
You can remove the smarmy tone and it’s still bad
Aug 25
•
Nick Heiner
4
1
1
Opus 4.8 Aggressively Pursues the Wrong Path
But it's really good at that pursuit
Jun 11
•
Nick Heiner
If you don't use an agent orchestrator, you'll be stuck in the permanent underclass
Or your b2b SaaS will just take a little longer to ship 🤷
Jun 9
•
Nick Heiner
2
SWE Hiring is Cooked
Agents are superhuman at the “1 hour exercise” format
May 19
•
Nick Heiner
1
How to use AI effectively even when you have no idea what you’re talking about
Bootstrapping out of the tar pit of ignorance
Apr 13
•
Nick Heiner
2
When is it ok to slop your colleagues?
Opportunities to beclown ourselves abound
Mar 18
•
Nick Heiner
4
1
1
Gemini 3.1 Pro: Not leading edge, also in love with me
Does it count as sycophancy if the AI is right?
Feb 24
•
Nick Heiner
1
See all
Nick Heiner's Substack
Independent benchmarks, essays on the future of work, and dispatches from someone building AI products and testing AI agents every day at Surge AI.
Subscribe
Nick Heiner's Substack
Subscribe
About
Archive
Sitemap
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
