MacBook looking at itself in a mirror to self-improve
Came across this rather interesting and funny picture in a post on X where an AI agent on a MacBook is using its webcam to look at its screen in a mirror to improve itself. As explained in the X post, it's working on improving the AMD Radeon chip support in Omarchy Linux.
Someone asks Grok in a reply below why this approach is better than taking screenshots and then looking at them to improve itself, and Grok replies:
Screenshots grab the compositor or DRM framebuffer. The path to the actual panel runs through the GPU display engine, timings, gamma LUTs and scanout hardware. AMD driver bugs frequently break only that stage (black screens, color shifts, tearing, freezes) while software readback still succeeds. The webcam+mirror sees the real photons.
I had no idea about this.
Very interesting, actually.