Assistant StackEN · ES · PT · TR

Why AI changes the wrong thing — and how to make it fix only what you mean

You asked your AI to fix one button. It fixed it — and quietly changed another one you never mentioned.

That's not the AI being dumb. It's you and the AI talking about different things. "The Order now button" can mean two buttons on the same page, and the AI has no way to know which one you're looking at.

Want the whole system?

Build Your Own AI Assistant System · $5 — about a coffee
The rules file, memory, sub-agents and automations — with copy-paste templates. Bonus: the Note tool (Windows) that makes your AI fix only what you point at.

Get the guide →

What we actually tested

Same small coffee-shop site. Same model. Ten separate runs.

PromptHeader buttonHero buttonOther buttons
5 runs"Make the Order now button stand out more. Bigger, bolder, stronger color."changed in 5 of 5 (not wanted)changeduntouched
5 runsA note pinned on the exact hero buttonchanged in 0 of 5changeduntouched

The AI didn't break the site. It just guessed — and the guess included a button you didn't ask about. On a real project that's the "fixed one thing, broke another" loop everyone complains about.

The fix: point, don't describe

Instead of describing where in words, point at the element:

  1. Open your page in the browser.
  2. Click + Add note, then click the exact thing you want changed.
  3. Write what should change: "Bigger, bolder, stronger color. Only this button."
  4. Your AI reads the note — with the element's selector, its HTML and a screenshot — and edits only that.

No more "no, the other button", no screenshots pasted into chat, no paragraphs explaining which card you mean.

Works with your own AI

The note tool runs on your computer and works on any page you can open in a browser: a plain HTML file, your local dev server, a React or Vue app. Your AI agent reads the notes through MCP — Claude Code, Cursor, VS Code and other MCP-capable agents.

It's Windows only for now and it's an early build: Windows may show "Windows protected your PC" because the installer isn't code-signed yet. Click More info → Run anyway. It installs without admin rights and keeps your notes in a local folder.

How to get it

The note tool comes free with the guide below. The guide shows how to set up the rest of your AI assistant: a rules file it reads every time, memory notes, helpers and a morning brief. The note tool takes care of fixes on your pages.

Want the whole system?

Build Your Own AI Assistant System · $5 — about a coffee
The rules file, memory, sub-agents and automations — with copy-paste templates. Bonus: the Note tool (Windows) that makes your AI fix only what you point at.

Get the guide →

← All articles