# Point at the page and say the change

> In Shuriken's browser, turn on Design, click an element and say what should change. Your agent gets the element, a cropped screenshot and your words.

Source: https://shuriken.sh/blog/design-mode-with-your-voice

In Shuriken's browser, turn on Design, click an element and say what should change. Your agent gets the element, a cropped screenshot and your words.

[Story](https://shuriken.sh/blog) By Shuriken Updated 13 November 2026 3 min read

**Contents**

You can now change a page by pointing at it and talking. In Shuriken's browser, turn on Design, click the element you mean and say what should change. The chat's agent gets your words, that element's details and a cropped screenshot of it. If the agent is busy, it goes to the queue instead.

## Why we put a microphone on the pointer #

When we shipped [Design mode](https://shuriken.sh/blog/design-mode-point-at-the-page), the clicking part felt right straight away. The typing part didn't. We'd click a button, then sit there composing a sentence about it, which felt like going back to describing the page in words.

Watch someone review a UI with a colleague and they don't type. They point and talk: "this one, bigger", "this gap is too wide", "same as the card above". Fast, a bit messy, and perfectly clear, because the finger already did the hard part.

So in 5.1 we joined two things Shuriken already had: the pointer from the browser, and [voice](https://shuriken.sh/features/voice) from the composer.

## How it works #

- Open your app in the browser. Pick one of the project's dev servers that Shuriken found, or type an address. The page opens beside your chat.
- Turn on Design. A strip says "Click the part of the page you want to change." Hold Shift to pick several elements.
- Press the microphone and talk. "Make this full width on phones and give it a bit more padding." You see the words while you speak.
- Stop, check, send. Press stop and the words land in the note. Edit anything the speech-to-text got wrong, then Send.

You can also start talking before you've clicked anything. The words wait, and the next element you pick takes them. Point, talk, point at the next thing, keep talking.

## What the agent receives #

For every element you picked, the message carries:

- your words, as the message;
- the element's details: where it sits in the page and its markup, so the agent can find it in your code;
- a cropped screenshot of that element, so it sees what you saw.

That combination is the point. "Make this full width" is useless on its own and perfectly clear with a picture of "this" attached. The agent can start on the change instead of asking which button you meant.

If the chat's agent runs in a terminal beside the browser instead, Shuriken pastes the note into that terminal and saves the screenshots as files it can open.

## Agent busy? It goes to the queue #

You don't have to wait for a turn to end. While the agent is working, the note's button reads Add to queue. The note joins the chat's [queue](https://shuriken.sh/features/queue) with its element and screenshot, and runs when the current turn is done. Click the next thing, say the next change, queue it too.

If your connection drops at the wrong moment, the note says "It sends when the connection is back" and keeps it.

In Shuriken you can dictate to any agent, turned into text on your own computer by default.

[Try Shuriken](https://shuriken.sh/)

## Which speech-to-text it uses #

The same as voice everywhere else in Shuriken. By default NVIDIA Parakeet turns what you say into text on your own computer: there's no key to add, nothing to pay per minute, and with the local model no speech service hears the note. If you'd rather use a cloud model, add your own key for a live provider such as ElevenLabs or AssemblyAI in Settings › Dictation, and your notes stream to it under your account.

If you like dictating long prompts too, [Your voice stays on your computer by default](https://shuriken.sh/blog/choosing-speech-to-text) covers the composer side.

## Desktop app only #

Design mode lives in Shuriken's browser, and the browser is part of the desktop app for macOS, Windows and Linux. On the phone you can still talk to your agents through the composer, but you can't point at a page.

A few things stay the way they were. Password and secret fields never leave the page. Every project shares one browser profile, so a site you signed in to once stays signed in. Your agent can drive the same tab you're looking at, so you can watch it click through the fix after you've asked for it. The [browser page](https://shuriken.sh/features/browser) has the details.

## A small habit that helps #

Say the why, not just the what. "Full width on phones, because the tap target is too small" gets you a better change than "full width". The agent reads intent as well as instructions, and talking makes the why easy to include. It's one extra sentence, and you don't have to type it.

Point, talk, send: it comes with Shuriken 5.1. [Try Shuriken](https://shuriken.sh/).

Share

[X](https://x.com/intent/post?url=https%3A%2F%2Fshuriken.sh%2Fblog%2Fdesign-mode-with-your-voice&text=Point%20at%20the%20page%20and%20say%20the%20change)[LinkedIn](https://www.linkedin.com/sharing/share-offsite/?url=https%3A%2F%2Fshuriken.sh%2Fblog%2Fdesign-mode-with-your-voice)[Hacker News](https://news.ycombinator.com/submitlink?u=https%3A%2F%2Fshuriken.sh%2Fblog%2Fdesign-mode-with-your-voice&t=Point%20at%20the%20page%20and%20say%20the%20change)[Reddit](https://www.reddit.com/submit?url=https%3A%2F%2Fshuriken.sh%2Fblog%2Fdesign-mode-with-your-voice&title=Point%20at%20the%20page%20and%20say%20the%20change)[E-mail](mailto:?subject=Point%20at%20the%20page%20and%20say%20the%20change&body=https%3A%2F%2Fshuriken.sh%2Fblog%2Fdesign-mode-with-your-voice)

## Frequently asked questions

**Can I change a web page's UI by talking to a coding agent?**

Yes, in Shuriken's desktop app. Open your app in its browser, turn on Design, click the element and press the microphone. Your words, the element's details and a cropped screenshot go to the chat's agent.

**Which speech-to-text does it use?**

The same as voice everywhere in Shuriken: by default NVIDIA Parakeet, running on your own computer, so with the local model no speech service hears it. If you picked a live speech provider with your own key in Settings › Dictation, such as ElevenLabs or AssemblyAI, the note goes to that provider instead.

**What if the agent is in the middle of a turn?**

The button reads Add to queue instead of Send. Your note waits its turn with the element and screenshot attached.

**Does it work on my phone?**

No. The browser and Design mode are part of the desktop app for macOS, Windows and Linux.

Voice

Talk to your agents. Privately.

Dictation runs on your own computer by default, so no speech service hears you. Or add your own key for a live speech provider.

[Try Shuriken](https://shuriken.sh/)

[How it works](https://shuriken.sh/features/voice)

## Keep reading

- [Shuriken vs Emdash (2026): Comparison 27 Oct 2026 6 min read Emdash is a free, open-source agent workspace for Mac, Windows and Linux. Shuriken adds account switching, session limits, your phone and voice.](https://shuriken.sh/compare/emdash)
- [Shuriken vs Paradev, formerly Superset (2026): Comparison 27 Oct 2026 6 min read Paradev (formerly Superset) is a source-available parallel-agent app for macOS. Shuriken also runs on Windows and Linux and switches accounts for you.](https://shuriken.sh/compare/superset)
- [Many dev servers, many worktrees, no port fights: Story 8 Nov 2026 5 min read Parallel Claude Code worktrees all want port 3000. How Shuriken finds dev servers, hands each worktree its own port, and tips that work without it.](https://shuriken.sh/blog/worktree-port-conflicts)
- [What's new in Shuriken 5.1: Update 27 Oct 2026 16 min read Shuriken 5.1 adds sign-in with Google, Apple or an email code, Allow and Always allow at a MacBook's notch, and billing and fuel in Sources.](https://shuriken.sh/blog/shuriken-5-1)
- [Your agents on your phone, from the browser: Update 27 Oct 2026 4 min read Open app.shuriken.sh in any phone browser and add it to your home screen: every chat, the queue, Changes and voice. Browsers never count as devices.](https://shuriken.sh/blog/phone-web-app)
- [Claude Code denyInsteadOfPrompting: runs that don't stall: Story 7 Nov 2026 2 min read Claude Code 2.1.319 adds permissions.denyInsteadOfPrompting: a tool call that would wait on a permission prompt is denied and the turn carries on.](https://shuriken.sh/blog/claude-code-deny-instead-of-prompting)
- [Claude break reminders: take the break, keep the agents: Story 6 Nov 2026 3 min read Claude's break reminders sit in Settings › Wellbeing and nudge you after a daily amount of time. Take the break; your coding agents can keep working.](https://shuriken.sh/blog/claude-break-reminders)

## Free tools

- [Claude limit reset tracker](https://shuriken.sh/tools/limit-resets/claude)
- [Codex limit reset tracker](https://shuriken.sh/tools/limit-resets/codex)
