← back to blog
developer productivity

Inline or Chat: Why Mixing AI Modes Costs More Than You Think

6 min read

A new paper from researchers at Hasso Plattner Institute and Microsoft posted on July 2nd found something counterintuitive about how developers use AI: using inline code suggestions and chat-based prompting together on the same task produces worse outcomes than using either one alone. Both modes independently improve efficiency. In combination, they interfere.

This is not a small sample study with undergrads on toy tasks. It's a mixed-methods field study of professional developers in their actual work environments, combining structured sessions with natural work periods. The finding isn't that AI tools make you slower overall. It's that the combination of modes on a single task has a specific cost that neither mode carries alone.

Two Different Cognitive Postures

The mechanism the researchers describe is about attention mode, not tool quality.

Inline AI suggestions — Copilot autocomplete, Cursor tab completion, whatever your editor provides — are reactive. You write, the suggestion appears, you decide accept or reject. The cognitive pattern is read-evaluate-continue. You stay in the edit-flow of the code. Your attention tracks forward through the file.

Chat-based prompting is the opposite posture. You stop writing, switch context, articulate a request in natural language, read a longer response, evaluate it, extract what's useful, and return to the file. The cognitive pattern is specify-review-integrate. You leave the edit-flow to do something more like planning or debugging from above.

Each mode requires its own kind of attention. Each is coherent on its own. The problem is the switch between them. When you're mid-task using both — autocomplete filling in the line you're on while a chat window is open with a question about the same function — you're running two attention regimes at once. The paper characterizes this as increased perceived cognitive load during development-heavy tasks when AI interaction is present. The combination doesn't compound the benefits of each mode. It compounds the overhead.

Every Major Tool Shipped Both Modes at Once

The timing of this finding is inconvenient for the tooling landscape.

VS Code 1.128, released earlier this month, ships with what GitHub is calling multi-chat Claude agents: you can run multiple chat sessions in parallel while inline suggestions stay active. The June batch of Copilot releases added session sync across machines, one-million-token context windows, and better parallel agent organization. Cursor, Windsurf, and Zed all offer the same combination by default. The design assumption across the category is that more AI surface area is always better — why wouldn't you want autocomplete and chat available simultaneously?

The field study suggests the assumption is wrong for a specific and important case. Having the tools available isn't the same as using them simultaneously on the same task. The distinction the researchers are drawing is finer than "use AI or don't use AI." It's about which cognitive mode the task actually calls for, and whether switching modes mid-task carries a real cost.

What the Task Tells You

The paper proposes a heuristic for mode selection based on task characteristics.

Tasks that are routine, have clear local context, and don't require you to explain what you're building are good candidates for inline suggestions. The AI's job is to complete what you've started. You know what you're doing; you just want the completion to be faster. Autocomplete works well here because your attention is already in edit-mode and the suggestion integrates with what you're already doing.

Tasks that are unfamiliar, architecturally ambiguous, or require reasoning about something outside the immediate file are better served by chat. You don't know exactly what you're building yet; you need to think it through. The mode matches the cognitive work: you're specifying and exploring, not completing and continuing.

The failure mode is treating the two as interchangeable additions rather than different tools for different postures. Starting a task in chat to understand the architecture, then switching to inline as you implement — that's sequential use, not simultaneous. The researchers aren't saying don't use both. They're saying don't use both on the same cognitive step.

The Problem Is You Don't Know Which Mode You're In

The practical obstacle is that most developers don't know, session by session, which AI modes they're using and how they're mixing them.

This isn't a discipline failure. It's a measurement gap. Your AI tools don't tell you that you opened a chat window 40% of the way through implementing a function and then accepted three autocomplete suggestions while the chat was still open. They don't surface that your most productive implementation sessions are the ones where you did a 10-minute chat pass at the start and then closed the window before writing any code. The signal is in the behavioral pattern; the tools don't make it visible.

What the July study adds to the existing body of work on AI perception gaps is a specific actionable mechanism. The METR randomized controlled trial data showed experienced developers were 19% slower with AI tools than without while believing they were faster — but that finding is hard to act on because the cause isn't clear. Mode interference gives you a specific thing to look for: tasks where you mixed the two modes. That's a concrete behavioral pattern you could actually change.

Separating the Tools Isn't Hard

The workflow adjustment the research suggests is simple enough to try.

Before starting a coding task, decide which mode you're using for this task. If you need to understand something before writing, open chat and stay in chat until you have enough context to close it. Then open the file and write with autocomplete active. If the task is something you already understand — a refactor of code you know, adding a parameter to an existing function, fixing a clear bug — skip chat entirely and work with inline suggestions only.

The test for whether this changes anything is not how you feel. Subjective flow is exactly what the perception research says is unreliable. The test is revision rate: do the tasks where you separated modes cleanly produce fewer correction cycles than the ones where both were running simultaneously?

That data exists in your development environment. The file change timestamps, the commit graph, the gap between first open and first passing test — these are observable without any special instrumentation. You're already generating this data. The question is whether you're looking at it.

At xeve, we track tool session boundaries and correlate them with productivity patterns across coding sessions. The specific finding in the July field study — that interaction mode selection has a measurable cost when done wrong — is exactly the kind of signal that doesn't appear in commit counts or PR merge rates. It's visible in the session-level pattern of what you opened, in what order, and what you did next.

The researchers published a rule of thumb. The harder version of the same question is whether your own patterns match it — or whether you've been combining modes in ways that are quietly costing you time.

Written by Kevin — builder of xeve

Track your apps, coding, music, and health — all in one place.

try xeve free