Does Remio's AI run in the cloud?

No. Every AI capability in Remio runs on-device or on your host machine. Adaptive quality reads telemetry on the host and the client; the planned agent platform routes language-model commands through Remio's encrypted peer-to-peer tunnel; predictive input pre-renders frames locally on the client; MetalFX neural upscaling uses Apple's Neural Engine on the device that decodes the stream. Remio's relay never sees session content — it forwards DTLS-SRTP encrypted bytes when peer-to-peer is impossible, and it cannot decrypt them. There is no Remio cloud endpoint that touches screen pixels, keystrokes, or inference output.

Can I use Claude or GPT to control my Mac through Remio?

Not yet — this is the AI-agent platform capability, currently in research. The underlying infrastructure is already in place: ScreenCaptureKit captures host frames for the agent to read, UnifiedInputHandler injects native mouse and keyboard events into the host, and FlatBuffers carries commands at sub-millisecond parse time over Remio's encrypted data channel. What is missing is a stable API surface for an agent to call. The agent platform will let any language model that supports tool use — Claude, GPT-4o, Gemini, local models — drive a real desktop through the same encrypted connection a human user gets.

What is adaptive quality and how does it differ from manual quality settings?

Adaptive quality is the only AI capability currently shipping in Remio. It reads three signals — network bandwidth from WebRTC bandwidth estimation, on-screen content type via the encoder content-type hint, and battery level on the client — then tunes encoder bitrate, codec choice, and resolution on the host in real time. Manual settings ask the user to pick a fixed bitrate and codec at session start; adaptive quality re-tunes every few hundred milliseconds without any UI interaction. The result is smoother fallback when Wi-Fi degrades, longer battery on the client, and crisper text when the host frame contains a document instead of motion.

When will predictive input ship in Remio?

Predictive input is in research — no shipping date yet. The technique pre-renders the local cursor position and keystroke echo before the host frame arrives over the network, masking 20 to 60 milliseconds of round-trip latency. The hard problem is rollback when the prediction does not match the host frame — a misprediction has to fade out smoothly enough that the eye does not catch the correction. Predictive input is grouped in the same research phase as the agent platform and MetalFX neural upscaling. Adaptive quality ships first because it is the only capability that does not need on-device model inference.

Does Remio's AI collect screen data for training?

No. Remio does not collect screen data, keystrokes, or inference output for training or any other purpose. The adaptive quality model that ships today runs on the host with no telemetry sent to Remio. The planned on-device models for predictive input, neural upscaling, and behavioural security all execute inside the client app sandbox and never write screen content to disk. The agent platform routes commands through the encrypted peer-to-peer channel; the language model that drives it is whichever model you connect to (Anthropic, OpenAI, Google, local), and Remio does not see the prompts or responses. The relay sees only opaque encrypted bytes.

✦AI

Six AI capabilities, one streaming pipeline.

One ships now — adaptive quality, which tunes bitrate, codec, and resolution from your network signal in real time. Three more are in research, two are planned. Every model runs on-device or on the host — Remio never sees your session.

✦Status

One shipping, three in research, two planned.

A working remote desktop has six places where AI can earn its keep: the encoder, the agent layer, the input loop, the decoder, the voice path, and the session signal. Remio builds one capability into each — status below is honest, not aspirational.

Shipping today

Adaptive quality

Reads round-trip time in the first second, then picks the bitrate envelope that keeps the picture sharp without spiking lag. LAN or 4G, chosen automatically. The one capability that ships today.

Live bandwidth readH.265 / AV1Host-sideZero config

Read deep dive → In research

Agent platform

A real OS desktop for Claude, GPT, Gemini, or your own model — native input, full screen access, an encrypted session. Most of the plumbing exists; a stable agent-facing surface is what's left.

Native screen captureNative inputFast command channelEnd-to-end encrypted

Read deep dive → In research

Neural upscaling

Stream at a lower resolution, rebuild the pixels on your device's neural engine. Text edges stay crisp and UI chrome stops looking like a JPEG — sharper than the bitrate suggests, entirely on-device.

Core ML / NNAPINeural EngineOn-deviceClient-side

Read deep dive →

In research

Predictive input

Pre-renders the cursor and keystroke echo on the client before the host frame arrives, masking 20–60 ms of round-trip. The hard part is rolling back gracefully when the host frame disagrees.

Planned

Voice control

Speak commands to your remote host — open an app, switch a Space, take a screenshot. Speech-to-text runs on-device; recognised intents route through the same keyboard and dock paths the touch UI uses.

Planned

Behavioural security

Learns the shape of your normal sessions — typical devices, hours, app patterns — and flags drift. The baseline lives on the host, so new geographies or unusual timing surface as an alert before any session data moves.

✦Native

AI lives in the pipeline, not in a sidecar.

Bolting AI onto a web-wrapped remote desktop is window dressing. Remio runs the model where the frame is — on the same Apple Neural Engine and on-device acceleration the stream already uses. Fewer hops, no cloud round-trip, and no screen data leaving the device that owns it.

Sub-millisecond command parsing · MetalFX upscaling on-device · zero screen data leaves your devices.

✦Roadmap

Three phases, no vapourware.

Each phase brings one more capability into the streaming pipeline. Phases sequence rather than overlap, so every capability gets a real shipping window.

Active · 2026

Phase 01 — Encoder intelligence

Adaptive quality

Bitrate, codec, and resolution tuned in real time from network round-trip, on-screen content type, and client battery level. Host-side, zero configuration. Rolling out across Mac, Windows, and Linux hosts.

Planned · 2026–2027

Phase 02 — Pipeline intelligence

Agents · predictive input · neural upscaling

An agent platform for Claude, GPT, Gemini, and any tool-using model. Predictive input that masks 20–60 ms of round-trip locally. Neural upscaling for sharper frames at lower bitrate. Each ships independently as it stabilises — no monolithic release.

Roadmap · 2027

Phase 03 — Interface intelligence

Voice control · behavioural security

Voice control mapped to host-side actions through the same dock and keyboard paths the touch UI uses. Behavioural session security that learns the shape of normal sessions on the host and flags geographic, temporal, or pattern drift before screen data moves.

✦Zero-knowledge

The model runs on your hardware, not ours.

Every AI capability runs on-device or on your host machine. Remio's relay forwards encrypted bytes when peer-to-peer is impossible, and cannot decrypt them. There is no Remio cloud endpoint that touches your pixels, keystrokes, or inference output.

What runs where

Adaptive quality tunes on the host. Neural upscaling runs on the client's Neural Engine. The agent platform routes commands through your encrypted peer-to-peer channel — the model is whichever one you connect to. None of it touches a Remio server.

No screen data for training

Remio does not collect screen content, keystrokes, or inference output — for training or anything else. On-device models execute inside the client sandbox and never write frames to disk. The relay sees only opaque encrypted bytes.

Get adaptive quality today, the rest as it ships.

Install Remio on the computer you want to reach and the device you reach it from. Adaptive quality is on by default; future capabilities arrive as silent updates — no account migration, no separate AI plan.

Download Remio — free Explore all features