v1.4.0Desktop
Flowly Desktop 1.4.0
- New β Computer Use: Flowly can now act on the Mac directly β open apps, click buttons, switch windows, read on-screen text. The bot reads the same semantic UI structure as VoiceOver so it can act on labels you'd say out loud ('the Sign In button in Safari') instead of guessing pixel coordinates. Sandboxed by default; every action visible in the Activity tab.
- New β Live tool-turn panel: Every assistant message ships a collapsible panel that streams tool calls (file edits, shell, search, computer-use) in real time, with per-tool renderers. The Activity tab's audit view uses the same renderers so history looks identical to live chat.
- New β In-app file preview: Click a file path the bot mentioned (markdown link or inline code) to open a resizable, syntax-highlighted side panel. Relative paths auto-resolve against common project roots; directories still reveal in Finder.
- New β Artifacts cloud sync: Canvases, slides, docs, and code sync automatically across signed-in devices. Offline-aware queue, S3-backed previews, 10 MB size cap (up from 500 KB).
- New β Screen-aware Coach (macOS, opt-in): When you enable it, a native ScreenCaptureKit sidecar shares lossless captures of the window under your cursor with the model alongside audio, so tips can reference what you're actually looking at. ElevenLabs Scribe v2 STT adds
[YOU]:/[OTHER]:speaker labels. Dual-Cmd forces a tip mid-session. Notch escalates to always-on-top with a 3-second watchdog. - New β Knowledge Graph overhaul: Floating detail panel, click-through entity relationships, in-app entity deletion (cascades to triples), liquid-glass zoom controls, flicker-free node drag.
- New β What's new modal: First launch after auto-update opens release highlights with a hero matching the website's auth screen and a link to the full changelog.
- New β Welcome-screen otter mascot (opt-in): Vector otter toggleable from Settings β Appearance. Eyes track your cursor while you type, mouth opens pink when you paste, blinks idly.
- New β Hey Flowly wake word: Production-ready on-device wake-word integration. Talk hands-off when the notch is live without holding Fn.
- New β Skill library expanded: 30+ new built-in skills covering finance modelling (3-statement-model, DCF, Excel authoring), GitHub workflow (PR review, repo management, code review), design and docs (concept diagrams, Excalidraw, PowerPoint authoring, nano-pdf), and SaaS integrations (Notion, Linear, Airtable, Google Workspace). Browse the full catalogue in Dashboard β Skills.
- Improvements β Sandbox by default: macOS uses
sandbox-exec, Linux usesbubblewrap; deny-list profile blocks writes outside the workspace. Master switch in Dashboard β Settings. Skill marketplace surfaces per-plugin risk labels. - Improvements β Composer attachments: Upload-first flow with per-file status (queued/uploading/ready/failed), 50 MB video uploads, correct serverId/conversationId on every upload.
- Improvements β Windows / Linux parity: Platform-aware default hotkeys, modifier labels, voice shortcut hints, and smart-pause process detection. Dedicated Windows tray icon.
- Improvements β Coach quota visibility: Live progress bar in Settings β Usage and the sidebar usage popover. Pre-flight gating stops the session cleanly on STT 429.
- Improvements β Coaching settings is now a floating panel matching the rest of the app's side-panel pattern.
- Improvements β Dashboard regrouped: AI Tools and Security promoted to top-level groups. Pre-Sonoma macOS gets a friendly capability warning.
- Improvements β Shared AlertDialog adopts the liquid-glass theme app-wide with softer corners.
- Fix β Activity tab now scrolls instead of clipping; Radix ScrollArea wrapper repaired.
- Fix β Tool output rendering is cleaner: stray wrapper markup removed, escape sequences normalised, and excessively long blobs collapse to a short summary by default.
- Fix β Artifacts: 8 small UX bugs (delete confirm cancel, sort persistence, distinct empty/loading/error states, a11y labels).
- Fix β Coach screenshots use a quality + cursor-display target that keeps small on-screen text legible to the model.
- Fix β Granting macOS Accessibility from onboarding registers the global hotkey live; no app restart needed.
- Fix β Coach Start gated on Flowly AI gateway availability so it doesn't 404 immediately.
- Fix β Computer Use finds targets more reliably: matches against multiple element attributes (not just the visible label), suggests the closest candidates when an exact match misses, and avoids re-using stale element IDs after a window changes.
- Fix β Terminal emulators (iTerm2, Terminal, Alacritty, Kitty, Ghostty, Wezterm) get clipboard paste instead of synthetic key events.
- Internal β Sentry on artifact sync with scope tags. Persistent sync cursor avoids re-uploads after cold restart. Window-hidden poll pause for limits + bot updates.
package.jsonat 1.4.0.