ai_flutter_agent
A Flutter package that lets LLMs operate app UIs via the Semantics tree. Perceive → Plan → Execute → Verify loop with built-in safety features.
0.1.3
ImL1s/flutter_agent
What this package is like to depend on
Last release 5 months ago
17 Mar 2026
Too new to tell
only 1 release windows
Nearly every release is documented
notes for 4 of 4 stable releases
Nothing withdrawn
no release was ever pulled
5 months old
4 releases · first in 2026
4 releases in the last 12 months
see the full history below
Release timeline
4 releases · Mar 2026 to Mar 2026Releases
latest 4-
0.1.317 Mar 2026Release notes
Open source →- Fix: Resolve "UI unchanged" error when toggling
Switch,Checkbox, and other stateful widgets —WidgetDescriptornow capturesisToggled,isChecked, andisEnabledstates fromSemanticsFlag. - Fix:
setTextaction now automatically taps the targetTextFieldfirst to ensure focus, fixing silent failures on unfocused text inputs. - Improve:
SemanticTreeWalkerexplicitly advertisessetTextaction for allTextFieldnodes. - Improve:
AgentCoreinjects execution feedback into conversation history for better multi-turn LLM reasoning. - Improve: Post-action delay increased for reliable UI state settling before verification.
- Docs: README rewrite with demo video and explanation of Semantics-tree approach vs screenshot-coordinate automation.
- Example: Added 5 demo apps (Counter, Todo, Chat, Form, Shopping) in
example/for testing all action types.
- Fix: Resolve "UI unchanged" error when toggling
-
0.1.217 Mar 2026Release notes
Open source →- Docs: Updated
README.mdinstallation instructions to useflutter pub addinstead ofgit, and added pub.dev version badge.
- Docs: Updated
-
0.1.117 Mar 2026Release notes
Open source →- Docs: Major README overhaul with new framework icon, badges, accurate Quick Start guide, and categorized feature list.
- Docs: Fixed GitHub URLs in
pubspec.yamlandREADME.mdto point to correct repository for pub.dev scoring. - Chore: Resolved 39 static analysis warnings (
prefer_const_constructors, unused imports). - Security: Replaced hardcoded localhost IPs in E2E tests with environment variables.
-
0.1.017 Mar 2026Release notes
Open source →Initial release with 25 features across 5 phases.
Core
- Agent loop: perceive → plan → execute → verify (
AgentCore) - Semantic tree walker (
SemanticTreeWalker) - Action registry with whitelist enforcement (
ActionRegistry) - LLM client abstraction with OpenAI implementation (
LLMClient,OpenAILLMClient) - Audit logging (
AuditLog)
Advanced
- Multi-turn conversation history (
ConversationHistory) - Privacy-aware data masking (
SensitiveDataMasker) - Resilient LLM calls with retry (
RetryExecutor) - Smart executor with node resolution (
ActionDispatcher) - Agent event callbacks (
AgentCallbacks) - Streaming LLM support (
StreamingLLMClient)
Safety
- User consent gate (
ConsentHandler) - Per-action confirmation hook
- Action timeout enforcement
- Isolate LLM execution (
IsolateLLMClient)
Production
- Customizable prompt templates (
PromptTemplate,CustomPromptTemplate) - Built-in actions: tap, longPress, scroll, setText, focus, dismiss (
BuiltInActions) - Semantics action executor (
SemanticsActionExecutor) - Structured diff verification (
VerificationDetail) - Macro recording & replay (
MacroRecorder,Macro,MacroStore) - Agent widget wrapper (
AgentOverlayWidget) - Debug event stream (
DebugLogStream)
- Agent loop: perceive → plan → execute → verify (