rcourtman a04d41ce2c Add end-to-end evaluation framework for AI assistant testing ...

Implement comprehensive eval framework for testing Pulse Assistant:

Core components:
- Runner: Executes scenarios against live API with SSE stream parsing
- Assertions: Reusable checks (tool usage, content, duration, errors)
- Scenarios: Multi-step test workflows with configurable assertions

Basic scenarios:
- QuickSmokeTest: Minimal functionality verification
- ReadOnlyInfrastructure: List, logs, status operations
- RoutingValidation: Command routing to correct targets
- LogTailing: Bounded log commands complete properly
- Discovery: Infrastructure discovery capabilities

Advanced scenarios:
- TroubleshootingScenario: Multi-step investigation workflow
- DeepDiveScenario: Thorough single-service investigation
- ConfigInspectionScenario: Reading configuration files
- ResourceAnalysisScenario: Cross-container resource comparison
- MultiNodeScenario: Operations across Proxmox nodes
- DockerInDockerScenario: Docker containers inside LXCs
- ContextChainScenario: Context retention across turns

Usage: go test ./internal/ai/eval -live -run TestQuickSmokeTest

2026-01-28 16:49:24 +00:00

..

eval

Add end-to-end evaluation framework for AI assistant testing

2026-01-28 16:49:24 +00:00

hashpw

feat: remove Enterprise badges, simplify Pro upgrade prompts

2026-01-09 16:51:08 +00:00

pulse

refactor: simplify temperature monitoring after sensor proxy removal

2026-01-21 12:00:28 +00:00

pulse-agent

feat: add host agent sysinfo and improve test coverage

2026-01-24 22:42:46 +00:00

pulse-host-agent

fix: Update runtime config when toggling Docker update actions setting

2026-01-03 11:14:17 +00:00