-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Labels
area: agentenhancementNew feature or requestNew feature or requestpriority:P1Highest priorityHighest priorityworkflowsWorkflow systemWorkflow system
Description
Objective
Replace/augment the TF-IDF heuristic classifier (#401) with a trained ML.NET binary classifier for higher accuracy workflow intent detection.
Approach
- ML.NET
SdcaLogisticRegressionorLbfgsMaximumEntropy - Train on synthesized prompt pairs (workflow vs conversation)
- Ship as .zip model file, loaded at Gateway startup
- <1ms inference, zero external deps
Prerequisites
- [P0] TF-IDF workflow intent classifier — pre-agent prompt routing #401 (TF-IDF classifier) proves out the concept and routing pipeline
- Training data synthesis: generate 500+ labeled prompt pairs from real agent sessions + synthetic augmentation
Deliverables
- Training data generation script (pull from agent session history + augment)
- ML.NET training pipeline
-
MlNetIntentClassifier : IPromptIntentClassifierimplementation - A/B comparison: TF-IDF vs ML.NET accuracy on holdout set
- Hot-swap support: replace classifier at runtime without restart
Blocking Order
Depends on #401 (TF-IDF proves concept)
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
area: agentenhancementNew feature or requestNew feature or requestpriority:P1Highest priorityHighest priorityworkflowsWorkflow systemWorkflow system