Skip to content

[P1] ML.NET workflow intent classifier — trained model upgrade path #404

@JerrettDavis

Description

@JerrettDavis

Objective

Replace/augment the TF-IDF heuristic classifier (#401) with a trained ML.NET binary classifier for higher accuracy workflow intent detection.

Approach

  • ML.NET SdcaLogisticRegression or LbfgsMaximumEntropy
  • Train on synthesized prompt pairs (workflow vs conversation)
  • Ship as .zip model file, loaded at Gateway startup
  • <1ms inference, zero external deps

Prerequisites

Deliverables

  • Training data generation script (pull from agent session history + augment)
  • ML.NET training pipeline
  • MlNetIntentClassifier : IPromptIntentClassifier implementation
  • A/B comparison: TF-IDF vs ML.NET accuracy on holdout set
  • Hot-swap support: replace classifier at runtime without restart

Blocking Order

Depends on #401 (TF-IDF proves concept)

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions