You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Show progress (or structured logs) while generate_suite runs, label scan phases (generating vs running), and add a verbose switch on quality_scan / vulnerability_scan so CI can suppress Rich UI and print_report while still returning SuiteResult.
Motivation
Suite.run already has Rich progress. Generation (adversarial LLM + HF downloads) can take minutes with no feedback. Scan helpers always print reports. Opt-in check-level logging (#2607) does not cover generation or a first-class quiet API.
Implementation plan
generate_suite: Rich progress (or logging INFO) over generators — i/n + generator class/name; update on completion/failure.
Scan helpers: set phase before generate vs run; pass verbose into Suite.run (existing flag) and gate result.print_report().
Non-TTY: fall back to log lines (no broken Rich escape codes in CI).
Feature Request
Show progress (or structured logs) while
generate_suiteruns, label scan phases (generating vs running), and add averboseswitch onquality_scan/vulnerability_scanso CI can suppress Rich UI andprint_reportwhile still returningSuiteResult.Motivation
Suite.runalready has Rich progress. Generation (adversarial LLM + HF downloads) can take minutes with no feedback. Scan helpers always print reports. Opt-in check-level logging (#2607) does not cover generation or a first-class quiet API.Implementation plan
generate_suite: Rich progress (orloggingINFO) over generators —i/n+ generator class/name; update on completion/failure.verboseintoSuite.run(existing flag) and gateresult.print_report().verbose=Falsenever callsprint_report; fake multi-generator suite emits ≥1 progress/log event during generate.API usage
Example terminal output (verbose generate)
Example log lines (non-TTY / verbose generate)
Quiet mode (
verbose=False)No Rich bars, no automatic
print_report(). Return value unchanged:Acceptance criteria
generate_suitealone is not a silent multi-minute hangverboseand can suppressprint_reportOut of scope