[Feature] Support tuning parameter-level optim hyperparameters.

[RangiLyu]

New Feature

Add nanodet.optim.build_optimizer
Support use optimizer building function to customize parameter-level hyperparameters with config.

How to use

optimizer:
   name: AdamW
   lr: 0.001
   weight_decay: 0.05
   no_norm_decay: True  # do not add weight decay to norm layer (from bag of tricks)
   param_level_cfg:  # parameter-level config
     backbone:
       lr_mult: 0.1  # example: use smaller lr for the backbone

[codecov]

Codecov Report

Merging #463 (f56af5f) into main (a3b3452) will increase coverage by 0.19%.
The diff coverage is 88.60%.

@@            Coverage Diff             @@
##             main     #463      +/-   ##
==========================================
+ Coverage   74.51%   74.71%   +0.19%     
==========================================
  Files          67       70       +3     
  Lines        4509     4572      +63     
  Branches      760      777      +17     
==========================================
+ Hits         3360     3416      +56     
- Misses        968      971       +3     
- Partials      181      185       +4     

Flag	Coverage Δ
unittests	74.71% <88.60%> (+0.19%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
nanodet/util/env_utils.py	86.95% <86.95%> (ø)
nanodet/optim/builder.py	88.88% <88.88%> (ø)
nanodet/trainer/task.py	55.23% <88.88%> (-0.08%)	⬇️
nanodet/optim/__init__.py	100.00% <100.00%> (ø)
nanodet/data/transform/warp.py	84.48% <0.00%> (-1.15%)	⬇️

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more