DNNL-BYOC enhancement

[crazydemo]

• add more patterns in dnnl.py.
• add test cases, which have covered the support ops and patterns, in test_dnnl.py.
• add implementation of new added ops and patterns in dnnl_json_runtime.cc.
• add support to dilated conv2d with dnnl backend.

[jwfromm]

Thanks for this change, it looks really excellent. I have a few small comments but am curious if youve done any benchmarking with this new pattern fusion. If so, how much do these changes speed up models you tried?

[crazydemo]

Thanks for this change, it looks really excellent. I have a few small comments but am curious if youve done any benchmarking with this new pattern fusion. If so, how much do these changes speed up models you tried?

Thank you for your comments. We do have done some benchmark, and the related results are posted on RFC.

Note that, the results in RFC are collected with the registered pattern and optimization from alter_op_layout pass.
We are going to submit another two layout transform related PRs to fully support the performance gain claimed in RFC.