Create a constant to initializer pass

[justinchuby]

https://gist.github.com/justinchuby/cf1699d05baeac281fb3e82f9d0fc473

[justinchuby]

Maybe call it constant manipulation or something

[titaiwangms]

If we make this pass, should we have it before model.optimze() or after model.optimize() in the middle of exporting?
https://github.com/pytorch/pytorch/blob/203a27e0cecce5b9050218c9d6a56c8cd2ebd0a5/torch/onnx/_internal/exporter/_compat.py#L184

Where we usually do graph pass is in _core.py (before optimize):
https://github.com/pytorch/pytorch/blob/203a27e0cecce5b9050218c9d6a56c8cd2ebd0a5/torch/onnx/_internal/exporter/_core.py#L1161

[justinchuby]

it should be called in optimize not PyTorch I think. It’s a pass to mend the behavior of optimize()