Consider GraphInferenceContext in inference functions: InferenceContext#4632
Consider GraphInferenceContext in inference functions: InferenceContext#4632
Conversation
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
|
Adding a test-case would be useful |
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
83be312 to
ce5f874
Compare
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
| subgraph = make_graph( | ||
| [ | ||
| make_node("Identity", ["loop_state_in"], ["loop_state_out"]), | ||
| make_node("Identity", ["input"], ["output"]), |
There was a problem hiding this comment.
Can we change this to include an outer-scope variable reference? Like
make_node("Add", ["input", "outer"], ["output"]),Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
| input_types: Dict[str, onnx.TypeProto], | ||
| input_data: Optional[Dict[str, onnx.TensorProto]] = None, | ||
| input_sparse_data: Optional[Dict[str, onnx.SparseTensorProto]] = None, | ||
| subgraph_opset_imports: Optional[List[onnx.OperatorSetIdProto]] = None, |
There was a problem hiding this comment.
minor nit: I think opset_imports and ir_version might be sufficient as the parameter names. I realize they are used only for subgraphs, but it is unlikely to cause any confusion or ambiguity to use the shorter name. It will be easier for callers, when they use keyword-arguments.
There was a problem hiding this comment.
I was in the debate of opset_imports and subgraph_opset_imports, but yes I agreed using shorter name here is cleaner. Just updated. Will merge this PR soon. Thank you for bringing this up!
gramalingam
left a comment
There was a problem hiding this comment.
LGTM, thanks! Just have one minor comment about naming of parameters.
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
…xt (onnx#4632) * Expose GraphInferenceContext in Python interface for inference functions Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * use the same map Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * add opset_imports and handle input_types Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * graph_opset_import to clarify Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * fix lint Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * fix black Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * add a test Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * make_opsetid Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * replace test with Add in subgraph Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * remove unused Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * use shorter name for opset_imports and ir_version Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
…xt (onnx#4632) * Expose GraphInferenceContext in Python interface for inference functions Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * use the same map Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * add opset_imports and handle input_types Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * graph_opset_import to clarify Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * fix lint Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * fix black Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * add a test Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * make_opsetid Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * replace test with Add in subgraph Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * remove unused Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> * use shorter name for opset_imports and ir_version Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com> Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Description
Motivation and Context
Follow up for #4409. Further consider GraphInferenceContext for inference function