onnx model exportable support

[lucasjinreal]

Since onnx provides almost all ops needs by maskrcnn, it would be great if model can exported to onnx and would be benefit more from TensorRT acceleration for these large models.

[sampepose]

The Portal team at Facebook is already using ONNX to deploy Detectron2 models to device.

I added ROIAlign to ONNX, but we're still missing:

• GenerateProposals
• BBoxTransform
• BoxWithNMSLimit

We splice up the model, using ONNX where possible, and using caffe2.python.core.CreateOperator for these unsupported ops. I will see if we can release our conversion script.

[lucasjinreal]

@sampepose Thanks for this wonderful work. AFAIK, original maskrcnn-benmark which detectron2 based mainly already exported to onnx by community, and ONNX opset 11 have all ops needed by maskrcnn.onnx.

For what we want final is, exported to onnx if possible and finally convert onnx model to TensorRT engine to gain the massive accelerations.

From this aspect, importing too many ops that not in range of onnx standard is not really necessary I think.

[mmxuan18]

onnx export mode has been supported

any docs or examples?

[dselivanov]

No, it's our internal support.

why is this closed then :-D ? Adding ONNX support to your proprietary facebook pipeline is not equal to adding it to detectron2 opensource.

[beniz]

@jiajunshen so Google, internally, made the onnx work, and keeps it closed-source, is that correct ? Confusing :)

[jillemash]

Hi,
Shouldn't this issue stay open as long as the conversion script is not available ?
In #243 (comment) and #46 (comment) Yuxin Wu
(ppwwyyxx) says that this issue will be updated to follow progress on this.
I'm interested to subscribe to this one to be notified when converting models to ONNX will be available.

Thanks.

[lucasjinreal]

I have to say generates onnx is quite simple. The question is make it runnable on a acceleration framwork such as TensorRT.

things becomes different when it comes to such a complicated model. Wish community can start the next step thing though.