完整仿真代码放在：Graph加速示例.zip-其它文档类资源-CSDN下载

参考资料：

Introduction to OpenCV Graph API (G-API) — OpenVINO™ documentation

Graph API · opencv/opencv Wiki · GitHub 

OpenCV: Porting anisotropic image segmentation on G-API 

  博文阅读密码验证 - 博客园 跟着试了下：

未使用之前：

cv time : 99.501 ms!
cv time : 95.689 ms!
cv time : 98.0095 ms!
cv time : 98.1107 ms!
cv time : 96.3742 ms!
cv time : 98.044 ms!
cv time : 95.7801 ms!
cv time : 96.1189 ms!
cv time : 97.9171 ms!
cv time : 97.3745 ms!
cv time : 95.5081 ms!
cv time : 97.727 ms!
cv time : 101.026 ms!
cv time : 95.986 ms!
cv time : 95.9782 ms!
cv time : 99.8497 ms!
cv time : 98.8214 ms!
cv time : 97.9106 ms!
cv time : 98.4407 ms!
cv time : 97.8548 ms!
cv time : 97.9381 ms!
cv time : 98.1569 ms!
cv time : 98.7183 ms!
cv time : 98.1326 ms!
cv time : 97.7033 ms!
cv time : 100.691 ms!
cv time : 97.4689 ms!
cv time : 96.1933 ms!
cv time : 96.8694 ms!
cv time : 98.3715 ms!
cv time : 96.4674 ms!
cv time : 96.252 ms!
cv time : 96.3347 ms!
cv time : 98.9862 ms!
cv time : 97.1109 ms!
cv time : 97.618 ms!
cv time : 98.1561 ms!
cv time : 97.1566 ms!
cv time : 97.4405 ms!
cv time : 96.7139 ms!
cv time : 96.6943 ms!
cv time : 97.4062 ms!
cv time : 99.4415 ms!
cv time : 97.8337 ms!
cv time : 98.3935 ms!
cv time : 96.2766 ms!
cv time : 98.9972 ms!
cv time : 96.5274 ms!
cv time : 99.8421 ms!
cv time : 100.417 ms!
cv time : 98.6711 ms!
cv time : 97.8427 ms!
cv time : 96.1251 ms!
cv time : 96.3101 ms!
cv time : 97.5754 ms!
cv time : 97.0058 ms!
cv time : 96.8089 ms!
cv time : 98.4195 ms!
cv time : 98.0034 ms!
cv time : 100.939 ms!
cv time : 97.7773 ms!
cv time : 97.2217 ms!
cv time : 97.3633 ms!
cv time : 99.1414 ms!
cv time : 96.724 ms!
cv time : 97.5761 ms!
cv time : 95.1741 ms!
cv time : 96.4939 ms!
cv time : 96.7922 ms!
cv time : 98.1082 ms!
cv time : 96.2842 ms!
cv time : 96.1301 ms!
cv time : 96.8976 ms!
cv time : 96.1653 ms!
cv time : 96.1877 ms!
cv time : 95.8758 ms!
cv time : 96.909 ms!
cv time : 98.1599 ms!
cv time : 95.7297 ms!
cv time : 95.7381 ms!
cv time : 99.1436 ms!

使用TBB后：

TBB time : 44.4609 ms!
TBB time : 38.5021 ms!
TBB time : 38.4773 ms!
TBB time : 38.4363 ms!
TBB time : 38.481 ms!
TBB time : 41.6342 ms!
TBB time : 39.1222 ms!
TBB time : 38.6057 ms!
TBB time : 38.6561 ms!
TBB time : 38.5312 ms!
TBB time : 41.8132 ms!
TBB time : 38.4815 ms!
TBB time : 38.5323 ms!
TBB time : 39.7848 ms!
TBB time : 43.703 ms!
TBB time : 43.98 ms!
TBB time : 41.2625 ms!
TBB time : 38.8581 ms!
TBB time : 39.2704 ms!
TBB time : 41.6127 ms!
TBB time : 45.5051 ms!
TBB time : 39.7299 ms!
TBB time : 42.0271 ms!
TBB time : 39.4413 ms!
TBB time : 39.7593 ms!
TBB time : 41.6844 ms!
TBB time : 39.5666 ms!
TBB time : 42.2724 ms!
TBB time : 41.2423 ms!
TBB time : 40.557 ms!
TBB time : 38.9499 ms!
TBB time : 41.2622 ms!
TBB time : 40.4103 ms!
TBB time : 38.8458 ms!
TBB time : 44.2368 ms!
TBB time : 38.9581 ms!
TBB time : 41.2792 ms!
TBB time : 39.8669 ms!
TBB time : 40.0218 ms!
TBB time : 39.1029 ms!
TBB time : 39.043 ms!
TBB time : 38.8553 ms!
TBB time : 38.4237 ms!
TBB time : 38.9918 ms!
TBB time : 38.8727 ms!
TBB time : 41.6919 ms!
TBB time : 41.6226 ms!
TBB time : 42.4347 ms!
TBB time : 41.9062 ms!
TBB time : 44.1528 ms!
TBB time : 40.4362 ms!
TBB time : 40.0174 ms!
TBB time : 40.8705 ms!
TBB time : 40.7688 ms!
TBB time : 39.2415 ms!
TBB time : 39.0336 ms!
TBB time : 43.687 ms!
TBB time : 38.4424 ms!
TBB time : 38.7625 ms!
TBB time : 40.4807 ms!
TBB time : 41.6201 ms!
TBB time : 40.9234 ms!
TBB time : 40.0211 ms!
TBB time : 42.5825 ms!
TBB time : 38.7514 ms!
TBB time : 41.1997 ms!
TBB time : 38.9014 ms!
TBB time : 38.5749 ms!
TBB time : 38.7365 ms!
TBB time : 38.4623 ms!
TBB time : 42.3607 ms!
TBB time : 39.8959 ms!
TBB time : 41.3502 ms!
TBB time : 41.0806 ms!
TBB time : 39.7346 ms!
TBB time : 38.5139 ms!
TBB time : 41.431 ms!
TBB time : 43.5324 ms!
TBB time : 40.9971 ms!
TBB time : 38.7231 ms!
TBB time : 41.4945 ms!

可以看到加速比达到2.4，接下来换成使用dynamic graph后：

test time with Graph pipeline : 21.1183 ms!
test time with Graph pipeline : 20.6564 ms!
test time with Graph pipeline : 21.0093 ms!
test time with Graph pipeline : 20.8072 ms!
test time with Graph pipeline : 20.8026 ms!
test time with Graph pipeline : 20.8431 ms!
test time with Graph pipeline : 21.1521 ms!
test time with Graph pipeline : 20.6711 ms!
test time with Graph pipeline : 20.7423 ms!
test time with Graph pipeline : 20.9054 ms!
test time with Graph pipeline : 20.9168 ms!
test time with Graph pipeline : 20.96 ms!
test time with Graph pipeline : 21.2163 ms!
test time with Graph pipeline : 20.7523 ms!
test time with Graph pipeline : 20.9341 ms!
test time with Graph pipeline : 20.6903 ms!
test time with Graph pipeline : 20.8563 ms!
test time with Graph pipeline : 20.7255 ms!
test time with Graph pipeline : 21.9423 ms!
test time with Graph pipeline : 20.5172 ms!
test time with Graph pipeline : 20.9017 ms!
test time with Graph pipeline : 20.801 ms!
test time with Graph pipeline : 20.8254 ms!
test time with Graph pipeline : 20.7073 ms!
test time with Graph pipeline : 21.1557 ms!
test time with Graph pipeline : 20.7868 ms!
test time with Graph pipeline : 21.0163 ms!
test time with Graph pipeline : 22.0695 ms!
test time with Graph pipeline : 20.7817 ms!
test time with Graph pipeline : 20.7704 ms!
test time with Graph pipeline : 21.4617 ms!
test time with Graph pipeline : 21.3813 ms!
test time with Graph pipeline : 20.8569 ms!
test time with Graph pipeline : 20.765 ms!
test time with Graph pipeline : 20.9694 ms!
test time with Graph pipeline : 20.8438 ms!
test time with Graph pipeline : 20.871 ms!
test time with Graph pipeline : 20.7563 ms!
test time with Graph pipeline : 21.5225 ms!
test time with Graph pipeline : 20.9548 ms!
test time with Graph pipeline : 20.7067 ms!
test time with Graph pipeline : 20.5678 ms!
test time with Graph pipeline : 20.9064 ms!
test time with Graph pipeline : 20.7507 ms!
test time with Graph pipeline : 20.8302 ms!
test time with Graph pipeline : 22.0085 ms!
test time with Graph pipeline : 22.1041 ms!
test time with Graph pipeline : 20.8057 ms!
test time with Graph pipeline : 21.0339 ms!
test time with Graph pipeline : 20.7129 ms!
test time with Graph pipeline : 20.6981 ms!
test time with Graph pipeline : 20.7083 ms!
test time with Graph pipeline : 20.9368 ms!
test time with Graph pipeline : 20.9097 ms!
test time with Graph pipeline : 20.8749 ms!
test time with Graph pipeline : 20.6811 ms!
test time with Graph pipeline : 22.7956 ms!
test time with Graph pipeline : 20.6596 ms!
test time with Graph pipeline : 20.8668 ms!
test time with Graph pipeline : 20.6973 ms!
test time with Graph pipeline : 20.8681 ms!
test time with Graph pipeline : 20.8009 ms!
test time with Graph pipeline : 20.8937 ms!
test time with Graph pipeline : 20.9901 ms!
test time with Graph pipeline : 21.1623 ms!
test time with Graph pipeline : 21.2565 ms!
test time with Graph pipeline : 20.7857 ms!
test time with Graph pipeline : 20.7822 ms!
test time with Graph pipeline : 20.9088 ms!
test time with Graph pipeline : 20.691 ms!
test time with Graph pipeline : 21.0772 ms!
test time with Graph pipeline : 20.7612 ms!
test time with Graph pipeline : 20.8782 ms!
test time with Graph pipeline : 20.757 ms!
test time with Graph pipeline : 21.2379 ms!
test time with Graph pipeline : 20.9211 ms!
test time with Graph pipeline : 20.9235 ms!
test time with Graph pipeline : 21.262 ms!
test time with Graph pipeline : 20.8335 ms!
test time with Graph pipeline : 20.7603 ms!
test time with Graph pipeline : 20.9435 ms!

可以看到加速比达到4.7！！！巨大性能提升！！！当然适用性有限，大家多试试看自己的工程是否合适。