Skip to content

add benchmark of yolo series #6358

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

add benchmark of yolo series #6358

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 18 additions & 0 deletions benchmark/benchncnn.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -463,6 +463,24 @@ int main(int argc, char** argv)
benchmark("vision_transformer", ncnn::Mat(384, 384, 3), opt);

benchmark("FastestDet", ncnn::Mat(352, 352, 3), opt);

benchmark("yolov5n", ncnn::Mat(640, 640, 3), opt);

benchmark("yolov6n", ncnn::Mat(640, 640, 3), opt);

benchmark("yolov7-tiny", ncnn::Mat(640, 640, 3), opt);

benchmark("yolov8n", ncnn::Mat(640, 640, 3), opt);

benchmark("yolov9-t", ncnn::Mat(640, 640, 3), opt);

benchmark("yolov10n", ncnn::Mat(640, 640, 3), opt);

benchmark("yolo11n", ncnn::Mat(640, 640, 3), opt);

benchmark("yolov12n", ncnn::Mat(640, 640, 3), opt);

benchmark("yolov13n", ncnn::Mat(640, 640, 3), opt);
}
#if NCNN_VULKAN
delete g_blob_vkallocator;
Expand Down
259 changes: 259 additions & 0 deletions benchmark/yolo11n.param
View file
Open in desktop

Large diffs are not rendered by default.

237 changes: 237 additions & 0 deletions benchmark/yolov10n.param
View file
Open in desktop

Large diffs are not rendered by default.

529 changes: 529 additions & 0 deletions benchmark/yolov12n.param
View file
Open in desktop

Large diffs are not rendered by default.

696 changes: 696 additions & 0 deletions benchmark/yolov13n.param
View file
Open in desktop

Large diffs are not rendered by default.

175 changes: 175 additions & 0 deletions benchmark/yolov5n.param
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,175 @@
7767517
173 197
Input in0 0 1 in0
Convolution conv_0 1 1 in0 1 0=16 1=6 11=6 12=1 13=2 14=2 2=1 3=2 4=2 5=1 6=1728
Swish silu_63 1 1 1 2
Convolution conv_1 1 1 2 3 0=32 1=3 11=3 12=1 13=2 14=1 2=1 3=2 4=1 5=1 6=4608
Swish silu_64 1 1 3 4
Split splitncnn_0 1 2 4 5 6
Convolution conv_2 1 1 6 7 0=16 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=512
Swish silu_65 1 1 7 8
Split splitncnn_1 1 2 8 9 10
Convolution conv_3 1 1 10 11 0=16 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=256
Swish silu_66 1 1 11 12
Convolution conv_4 1 1 12 13 0=16 1=3 11=3 12=1 13=1 14=1 2=1 3=1 4=1 5=1 6=2304
Swish silu_67 1 1 13 14
BinaryOp add_0 2 1 9 14 15 0=0
Convolution conv_5 1 1 5 16 0=16 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=512
Swish silu_68 1 1 16 17
Concat cat_0 2 1 15 17 18 0=0
Convolution conv_6 1 1 18 19 0=32 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=1024
Swish silu_69 1 1 19 20
Convolution conv_7 1 1 20 21 0=64 1=3 11=3 12=1 13=2 14=1 2=1 3=2 4=1 5=1 6=18432
Swish silu_70 1 1 21 22
Split splitncnn_2 1 2 22 23 24
Convolution conv_8 1 1 24 25 0=32 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=2048
Swish silu_71 1 1 25 26
Split splitncnn_3 1 2 26 27 28
Convolution conv_9 1 1 28 29 0=32 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=1024
Swish silu_72 1 1 29 30
Convolution conv_10 1 1 30 31 0=32 1=3 11=3 12=1 13=1 14=1 2=1 3=1 4=1 5=1 6=9216
Swish silu_73 1 1 31 32
BinaryOp add_1 2 1 27 32 33 0=0
Split splitncnn_4 1 2 33 34 35
Convolution conv_11 1 1 35 36 0=32 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=1024
Swish silu_74 1 1 36 37
Convolution conv_12 1 1 37 38 0=32 1=3 11=3 12=1 13=1 14=1 2=1 3=1 4=1 5=1 6=9216
Swish silu_75 1 1 38 39
BinaryOp add_2 2 1 34 39 40 0=0
Convolution conv_13 1 1 23 41 0=32 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=2048
Swish silu_76 1 1 41 42
Concat cat_1 2 1 40 42 43 0=0
Convolution conv_14 1 1 43 44 0=64 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=4096
Swish silu_77 1 1 44 45
Split splitncnn_5 1 2 45 46 47
Convolution conv_15 1 1 47 48 0=128 1=3 11=3 12=1 13=2 14=1 2=1 3=2 4=1 5=1 6=73728
Swish silu_78 1 1 48 49
Split splitncnn_6 1 2 49 50 51
Convolution conv_16 1 1 51 52 0=64 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=8192
Swish silu_79 1 1 52 53
Split splitncnn_7 1 2 53 54 55
Convolution conv_17 1 1 55 56 0=64 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=4096
Swish silu_80 1 1 56 57
Convolution conv_18 1 1 57 58 0=64 1=3 11=3 12=1 13=1 14=1 2=1 3=1 4=1 5=1 6=36864
Swish silu_81 1 1 58 59
BinaryOp add_3 2 1 54 59 60 0=0
Split splitncnn_8 1 2 60 61 62
Convolution conv_19 1 1 62 63 0=64 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=4096
Swish silu_82 1 1 63 64
Convolution conv_20 1 1 64 65 0=64 1=3 11=3 12=1 13=1 14=1 2=1 3=1 4=1 5=1 6=36864
Swish silu_83 1 1 65 66
BinaryOp add_4 2 1 61 66 67 0=0
Split splitncnn_9 1 2 67 68 69
Convolution conv_21 1 1 69 70 0=64 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=4096
Swish silu_84 1 1 70 71
Convolution conv_22 1 1 71 72 0=64 1=3 11=3 12=1 13=1 14=1 2=1 3=1 4=1 5=1 6=36864
Swish silu_85 1 1 72 73
BinaryOp add_5 2 1 68 73 74 0=0
Convolution conv_23 1 1 50 75 0=64 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=8192
Swish silu_86 1 1 75 76
Concat cat_2 2 1 74 76 77 0=0
Convolution conv_24 1 1 77 78 0=128 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=16384
Swish silu_87 1 1 78 79
Split splitncnn_10 1 2 79 80 81
Convolution conv_25 1 1 81 82 0=256 1=3 11=3 12=1 13=2 14=1 2=1 3=2 4=1 5=1 6=294912
Swish silu_88 1 1 82 83
Split splitncnn_11 1 2 83 84 85
Convolution conv_26 1 1 85 86 0=128 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=32768
Swish silu_89 1 1 86 87
Split splitncnn_12 1 2 87 88 89
Convolution conv_27 1 1 89 90 0=128 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=16384
Swish silu_90 1 1 90 91
Convolution conv_28 1 1 91 92 0=128 1=3 11=3 12=1 13=1 14=1 2=1 3=1 4=1 5=1 6=147456
Swish silu_91 1 1 92 93
BinaryOp add_6 2 1 88 93 94 0=0
Convolution conv_29 1 1 84 95 0=128 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=32768
Swish silu_92 1 1 95 96
Concat cat_3 2 1 94 96 97 0=0
Convolution conv_30 1 1 97 98 0=256 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=65536
Swish silu_93 1 1 98 99
Convolution conv_31 1 1 99 100 0=128 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=32768
Swish silu_94 1 1 100 101
Split splitncnn_13 1 2 101 102 103
Pooling maxpool2d_60 1 1 103 104 0=0 1=5 11=5 12=1 13=2 2=1 3=2 5=1
Split splitncnn_14 1 2 104 105 106
Pooling maxpool2d_61 1 1 106 107 0=0 1=5 11=5 12=1 13=2 2=1 3=2 5=1
Split splitncnn_15 1 2 107 108 109
Pooling maxpool2d_62 1 1 109 110 0=0 1=5 11=5 12=1 13=2 2=1 3=2 5=1
Concat cat_4 4 1 102 105 108 110 111 0=0
Convolution conv_32 1 1 111 112 0=256 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=131072
Swish silu_95 1 1 112 113
Convolution conv_33 1 1 113 114 0=128 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=32768
Swish silu_96 1 1 114 115
Split splitncnn_16 1 2 115 116 117
Interp upsample_120 1 1 117 118 0=1 1=2.0 2=2.0 6=0
Concat cat_5 2 1 118 80 119 0=0
Split splitncnn_17 1 2 119 120 121
Convolution conv_34 1 1 121 122 0=64 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=16384
Swish silu_97 1 1 122 123
Convolution conv_35 1 1 123 124 0=64 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=4096
Swish silu_98 1 1 124 125
Convolution conv_36 1 1 125 126 0=64 1=3 11=3 12=1 13=1 14=1 2=1 3=1 4=1 5=1 6=36864
Swish silu_99 1 1 126 127
Convolution conv_37 1 1 120 128 0=64 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=16384
Swish silu_100 1 1 128 129
Concat cat_6 2 1 127 129 130 0=0
Convolution conv_38 1 1 130 131 0=128 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=16384
Swish silu_101 1 1 131 132
Convolution conv_39 1 1 132 133 0=64 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=8192
Swish silu_102 1 1 133 134
Split splitncnn_18 1 2 134 135 136
Interp upsample_121 1 1 136 137 0=1 1=2.0 2=2.0 6=0
Concat cat_7 2 1 137 46 138 0=0
Split splitncnn_19 1 2 138 139 140
Convolution conv_40 1 1 140 141 0=32 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=4096
Swish silu_103 1 1 141 142
Convolution conv_41 1 1 142 143 0=32 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=1024
Swish silu_104 1 1 143 144
Convolution conv_42 1 1 144 145 0=32 1=3 11=3 12=1 13=1 14=1 2=1 3=1 4=1 5=1 6=9216
Swish silu_105 1 1 145 146
Convolution conv_43 1 1 139 147 0=32 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=4096
Swish silu_106 1 1 147 148
Concat cat_8 2 1 146 148 149 0=0
Convolution conv_44 1 1 149 150 0=64 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=4096
Swish silu_107 1 1 150 151
Split splitncnn_20 1 2 151 152 153
Convolution conv_45 1 1 153 154 0=64 1=3 11=3 12=1 13=2 14=1 2=1 3=2 4=1 5=1 6=36864
Swish silu_108 1 1 154 155
Concat cat_9 2 1 155 135 156 0=0
Split splitncnn_21 1 2 156 157 158
Convolution conv_46 1 1 158 159 0=64 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=8192
Swish silu_109 1 1 159 160
Convolution conv_47 1 1 160 161 0=64 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=4096
Swish silu_110 1 1 161 162
Convolution conv_48 1 1 162 163 0=64 1=3 11=3 12=1 13=1 14=1 2=1 3=1 4=1 5=1 6=36864
Swish silu_111 1 1 163 164
Convolution conv_49 1 1 157 165 0=64 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=8192
Swish silu_112 1 1 165 166
Concat cat_10 2 1 164 166 167 0=0
Convolution conv_50 1 1 167 168 0=128 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=16384
Swish silu_113 1 1 168 169
Split splitncnn_22 1 2 169 170 171
Convolution conv_51 1 1 171 172 0=128 1=3 11=3 12=1 13=2 14=1 2=1 3=2 4=1 5=1 6=147456
Swish silu_114 1 1 172 173
Concat cat_11 2 1 173 116 174 0=0
Split splitncnn_23 1 2 174 175 176
Convolution conv_52 1 1 176 177 0=128 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=32768
Swish silu_115 1 1 177 178
Convolution conv_53 1 1 178 179 0=128 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=16384
Swish silu_116 1 1 179 180
Convolution conv_54 1 1 180 181 0=128 1=3 11=3 12=1 13=1 14=1 2=1 3=1 4=1 5=1 6=147456
Swish silu_117 1 1 181 182
Convolution conv_55 1 1 175 183 0=128 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=32768
Swish silu_118 1 1 183 184
Concat cat_12 2 1 182 184 185 0=0
Convolution conv_56 1 1 185 186 0=256 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=65536
Swish silu_119 1 1 186 187
Convolution conv_57 1 1 152 188 0=255 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=16320
Reshape view_128 1 1 188 189 0=-1 1=85 2=3
Permute permute_125 1 1 189 out0 0=1
Convolution conv_58 1 1 170 191 0=255 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=32640
Reshape view_129 1 1 191 192 0=-1 1=85 2=3
Permute permute_126 1 1 192 out1 0=1
Convolution conv_59 1 1 187 194 0=255 1=1 11=1 12=1 13=1 14=0 2=1 3=1 4=0 5=1 6=65280
Reshape view_130 1 1 194 195 0=-1 1=85 2=3
Permute permute_127 1 1 195 out2 0=1
Loading