Inference time, execution time, fps

[tucan9389]

Infernece Time (ms)

Model vs. Device	11 Pro	XS	XS Max	XR	X	7+	7
YOLOv3	83	108	93	100	356	569	561
YOLOv3FP16	84	104	89	101	348	572	565
YOLOv3Int8LUT	86	101	92	100	337	575	572
YOLOv3Tiny	44	46	41	47	106	165	168
YOLOv3TinyFP16	44	51	41	44	103	165	167
YOLOv3TinyInt8LUT	44	45	39	39	106	160	161
MobileNetV2_SSDLite	18	31	31	31	109	141	134
ObjectDetector	18	24	26	23	63	86	84

Total Time (ms)

Model vs. Device	11 Pro	XS	XS Max	XR	X	7+	7
YOLOv3	84	108	93	100	357	569	561
YOLOv3FP16	85	104	89	101	348	572	565
YOLOv3Int8LUT	86	102	92	102	338	576	573
YOLOv3Tiny	45	46	42	48	106	166	169
YOLOv3TinyFP16	45	51	41	44	104	165	167
YOLOv3TinyInt8LUT	45	45	39	40	107	160	161
MobileNetV2_SSDLite	19	32	31	32	109	142	134
ObjectDetector	18	25	26	23	64	87	85

FPS

Model vs. Device	11 Pro	XS	XS Max	XR	X	7+	7
YOLOv3	9	8	10	9	2	1	1
YOLOv3FP16	9	9	10	8	2	1	1
YOLOv3Int8LUT	9	9	10	9	2	1	1
YOLOv3Tiny	14	21	22	20	8	5	5
YOLOv3TinyFP16	14	19	23	21	9	5	5
YOLOv3TinyInt8LUT	14	21	24	23	8	5	5
MobileNetV2_SSDLite	29	23	23	23	8	6	6
ObjectDetector	29	23	23	24	14	10	11

[tucan9389]

Model	Size (MB)	Minimum iOS Version	Download Link
YOLOv3	248.4	iOS12	Machine Learning - Models - Apple Developer
YOLOv3FP16	124.2	iOS12	Machine Learning - Models - Apple Developer
YOLOv3Int8LUT	62.2	iOS12	Machine Learning - Models - Apple Developer
YOLOv3Tiny	35.5	iOS12	Machine Learning - Models - Apple Developer
YOLOv3TinyFP16	17.8	iOS12	Machine Learning - Models - Apple Developer
YOLOv3TinyInt8LUT	8.9	iOS12	Machine Learning - Models - Apple Developer
MobileNetV2_SSDLite	9.3	iOS12	SSDMobileNet - Core ML Survival Guide
ObjectDetector	63.7	iOS12	Recognizing Objects in Live Capture | Apple Developer Documentation

[pc11000]

Excellent work!

Are you planning to add yolov4 too?

[tucan9389]

@Pad90

Excellent work!

Are you planning to add yolov4 too?

If I get the model, I'm able to measure the performance. But I haven't plan to convert the yolo v4 to Core ML model now myself.

[pc11000]

ok I may try it next week when v3 is to slow.

what is the "ObjectDetector" exactly? is it a detector from apple itself?

[tucan9389]

@Pad90

Hmm, I can't remember the detail of ObjectDetector.mlmodel but It seems it can detect general objects.

Here is the sample output of the model.

If you want to know the detail, please check the sample project provided by apple.