How to monitor CPU and GPU frequency and utilization?

[Ivan_Zhukov]

@Electr1 Got it, thank you for explanations.
May be this is the question for the separated topic, but I’m trying to increase knns-yolov7 demo’s fps and because of that I decided to check, which one unit is used for computations: CPU or GPU. And everything says that CPU is used. Is there some ways to involve GPU in this? Cause I have only 5 fps, it’s not very high.

[Electr1]

@Ivan_Zhukov the extra time is incurred because of post-processing needed to be done on the outputs of YOLO,

you can see it was discussed in another topic:

Vim3 NPU work time

Hola! Previously thank you very much for your help with yolov8n and custom dataset, but here I found a new problem. The inference of Vim3 Pro on Yolov8n takes 0.06sec (on my data it’s 0.04sec) and wow! that’s fast! But the leftover process of working with data takes 0.338 - 0.06 = 0.278sec [image] And that’s a lot. When I’m running khadas on my ip cam, he catches only 3 frames per second. And wtf? My OrangePi’s CPU was giving me at least 4 FPS. Here I have three options: I’m doing somet…

[Ivan_Zhukov]

@Electr1 Thank you!
Topic creator in provided topic says that his inference with yolov8n takes about 0.06 sec and leftovers about 0.25 sec, but I have the opposite situation: my inference time with VIM3 and yolov7 takes about 0.2 sec, and leftovers take about 0.05 sec. What do you think, is it ok for this VIM/yolo configuration?

[Agent_kapo]

Hello
I’m the Author of the topic
Are you sure that you measuring time correctly?
Also, do you use the exact code from ksnn repo or you’ve modified it?

[Ivan_Zhukov]

Hello, I think yes, I print time before and after calls and calculate difference (as it organized in repo). I didn’t modify code except time tracing.