Is the new Raspberry Pi AI Kit better than Google Coral?

I've got my hands on the new Raspberry Pi AI Kit, an M.2 Hat with the Halio 8L module onboard. This brings advanced AI capabilities to the Raspberry Pi 5, and offloads this to the Neural Processing Unit.

Join this channel to get access to perks:

🎖To join the membership at 🥉bronze, 🥈silver or 🥇gold levels, head over to

#Pico​ #MicroPython​ #Robotics

[victorial]

I'm so glad I found your channel so awesome and informative videos! keep it up

[felicemassaro]

Thanks for the video. I got one of these kits and it is amazing when running the provided sample codes/apps. Pity to program something leveraging on this kit you need c++, the installation of the Hailo SDK and then it becomes very complicated for 99% of the people using a Pi. I would not recommend the AI Hailo kit for everyone. It is for developers with good knowledge of AI and c++. There is not a single video explains that, all video on YouTube just try to market it, I have not found any tutorial explains how to modify or make a new app. At present, if you got one of these kits you will be on your own.

[eelcohoogendoorn]

It great to have such a chip design with tightly integrated memory which is obvious the way to go for any inference tasks. But ive found it interesting how hailo manages to keep any information about the amount of that super useful memory 100% secret; and this product launch is no exception. Like, dont we all want to know what models we can actually run on there? Arnt we going to find out eventually what the memory limits are after we spend our money? Or is that somehow the point?

[AerialWaviator]

Very interesting. It would be nice to hear more about supported frameworks in future. Realize this a hardware unboxing and quick demo.

[Playfool]

I'm quite interested in seeing its performance running LLMs via Ollama. With a RPi5 alone, it takes vision model LlaVa about 5 whole minutes to interpret an image. I'm hoping the AI kit can improve that vastly! Have you given it a go?

[raspberrypi]

Hiiii Kev! 👋you could make your fortune telling robot EXTRA spookily accurate with this kit.

[ahmedosama]

When tried, the hailo causes issues in identification, and aside from the fps, accuracy is very low, is that accuracy lost during conversion ?, i would still use the coral for now

[tinkerman]

Thx for sharing! Apart from object recognition, any other use caes be benefit with edge compute power?

[mrarfarf]

Hey I got one of these but was disappointed you can't use it with PyTorch or llm models or other models without some weird recompiling but they don't provide the full sdk. So if you wanna train something to find a squirrel for example, I don't see any way. In the mean time it's just a simple toy to run some of their demos. Unimpressive imo. I think the coral is better since it's easier to get it to help with tasks..

[steaders]

Can I use this chip in a standard tensorflow model? If so how? Or is it automatic?

[Technicallyaddicted]

Do they cluster stack? Suppose I have an AI project that is 4 different models at once. Can I assign 1 model per pi and make a 4 cluster? I need a LLM that works at least as good as GPT-3, and I need both image(face) recognition, and image generation(from prompt and from fed images, like stable diffusion). Can I use one pi for both image processes, or will I need 5 pi total? I’ve got a cap of 150w because the thing needs to run off a single 200w solar panel(with battery array). Can I get lucky enough to do it all locally without the cloud?

[marcdurbach]

Hi Kevin. Maybe you know a solution for connecting both an Ai Kit hat as well as an ssd on m.2 hat at the same time to a pi 5?

[biskero]

I use the PCIe for an NVMe, so how would I add this AI kit, need a splitter?

[HC]

Does openvino work with this ?
(I'd like to use Audacity's openvino tools and Whisper for speech recognition).

[ScottFoust]

I'm interested in detecting ArUco markers and getting their pose estimates. Is that something this AI chip can do well? Would you still need to run something like OpenCV on it? I've never used AI specific hardware so not sure how it works.

[DarcilioKreitlow]

É possivel utilizar essa IA junto com uma camera IP ligado a um NVR? Ou somente com essa mini camera?

[SA-ojbo]

Hi, looks interesting, can this AI Kit also work with a stream from an IP-cam?

[yrnfcrv]

Looking forward to a tutorial, inferencing custom trained Yolov8 object detection models using this....

[JeffGeerling]

A great option for robot vision, IMO. I still wish there were at least a little NPU right on the Pi (like the RK3588)... but this is a worthy option in lieu of that.

Also regarding the TOPS/W rating, I had 13 TOPS at 1.5W-according to their specs, but I was wondering if you are using the full Pi + Hailo-8L power consumption for your rating of 3 TOPS/W?

[TheArcanis]

Very informative, I was looking for an accelerator for mobile robotics and found nothing useful. The Orin is powerful but has nvidia blessed binary blobs and is really expensive.

13TOPS, PCIE1x3.0 3.0TOPS/W are promising specs. On an 8GB RPi it might be enough to run a llama3-8B-4QKM model.