I Built a CoPilot+ AI PC (without Windows)

Raspberry Pi AI enters the chat.

Full disclosure: Raspberry Pi sent the AI Kit I've been testing for this video—they did not sponsor the video nor did they have any input into the content of this video (or a chance to review it before it was published).

Some of the things I mentioned in this video:

- Raspberry Pi AI Kit docs:

Contents:

00:00 - Total Recall
00:33 - Raspberry Pi AI Kit
01:05 - AI AI oh.
01:38 - Cameras
02:59 - AI architecture
04:22 - YOLO (and other Demos)
06:04 - LLMs and Generative AI
06:28 - 51 TOPS attempt - the build
09:42 - No magic smoke!
11:02 - Any other way?
11:49 - Other AI options (that are actually useful)

[JeffGeerling]

0:53 - My brain must've been turned off when I was making that slide. The Coral does 4 TOPS, not 2. And the Hailo-8L is more like 3-4 TOPS/W, not the 8 I put in the slide.

Sorry about that, wish I could edit that bit in the video but YouTube doesn't have any mechanism to allow it! Thanks to @thijsp for pointing out my glaring mistake!

Good night, I'm getting some sleep—it's morning in the UK, middle of the night here ;)

[kenzieduckmoo]

One of the quotes i heard that i really liked was "Its only called AI till it has an actual practical use. Then we just call it what it is". Think things like automatic captioners or OCR tools, or some of the earlier tools of CGI.

[nfugitt]

Love your attitude towards the AI hype. Much of it seems like a manager or executive's idea of what problems people have, like forgetting what they were doing on their computer an hour ago or summarizing emails

[dudeh]

"Ah yes, with our new AI-POWERED DNS RESOLVER, all your problems are over!" *evil laughter*

[michaelturk]

Jeff: don’t forget that you can use a Coral TPU with each USB port as well.

A couple of years ago I attempted to use a webcam and coral TPU (based on a YouTube tute) to use eye-gaze and muscle twitch, to control a mouse … to control a PC as a communication device for my late wife who had ALS. However, a much more sophisticated (and device with integrated software was loaned to her by our state ALS support team before I completed it. However, there's a practical use for AI and a raspberry 5 and AI device for probably 10% of the cost of what they provided on loan.

[jeremyjedynak]

The killer app for the Co(Pi)lot around Geerling Engineering will be to use pose detection to sound an alarm and activate a water cannon whenever Red Shirt Jeff is about to do something that would release the magic smoke.

[TheJonathanc]

Jeff: i want all the TOPS
RaspberryPi: We don’t recom…
Jeff: ALL THE TOPS!!!

[slimhazard]

4:20 “Enough about AI“ — music to my ears.

[SequoiaAlexander]

This looks great! For my farming robot I’m planning to add eight raspberry Pi HQ cameras to four Raspberry Pi 5’s, and I originally planned to send those feeds over gigabit to an Nvidia Orin. And while centralizing has value, I could perhaps use these with some decentralized processing. Really cool to see raspberry pi focused on real world automation. That’s what I’m doing! I don’t need another chat bot I need computer vision for my farming robot.

[DiamondMaster]

This is exactly what AI should be used for, not constantly watching what your doing on your PC and not telling you to eat "at least one small rock per day" 🤣 Glad to see that the RPI foundation is tapping into the best form of AI tools, the ones that are actually helpful and fun, all at a fairly low cost.

[charlesdoesmore]

5:15 Pose Estimation is also useful for building a camera-based FBT setup for VR Apps

[jdl]

You KNOW we want to see all these on the Alftel board! Would be interesting to see the software support for multiple NPUs in general. Wondering how useful a (future) CM5 based carrier with a PCIe switch and 4-6 m.2 slots for NPUs would be. Would probably run out of RAM or network bandwidth trying to do anything useful, maybe. I think my 8x4MP cameras at 10FPS is only like 55Mbps into Frigate.

[kryptonic]

Good stuff Jeff. Can't wait to see more. Keep up the good work!

[dazryan]

Looking forward to seeing this tried with the Alftel 12x PCI Express M.2 Carrier Board

[patrickderp]

"i dont think a farmer wants a 4090 taking up 600 watts on his tractor." bro you realize a 580 HP diesel tractor is around four hundred THOUSAND watts....lmao

[FluffyFoxUwU]

Jeff: "Wildly unsupported configuration"
Jeff also: *daisy chains 5 pineberry M.2 hats*

[stephenhargreaves]

I disagree with your T-Shirt. "/ is the root of all problems".

[UNVIRUSLETALE]

This would be great for machine vision in 3d printers and maybe even optimizing parameters dynamically

[TruthDoesNotExist]

glad to see the tech tubers talking about how we can use our own AI, I love Ai and wish more youtubers talked about the hardware and how to install it. it is a little annoying how people don't undertand how revolutionary AI is compared to something like NFT's that had no practical use case

[stuaxo]

I live that that you really stress test the IO on these, of course we want to see them on the big card.