Using Image Recognition to find Mario

Can a Python script find Mario using image recognition?

In this video I write a Python program to try to automatically find and click on Mario in the mini game Wanted. The program uses basic image recognition to locate textures, and it manages to be extremely effective. If you like the video, make sure to subscribe!

LINKS
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀

█▀ █ █ █▄▄ █▀ █▀▀ █▀█ █ █▄▄ █▀▀
▄█ █▄█ █▄█ ▄█ █▄▄ █▀▄ █ █▄█ ██▄

[BlueYoshi]

It seems like towards the end the problem wasn't with recognition but with the touching part. Moving icons seem to be hard for it. It clicks where they are rather than where they are going to be, which means that sometimes it can miss the icon.

I mean at least that's what it looks like to me. I have literally 0 programming knowledge so I could be completely wrong lol

[nicktalksnonsense]

It is odd how nostalgic this is. I strangely remember this mini game extraordinarily vividly.

[WarioWill]

It would be fun to see this same concept used in the bob-omb sorting minigame. Nice vid. Very good. 10/10 would subscribe again.

[zdelrod]

The NSMB minigames were probably majority of people's childhood.

I honestly want to see someone push this idea to the game's limits

[voidpunch]

As a barely ok programmer, i just wanted to say your projects are exactly the type of problems i wanted to solve if i had more skill, you inspire me. Currently recovering from a prp shot on my arm, so this video helped me in this difficult time. Oh and your avatar is cool, cheers.

[thisguy.-.]

I love how the ai isn't perfect and makes mistakes instead of nailing it every time, it's soo much more entertaining that way

Edit: It isn't AI goddammit, read the replies before telling it to me for the millionth time please.

Edit 2: okay fine it might as well be AI, only not machine learning. Okay? So unless you have something else to say please stop.

[travis-n-joy]

Seems like you could double the accuracy by programming it so that it looks for Red on Mario and Yellow on Wario. Since those colors are unique to that character, you could basically ensure that those 2 characters are never missed. It wouldn't have to match tiles at all. Once it detects the color, that's where the character is located. That would just leave Luigi and Yoshi to the rest of your code. Since virtually no time would ever be lost and only added for Mario and Wario, I can't imagine that the script would ever run out of time.

[theenchantedgoldenapplekin]

[Spoiler]















that AI had many close calls, the fact that it made it passed 100 is very impressive

[Ktap]

Ironically the mini games here taught me blackjack and poker.

[sauci.]

dude this is already in the first 20 seconds a nostalgia punch in the face nose break for me, new super mario bros minigames were my life

[jackhawkins]

This video gave me much needed inspiration for my final year project in my Computer Science degree at university. I was already looking into doing something around image recognition but didn’t know if it was viable. Thank you

[SuperDZ]

Ok but can we get an AI that can learn to manipulate RNG and beat Luigi at poker
Edit: yes i have watched the video about toad manipulating the cards its just that i posted this comment before that existed

[loansharkjoe]

I still play this game to this day.
Me and my brother take this game everywhere when we go on holidays with our DSIXLs.
We always played Minigames and Mario VS Luigi and just mastered every single thing about the game.

Wanted is one of our hated minigames because we played it so much that we would manage to find the faces in less than 1 second of the minigame clock ticking.
It's exhausting to play against that level of experience.

Really glad you made a video about NSMB, it means a lot to me that this game is still being played, I feel so alone and stuck in the past for still playing DS Lite games in 2022.

[KLGB]

I noticed that most of, if not every time that the AI fails, it's on levels where the icon moves. I guess that's because the reaction time between getting the position of the icon and the moment the AI actually clicks on that position is long enough for the icon to be out of reach. I wonder if there is a way to fix this tiny problem.

[prestofungus]

8:30 i love that reference to the Super Mario Bros game

[MinergamesWasTaken]

I remember specifically that I managed to get to Level 256 on this game. It was when I was younger, so younger me thought, "yeah, time to stop here".

I still do not know how I managed to get that high of a score.
Younger me, you are an absolute gamer.

[jestersmith]

That is so cool!!! I love your tenacity very much. It makes me giddy to see you keep pushing through even when faced with a new problem! I love watching people show off what they do with coding, it really is technological magic to me! Thank you for sharing!!

[the_vine_queen]

You could've just searched for red and yellow pixels for Mario and Wario respectively, since red and yellow only show up for those characters. This obviously couldn't work for Luigi and Yoshi, but it might speed up the process and ensure no time is lost on Mario or Wario. Great program tho!

[ladyyy_rosa]

NSMB was ahead of its time. Also, I can’t code Python except for print, so you’ve earned my sub

[virtualcolt]

I remember playing wanted with my mom for hours, i got so good at it that I can now spot the faces pretty fast and accumulate a lot of extra time