Bro a Pokédex with all recognized real life species of animals would actually be dope. And can only capture via camera instead of through photos on-system, and can use AI/lidar to tell if it’s a photo of a real life thing instead of a photo of someone’s computer screen. 🔥
Lidar! That's smart. I was like "Hmmm, how do we keep kids from cheating? I mean, they'll likely be able to cheat the AI, but once a human becomes involved..... nahhh, that'd take too much resources".
Oooh x3 sugggestions : - Search by Type - Scanned Objects may have a Potential Rarity which gives a sense of acomplishment and a reason to go on the leaderboards - Auto fullscreen to complete the Pokedex feel - Custom categories for users to sort their snaps in
How can we determine the rarity of a snap though? For example, (keeping the irl objects aside for now), a Pikachu could be worth more to someone than a charmander but vice versa for the other person.
@@HT79 its not a value or what is it worth, it's literally how often you can "meet" the object in question, so like a rhino would be ultra rare and a dog or a road sign would be common
Great video and great product! Haven't gone through the source code yet and you've probably implemented this way already but, GPT has problems reproducing the same text for the same prompt unless you set a very low temperature in which case it's usually gibberish. So what would happen is different people scanning Pikachu would create different entries for it. To save on the database size and keep things consistent for everyone, what you could do is have a two layer prompt for GPT. First one will only get the pokemon/rl object name and the second prompt would get the description and stats for the name. The very first time you get a response for the second prompt, you could save it in the db. The second person who would've scan a Pikachu would get the stored records from the vector search. This will even save up on the GPT tokens. Another added benefit would be being able to poll PokemonDB for accurate stats for actual pokemons. Database, however, needs to be redesigned a bit to have two collections - one for saving the embeddings and one for saving the user snaps. Btw, do you have a Gitter or something similar to discuss this more, if interested?
Really awesome project and video altogether. I'm grateful youtube has recommended me your channel, it was a nice surprise. I'm eager to see what enhancements you and the community come up with.
This is One of the videos I found that actually takes us through the thought process and every detail of how a project is actually made. Thanks a lot Adrian for this, this came to me just in time. It's my first time on your channel and you just earned a subscriber 👍
Really nice project! :) a great demonstration that we can stitch several pieces without needing to know any of them in depth and make something unique.
As much as I am interested in the PokeDex itself for the same reasons you are, I really appreciate the explanation and project pre-development process and your mindset/breakdown going into it much more. That came to be one of the more valuable things i got from this video, thanks.
I am super surprised you haven't done TS yet! It's a game changer and once you do it there's no going back. Awesome project! I'm looking to do a project like this as well so it's really informative that you went through each step in good enough detail instead of a super high level brushthrough!
I was telling my partner the other day that I wish there was a IRL Animal Crossing Flower, bird, Animal etc catalog you could go and fill out , and sure you could just take picture of your monitor but the fun is in discorvering things on your own imo. this hit that itch very close, first entry is already my doggo!
Wow wow wow. As a 20 years old guy who's going through the process of trying to get first coding job this seems insane. I took the huge inspiration from this video, for example. the Figma preparatios. I'm used to take colors by the "rule" 60/30/10" for the colors but your process is way more efficient. I cannot afford graphic tablet but maybe I could try to save it as in the video it looked so useful. You've earned my sub, definitly gonna watch something else too.
This app is incredible. I discovered that bananas had 5 HP with this. You should add a button that allows sharing an entry (like the banana one) with someone else.
Wow so you and a guy on Etsy has made a working Camera based pokedex that both use AI! I've already been testing the one from Etsy and it's very good. Can tell what pokemon cards are, plushies, very random 3D versions of pokemon I have like LEGO. Just wish it had a better camera and closer focus! Your generated voice was very impressive.
I made an app similar to this before the ai era but ai really is a game changer here. There are many id apps out there but as you stated surprisingly none with pokedex style branding. Merlin Bird ID has shown me that audio capture is also a game changer. Can capture 10 birds effortlessly on a short walk. Would be cool to see that option when there is a public model available.
For the real life animals, you should use some form of federated/crowdsourced model to create a wiki for updating and fine tuning results. It would be also cool to provide some form of location data to create a heat map like Snapchat to show where certain “Pokemon” have been spotted.
really cool the only thing i think would really help is if the initial line was the "dragonite the knight pokemon and the evolved form of dragonair" line at the start and then limit the response to a single sentence other than that great video i thought the use of AI in the title meant you were gonna ask chat gpt to write the code and test it as you implement it, you would be surprise how much that is going to happen in the future though i dont see it as a difference as using an API at this point its just a tool, great vid :D
Omg! I saw another RU-vid video where a physical Pokédex was designed. I’m very similar to you in that -that I’ve followed Pokémon for most of my life and it doesn’t make sense for me to not follow it anymore! I really wanted to build something like this but was slacking off because of not having a process in place for this. You video seems to be great for that. I’d be disappointed if this was a tutorial xD
Amazing 🤩 it would be wild if you could get mid journey to generate a pokemon inspired image from the image inputted lol fun app tho. I see so many uses
This is amazing! Well done. A couple ideas to build on this... One is to use generative Ai to give the creature a Pokémon like creative name and a bio. Two is use the photo and the Pokémon like name and description to generate a cartoon version of the creature image. Then the app can switch between Pokémon world and real world
I tried converting to gpt4o-mini. From my testing I can say that it has almost the same results, sometimes even better (with slight tweaking of the gpt query), but at fraction of the cost of the gpt-4o. Higly recommend to try 😉
I can't express how envious I am of you for being able to do this and I can't hahaha. Pretty good job mate. The video was also very entertaining to watch! Btw, what was that device where you did the sketch for the project? Cheers!
This is the best quality tutorial I have seen online~ I loved you show the whole process in such detail and even open source it! Thank you! I just have a question, the app as it is today costs you money to run... Specially becaude of the calls to OpenAI. How could you make a profit with an app like this? If this were to become really popular I think you would need to turn it down?
I really hope that eventually you can have all of the different generations of the Pokedex skins available to either buy or swap too, I'm really partial to the diamond pearl version but sometimes you just can't beat the original Dexter. That and If you swap to Dexter you get the original snark with the descriptions heh Best times. But mainly just the skins alone would be dope. Can't wait for this to be publicly available, hopefully there can be a choice when taking the picture also to either upload it to a public database that everyone can share and start collecting stuff togeather or a private one, either connected to your account and privatized. Stored locally on your own phones file or something in-between. Would be very useful to also have a option for accessibility to use for blind people if it had a basic voice command mode. Regardless all of these are just concepts I thought up halfway through the video. You might touch on some of them in the video somewhere later And I just don't know it yet. No matter what this is a freaking amazing idea and is a fellow pokémon nerd who's been there since before the gold and silver games all the way to Scarlet and Violet I'm there with you fellow nerd. Gotta catch em all will never perish, even if the dream gets harder every generation 😂
such a cool project! But i wonder what is that device u used on the minute 3:00? whats the name of it? and stay tuned with Nintendo.. They must be looking for u rn👀👀👀👀👀👀
Really good job it would be even better if you could make the website a PWA so you could add it to your home screen as a app so it would hide the search bar etc.
there should also be option where if the pokedex has nothing it will ask user to if they wanted to add this new things to entry in pokedex like in pokemon
dumb idea but imagine a pokemon showdown branch of this where you take photos of real things and it generates a stat and moveset for it so you can use it in battles
@@AdrianTwarog You used an IP that is part owned by Nintendo, a company that sues everyone that even mentions one of their IPs. I've seen Nintendo take down much smaller passion projects that weren't even going to be released to the public, and yours was released. IDK how the Pokemon company handles this kind of things but I know you don't want to mess with Nintendo, there's a reason there are memes about their lawsuits. You wouldn't necessarily get in trouble for making a pokedex like ai powered app, but you would get in trouble for using the Pikachu image, the Pokedex name, possibly the design of the pokedex and the voice, so maybe change those things at least in the version on github. I'm not a lawyer, I'm just basing this advice on what I've seen online and I think you made something too cool to be ignored by them.
Is Nintendo/GameFreak/The Pokémon Company going to allow you to put this up under the PokeDex name? I'd imagine that would be trademarked, and if not directly, would likely still fall under a larger umbrella of protection that the Pokémon title has.
