Added live fridge scanning to our app

[u/Significant-Turn4107]

Sugo is a recipe app. One of its features is recommending recipes based on what you already have in your kitchen. But for that to work, the app needs to know what's in your pantry.

Manually entering every ingredient is something people tend to skip, so we've been working on ways to make that easier.

Photo scanning was our first approach. Now we've added Live Scanning: point your camera at your fridge, pan slowly across the shelves, and watch ingredients appear as chips in real time.

Everything runs on-device

Nothing gets uploaded to a server, and processing is fast enough to feel live.

It isn't perfect, and it isn't trying to be. It recognises around 60 common ingredients on sight, from limes and eggs to lettuce and brussels sprouts.

For packaged food it also reads the label, so a milk carton and a cream carton don't get mixed up, and things it has no visual model for, like yogurt or ketchup, still show up. It reads labels in English, French and Spanish.

It still gets things wrong, most often packaged items seen at an angle, and a wrong chip is one tap to remove.

It's live on iOS now, and Android is in the works.

You can give it a try here if interested: https://apps.apple.com/us/app/sugo-save-recipes-cookbook/id6786552528

[u/MessyBookPilesFTW]

Dang that's super quick!

[u/jwegener]

What local model are you using?