When a user loads the image in the Edit View of our photo editor, inference (prediction) via the model is instantly kicked off.To understand the flow of how the “For This Photo” feature works when a user starts editing an image, we will walk through the steps that take place:
Our Imaging team thoughtfully curated presets that complement different types of images, allowing us to deliver a personalized recommendation for each photo. We decided to use deep convolutional neural network (CNN) models because these models can understand a lot of the nuances in the images, making categorization easier and faster than traditional computer vision algorithms. The feature has been so loved by our users that “For This Photo” is now the second most used preset category second only to showing all available presets. We developed the “For This Photo” feature, which uses on-device ML to identify what kind of photo a user is editing and then suggest relevant presets from a curated list. We decided to solve this problem by suggesting presets for images. Our challenge was to overcome decision fatigue by providing trusted guidance and encouraging discovery, while still leaving space for our users to be creative in how they edit their images. With so many presets to choose from, our research suggested members were overwhelmed and stuck to using the few favorites they knew and liked, instead of trying new presets.
These include emulations of old film camera stock such as Kodak Kodachrome 25, Fujifilm Velvia 50, Agfa Ultra 50, and more. VSCO has a catalog of over 200 presets, which are pre-configured editing adjustments to help our users transform their images. It’s a great solution to a complex problem, and it also combines exciting areas of technology for us. One of the most exciting is our latest feature taking advantage of on-device ML: For This Photo. Later on, you'll work your magic and post pictures from VSCO with one of these 30 captions.At VSCO, we’re using machine learning (ML) in many different ways. When you grab a smoothie, you take a quick snap of it against the skyline before taking a sip. When you walk by a unique and vintage sign, you can't help but strike a cool pose in front of it. You may spend the day wandering around your city, going on a lunch date with your besties, and capturing the world at a different angle or perspective. Then you might roll out of bed, put on your favorite oversized sweater, and grab your camera bag. You tap through various editorials for inspiration, favorite the film portraits you like, and rework the highlights and shadows in your latest flower and sunset pics in the studio.
If I had to take a guess, I'd say you probably wake up in the morning and scroll through the new #content on your Explore page with bright eyes and a full heart. If you can relate, you likely love having an app on your phone where you can be your most creative self. They may embrace the editing features and filters on multiple apps and are always in need of captions for VSCO pictures. For others, their profile may be a digital journal where they can post the artsy photographs and videos from their camera roll. To some, hitting the share button may be an incredible way to stay in touch with long-distance besties. I'm a firm believer that social media is whatever you make of it.