AR/VR for Cosmetic Visualization
66 patents in this list
Updated:
Virtual makeup applications must process and render complex facial data in real-time, handling variations in lighting conditions, skin textures, and facial movements. Current systems struggle with latency issues when rendering multiple makeup elements simultaneously, with frame rates dropping below 30 fps when processing high-resolution facial meshes containing over 50,000 vertices.
The fundamental challenge lies in balancing computational efficiency with visual fidelity while maintaining real-time responsiveness across diverse facial features and makeup combinations.
This page brings together solutions from recent research—including batch rendering systems for simultaneous element application, server-driven makeup parameter generation, facial feature-specific analysis algorithms, and motion-capture based real-time visualization techniques. These and other approaches focus on creating responsive, accurate, and personalized virtual makeup experiences that closely mirror physical application.
1. Virtual Makeup Try-On System with Batch Rendering for Simultaneous Multiple Element Application
BEIJING JINGDONG CENTURY TRADING CO LTD, 2023
Virtual makeup try-on method and device that enables users to try on multiple makeup products and elements simultaneously to provide a more intuitive and efficient virtual makeup experience. It involves generating makeup trial renderings in batches for multiple makeup trial elements and objects, rather than individually. This allows comparing multiple elements on the same face, and multiple faces with the same element. This improves efficiency and enables side-by-side comparisons of makeup trials.
2. Integrated Virtual Fitting and Makeup System with Combined Body Image Generation and Makeup Recommendation
QINGDAO HAIER WASHING MACHINE CO LTD, 2023
Virtual fitting and makeup system that allows users to try on clothes and makeup together in a more efficient and realistic way compared to separate virtual fitting and virtual makeup mirrors. The system generates a human body model based on user's physical characteristics, combines it with their current clothing to create a body image, and then recommends makeup based on that body image. The recommended makeup is then combined with the body image to show a recommended overall look. This allows users to see how the makeup will look with the clothes before applying it.
3. Augmented Reality Device Method for Facial Feature Analysis and Personalized Makeup Visualization
BEIJING HONEYCOMB CENTURY TECH CO LTD, 2023
Method for assisting users in applying makeup using augmented reality (AR) devices. The method involves analyzing the user's facial image to identify features like skin tone, facial shape, and contours. This facial information is then matched with auxiliary makeup solutions to create a personalized makeup plan for the user. The AR device displays a preview of the suggested makeup to the user, who can adjust it as desired. This allows the user to have a customized makeup experience tailored to their unique facial features.
4. Virtual Makeup Try-On System with Smart Mirror and Tray-Based Physical Makeup Localization
Beijing Aibi Technology Co., Ltd., BEIJING AIBEE TECHNOLOGY CO LTD, 2023
Virtual makeup try-on system that improves efficiency by accurately locating and displaying the position of the selected physical makeup to match the virtual makeup being tried. The system uses smart mirrors and trays to associate virtual and physical makeup, and during virtual trials, the system shows the tray location of the corresponding physical makeup. This allows users to quickly find and locate the exact spot to try the physical product, avoiding searching multiple trays.
5. Facial Image Analysis System with Interactive Makeup Suggestion and Tutorial Generation Capabilities
LOREAL, 2023
Digital makeup artist system that provides interactive makeup suggestions and tutorials to users in a way that mimics a personal makeup artist experience. The system analyzes user facial images using machine learning to identify features, skin tone, etc. Then it interacts with the user to understand their needs and preferences. Based on that, it generates customized makeup looks and tutorials synced to the user's facial image. Users can control playback, adjust steps, etc. The system also learns from user feedback to improve recommendations.
6. Image-Based Makeup Application System with Cross-User Makeup Transfer and Visualization
ZOZO INC, 2023
A system for helping users see how makeup looks on them by applying makeup from other people's images. The system generates makeup information for a user's face based on makeup seen on other contributors. It applies this generated makeup to the user's own face image. The system also provides content with the applied makeup and product details to the user. This allows users to see how makeup from others looks on themselves before buying.
7. Real-Time Virtual Makeup Application System with Motion Capture and Tool Selection
4U BEIJING TECH CO LTD, 2023
Virtual makeup method that accurately recreates a user's simulated makeup application on a virtual human. The method involves capturing the user's makeup motions in real-time, selecting the correct tools and accessories based on those motions, and generating and rendering the virtual makeup accordingly. This allows more realistic virtual makeup that accurately reflects the user's intended application.
8. Interactive Virtual Makeup System with Real-Time Tool-Specific Auxiliary Layer for Digital Humans
SHIYOU TECHNOLOGY CO LTD, 2023
Interactive virtual makeup system for virtual digital humans that allows users to apply makeup in real-time. It provides a makeup interface with tools to dress up the virtual digital human. When a user selects a makeup tool, it displays a floating layer with auxiliary makeup options specific to that tool. The user can then choose options to customize the makeup. This allows users to try on different makeup looks and experiment with various tools and accessories. The system uses computer vision to accurately place the makeup tools on the virtual face.
9. Virtual Makeup Application System with Customizable Texture Mapping for Target Facial Areas
PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD, Panasonic Intellectual Property Management Co., Ltd., 2023
Virtual makeup device and method that allows users to try on virtual makeup with customizable textures for a more realistic and immersive experience. The device extracts the target area like lips from a facial image, applies the desired color, and then adds specific texture components to parts of the target area for each makeup item. This enables virtual makeup with unique textures like gloss, matte, or balm for different products.
10. Virtual Makeup Application System with Real-Time Remote Artist Interaction and 3D Facial Modeling
ALINIC FAMILY PARTNERSHIP LP, 英属开曼群岛商玩美股份有限公司, 2023
Virtual makeup application system that allows a makeup artist to apply makeup remotely to a user's digital images in real-time. The system involves a makeup application device used by the artist and a client device used by the user. The artist requests a makeup consultation, gets images from the user, creates a 3D facial model, applies virtual makeup effects, generates commands based on artist actions, and sends them to the user's device. The user receives the commands and applies the virtual makeup to their images.
11. Real-Time Facial Image Processing with User-Specific Digital Makeup Application
GOOGLE LLC, 2023
Automatically applying digital makeup enhancements to user faces in real-time images based on previously stored makeup settings for that user. The technique involves identifying a user's face in an image, recognizing it as belonging to a registered user, and retrieving the customized digital makeup enhancements for that user. These enhancements are then applied to the user's face in the current image to generate a modified image with virtual makeup. The technique allows personalized makeup effects to be automatically applied to a user's face in real-time without manual setup.
12. Simulated Makeup System with Camera-Integrated Display and Pressure-Sensitive Cosmetic Pen
UNIV XIAMEN TECHNOLOGY, 2023
Simulated makeup method, system and intelligent dressing table that provides a realistic and tactile experience for simulating makeup applications. It uses a camera, display screen, makeup model and central processing unit to capture images, display them, and overlay virtual makeup. The system also has a pressure sensitive cosmetic pen for simulating the feel of applying makeup. The cosmetic pen has a sensor to detect pen pressure and transmit it to the processing unit to adjust the virtual makeup effect. This allows users to experience the sensation of applying makeup with a realistic tactile feedback.
13. Artificial Intelligence Method for Virtual Makeup Application and Recommendation Using Facial Feature Extraction and Similarity Analysis
AWESOME COMMERCE CO LTD, Awesome Commerce Co., Ltd., 2023
Artificial intelligence-based facial makeup processing method that allows users to try on virtual makeup using AI and provides personalized makeup recommendations. The method extracts facial features from a user's image, finds similar faces, applies makeup from those faces, and generates a virtual makeup image. It also recommends hairstyles based on user preferences. The AI analyzes live makeup sales videos to extract virtual makeup areas and replaces them with real products.
14. Digital Makeup Consulting System with Machine Learning-Driven Style and Product Recommendations
OREAL, 2023
Interactive makeup consulting and tutorial system using a digital makeup artist that provides personalized makeup experiences comparable to a real makeup artist. The system involves a mobile app with a database of makeup styles, products, and user preferences. A machine learning system analyzes user images to suggest styles and products. The app provides makeup tutorials with step-by-step guidance customized to the user's face.
15. Method for Real-Time Makeup Application Using Superimposed Contours Derived from Target Images
HUAWEI TECH CO LTD, 2023
Method for assisting makeup using superimposed contours based on target images to provide guidance and evaluation during makeup application. The method involves obtaining makeup contours from a selected target image and overlaying them on the user's face in real time. This allows the user to see where to apply makeup based on the target image. The device also checks if the user's makeup exceeds the contours or has inconsistent colors. If so, it provides correction guidance.
16. Virtual Makeup Simulation System with Camera-Based Facial Image Analysis and Display
SUZHOU QIANPING INTELLIGENT TECH CO LTD, 2022
Non-contact simulation virtual makeup system that allows users to try on virtual makeup without physically applying it. It uses a camera to capture images of the user's face and analyzes them to simulate makeup application. The system has a display for showing the virtual makeup results and a processing unit that performs the makeup simulation calculations. The user faces the camera to select makeup products and see a virtual preview of how they would look. The system is designed for use in physical stores to provide a touchless, sanitary alternative to traditional makeup trials. It uses image processing instead of physical interaction like touchscreens or keyboards.
17. Smart Mirror with Real-Time Virtual Makeup Overlay Using Integrated Camera and Display System
SHANDONG JIASHIMEI HOUSEHOLD PRODUCTS CO LTD, 2022
Smart makeup mirror that provides real-time virtual makeup overlays on the user's face as they apply makeup. The mirror uses a camera, lighting, and display to capture the user's face, apply virtual makeup in real time, and overlay it on the user's reflection. This allows the user to see how the virtual makeup looks as they apply their own. The mirror also provides makeup guidance and comparison by accessing makeup databases with pre-stored schemes.
18. Smart Mirror with Machine Learning-Based Facial Analysis for Makeup Application Feedback
BOE TECHNOLOGY GROUP CO LTD, 2022
Smart mirror that provides personalized makeup assistance using machine learning. The mirror analyzes a user's facial image to identify skin areas and detect makeup application. It compares the user's live makeup to a selected makeup plan and provides real-time feedback on areas that need adjustment. This helps the user make more efficient and consistent makeup applications by providing targeted modification suggestions.
19. Digital Makeup Palette with Machine Learning-Driven Facial Analysis for Augmented Reality Try-Ons
LOREAL, 2022
A digital makeup palette for augmented reality that provides personalized virtual makeup try-on experiences. It uses analysis of user's face to identify problem areas and best features, and creates custom virtual try-ons based on user-selected makeup objectives. The palette is a collection of digital makeup colors with characteristics like coverage, shade, and finish. It goes beyond physical makeup limitations by using display filters. The system analyzes user makeup steps to improve recommendations and uses machine learning to estimate problem areas and best features.
20. Interactive System for Personalized Makeup Guidance Using Facial Analysis and Machine Learning
LOREAL, 2022
Interactive digital makeup artist system that provides customized makeup advice and tutorials to users in a manner similar to a personal makeup artist. The system analyzes a user's face using machine learning and then guides the user through applying makeup to recreate desired looks based on factors like skin type, facial features, and preferences. It provides personalized makeup routines and tips instead of just offering predefined looks.
Get Full Report
Access our comprehensive collection of patents related to this technology