Detects faces using the Vision-API and runs the extracted face through a CoreML-model to identiy the specific persons.

Related tags

Augmented Reality ios machine-learning face-recognition arkit coreml
Overview

FaceRecognition in ARKit

This is a simple showcase project, that detects faces using the Vision-API and runs the extracted face through a CoreML-model to identiy the specific persons.

image of scene with face recognition

Requirements

  • Xcode 9
  • iPhone 6s or newer
  • Machine-Learning model

Machine-Learning model

To create your own machine-learning model, you can read our blog post "How we created our Face-Recognition model"

The short version is:

  • We trained a model in the AWS using Nvidia DIGITS
  • Took a couple of hundred pictures of each person, and extracted the faces
  • Also added an "unknown" category with differnent faces.
  • Used a pretrained model fine-tuned for face-recognition.

Acknowledgements

Comments
  • From where do you show the image icon of the recognized person ?

    From where do you show the image icon of the recognized person ?

    Hi,

    I went through the code but I couldnt make out how are you able to show the image icon of the person who's recognized like Boris with his image.

    Where are those image being pulled from ? and which part of code handles it.

    Thanks.

    opened by umarF 2
  • Feature request: Can we recognize multiple faces at once ?

    Feature request: Can we recognize multiple faces at once ?

    Hello, I am working on the demo where I have a similar requirement. But I have to recognize multiple person's faces at once. So here can we recognize multiple faces at once? Thanks in advance.

    opened by vivekshah-zymr 2
  • This model only recognize faces trained?

    This model only recognize faces trained?

    The training data is classified for each person.

    1. Each person has over 300 augmented photos.
    2. Each person is classified as one class.
    3. Plus other photos not classified as a person above, rather classified just as other class.

    In the example, there are 4 classes, 3 for each person, 1 for others.

    Train with these photos would recognize only classified persons. That is one of the reasons why model is not provided, because this model recognizes only the three people.

    opened by clockwiser 1
  • Do you know how to convert dlib_face_recognition_resnet_model_v1 to coreml?

    Do you know how to convert dlib_face_recognition_resnet_model_v1 to coreml?

    Sorry for the super newbie question but this model generates "face features" that can be stored and compared later on.

    The thing is I don't know what format it is so I can use the conversion tools provided by Apple to convert it to CoreML format.

    TIA and thanks for sharing such a clean minimalistic code! ❤️

    opened by moniquelive 0
  • Does not work on macOS Majove and Xcode 10

    Does not work on macOS Majove and Xcode 10

    Basically, the libraries RxSwift and PKHUD don't work and the observer.onNext calls in your code flag as being a problem. There is no way to just pick up the code and get it running in Majove and Xcode 10 without doing a bit of work...

    opened by ghost 0

  • ".mlmodel" file is missing

    Hi All,

    We have download and checked this project but we are getting compile error like ".mlmodel" file is missing. Could you please update the latest source code to test this project? this help us to know more about this technology and move forward.

    Thanks Suresh

    opened by ftssuresh 8
Owner
Novatec Consulting GmbH
Novatec Consulting GmbH
GitHub
A minimal iOS AR app that displays virtual objects at specific geographical locations, in an AR scene.

AR Simple GeoLocation A minimal iOS AR, Augmented Reality, app that displays virtual objects at specific geographical location, in an AR scene. With t

Yasuhito Nagatomo 23 Dec 16, 2022
Sample iOS AR app that demonstrates how to capture the texture of a user's face in realtime.

Sample iOS AR app that demonstrates how to capture the texture of a user's face in realtime. This texture can be used to create a simple textured 3D face model.

Matt Bierner 58 Dec 14, 2022
This library uses ARKit Face Tracking in order to catch user's smile.

SmileToUnlock Make your users smile before opening the app :) Gif with the demonstration Installation Cocoapods The most preferable way to use this li

Ruslan Serebriakov 628 Oct 22, 2022
A sample project demonstrating a usecase for the DrawableQueue API in RealityKit 2.

RealityKit 2 DrawableQueue: Animated (transparent) GIFs A sample project demonstrating a usecase for the DrawableQueue API in RealityKit 2 – which cur

Arthur Schiller 17 Dec 14, 2022
A library that allows you to generate and update environment maps in real-time using the camera feed and ARKit's tracking capabilities.

ARKitEnvironmentMapper Example To run the example project, clone the repo, and run pod install from the Example directory first. Installation ARKitEnv

SV Hawks 91 Dec 4, 2022
A library that allows you to generate and update environment maps in real-time using the camera feed and ARKit's tracking capabilities.

ARKitEnvironmentMapper Example To run the example project, clone the repo, and run pod install from the Example directory first. Installation ARKitEnv

SV Hawks 91 Dec 4, 2022
Smart Online Shopping iOS App with Augmented Reality (AR) and simple Social Media features using SwiftUI and Google Firebase Cloud Services

Table of contents App Demo How to Run Context Content How it's written Inspiration App Demo AR.online.shopping.iOS.demo.mp4 How to Run First make sure

Ashkan Goharfar 13 Nov 1, 2022
Using ARKit and LiDAR to save depth data and export point cloud, based on WWDC20-10611 sample code

Save iOS ARFrame and Point Cloud This project improves the usability of the sample code from WWDC20 session 10611: Explore ARKit 4. Note that the samp

null 4 Dec 22, 2022
It is a music and podcast creation system that enables users to create multiple tracks using AR(Augmented Reality).

AR-Studio It is a music creation system enables users to create multiple tracks using AR(Augmented Reality). Introduction AR Studio turns your iPad, a

Ayush Singh 5 Dec 3, 2022
Cut and paste your surroundings using AR

An AR+ML prototype that allows cutting elements from your surroundings and pasting them in an image editing software.

Cyril Diagne 14.5k Dec 27, 2022
ARDicee - Simple augmented reality app using SceneKit and ARKit

ARDicee Simple augmented reality app using SceneKit and ARKit Requirements Xcode

donggyu 3 Feb 4, 2022
AR Ruler - A simple iOS app made using ARKit and SceneKit

A simple iOS app made using ARKit and SceneKit.Which can try to simplify little things in your life such as measuring stuff.

Dishant Nagpal 5 Aug 31, 2022
ARVoxelKit - Lightweight Framework for Voxel graphic using AR + SceneKit

ARVoxelKit Lightweight Framework for Voxel graphic using AR + SceneKit Requirements ARVoxelKit requires iOS 11 and devices, which support ARKit Usage

null 79 Dec 29, 2022
IOS example app to generate point clouds in ARKit using scenedepth

Visualizing a Point Cloud Using Scene Depth Place points in the real-world using the scene's depth data to visualize the shape of the physical environ

Isak Diaz 20 Oct 31, 2022
PlacenoteSDK Sample app in native iOS using ARKit, written primarily in Swift

Placenote SDK for iOS Placenote SDK lets you easily build cloud-based Augmented Reality (AR) apps that pin digital content to locations in the real wo

Placenote 93 Nov 15, 2022
A minimal iOS AR app that displays a wave animation using RealityKit2 Geometry Modifier

AR Simple Sea A minimal iOS AR app that displays a wave animation using RealityKit2 Geometry Modifier. Xcode 13.3 Target: iOS / iPadOS 15.0+ SwiftUI,

Yasuhito Nagatomo 15 Dec 29, 2022
An iOS Framework Capture & record ARKit videos 📹, photos 🌄, Live Photos 🎇, and GIFs 🎆.

An iOS Framework that enables developers to capture videos ?? , photos ?? , Live Photos ?? , and GIFs ?? with ARKit content.

Ahmed Bekhit 1.5k Dec 24, 2022
Augmented Reality image tracking with SwiftUI, RealityKit and ARKit 4.

ARImageTracking This is an Augmented Reality Xcode project that uses Apple's newest RealityKit framework and ARKit 4 features, to dynamically track a

Richard Qi 198 Dec 7, 2022
This package enables easy, convenient fading in and fading out in RealityKit.

RKFade This package enables easy, convenient fading in and fading out in RealityKit. Be sure to call FadeSystem.register() (Not FadeSystem.registerSys

Grant Jarvis 2 Nov 7, 2022