PoC to detect and track parts under a car's hood, with ARKit + Vision + CreateML + RealityKit.

Overview

required ios version  swift version 

ARCarGuidePoC

Detects parts under a hood of a motor vehicle, and tracks the detected parts in AR.
Tap AR entities to get more information about the part.

This is a PoC project, designed to detect a handful of Mazda 3 parts.
Debug .mov file with AR planes is avaialbe for download here

  • ARKit
  • Vision with a self taught CoreML model; Model included
  • RealityKit with RealityComposer

App Demo

App Flow

Feel free to suggest ideas to make this more than just a PoC

Cheers! 🎈
Eldar.

You might also like...
An iOS Framework Capture & record ARKit videos πŸ“Ή, photos πŸŒ„, Live Photos πŸŽ‡, and GIFs πŸŽ†.
An iOS Framework Capture & record ARKit videos πŸ“Ή, photos πŸŒ„, Live Photos πŸŽ‡, and GIFs πŸŽ†.

An iOS Framework that enables developers to capture videos πŸ“Ή , photos πŸŒ„ , Live Photos πŸŽ‡ , and GIFs πŸŽ† with ARKit content.

ARDicee - Simple augmented reality app using SceneKit and ARKit
ARDicee - Simple augmented reality app using SceneKit and ARKit

ARDicee Simple augmented reality app using SceneKit and ARKit Requirements Xcode

AR Ruler - A simple iOS app made using ARKit and SceneKit
AR Ruler - A simple iOS app made using ARKit and SceneKit

A simple iOS app made using ARKit and SceneKit.Which can try to simplify little things in your life such as measuring stuff.

ARKit + CoreLocation: Combines the high accuracy of AR with the scale of GPS data.
ARKit + CoreLocation: Combines the high accuracy of AR with the scale of GPS data.

ARKit: Uses camera and motion data to map out the local world as you move around. CoreLocation: Uses wifi and GPS data to determine your global locati

ARKit Demo Application
ARKit Demo Application

ARKitNavigationDemo Work in progress. In Progress Region β€” For one, we could render far fewer nodes. In fact, it’s a bit distracting that the entire t

IOS example app to generate point clouds in ARKit using scenedepth
IOS example app to generate point clouds in ARKit using scenedepth

Visualizing a Point Cloud Using Scene Depth Place points in the real-world using the scene's depth data to visualize the shape of the physical environ

ARKit Base Project. Place virtual objects based on WWDC example project
ARKit Base Project. Place virtual objects based on WWDC example project

ARKit - Placing Virtual Objects in Augmented Reality Learn best practices for visual feedback, gesture interactions, and realistic rendering in AR exp

This library uses ARKit Face Tracking in order to catch user's smile.
This library uses ARKit Face Tracking in order to catch user's smile.

SmileToUnlock Make your users smile before opening the app :) Gif with the demonstration Installation Cocoapods The most preferable way to use this li

PlacenoteSDK Sample app in native iOS using ARKit, written primarily in Swift

Placenote SDK for iOS Placenote SDK lets you easily build cloud-based Augmented Reality (AR) apps that pin digital content to locations in the real wo

Owner
Eldar E.
I just β™₯️ coding - I'm in my #mobile phase atm: #iOS #Swift - A startup dweller πŸ¦„
Eldar E.
This package enables easy, convenient fading in and fading out in RealityKit.

RKFade This package enables easy, convenient fading in and fading out in RealityKit. Be sure to call FadeSystem.register() (Not FadeSystem.registerSys

Grant Jarvis 2 Nov 7, 2022
Funny app with the fitting of sunglasses Used SwiftUI and RealityKit

Reality-Glasses-2021 on SwiftUI Funny app with the fitting of sunglasses. Used SwiftUI and RealityKit Interface and Features: Simple Intuitive Design

null 1 Nov 13, 2021
An example project showing how to extract and color anchor geometry in RealityKit

RealityKit - Extracting anchor geometry to create a custom Mesh An example project showing how to extract anchor geometry from ARMeshAnchor, create a

Travis Hall 11 Dec 1, 2022
A collection of additional geometries ready for use in RealityKit 2

RealityGeometries By default, the only shapes available in RealityKit are a Sphere, Cuboid and Plane (with 4 vertices). Until iOS 15 the only clean wa

Max Cobb 49 Dec 19, 2022
RealityKit Bool Demo with Euclid

RealityKit Bool Demo with Euclid A demo subtracting RealityKit meshes with a bool operation using Euclid. First a RealityKit MeshResource is converted

Anton Heestand 4 Dec 5, 2022
A sample project demonstrating a usecase for the DrawableQueue API in RealityKit 2.

RealityKit 2 DrawableQueue: Animated (transparent) GIFs A sample project demonstrating a usecase for the DrawableQueue API in RealityKit 2 – which cur

Arthur Schiller 17 Dec 14, 2022
This is a minimal AR Portal app that uses the RealityKit's occlusion materials to hide the inner space

AR Simple Portal This is a minimal AR Portal app that uses the RealityKit's occlusion materials to hide the inner space. Xcode 13.2.1 Target: iOS / iP

Yasuhito Nagatomo 6 Aug 10, 2022
A library that allows you to generate and update environment maps in real-time using the camera feed and ARKit's tracking capabilities.

ARKitEnvironmentMapper Example To run the example project, clone the repo, and run pod install from the Example directory first. Installation ARKitEnv

SV Hawks 91 Dec 4, 2022
A library that allows you to generate and update environment maps in real-time using the camera feed and ARKit's tracking capabilities.

ARKitEnvironmentMapper Example To run the example project, clone the repo, and run pod install from the Example directory first. Installation ARKitEnv

SV Hawks 91 Dec 4, 2022
Using ARKit and LiDAR to save depth data and export point cloud, based on WWDC20-10611 sample code

Save iOS ARFrame and Point Cloud This project improves the usability of the sample code from WWDC20 session 10611: Explore ARKit 4. Note that the samp

null 4 Dec 22, 2022