Code and documentation for my talk Anime-fy Yourself Using Core ML

Yono Mittlefehldt

Last update: May 29, 2022

Related tags

Alert & Action Sheet Anime-fy-Yourself

Overview

Anime-fy Yourself

Code and documentation for my talk Anime-fy Yourself Using Core ML

Convert from PyTorch to Core ML

To convert @bryandlee's PyTorch implementation of AnimeGANv2 to Core ML, run the following command:

python convert_to_nn.py 512

Running like this, the output image sizes will be 512 x 512px. If you want a different resolution, you can run the script with a different parameter. Currently only square image formats are supported.

This script will save a file called AnimeGANv2_512.mlmodel in the same directory, from which it was run. This model can be imported into Xcode and used in the sample project.

Comparing outputs

Additionally a script to compare the outputs of the PyTorch and Core ML models is available in the python directory.

python compare 512 MyCoolImage.jpg

Running this will print the cosine similarity of the PyTorch and Core ML model outputs. To do so, it flattens the output image and treats them as large 1D vectors. This may or may not be useful.

It will also save the PyTorch and CoreML generated images under the following names (based on the name of the passed in file):

MyCoolImage_pt.png
MyCoolImage_cml.png

Here are some example images and their cosine similarities:

Original	PyTorch	Core ML	Cosine Similarity
			91.04%
			80.48%

You might also like...

Comments

Change pixel format for the camera feed

Current pixel format is kCVPixelFormatType_32BGRA. According to TN3121: Selecting a pixel format for an AVCaptureVideoDataOutput, this is inefficient if you don't specifically need BGRA format, as it needs to convert to this format for every frame. Additionally, this requires more memory

opened by yonomitt 0

Code and documentation for my talk Anime-fy Yourself Using Core ML

Related tags

Overview

Anime-fy Yourself

Convert from PyTorch to Core ML

Comparing outputs

You might also like...

(Experimental libraries) Controls interrupt handling, such as alert views, and is compatible with UIKit and Swift UI.

Highly customizable alertview and alert/notification/success/error/alarm popup written in Swift

PMAlertController is a great and customizable alert that can substitute UIAlertController

Toasts and popups library written with SwiftUI

Native alert from Apple Music & Feedback. Contains Done, Heart & Message and other presets.

SwiftMessages is a very flexible view and view controller presentation library for iOS.

SwiftOverlays is a Swift GUI library for displaying various popups and notifications

Lightweight dropdown message bar in Swift. It's simple and beautiful.

Fully customizable and extensible action sheet controller written in Swift

Comments

Change pixel format for the camera feed

Owner

Yono Mittlefehldt

Advanced usage of UIAlertController and pickers based on it: Telegram, Contacts, Location, PhotoLibrary, Country, Phone Code, Currency, Date...

ColorAssetsFinder can help you find particular color assets easily by hex color code.

💬 A tiny extension for UIAlertController that makes working with it very simple. Only 150 lines of code.

Create Apple-like alerts & toasts using SwiftUI

This is an iOS control for selecting a date using UIDatePicker in an UIAlertController like manner

This is an iOS control for selecting something using UIPickerView in an UIAlertController like manner

PageSheet - Customizable sheets using UISheetPresentationController in SwiftUI

🌊 - Jelly is a library for animated, non-interactive & interactive viewcontroller transitions and presentations with the focus on a simple and yet flexible API.

It is a highly configurable iOS library which allows easy styling with built in styles as well as extra header and footer views so that you can make extremely unique alerts and action sheets.

TTGSnackbar shows simple message and action button on the bottom or top of the screen with multi kinds of animation, which is written in Swift3 and inspired by Snackbar in Android. It also support showing custom view, icon image or multi action button.