A VisionCamera Frame Processor plugin for fast buffer resizing

Marc Rousavy

Last update: Aug 10, 2022

Related tags

Image vision-camera-resize-plugin

Overview

vision-camera-resize-plugin

A VisionCamera Frame Processor Plugin for fast buffer resizing.

By resizing buffers to a smaller resolution, you can achieve much faster frame processor executions than by running AI on a full-sized (4k) buffer.

Installation

npm install vision-camera-resize-plugin
cd ios && pod install

Add the plugin to your babel.config.js:

module.exports = {
  plugins: [
    [
      'react-native-reanimated/plugin',
      {
        globals: ['__resize'],
      },
    ],

    // ...

Note: You have to restart metro-bundler for changes in the babel.config.js file to take effect.

Usage

{ 'worklet'; if (frame.width > 1920) { frame = resize(frame, 1920, 1080) } // run AI on smaller buffer here }, []); ">

import { resize } from "vision-camera-resize-plugin";

// ...

const frameProcessor = useFrameProcessor((frame) => {
  'worklet';
  if (frame.width > 1920) {
    frame = resize(frame, 1920, 1080)
  }
  // run AI on smaller buffer here
}, []);

Contributing

See the contributing guide to learn how to contribute to the repository and the development workflow.

License

MIT

1D, 2D, and 3D variations of Fast Fourier Transforms for a Metal S4TF backend

MetalFFT MetalFFT is an experiment in adding GPU acceleration for 1D, 2D, and 3D variations of Fast Fourier Transforms. This framework's original purp

21 Oct 11, 2022

API surface for Swift plug-ins using the Swift Plugin Manager

SwiftPlugin The minimal API surface required for the Swift Plugin Manager to create instances from a loaded plugin. Additional documentation and refer

2 Mar 25, 2022

Cordova plugin to display a native color-picker dialog

Color Picker Plugin for Cordova (cordova-plugin-color-picker) Description This plugin allows you to display a color-picker native dialog in iOS and An

1 May 10, 2022

Metazoom - A virtual camera plugin to pixellatedly share your screen

MetaZoom A virtual camera plugin to pixellatedly share your screen. See LICENSE.

22 Jan 4, 2023

Flutter openvpn - A new Flutter plugin that uses OpenVpn

flutter_openvpn A new Flutter plugin that uses OpenVpn. Installation Depend on i

0 Jan 8, 2022

PerFolderResourcesPublishPlugin - Per-folder resources plugin for the Publish package

Per-folder resources for Publish A Publish plugin that copies per-folder resourc

1 Feb 18, 2022

Xcode plugin that moves the instruction pointer to the selected line

SFJumpToLine Xcode plugin that moves the instruction pointer to the selected line. Install: Install via Alcatraz Or clone and build the project, then

9 Jan 14, 2021

Touch ID Plugin (Cordova) for iOS

cordova-plugin-gctouch-id Touch ID Plugin (Cordova) for iOS Author: Giulio Caruso aka rdn Index Description Technical Documentation Screenshots Adding

20 Jan 3, 2022

Xcode plugin that brings ⇧⌘T from AppCode over to Xcode

Aviator An Xcode Plugin that brings ⇧⌘T over to Xcode This minimal plugin allows you to use the key combo ⇧⌘T to toggle between source and test files.

29 Aug 18, 2018

Comments

Implicit conversion of Objective-C pointer type 'Frame *' to C pointer type 'CMSampleBufferRef'
Hey,

that's exactly the plugin I'd need right now, but it looks like it's not really ready to use (like: at all) 😅

I get an error

Implicit conversion of Objective-C pointer type 'Frame *' to C pointer type 'CMSampleBufferRef' aka 'struct opaqueCMSampleBuffer *') requires a bridged cast

in line 27 and line 30 when I try to create a build in xcode

Also, as somebody else pointed out already: the JS part of this plugin is still the labelImage function. Any chance to get this fixed on the short term? 🙂
opened by manuelbieh 0