Object Tracking
Saturday 2 November 2024

Track your real objects and track them in VRChat. All SteamVR/OpenVR supported trackers are supported. Demo

History

On February 16, 2022, VRChat announced support for OSC1. Four months later, I assembled an ESP32 integrated with an IMU sensor and attached it to my pole to monitor its rotation speed. My objective was to transmit this data to my PC and relay it through OSC into VRChat. This would enable the visualization of rotation speed and trigger corresponding effects based on that speed. Initially, I envisioned using a candy cane as a festive Christmas pole. However, by December 2022, the concept had evolved to accommodate a different type of pole from the same manufacturer. The “X-Fly”2 pole features a top connected with a rope or chain, while the bottom remains loose. The primary challenge was determining the pole’s angle and transmitting this information. I tried to locate the pole within the room without success while using an IMU. Up to this point, the project was known as “Pole Sync”.

I desired a more versatile system that could be utilized with a wide variety of objects. What is the limit? This idea quickly expanded to include tracking an aerial hoop from the same manufacturer as my pole. At the time, I had only seen a handful of videos showcasing its use. It didn’t appear significantly more demanding than pole dancing. I considered using it as a swing if dancing didn’t work out. After determining my ring size, I placed an order. In early 2023, a “huge metal ring”, also known as an aerial hoop, arrived at my doorstep.

In April 2023, I presented a proof of concept (POC) to some friends and began dancing with it in VRChat. By July 20233, I was demonstrating a low-latency version with support for variable bit usage. However, manually crafting every parameter and relying on handcrafted animators proved to be cumbersome. Consequently, I started developing it into a tool that could be accessible to everyone. In July 20244, the open beta release was launched.

Motivation

Being immersed. Immersive interaction with objects, both for myself and others. Imagine lifting a bottle to take a refreshing sip of water, moving a chair to sit down, patting your cat on her tree, tracking your camera in its gimbal, or bringing your studio setup with you. These are just a few of the possibilities. Tracking a bottle with VRC Tracked Objects5 by jangxx.

I hope many people will discover this tool and use it to create something creative. Don’t forget to share your creations on my socials.

Vive tracker laying on hand in VRChat
Cup using vive tracker as tripod

Resources

  1. VRChat Announcement, VRChat OSC for Avatars at vrchat.com ↩︎

  2. Product Page, X-FLY at x-pole-co.uk ↩︎

  3. X Post, First Aerial Hoop dancer in @VRChat soon at x.com ↩︎

  4. X Post, Public release announcement at x.com ↩︎

  5. Github Project, VRC Tracked Objects at github.com ↩︎

Backlinks