Founder & Inventor
Inventor of core patent-pending technology for a next-generation speaker company.
Lab Manager & Creative Technologist
Lab Manager & Creative Technologist under Academy Award Winner, Jack Cashin
Computer Vision Lead
Lead computer vision engineer for international public event, turning a large format projector into an explorable world
Projection Mapping & Audio Systems
Custom screen, audio system, projection mapping for a reverse-projection showing of Fantastic Mr. Fox in a theatrical 7.1 audio channel up-mix
Animatronics & LLM Systems
A Star Wars-inspired animatronic with face tracking eyes and LLM-enabled communication
Real-Time Writing Systems
A real time system-level editing assistant that automatically updates your writing to the desired tone as you go
Physics-Informed Neural Networks
A PINN-based deep learning formulation of the Gerchberg-Saxton algorithm for volumetric phase retrieval in immersive displays
Volume Rendering & Acoustics
OpenGL Volume Rendering Engine for designing visual displays and acoustic fields in immersive environments
Investigating high amplitude ultrasound’s effect on Varroa Destructor pests
Captured Performer Motion for Projected Digital Character Animation
R&D in sound-based levitation of objects in immersive displays
Entirely computer vision based control of computer, including cursor, keyboard, and scrolling
An Ubuntu Server Configuration for Remote Deep Learning Tasks
While living in India, managed a team of five PHD-Students in developing and shipping a mobile app
An oxidation-driven expansion rate in a layered titanium prosthesis for children with knee conditions
Researcher with Center for Social Action in Bangalore
An exploration of a selection of my photos chosen to tell stories.
Some of my favorite origami pieces: modern takes on an ancient art form with intricate design, a single piece of paper, and no cutting or tearing.
A collection of my abstract, impressionistic, and geometric ink drawings.
A collection of my digital art.
Mixed Media Limited Palette Figurative Impressions.
A rigorous work in modern metaphysical philosophy.
Ice picks, mules, and diseased glacial water.
A glimpse into my life in India at a local university, as a researcher, and mobile application team manager.
Scuba Diving, Drone Photography, Big Mountain Skiing, Climbing Mt. Fuji, etc.
Compassionate ∩ Curious ∩ Persistent ∩ Innovative ∩ Collaborative
Gesture-Based Computer Control
Entirely computer vision based control of computer, including cursor, keyboard, and scrolling
Summary
This project was built for two target experiences- as a presentation tool and as an accessibility tool. As a presentation tool, it excels of keeping a presenter from needing to hide themselves behind a computer in order to do anything from it. In front of large audiences, being able to control the mouse by pointing, type with sugn language, and scroll with two fingers completely changes the way tech can be utilized in a presentation. As an accessibility tool, though it is not particularly helpful to the deaf community (typing is faster), it is helpful to be able to type from farther away, and it is very intuitive to point to the screen with your finger instead of touching it or using a mouse. The project began with a motion capture glove to isolate the gesture recognition techniques from stable motion data and then transferred onto a pre-trained computer vision model.
Key Contribution: Designed and implemented a fully computer vision-based computer control including cursor movement, typing, and scrolling through mid-air hand gestures. Prototyped gesture semantics using motion capture for ground-truth stability, then translated the interaction model to a camera-only computer vision pipeline suitable for presentations and accessibility-focused use cases.
Skills
Touchless Interaction Design ▪︎ Gesture-to-Action Mapping ▪︎ Accessibility-Oriented Interface Design ▪︎ Computer Vision Model Deployment ▪︎ Real-Time Interaction Pipelines ▪︎ Rapid Interaction Prototyping ▪︎ Python ▪︎ Numpy ▪︎ Tensorflow ▪︎ OpenCV ▪︎ C++
You may also be interested in:
F.R.I.D.A
A Star Wars-inspired animatronic with face tracking eyes and LLM-enabled communication
Ocean Site One
Lead Engineer for an International Event, Turning a Large Format 360° Video into a Touchscreen-Like Explorable World Using Computer Vision
Founder
Inventor of Core Patent-Pending Technology of a Speaker Manufacturing and IP Company
‘Deep Gerchberg-Saxton’: A Physics Informed Neural Network Architecture
A novel deep learning approach to Volumetric Phase Retrieval problems; applied to immersive displays