Fox Robotics
Senior Software Engineer (Perception) (September 2024 - Present)
Created a sensor fusion-based system using panoptic segmentation and 3D point clouds to identify, localize, and associate dunnage airbags with the pallets they obstruct, preventing autonomous operation failures and improving throughput.
Developed 3D obstacle detection system to track obstacles using visibility analysis and occupancy grids to maintain persistent memory of occluded hazards, improving operational safety while reducing the map’s storage footprint by 30% through layered Protobuf maps and deferred map updates.
Software Engineer (Perception) (January 2023 - September 2024)
Implemented robust pallet exception handling systems using multi-modal inputs (images, 2D/3D point clouds) to proactively detect pallet sliding, pallet stabbing, and 3D pallet tracking, reducing operational risks and product damages.
Engineered a pallet load height estimation system with image segmentation and 3D point cloud clustering in C++, boosting picking throughput by 4-6% with improved accuracy.
Deployed a facial anonymization system using YOLOX for human head detection, enhancing data privacy compliance.
Overhauled the end-to-end pallet detection MLOps pipeline, automating dataset curation, model training, and experiment tracking with MLflow to accelerate the model training lifecycle, and enable faster model deployment.
Carnegie Mellon University (December 2022)
Master of Science in Mechanical Engineering - Advanced Study (GPA: 4.0/4.0)
Robotic and Control Systems Specialization
Courses: Electromechanical System Design, Modern Control Theory, Computer Vision for Engineers, Robot Mobility on Air, Land and Sea, Intro to Deep Learning, Simultaneous Localization and Mapping, Making Products at Scale, Planning and Decision Making, Advanced Controls Systems Integration, Engineering Optimization, Engineering a Startup
Birla Institute of Technology and Science, Pilani (July 2020)
Bachelor of Engineering in Mechanical (GPA: 9.2/10.0)
Courses: Solid Mechanics, Fluid Mechanics, Applied Thermodynamics, Kinematics and Dynamics of Machines, Heat Transfer, CAD, Intro to Robotics, Pattern Recognition, Renewable Energy, Supply Chain Management, Foundations of Data Science, Business Analysis and Valuation
Neocis Inc, Software Engineer Intern (May 2022 - August 2022)
Designed algorithm to detect dental implants in CBCT Scan point cloud data and compute error metrics post-robot-assisted dental operation. Improved error analysis accuracy and consistency over existing methods by 27%.
Researched singularity and joint limit avoidance algorithms for a 6 DOF robot arm.
Deepedge AI, Machine Learning Engineer (January 2021 - July 2022)
Developed and deployed a Siamese network-based model for one-shot image recognition of identical eyelashes in stereo image pairs using TensorFlow in C++, achieving 98% accuracy in stereo matching and reducing inference time by over 200ms.
Developed auto-annotation pipeline, enhancing the data labeling process and reducing the turnaround time by nearly 50%.
ICICI Bank, Management Trainee (October 2020 - December 2020)
Managed the marketing data from the various internet banking touchpoints, and developed meaningful insights to target customers for all the products in the ICICI Bank portfolio to boost sales.
Mercedes-Benz Research and Development India, R&D Intern (Januray 2020 - July 2020)
Initiated experimental project with Noise, Vibration, and Harshness Team involving analysis of noise signals and classification using fingerprinting and Neural Networks.
Created an ESResNet based diagnostic tool using Pytorch to classify various vehicle noises, predict their source, and eventually find a serviceable solution for the problem.
Minimized diagnosis and resolution time for service technician, to consequently improve customer experience by reducing overall servicing time.
Paytm Mall, Data Analyst Intern (May 2018 - July 2018)
Built an automated Seller Scoring System based on KPIs from sales data to evaluate seller's performance in Paytm marketplace using Python pandas and MySQL.
Analyzed sellers' scores to identify non-performing sellers and helped sellers improve their performance on the platform by recognizing their problem areas.
UAV Mapping with Semantic and Traversability Metrics for Forest Fire Mitigation (January 2021 - May 2022)
Designed a system to predict UGV traversability using 3D point cloud data from UAVs, incorporating fuzzy-logic algorithms and ground segmentation with a Cloth Simulation Filter.
Together with research group implemented SLAM system to understand 3D structure of forest environment, a semantics system to identify fuel and other features in environment, and a system that predicts which region a UGV can navigate.
Paper in OpenReview and oral presentation in ICRA 2022 Workshop IFRRIA.
Context-based Video Colorization (March 2022 - July 2022)
Building a novel, fully automatic neural network architecture with context-based attention to colorize grayscale videos by augmenting colorful image colorization for temporal coherency.
Automatic Eye-in-Hand Calibration using EKF (March 2022 - May 2022)
Conceptualized employing Extended Kalman Filter to automatically calibrate an industrial robotic arm with a camera on end-effector to make hand-in-eye calibration fast and effortless.
Aurecle - Augmented Reality Clearance Estimation (November 2021 - December 2021)
Developed a computer vision-based warning system for logistic vehicles to estimate clearance height under bridges and overpasses to avoid over height vehicle crashes.
KickFlip - The Cooking Robot (August 2021 - December 2021)
Built a kitchen appliance cooking robot prototype with an integrated cooktop, 2-DOF actuated spatula, and sensing probe to automatically cook burger patties to the desired cooking level.
Integrated various sensors to get density and temperature and to observe texture and colour to monitor cooking status and actuate relevant mechanisms.
Control and Planning for Vehicle and Quadcopter (September 2021 - December 2021)
Applied PID and LQR controllers, EKF for localization and A* planning for lane change using Python on vehicle and quadcopter in Webots simulator.
Programming :
Advanced - Python, C++ ; Intermediate - MATLAB
Frameworks and Libraries :
Pytorch, TensorFlow, ONNX Runtime, VTK, ROS, OpenCV, Pandas
Others :
Solidworks, Arduino, Linux, Git
Designing and Deploying ML/AI Systems
(August 2021 - December 2021)
Carnegie Mellon University
Heat Transfer
(August 2019 - December 2019)
Birla Institute of Technology and Science