Fox Robotics
Senior Software Engineer (Perception) (September 2024 - Present)
Developed a stateful 3D obstacle detection system that tracks obstacles over time using point cloud visibility analysis and occupancy grids, allowing the robot to retain unseen obstacles and stop near potential hazards, while also reducing map storage size by 30%.
Software Engineer (Perception) (January 2023 - September 2024)
Implemented robust pallet exception handling systems to improve robot safety and reliability, including pallet sliding detection, pallet stab detection, and airbag detection, reducing operational risks and product damages.
Engineered a pallet load height estimation system with image segmentation and point cloud clustering in C++, boosting picking throughput by 4-6% with improved accuracy.
Developed a facial anonymization system with YOLOX for human head detection, enhancing data privacy compliance.
Designed an end-to-end deep learning pipeline to automate dataset generation, model training, and MLflow integration, optimizing processing speed by 30-40% through multi-threading, dataset versioning, and improved model iteration metrics.
Carnegie Mellon University (December 2022)
Master of Science in Mechanical Engineering - Advanced Study (GPA: 4.0/4.0)
Robotic and Control Systems Specialization
Courses: Electromechanical System Design, Modern Control Theory, Computer Vision for Engineers, Robot Mobility on Air, Land and Sea, Intro to Deep Learning, Simultaneous Localization and Mapping, Making Products at Scale, Planning and Decision Making, Advanced Controls Systems Integration, Engineering Optimization, Engineering a Startup
Birla Institute of Technology and Science, Pilani (July 2020)
Bachelor of Engineering in Mechanical (GPA: 9.2/10.0)
Courses: Solid Mechanics, Fluid Mechanics, Applied Thermodynamics, Kinematics and Dynamics of Machines, Heat Transfer, CAD, Intro to Robotics, Pattern Recognition, Renewable Energy, Supply Chain Management, Foundations of Data Science, Business Analysis and Valuation
Neocis Inc, Software Engineer Intern (May 2022 - August 2022)
Designed algorithm to detect dental implants in CBCT Scan point cloud data and compute error metrics post-robot-assisted dental operation. Improved error analysis accuracy and consistency over existing methods by 27%.
Researched singularity and joint limit avoidance algorithms for a 6 DOF robot arm.
Deepedge AI, Machine Learning Engineer (January 2021 - July 2022)
Collaborated with Luum Robotics on Lash robot's AI and Vision system for extending eyelashes in beauty salons.
Developed and deployed a Siamese network-based model for one-shot image recognition of identical eyelashes in stereo image pairs using TensorFlow in C++, achieving 98% accuracy in stereo matching and reducing inference time by over 200ms.
Developed auto-annotation pipeline, enhancing the data labeling process and reducing the turnaround time by nearly 50%.
ICICI Bank, Management Trainee (October 2020 - December 2020)
Managed the marketing data from the various internet banking touchpoints, and developed meaningful insights to target customers for all the products in the ICICI Bank portfolio to boost sales.
Mercedes-Benz Research and Development India, Student Trainee (Januray 2020 - July 2020)
Initiated experimental project with Noise, Vibration, and Harshness Team involving analysis of noise signals and classification using fingerprinting and Neural Networks.
Created an ESResNet based diagnostic tool using Pytorch to classify various vehicle noises, predict their source, and eventually find a serviceable solution for the problem.
Minimized diagnosis and resolution time for service technician, to consequently improve customer experience by reducing overall servicing time.
Paytm Mall, Data Analyst Intern (May 2018 - July 2018)
Built an automated Seller Scoring System based on KPIs from sales data to evaluate seller's performance in Paytm marketplace using Python pandas and MySQL.
Analyzed sellers' scores to identify non-performing sellers and helped sellers improve their performance on the platform by recognizing their problem areas.
UAV Mapping with Semantic and Traversability Metrics for Forest Fire Mitigation (January 2021 - May 2022)
Formulated fuzzy logic-based algorithm to determine ground traversability for UGV using point cloud data from UAV as part of SafeForest project.
Together with research group implemented SLAM system to understand 3D structure of forest environment, a semantics system to identify fuel and other features in environment, and a system that predicts which region a UGV can navigate.
Paper in OpenReview and oral presentation in ICRA 2022 Workshop IFRRIA.
Context-based Video Colorization (March 2022 - July 2022)
Building a novel, fully automatic neural network architecture with context-based attention to colorize grayscale videos by augmenting colorful image colorization for temporal coherency.
Automatic Eye-in-Hand Calibration using EKF (March 2022 - May 2022)
Conceptualized employing Extended Kalman Filter to automatically calibrate an industrial robotic arm with a camera on end-effector to make hand-in-eye calibration fast and effortless.
Aurecle - Augmented Reality Clearance Estimation (November 2021 - December 2021)
Developed a computer vision-based warning system for logistic vehicles to estimate clearance height under bridges and overpasses to avoid over height vehicle crashes.
KickFlip - The Cooking Robot (August 2021 - December 2021)
Built a kitchen appliance cooking robot prototype with an integrated cooktop, 2-DOF actuated spatula, and sensing probe to automatically cook burger patties to the desired cooking level.
Integrated various sensors to get density and temperature and to observe texture and colour to monitor cooking status and actuate relevant mechanisms.
Control and Planning for Vehicle and Quadcopter (September 2021 - December 2021)
Applied PID and LQR controllers, EKF for localization and A* planning for lane change using Python on vehicle and quadcopter in Webots simulator.
Programming :
Advanced - Python, C++ ; Intermediate - MATLAB ; Basic - R, SQL
Frameworks and Libraries :
Pytorch, TensorFlow, ONNX Runtime, VTK, ROS, OpenCV, Pandas
Others :
Solidworks, Arduino, Linux, Git
Designing and Deploying ML/AI Systems
(August 2021 - December 2021)
Carnegie Mellon University
Heat Transfer
(August 2019 - December 2019)
Birla Institute of Technology and Science