Safe-RL exploration
archivedDDPG and TD3 agents that explore safely in continuous-action spaces with physical constraints violation.
rajarshi@portfolio:~$ whoami
Data Scientist — Commercial Marketing Decision Sciences, American Express
ようこそ" (Yōkoso)
I am currently working as a Data Scientist in the Commercial Marketing Decision Sciences team here at American Express. focusing on ranking and propensity models for commercial and consumer card offers. I have also worked on an end-to-end project involving the creation and validation of a multi-offer ranking framework for Email channel which replaced 3 XGBoost models with 2 segmentations solutions.
I had graduated from IIT Kanpur with a B.Tech in Materials Science and Engineering, where I also explored courses ranging across domains like Control Systems, Machine Learning, NLP, and Reinforcement Learning. My academic journey involved extensive involvement with Aerial Robotics as a Team Head and other associations like Astronomy, Quiz and Programming club. My interest in Astronomy led me to participate in various Inter IIT Tech Meets with ISRO, working on challenges like Lunar Atlas creation from Chandrayaan Orbiter imagery and Web-Based X-Ray Burst Identification.
Outside of work, I'm usually chasing a good badminton or lawn tennis match. I'm also into photography — mostly street and still life — and have been learning my way around a Fujifilm X-T50. The rest of my time goes to watching films (I log them sometimes on Letterboxd — an ardent cinephile), and occasionally reading murder mysteries as well as fumbling through a tune on the keyboard.
toolbelt
Programming
Databases
AI / ML
Platform & tools
American Express · Commercial Marketing Decision Sciences, Credit & Fraud Risk
Decision Point Analytics · Pricing & Promotion Modelling
Clean Energy Group, University of Toronto Scarborough · under Prof. Oleksandr Voznyy
2020 — 2024
Indian Institute of Technology (IIT) Kanpur
Four years of materials science along with other courses across Control Systems, Machine learning, NLP and RL. Involved with Aerial Robotics as a Team Head, Secretary of the Programming Club.
Achievements
A few of the ones that stuck: an Analyst of the Quarter award at American Express for optimizing usage of the Email Response model, and two Inter IIT Tech Meet results working on ISRO challenges and winning a Shastra Challenge in Orbital Mechanics track.
DDPG and TD3 agents that explore safely in continuous-action spaces with physical constraints violation.
A 4-stage MLOps pipeline — ingest, clean, train, evaluate — for forecasting e-commerce review scores.
Neural machine translation between English and seven major Indian languages encompassing LSTM, GRU, and Transformer architectures with various encoding strategies.
Reading
Read across fiction and non-fiction, with a keen interest in science, murder mysteries and philosophy
Sport / fitness
Am personally excited about racket sports in general. Have been a state level badminton player in the past, and always in search of exciting matches around!
Photography
Keen interest in photography, especially street and still life. I possess a Fujifilm X-t50 and have been tinkering with Adobe lightroom for post-processing. I have a small collection of my work on my Instagram page named fuji_visions