Skip to content
View sahilSENPAII's full-sized avatar

Block or report sahilSENPAII

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
sahilSENPAII/README.md

Hi, I'm Sahil Ray

Software Engineer · LLM Infrastructure & AI Systems · Python · C++ · FastAPI

B.Tech ECE @ BIT Mesra

LinkedIn Email Profile views


About Me

  • Pre-final year B.Tech, Electronics & Communication Engineering, BIT Mesra
  • Former SWE Intern @ NETSCOUT, where I built a production LLM routing gateway
  • Interested in LLM infrastructure: gateways, routing, agent orchestration and reliable AI systems
  • Contributing to open source, starting with LiteLLM

Experience

Role What I built
SWE Intern, NETSCOUT Production LLM routing gateway in FastAPI and asyncio, with circuit breakers, rate limiting and multi-strategy load balancing across LLM providers (proprietary)

Featured Projects

Project Description Highlights
LLM Routing Gateway
internship project, NETSCOUT (proprietary)
Production gateway that routes requests across multiple LLM providers FastAPI, asyncio, circuit breakers, rate limiting, multi-strategy load balancing
Murmur
fork of mightbeanshuu/murmur
Event-driven AI agent orchestrator: a planner builds a task graph, worker agents run in parallel, validators request revisions, a synthesizer produces the answer Next.js, Go, PostgreSQL, Redis, Temporal
Marg (Smart India Hackathon 2026)
4-person team project, I owned the backend and the ML workflow
City-wide multi-camera vehicle tracking and re-identification for Indian roads, fusing plate OCR, visual Re-ID and a spatio-temporal feasibility gate YOLOv8 + ByteTrack, OSNet Re-ID, EasyOCR, FastAPI + SQLite + FAISS, React + TypeScript + Leaflet. Cleared the BIT Mesra internal round
UPI Fraud Detection End-to-end fraud detection system on the PaySim dataset (6.3M transactions) XGBoost, SMOTE for class imbalance, SHAP explanations, FastAPI + React, Dockerized
Medical QA with LoRA Fine-tuned LLaMA-3.2-1B-Instruct on MedQuAD with LoRA / PEFT on a Colab T4 ROUGE-L 0.180 → 0.195, BERTScore-F1 0.839 → 0.841

Open Source

Project Contribution Status
LiteLLM fix(responses): attribute a mid-stream 429 to the failing deployment: fixed a race where a mid-stream rate limit cooled down the healthy fallback deployment instead of the one that failed In review

Tech Stack

Languages

Python C++ TypeScript JavaScript Go

Backend & Infra

FastAPI Node.js PostgreSQL MongoDB Redis Apache Kafka Docker

ML & LLMs

PyTorch Hugging Face LoRA / PEFT scikit-learn XGBoost OpenCV YOLOv8 FAISS

Frontend

React Next.js Tailwind CSS

Tools

Git pytest


GitHub Stats

GitHub stats GitHub streak

Popular repositories Loading

  1. LEASH-Spending-Firewall-for-AI-agents LEASH-Spending-Firewall-for-AI-agents Public

    PayPal hackathon project

    Python 2

  2. LMS-web LMS-web Public

    JavaScript

  3. house-price-prediction house-price-prediction Public

    JavaScript

  4. upi-fraud-detection upi-fraud-detection Public

    Jupyter Notebook

  5. FlowState FlowState Public

    JavaScript

  6. medical-qa-lora medical-qa-lora Public

    Fine-tuning LLaMA-3.2-1B-Instruct on MedQuAD using LoRA

    Python