NJ
Nehil Jain
Member of Technical Staff @ Anyscale
SF Bay Area
Skills
AI and Machine Learning
Agentic Applications
RAG
LLM Serving (vLLM, Ray Serve)
LLM Fine-tuning (LoRA, RLHF, GRPO)
Sentence Transformers
MLOps
Forecasting
Data Engineering and Infrastructure
Python
SQL
Ray (Data, Serve, Train)
Spark / PySpark
Dagster
Airflow
MLflow
Snowflake
Databricks
dbt
PyArrow
Cloud and Distributed Systems
AWS
Azure
GCP
Kubernetes
Docker
A100 / H100 / A10G / L40S GPUs
Frameworks and Tools
PyTorch
LangChain
LangGraph
LangSmith
FastAPI
Streamlit
Playwright
XGBoost
pyGAM
Experience
Member of Technical Staff
AnyscaleSep 2025 - Present
- Field engineer for 10+ Fortune 500 Anyscale accounts on Ray, including Notion and Palo Alto Networks.
- Own a multi-seven-figure ACV book and seven-figure qualified pre-sales pipeline.
- Drove 6x growth at Notion by migrating Spark + OpenAI embeddings to Ray Data + self-hosted pipelines across 10M+ workspaces.
- Shipped upstream Ray Data and Ray Serve fixes that unblocked customer training and serving workloads.
- Core team member for Ray on the Roads; delivered SF workshop to 150+ engineers and converted Twitch from prospect to customer via a 4-hour custom workshop.
Founder & CEO
DemoDrive AIMay 2024 - Aug 2025
- Built an agentic video editor for DevRel teams from zero (Playwright automation → AI scripting → Remotion render).
- Ran 70+ discovery interviews across Okta, Google, Stripe, Shopify, Microsoft; executed 3 product pivots in 8 months.
- Shipped 120+ automated videos cutting content creation time 70% across 5 pilots; secured 1 paid pilot and 2 design partners.
- Placed in 4 SF AI hackathons: 1st at MongoDB GenAI ($2k, KinConnect), solo 1st at Luma AI, 2nd at E2B × Fireworks AI (ProoferX), 3rd at LangChain Agents & Compound AI Systems (LazyPMs) - featured by Fireworks AI as a triple-hackathon placer.
Principal AI Engineer
QuantumBlack, McKinseyNov 2022 - Apr 2024
- Led AI engineering across Fortune 500 clients in insurance, CPG, and mining.
- Led a 7-person team building a life-insurance claims LLM RAG system (AWS Textract OCR beat GPT-4V, LangChain knowledge-graph, FastAPI) - 82% accuracy, 64% actuarial-dependency reduction, ~$5M/year savings.
- Built a dbt data-quality framework across 107 CPG supply-chain teams (70% → 98% pass rate, $30M+ EBITDA in a quarter).
- Managed 9 engineers across a copper-mining forecasting program - 18 production models, 40% faster deployments, 4+ patents.
Senior AI Engineer II
QuantumBlack, McKinseyJan 2021 - Oct 2022
- Designed a Delta Lake feature store for a major telecom's churn-prediction program with automated retraining into CRM workflows - 11% QoQ customer win-back lift.
- Refactored Spark pipelines on a crushing-optimization workload (incremental processing, vectorized UDFs) cutting runtime from 2h to 4min (96%).
- Designed the pair-programming interview process across 12 McKinsey global offices.
Tech Lead - Data
Super.comJan 2019 - Nov 2020
- Led a 12-person data + analytics team building the unified data platform (Airflow consuming 5M+ events/day into S3, dbt revenue models, Looker/Mode) - contributed to 22% YoY revenue uplift through Series B.
- Facilitated COVID war-room sessions with dbt unit-economics models, supporting vendor renegotiations for seven-figure savings, 18% OPEX cut, and 3 consecutive profitable months.
- Built a smart-bidding system (XGBoost on FastAPI/ECS) lifting margin 10% → 13%, cutting CPA 15%, driving 20% ROAS improvement.
- Rolled out self-serve analytics cutting KPI delivery 10d → 1d.
Founding Engineer - Data
Super.comJul 2016 - Dec 2018
- Architected a scalable event pipeline from scratch processing 5M+ events/day at 98% reliability with sub-hourly latency and 20% cost cut via incremental processing.
- Built a location recognition model on 500K labeled chat events (Random Forest on Spark MLlib) - F1 0.96, 15% personalization lift, 8% reduction in time-to-booking.
Co-Founder
AthletigenApr 2013 - Jul 2016
- Co-founded biotech startup combining genomics and AI for elite athletes.
- Scaled to 16,000 reports, built 8-person engineering team, and designed genetic analytics pipeline on Spark and AWS.
Education
BITS Pilani University
MS in Mathematics & B.E. in Electronics
Pilani, Rajasthan, India
2008 - 2013
Projects
Notion Batch Embeddings Optimization
Autoresearch
Ran an 80-experiment autoresearch-style sweep across Notion's AI search embedding pipeline (millions of pages, 10M+ workspaces), tuning Ray Data + self-hosted embedding throughput.
Sales Context DataHub - Agent at Scale
Claude Skills
Built an agent-at-scale system over 7 fragmented internal sources (Gong, Slack, Pylon, Jira, Metronome, Salesforce, Notion) serving 30 Anyscale field engineers - Ray Data batch pipeline, recursive LLM summarization, dbt semantic layer, Claude agent skill, Streamlit app.
Ray Data OSS Vector Sink Connector
AI Infrastructure
Shipped a production-grade vector-DB connector to Ray OSS with column-oriented batching, memory-safe sort+slice implementation, and a PyArrow hash-order bugfix.