Programming & Data
Languages and the data work that comes before any model.
Loading
I work on
AI/ML engineer and researcher building production-oriented multi-agent systems, retrieval pipelines and security methods for large language models — with published research in NLP and computer vision.
# whoami name = "Baharul Islam" role = "AI/ML Engineer & Researcher" based_in = "Bengaluru, India" degree = "B.Tech CSE, IIIT Guwahati" # what I actually do focus = [ "multi-agent orchestration", "retrieval-augmented generation", "LLM safety & backdoor defence", "vision + NLP research", ] # currently building("HR decision platform", at="ITCart") writing("papers", published=3, under_review=2) telling("human stories", on="Instagram")
I'm an AI/ML engineer and researcher who likes the whole arc of a problem — reading the literature, designing the method, then actually shipping it behind an API that someone depends on.
Right now I'm at ITCart, building a multi-tenant, human-governed HR decision platform on LangGraph, and a retrieval-grounded learning platform on FastAPI, Haystack and Qdrant. Before that I worked on backdoor detection and removal for LoRA-adapted LLMs at the University of Adelaide, and on foundation models for underexplored domains at Khalifa University.
My research has appeared in Springer Nature's Earth Systems and Environment, SemEval 2025 and IEEE GCON 2025, and I've placed in the global top ten at IEEE ICIP, IEEE SaTML and SemEval.
The stack I reach for — from tensors and training loops to agent graphs, vector stores and the services that put them in front of users.
Languages and the data work that comes before any model.
Training, fine-tuning and evaluating models across vision and language.
Orchestrating agents, grounding them in retrieval, and measuring whether it worked.
Turning a notebook into a service that stays up and stays observable.
Industry engineering and academic research — usually at the same time.
Agent systems, local speech pipelines, research models and a quantitative scanner that runs itself every morning.
A private assistant that runs entirely on your own laptop and can reach over a thousand real tools through MCP, while never showing the model more than a handful of them at once.
An agent that carries an open-source contribution from finding the issue through to merge — and cannot take a single public action without a human clicking approve.
A kit you drop into a project before building with an AI assistant. It makes you pin down what must be built and what must not be, locks that list, and then physically prevents the assistant from wandering off it.
A VS Code extension that keeps a plain-English twin of every code file and puts a human checkpoint in front of every change an AI coding assistant tries to make.
Upload a codebase and read how it works as a flow you can open up — from where information enters the system down to the lines inside one small function. Every box points at real code.
A quiet macOS menu-bar helper that holds you to the one sentence you said you were going to do. It asks what you are working on, watches the desktop once a second, and speaks only when you have genuinely drifted.
Data, simulator and figure pipeline for a measurement study showing that runtime drift breaks static energy profiles, together with a survival-constrained router built to hold a budget despite that drift.
A browser-based, fully offline voice assistant for Indian English, Hindi and code-mixed Hinglish. It listens continuously over a WebSocket, transcribes with an accent-tuned Whisper model, and speaks its reply back about a second after you stop talking.
An art-direction service that sells to other software. A buying agent discovers the price list, checks it against its own budget, signs a payment and consumes the result — with no account, no API key and no human in the loop.
An agent skill that turns a plain-language product idea into a researched system architecture. Five evidence lanes become rival architects that compete and cross-examine one another, and the verified winner is handed over as a five-file build pack.
A location-based history storyteller: name or photograph an Indian heritage site and it assembles a 58-second vertical documentary from archival Wikimedia material, with generated footage confined to two clearly labelled reconstruction windows.
A LangGraph pipeline of specialised agents that researches a topic end to end — searching, summarising, fact-checking itself, and looping back when its own confidence is too low.
A supervisor-based multi-agent assistant that handles clinic scheduling in plain language — booking, cancelling, rescheduling and answering questions about availability.
A Streamlit and command-line application that scans PDFs, CSVs, text and scanned images for sensitive data, classifies each document as low, medium or high risk, and produces redacted copies and audit-logged compliance reports entirely on the local machine.
An open technical book on taking LLM systems into production, published as a static site built by its own generator. Fifteen chapters are written so far, with a further thirteen parts outlined and in progress.
A self-running quantitative scanner for the Indian market: it ranks the NSE universe on fundamentals, then hunts for bullish technical setups across daily, weekly and monthly candles — and messages the results every trading morning.
The model behind the AquaFusionNet paper: a hybrid classifier that separates biofouling, holes and vegetation in underwater imagery by fusing four pretrained vision backbones with handcrafted texture and colour descriptors, then reweighting the combined vector through a learned attention layer.
An end-to-end clinical-trial NLP pipeline that predicts multiple labels from long reports and retrieves the exact passages that support each prediction.
I'm actively building several things that aren't ready to show yet: more agentic systems, retrieval tooling and research prototypes. They'll land here as they ship.
Three published, two under review. Tap any entry to read the abstract.
Abstract
Underwater infrastructures such as pipelines, ship hulls, and offshore platforms are critical to marine operations but are highly vulnerable to biofouling, structural corrosion, and vegetation overgrowth, leading to increased maintenance costs and environmental hazards. However, visual inspection of these structures remains challenging due to low visibility, uneven lighting, and complex textured surfaces that limit the effectiveness of both traditional and purely deep learning-based approaches. In this work, we introduce AquaFusionNet, a hybrid defect classification framework that seamlessly integrates embeddings from four state-of-the-art pre-trained backbones (EfficientNet-B0, ResNet-50, SENet-50, and Vision Transformer) with complementary traditional descriptors including colour histograms, histogram of oriented gradients (HOG), local binary patterns (LBP), edge density, and gradient statistics via a trainable attention module. This attention mechanism dynamically weights each feature channel, allowing the model to emphasise the most informative cues while preserving fine-scale details under variable turbidity and illumination. We evaluate AquaFusionNet on a curated dataset of 2,228 underwater images spanning three defect categories, with 445 images held out for testing. Our model achieves 98.43% accuracy, 98.18% precision, 97.79% recall, a 96.06% intersection-over-union, and a 97.97% F₁-score, outperforming eleven strong baselines, including ResNet-152 and EfficientNet-B0, by a substantial margin. These results demonstrate AquaFusionNet's robustness and generalisability, paving the way for real-time, automated underwater inspection systems that can significantly enhance operational safety and reduce maintenance costs across marine industries.
Abstract
This paper presents a system for automated subject tagging in a bilingual academic setting. Our approach leverages a novel burst attention mechanism to enhance the alignment between article and subject embeddings, derived from a large cross-lingual subject corpus. By employing a margin-based loss with negative sampling, our resource-efficient model achieves competitive performance in both quantitative and qualitative evaluations. Experimental results demonstrate average recall rates of 32.24% on the full test set, along with robust performance on specialized subsets, making our system well-suited for large-scale subject recommendation tasks.
Abstract
Road accidents attributed to driver drowsiness impose a severe social and economic burden worldwide. We present a hybrid vision–based framework that combines compact embeddings from a Vision Transformer (ViT, specifically NV-DINOv2) with a lightweight multi-layer perceptron (MLP) classifier to detect driver fatigue from facial cues and eye dynamics. By decoupling high-capacity visual feature extraction (ViT) from a small task-specific head (MLP), the proposed system delivers state-of-the-art accuracy while remaining fast enough for real-time deployment on commodity hardware. The model attains 99.25% test accuracy together with 99% precision, 99% recall, and a 99% F1 score substantially outperforming MobileNetV2, VGG16, and VGG19 baselines. These results demonstrate the effectiveness of ViT embeddings for robust, low-cost driver-monitoring applications.
Abstract
Abstract
Organised by Cognizant AI Lab in collaboration with IIIT Guwahati.
An anti-backdoor challenge for post-trained large language models, run for IEEE SaTML 2026.
View leaderboardIEEE International Conference on Image Processing (ICIP), Abu Dhabi, 2024.
Certificate of achievementLLMs for subject indexing — placed 9th worldwide.
Organised by the Programming Club at IIIT Guwahati.
All India Rank 11,771 in JEE Advanced and 16,571 in JEE Mains.
“Education is not the learning of facts, but the training of the mind to think.”



Alongside the research and engineering, I've started a storytelling channel on Instagram.
“Real people. Honest conversations. Work, struggles, lessons and life stories — shared with permission.”
Beyond Roles is where I step away from models and metrics and talk to people about the parts of their lives that job titles never capture — the work behind the role, the struggles nobody posts about, and the lessons that actually stuck.
Every story is shared with the permission of the person telling it. It's a new channel, and it's growing one honest conversation at a time.
Open to research collaborations, AI/ML roles, and requests for access to private work.
I read everything that comes in and reply to anything genuine — whether it's a paper idea, a role, or a request for repository access.