Projects

View GitHub

A showcase of my personal and technical projects.

Project Gallery

DDPG: Deep Deterministic Policy Gradient (TensorFlow 2.x) July 2025 Completed

GitHub Architecture Diagram Original Paper

A robust, modular, and extensible reimplementation of the DDPG reinforcement learning algorithm (Lillicrap et al., 2015) using TensorFlow 2.x. Built for reproducibility, research comparison, and interactive experimentation with Gym environments.

Modular architecture: separate agent, networks, noise, buffer, wrappers
Hyperparameter sweeps, YAML config system, and TensorBoard logging
Includes full unit test suite and reproducibility controls (seed, version logging)
Supports Gym ≥ 0.26, Apple Silicon acceleration (tensorflow-macos, -metal)

Reinforcement Learning DDPG TensorFlow OpenAI Gym

ACME10-HE-RAGApp: RAG with Vector Search, Knowledge Graphs, and LLMs May 2025 Completed

GitHub Final Report

A full-stack Retrieval-Augmented Generation (RAG) application developed for HackerEarth that integrates vector search (FAISS), knowledge graphs (DBpedia), and OpenAI’s LLM to generate traceable, context-rich answers from a Wikipedia-based knowledge base.

Developed for HackerEarth using 10,000+ Wikipedia articles
FAISS-based vector search for semantic retrieval
Knowledge graph context enhancement with DBpedia and SPARQL
OpenAI LLM for coherent and natural language answers
Dockerized deployment with local dev option

LLM RAG Vector Search Knowledge Graph Full-Stack NLP