Harshhaa Vardhan Reddy
Building scalable developer platforms, production AI infrastructure, autonomous AI agents, MCP ecosystems, and AI products.
Senior Platform & DevOps Engineer with 5+ years of hands-on experience engineering Internal Developer Platforms (IDPs), declarative infrastructure as code, enterprise DevOps delivery pipelines, production AI infrastructure, and autonomous AI agents.
Specializing in multi-cloud platform automation across AWS and Azure, Kubernetes orchestration, GitOps with ArgoCD, and developer experience workflows that dramatically accelerate software delivery cycles while maintaining 99.99% availability.
Pioneering modern AI Product Development, LLMOps, and Agentic Systems — building custom Model Context Protocol (MCP) servers, multi-agent workflows with LangGraph, high-throughput model inference serving with vLLM and Ollama, vector search retrieval pipelines, and end-to-end user-facing AI products.
Prolific open-source author and technical educator behind 40+ production blueprints, comprehensive documentation portals, and a global engineering community of over 250,000+ developers leveraging real-world DevOps and AI architectures.
5+
Years
Experience
23+
Projects
Shipped
4+
Companies
Roles
74+
Skills
Technologies
Platform Engineering & IDP
Self-Service Developer Portals & Golden Paths
- Self-service templates for one-click ephemeral preview environments with ArgoCD
- Unified developer portals and Backstage service catalog reducing cognitive load
- Standardized golden paths enforcing zero-drift declarative baselines
- Automated policy-as-code guardrails ensuring compliance without gatekeeping
AI Infrastructure & LLMOps
High-Throughput Model Serving & GPU Clusters
- Production inference serving with vLLM, Ollama, and Triton on GPU Kubernetes nodes
- Dynamic GPU scheduling and node autoscaling with Karpenter
- Semantic search retrieval pipelines with Qdrant, Milvus, and pgvector embeddings
- Experiment tracking, prompt versioning, and latency benchmarks with MLflow
GenAI, AI Agents & MCP
Autonomous Agentic Systems & Direct Tool Calling
- Custom Model Context Protocol (MCP) servers exposing Kubernetes & cloud APIs to LLMs
- Stateful multi-agent orchestrations with LangGraph and memory checkpoints
- Autonomous incident diagnostics, root-cause investigation, and triage runbooks
- Context engineering, human-in-the-loop approvals, and multi-agent coordination
DevOps & Multi-Cloud Automation
Declarative IaC & Resilient Delivery Pipelines
- Modular Terraform & OpenTofu architecture with multi-region DynamoDB state locks
- Keyless GitHub Actions & Jenkins pipelines utilizing OIDC role federation
- Production multi-tenant Amazon EKS & Azure AKS cluster administration
- Full distributed observability with Prometheus, Grafana, OpenTelemetry, and Loki
DevOps Incident & Diagnostics AI Agent
Autonomous Kubernetes incident triage powered by LangGraph & Model Context Protocol
FastAPI orchestration runtime coupling a stateful LangGraph agent graph with a custom Model Context Protocol (MCP) server that securely queries live Kubernetes APIs, Prometheus metrics, and vector embeddings.
45%
MTTD Reduction
MCP Native
Tool Protocol
LangGraph
Framework
- Automated root-cause analysis for CrashLoopBackOff, OOMKilled pods, and ingress network partitions
- Custom Model Context Protocol (MCP) server exposing cluster readouts directly as LLM tools
- Human-in-the-loop validation checkpoints before triggering any corrective patch commands
Self-Service Internal Developer Platform (IDP)
Standardized golden paths and automated ephemeral environments for engineering squads
Declarative developer portal combining Backstage service catalog, ArgoCD ApplicationSets, and Kubernetes Helm automation to deploy isolated ephemeral preview environments per Git pull request.
< 2 Days
Onboarding Time
< 2 Mins
Preview Deploy
99.99%
Reliability
- Self-service web portal enabling developers to spin up isolated preview stacks in under 2 minutes
- Standardized golden paths with pre-wired Prometheus metrics, Grafana dashboards, and Vault secrets
- Drastically compressed engineering onboarding from 3 weeks to under 2 days
Real-Time DevOps & Multi-Cloud Projects Hub
Enterprise production blueprints platform serving 250,000+ engineers worldwide
Production platform featuring automated GitHub Actions CI/CD workflows, modular multi-provider Terraform workspaces, and interactive architectural diagrams for hands-on learning.
40+
Blueprints
250k+
Global Reach
100% Terraform
IaC Coverage
- Curated 40+ production-grade blueprints across Kubernetes, GitOps, IaC, and observability
- Integrated security scanning using Trivy, SonarQube, and OWASP dependency verification
- Empowering a global community of over 250,000+ practicing DevOps and Platform engineers
- Tata Consultancy Services
Hybrid · Platform & AI Engineering
Lead DevOps & Platform Engineer
- Architected and implemented self-service Internal Developer Platform (IDP) templates with ArgoCD and Kubernetes, enabling squads to spin up ephemeral preview environments in minutes and reducing developer onboarding from 3 weeks to under 2 days.
- Engineered enterprise GitOps CI/CD delivery pipelines using GitHub Actions, ArgoCD, and Helm across multi-region AWS and Azure estates, accelerating deployment frequency by 65% while keeping deployment failure rates under 0.1%.
- Spearheaded internal GenAI developer tools and custom Model Context Protocol (MCP) servers, enabling engineering teams to inspect Kubernetes cluster health and cloud resources using natural language agents.
- Provisioned scalable AI infrastructure and LLMOps pipelines for local LLM inference (vLLM/Ollama) and embedding models with optimized container runtimes and GPU cluster scheduling.
- Implemented distributed observability and SRE monitoring across 80+ microservices with Prometheus, Grafana, OpenTelemetry, and Loki, dropping Mean Time to Detection (MTTD) by 45%.
- Governed multi-account AWS and Azure infrastructure via modular Terraform and policy-as-code, executing FinOps resource rightsizing that yielded 28% monthly cloud cost savings.
- IBM
Remote · Cloud & DevOps
DevOps & Cloud Engineer
- Automated multi-tier AWS cloud infrastructure provisioning (VPCs, EKS clusters, RDS Multi-AZ, ALB) using modular Terraform with DynamoDB state locking, eliminating configuration drift.
- Containerized 25+ microservices with multi-stage Docker builds, shrinking artifact image payloads by 65% and significantly accelerating Jenkins automated build and test cycles.
- Configured AWS EKS cluster networking, IAM Roles for Service Accounts (IRSA), ingress controllers, and Horizontal Pod Autoscalers (HPA) for high-traffic services.
- Automated build, test, and release artifact lifecycles with Jenkins and AWS ECR, integrating automated container vulnerability scanning and blue/green deployment patterns.
- Established SRE disaster recovery runbooks and CloudWatch automated alarms with SNS paging, sustaining 99.95% system uptime across client workloads.
- DEV Community
Community · Top Author
DevOps & AI Technical Writer / Community Lead
- Authored deep-dive technical articles on DevOps automation, Kubernetes cluster administration, Terraform, GenAI agents, and Model Context Protocol (MCP).
- Recognized as a Top Author and Community Leader with over 150,000+ reads and thousands of community discussions on real-world platform patterns.
- Created step-by-step hands-on tutorials helping engineers transition from traditional operations to modern Platform Engineering and AI systems.
- Hashnode
Community · Ambassador
Platform Engineering & AI Content Creator
- Published comprehensive architectural guides on GitOps, ArgoCD, LLMOps, autonomous AI agents, and production multi-cloud deployments.
- Cultivated a dedicated readership of 100,000+ engineers, delivering production-ready snippets, architecture diagrams, and open-source blueprints.
- Organized community learning challenges around Kubernetes, Terraform IaC, and emerging Agentic AI tooling.
Internal Developer Platform (IDP) & AI Agent Topology
End-to-end production architecture: GitOps CI/CD → Kubernetes Multi-Cloud → Autonomous AI Agents → Observability.
Production EKS / AKS
Multi-Tenant K8s Engine
High-availability compute cluster orchestrating stateless web services, background workers, and GPU inference pods.
- ›Cilium eBPF CNI for lightning-fast container networking & L7 policy
- ›Karpenter autoscaling provisioning EC2 spot & on-demand in seconds
- ›Multi-tenant namespace isolation with hard CPU/Memory ResourceQuotas
apiVersion: karpenter.sh/v1beta1
kind: NodePool
metadata:
name: gpu-inference-pool
spec:
template:
spec:
requirements:
- key: "node.kubernetes.io/instance-type"
operator: In
values: ["g5.xlarge", "g5.2xlarge"]- Platform Engineering
- Internal Developer Platforms (IDP)
- Backstage
- Developer Experience (DevEx)
- GitOps
- ArgoCD
- Self-Service Portals
- Golden Paths
- DevOps
- CI/CD Pipelines
- GitHub Actions
- Azure DevOps
- GitLab CI
- Jenkins
- Helm
- Argo Rollouts
- Release Automation
- AI Infrastructure
- LLMOps
- MLOps
- vLLM
- Ollama
- MLflow
- Vector Databases (Qdrant/Milvus/pgvector)
- RAG Pipelines
- GPU Cluster Management
- Generative AI
- AI Agents
- Agentic AI Systems
- Model Context Protocol (MCP)
- Agent2Agent (A2A)
- LangGraph
- LangChain
- Prompt Engineering
- Context Engineering
- Autonomous Workflows
- AI Automation
- AI Product Development
- Full-Stack AI Apps
- FastAPI
- Next.js AI SDK
- Interactive AI Agents
- Tool Calling & Function Calling
- Semantic Search
Certified Kubernetes Administrator (CKA)
CNCFActiveCloud Native Computing Foundation (CNCF)
Kubernetesetcd Backup/RestoreCluster HardeningCoreDNSNetwork Policies2023VerifyAWS Certified Solutions Architect – Associate
AWSVerifiedAmazon Web Services (AWS)
VPC PeeringAmazon EKSRDS Multi-AZIAM Zero-TrustRoute532022VerifyHashiCorp Certified: Terraform Associate
HashiCorpIaCHashiCorp
Terraform ModulesRemote State LockingDynamic BlocksIaC Testing2023VerifyGenerative AI & LLM Systems Specialization
DeepLearning.AIGenAIDeepLearning.AI & AWS
LangGraphLangChainModel Context Protocol (MCP)RAGPrompt Tuning2024VerifyGitHub Actions & CI/CD Automation Specialist
GitHubCI/CDGitHub
OIDC Keyless AuthCustom Action WorkflowsSelf-Hosted RunnersSecurity Scanning2023Verify
A dedicated platform featuring real-time enterprise DevOps & Cloud projects, spanning CI/CD, Kubernetes orchestration, Terraform IaC, and SRE monitoring.
- AWS
- Terraform
- Docker
- Kubernetes
- DevOps
- ArgoCD
Autonomous AI agent powered by LangGraph and Model Context Protocol (MCP) to troubleshoot Kubernetes pod failures, inspect cluster logs, and formulate remediation plans.
- Python
- LangGraph
- MCP
- Kubernetes
- FastAPI
- LLMOps
900+ handpicked resources, architecture blueprints, and docs for AWS, Azure, and DevOps — learning content for engineers at all levels.
- AWS
- Azure
- DevOps
- Docs
- Platform Engineering
Major repositories curated and organized — from automation scripts to infra as code to interview prep.
- GitHub
- DevOps
- Terraform
- Automation
Beginner → advanced real-world DevOps projects for hands-on learning with production architectures.
- DevOps
- Projects
- Kubernetes
- CI/CD
Production-grade AWS deployments and hands-on cloud projects for platform engineering and certification prep.
- AWS
- DevOps
- Terraform
- EKS
Comprehensive DevOps interview guide covering Linux, AWS, Kubernetes, Terraform, Docker, and platform design.
- DevOps
- Interview
- Kubernetes
- Linux
Step-by-step Kubernetes roadmap and CKA preparation from beginner to production cluster administration.
- Kubernetes
- Helm
- Docker
- GitOps
Hands-on learning path from containerization fundamentals to real-world Kubernetes deployments.
- Docker
- Kubernetes
- Containers
Ready-to-use monitoring platform — Prometheus, Grafana, Loki, Alertmanager, and Node Exporter with one command.
- Prometheus
- Grafana
- Loki
- Observability
- AWS | GCP | Azure — Cloud Projects WorkshopNewgithub.com/NotHarshhaa/AWS-GCP-Azure-Cloud-Projects-Workshop
Hands-on multi-cloud projects designed for real-world experience, portfolio building, and enterprise certifications.
- AWS
- GCP
- Azure
- Terraform
- DevOps
- DevOps Environment Toolkit for Beginnersgithub.com/NotHarshhaa/devops-environment-toolkit-beginners
Ready-to-use local environment setup script with essential CLI tools, container runtimes, and linters.
- DevOps
- Automation
- Bash
- Docker
- Awesome DevOps Cloud UIgithub.com/NotHarshhaa/awesome-devops-cloud-ui
Curated catalog of top open-source GUI and web-based tools for Kubernetes management, CI/CD visualization, and cloud operations.
- DevOps
- UI Tools
- Kubernetes
- Cloud
- AWS Terraform Workshopgithub.com/NotHarshhaa/AWS-Terraform-Workshop
Modular, battle-tested guide to setting up production AWS infrastructure using declarative Terraform.
- Terraform
- AWS
- IaC
- DevOps
- CI/CD on EKS using GitHub Actionsgithub.com/NotHarshhaa/CI-CD_EKS-GitHub_Actions
Automated CI/CD pipeline for building, testing, and deploying microservices to Amazon EKS using GitHub Actions and Helm.
- CI/CD
- EKS
- GitHub Actions
- Terraform
- Kubernetes
- Amazon EKS Cluster with Terraformgithub.com/NotHarshhaa/eks-cluster-terraform
Production-ready Terraform module for provisioning highly available Amazon EKS clusters with managed node groups.
- Terraform
- EKS
- Kubernetes
- AWS
- DevOps Tools Collectiongithub.com/NotHarshhaa/devops-tools
Comprehensive collection of essential DevOps utilities for build automation, deployment, monitoring, and security.
- DevOps
- Automation
- Linux
- Security
- DevOps Cheatsheetgithub.com/NotHarshhaa/devops-cheatsheet
High-density, quick-reference DevOps cheatsheets covering Docker, Kubernetes, Terraform, Linux commands, and CI/CD.
- DevOps
- Cheatsheets
- Kubernetes
- Linux
- Terraform
- DevOps Interview Questionsgithub.com/NotHarshhaa/DevOps-Interview-Questions
550+ scenario-based DevOps and Platform Engineering interview questions with in-depth technical explanations.
- DevOps
- Interview
- Kubernetes
- Terraform
- CI/CD
- Certified Kubernetes Administrator (CKA) Prepgithub.com/NotHarshhaa/Certified_Kubernetes_Administrator
Hands-on lab repository and exam guide to mastering Kubernetes cluster administration and passing the CKA certification.
- Kubernetes
- CKA
- Cluster Admin
- Linux
- DevOps Tool Installer Scriptsgithub.com/NotHarshhaa/DevOps-Tool-Installer
Automated installation and verification scripts for essential DevOps & cloud tools on Linux and Windows.
- Automation
- Linux
- Bash
- PowerShell
- Azure Cloud Resources Hubgithub.com/NotHarshhaa/azure-all_in_one
Curated list of Azure platform resources, architecture blueprints, CLI commands, and enterprise best practices.
- Azure
- Cloud
- DevOps
- AKS
- ECR to ECS Deployment with GitHub Actionsgithub.com/NotHarshhaa/tf-ecr-ecs-gh-deploy
Automated deployment pipeline for containerized Python applications to AWS ECS Fargate using GitHub Actions and Terraform.
- Terraform
- ECS
- GitHub Actions
- Docker
- AWS
250K+
Global Readers
Engineers reached worldwide across Hashnode & DEV.to
120+
Technical Guides
In-depth architecture blueprints and troubleshooting tutorials
40+
Open Source Repos
Production templates, Helm charts, and IaC blueprints
Top Author
Community Awards
Recognized technical voice & DevOps ambassador
Dedicated to demystifying enterprise Platform Engineering, GitOps automation, and production Agentic AI systems through open-source blueprints and reproducible architectures. Championing developer experience, continuous learning, and practical production engineering for the global tech community.
Jawaharlal Nehru Technological University Hyderabad (JNTUH)
Bachelor of Technology, Mechanical Engineering
- Built a strong quantitative foundation in engineering principles, systems dynamics, and algorithmic problem-solving.
- Pivoted computational modeling and systems logic into cloud infrastructure, automated delivery pipelines, and platform engineering.
- Led hands-on technical workshops and collaborative engineering initiatives, fostering an enduring commitment to open-source software delivery.
Command Palette
Search for a command to run...