👋 Hello, I'm

Yash Shah

Cloud Automation & DevOps Engineer

@ DataHub LLC (IBM Partner) | Former Intern @ Zipline | MS CS, Cal State LA

Yash Shah
Available for hire

Cloud Automation & DevOps Engineer at DataHub LLC (an IBM Partner), specializing in automation, cloud infrastructure, and AI/ML pipelines. Former Software Engineer Intern at Zipline - the world's leading autonomous drone delivery company.

M.S. Computer Science graduate of Cal State LA, where I served as Research Assistant, Teaching Assistant, and Graduate Assistant.

Let's Work Together Download Resume View Research
Current Role DataHub LLC
MS Computer Science Cal State LA
Former Intern Zipline
1.7+ Years DevOps Experience

Work Experience

Professional journey and key achievements

Jun 2026 - Present

DataHub LLC

IBM Partner · Cloud Automation & DevOps
Chicago, IL

Cloud Automation & DevOps Engineer

  • Leading an Oracle-to-CockroachDB migration on IBM Cloud, using Terraform and MOLT for bulk migration plus a real-time CDC pipeline syncing changes in under 15 seconds
  • Built an internal AI-powered troubleshooting agent that investigates Kubernetes clusters supporting the Redshift data platform, returning root cause, fix, and a ready-to-run kubectl command with a confidence score
Oracle CockroachDB IBM Cloud Terraform Docker CDC FastAPI
Aug 2025 - May 2026

Cal State LA College of ECST

California State University
Los Angeles, CA

Research Assistant - Intelligent Water Management

Conducting research on intelligent water management with focus on leak detection and prevention. Designing and testing innovative methods to minimize water wastage through data-driven solutions.

Teaching Assistant - Introduction to Operating Systems

Evaluating and grading student assignments and examinations, ensuring consistency, accuracy, and fairness in the assessment process.

Graduate Assistant - MLOps

Sep 2024 - May 2026

Designed and maintained microservices and CI/CD pipelines on AWS with automated testing and containerized deployments, improving system uptime by 20%. Built an AI-driven book recommendation system using Python, Flask, and the Gemini API, enhancing recommendation accuracy by 25% and reducing environment configuration errors by 35% via Docker-based automation.

Python AWS Flask Docker Gemini API MLOps Data Science
May 2025 - Aug 2025

Zipline

Autonomous Drone Delivery
San Francisco Bay Area

Software Engineer Intern

Worked at the world's leading autonomous drone delivery company that has made millions of deliveries globally.

  • Developed automation for distributed validation systems using Python and TypeScript for connectivity checks, health monitoring, and configuration deployment, reducing manual intervention by 30% and improving reliability
  • Enhanced observability by integrating Grafana, Prometheus, and Datadog dashboards and metrics pipelines, cutting failure diagnosis time by 25% across distributed environments spanning 330+ locations
  • Built an automated resource allocation system that ran network connectivity, availability, and health checks before assignment, increasing infrastructure utilization efficiency by 40% and eliminating manual coordination for 50+ engineers
  • Optimized CI/CD pipelines using Bazel and GitHub Actions, achieving 30% faster build cycles and improving deployment consistency across distributed validation environments supporting millions of requests daily
Python TypeScript GitHub Actions Bazel Grafana Prometheus Datadog
Read My Zipline Journey
Jun 2023 - Jul 2024

Squadron Technology

DevOps & Cloud Solutions
On-site

DevOps and Cloud Data Engineer

  • Optimized Python-based ETL tool for Azure Blob Storage, increasing data processing efficiency by 30%
  • Enhanced AWS and Docker systems reducing data retrieval times by 50%
  • Designed and deployed high-availability database system using Percona XtraDB, cutting downtime by 40%
  • Automated CI/CD pipelines with GitHub Actions, reducing release cycles by 70%
  • Implemented real-time data streaming with Apache Kafka, significantly reducing latency
Python Azure AWS Docker Percona XtraDB Apache Kafka Grafana
May 2021 - Jun 2021

Ownux Infosec Private Limited

Cybersecurity Solutions
Ahmedabad, Gujarat, India

Software Developer Intern

  • Created Flask API integrated with Selenium to automate social media verification, boosting efficiency by 40%
  • Deployed scalable applications on AWS ECS containers, ensuring high availability and optimal performance
  • Collaborated with engineering teams to deliver reliable, high-performance solutions
Flask Selenium AWS ECS Python
💼 Portfolio

Featured Projects

Explore my comprehensive portfolio of technical projects across AI/ML, Cloud Infrastructure, DevOps, and Data Engineering

97+
Projects
7
Companies
100+
Technologies
Zipline

Jira Automation & Label Synchronization Platform

Built GitHub Actions–driven automation using Python to synchronize HIL runner states with Jira epics, eliminating manual status updates and preventing label drift. Enforced credential validation and modularized Jira utilities, improving workflow reliability and reducing inconsistent state transitions.

Python GitHub Actions REST API Jira
Zipline

HIL Claim Automation & Resource Management System

Redesigned the HIL claim workflow by implementing automated selection, pool protection rules, and capability-based validation, ensuring safe and correct resource allocation. Unified RTS, RFS, and claim logic with Bazel execution, simplifying maintenance and improving reliability under concurrent usage.

Python Bazel GitHub Actions HIL Testing
Zipline

CI/CD Scaling & GitHub Actions Optimization

Optimized CI pipelines by removing SSH-based execution, introducing Bazel-driven workflows, and mitigating GitHub API rate limits at scale. Improved pipeline performance and stability by streamlining runner discovery and eliminating unnecessary cache generation across administrative workflows.

GitHub Actions Bazel Python CI/CD
Zipline

HIL Observability, Dashboard & Notifications Platform

Enhanced an internal observability dashboard by aggregating runner state, rotation data, and claim progress into a unified view for operators. Integrated Slack notifications with user resolution and caching to deliver timely, accurate updates and improve system visibility.

Python GitHub Actions Slack API Observability
Zipline

Automation Scripts & Deployment Safety Toolkit

Built automation scripts to extract hardware metadata, validate configurations, and generate structured inventories for infrastructure cleanup. Improved deployment safety by hardening Ansible workflows and filtering protected resources, reducing accidental execution and configuration errors.

Python Ansible Shell Scripting Automation
NASA JPL-Funded

YOLOv11 Lunar Detection Pipeline

Built an end-to-end lunar object detection pipeline using YOLOv11 to identify craters, pits, and rocks in NASA LROC imagery with automated inference workflows. Integrated SPICE for precise lunar geolocation and Roboflow for dataset management, leading model training, optimization, and deployment across CPU/GPU environments for scalable lunar analysis.

Python YOLOv11 Computer Vision SPICE NASA
SITI-Funded

Intelligent Leak Detection & Localization System

Built an end-to-end MLOps pipeline for IoT leak detection using acoustic and pressure sensor data from Raspberry Pi nodes, orchestrating data ingestion, model versioning, and MLflow tracking. Containerized FastAPI inference with Docker and DockerHub, achieving 100% detection accuracy and 90%+ localization accuracy across digital twin simulations and a real-world IoT testbed.

Python IoT MLflow FastAPI Docker Raspberry Pi

AI-Augmented Bibliotherapy Platform

Built an AI-driven bibliotherapy system using NLP and embedding models to analyze large-scale text corpora (e.g., Project Gutenberg) and extract emotional and thematic patterns. Implemented sentiment analysis, character recognition, clustering, and embedding-based retrieval pipelines to recommend books aligned with users' emotional experiences and mental health needs.

Python NLP Embeddings Topic Modeling AI/ML

Cloud Agnostic AI IoT Kubernetes Platform

Designed and implemented a private multi-tenant Kubernetes platform to modernize a complex AI IoT stack built on 30+ open-source AI and data tools, enabling cloud-agnostic deployment, scaling, and authentication. Integrated distributed systems such as Hadoop, Spark, Flink, and Kafka with monitoring dashboards including Grafana, Superset, and Kibana, automating infrastructure using Terraform and Python.

Kubernetes Terraform Python Hadoop Spark Kafka

PharmaSaver Prescription Price Intelligence Platform

Developed a prescription price comparison platform using Python and Selenium WebDriver to extract medication pricing from dynamic healthcare websites, handling JavaScript content and anti-scraping mechanisms, and implemented regex-based parsing with structured storage to standardize pricing for accurate comparison and lowest-cost identification.

Python Selenium Regex CSV JSON
Squadron Technology

SQOR GitLab CI/CD & Cloud Deployment

Improved SaaS backend performance by refactoring workflows and orchestrating asynchronous processing using AWS Step Functions. Built a GitLab CI/CD pipeline for containerized deployments and deployed the application on AWS ECS with Route 53 DNS routing, ensuring high availability and reliable releases.

AWS ECS Step Functions GitLab CI/CD Route 53
Squadron Technology

CloudTrafficMonitor - Serverless Traffic Monitoring API

Built a serverless REST API using AWS API Gateway and Lambda to ingest and process roadside traffic data with scalable request handling. Secured data access using AWS Cognito and automated CI/CD with CodePipeline, enabling reliable deployments and efficient traffic data analysis.

AWS API Gateway Lambda Cognito CodePipeline
Ownux Infosec

Social Media Details API

Built a REST API using Flask and a lightweight NoSQL datastore to validate email addresses and retrieve linked social media profiles across major platforms. Integrated Selenium-based web automation to collect real-time account data, enabling fast, secure verification and detection of fraudulent or fake emails.

Python Flask NoSQL Selenium REST API

Database Cluster & Load Balancing Platform

Built a 3-node Percona XtraDB cluster on Rocky Linux using Galera replication, configuring networking, firewalls, and secure SSL/TLS communication. Implemented ProxySQL for database load balancing and integrated Prometheus and Grafana to monitor cluster health, replication status, and performance metrics.

Percona XtraDB ProxySQL Galera Prometheus Grafana

Kubernetes Application Deployment

Deployed a containerized Node.js application and MongoDB database on Kubernetes across AWS EC2 nodes, enabling automated orchestration and service management. Automated infrastructure provisioning using Terraform and shell scripts, achieving high availability, load balancing, and fault tolerance with improved resource utilization and reduced downtime.

Kubernetes AWS EC2 Terraform Docker MongoDB

Edustaff E-Learning Platform

Built a role-based e-learning platform using Node.js that automatically routed users to training courses with video playback, progress tracking, and certification upon completion. Deployed on AWS EC2 with RDS for persistent storage and automated infrastructure provisioning using Terraform, enabling scalable and consistent deployments.

Node.js AWS EC2 RDS Terraform

Microcouriers Courier Application

Developed a courier management application using Node.js that enabled users to create, update, and delete delivery orders with persistent storage in MySQL. Containerized the application using Docker and published images to Docker Hub, ensuring consistent deployments and simplified version management.

Node.js MySQL Docker Docker Hub

Kafka Streaming & Data Processing Pipeline

Built a local and containerized Apache Kafka setup with producers and consumers, integrating Python to stream JSON data and persist messages into MySQL for downstream processing. Implemented stream processing using KSQL (CLI and Docker-based) to create streams and tables, transform data in real time, and validate end-to-end data flow across Kafka topics.

Apache Kafka Python MySQL KSQL Docker

Ecom360 E-Commerce Analytics Platform

Built a full-stack analytics platform using Node.js and React that ingested E-Commerce data and extracted structured information from invoices and documents using AWS Textract. Designed and integrated a hybrid data layer using Supabase and MySQL to store orders, revenue, returns, and inventory metrics with efficient querying and historical tracking.

Node.js React AWS Textract Supabase MySQL Docker

AWS LAPD Transcript Intelligence Pipeline

Developed an NLP pipeline using Python, AWS Bedrock, and LangChain to process and index 43+ LAPD court transcripts, automating transcript cleaning, chunking, and enrichment workflows. Built FAISS vector indexes with in-memory S3 streaming and integrated LLM-powered retrieval, reducing manual legal document analysis by 40%.

Python AWS Bedrock LangChain FAISS Amazon S3

HIPAA-Compliant Healthcare Platform on AWS

Built a HIPAA-compliant AWS platform with isolated Dev/Prod environments using VPCs, EC2, RDS, and S3. Implemented ALB, WAF, IAM, SSM Parameter Store, Auto Scaling, and CloudWatch monitoring for healthcare systems, and automated infrastructure and deployments using Terraform, CloudFormation, CodePipeline, CodeBuild, and CodeDeploy.

AWS ECS Terraform CloudFormation WAF IAM

Weather API CI/CD Deployment on Amazon EKS

Built and deployed a weather API using Flask, Terraform, and Amazon EKS, automating Kubernetes infrastructure provisioning and Jenkins-based CI/CD workflows on AWS. Integrated GitHub-driven deployment pipelines and Python automation scripts using boto3, reducing manual infrastructure management effort by 40%.

Terraform Jenkins AWS EKS Flask Docker

Distributed Data Processing System

Built a scalable ETL pipeline using Azure Blob Storage and TigerGraph to automate ingestion, validation, and transformation with Pydantic-based rules. Designed microservices with modular preprocessors and change data capture, enabling real-time processing, improving efficiency by 30%, and reducing manual operations by 60%.

Python Azure TigerGraph REST API Microservices

Intelligent Water Leak Detection & Localization System

Developed a multi-sensor machine learning system for real-time leak detection and localization using acoustic and pressure data, integrating EPANET simulations, gRPC communication, and a Raspberry Pi-based testbed. Built data pipelines and Random Forest models achieving up to 100% detection accuracy and 90%+ localization accuracy across simulated and real-world environments.

Python ML IoT EPANET Raspberry Pi

Galera Cluster Setup & MySQL WSREP Configuration

Configured a Galera multi-node database cluster using MySQL WSREP, managing repository keys, package sources, and installation on Linux systems. Tuned security settings by modifying AppArmor policies to enable clustering, ensuring high availability, synchronous replication, and reliable distributed database performance.

Linux MySQL Galera AppArmor Networking

Automated Billing Data Extraction & Generation System

Built a Python-based pipeline to extract billing data using AWS Textract from scanned documents and populate MySQL tables with structured records. Integrated configuration-driven processing, synthetic data generation using Faker, and billing logic for usage, charges, and due-date calculations, enabling scalable ingestion and validation of billing data across multiple clients and yearly cycles.

Python MySQL AWS Textract SQL Faker

Percona PMM Server Deployment with Docker

Deployed and configured Percona Monitoring and Management (PMM) server using Docker, managing persistent volumes and container lifecycle for reliable monitoring services. Validated container health, configured firewall rules for secure port exposure, and ensured seamless access to monitoring dashboards across Linux-based environments.

Docker Linux Networking Monitoring

Site-to-Site IPSec VPN & Firewall Routing Configuration

Configured a secure site-to-site IPSec VPN between a Cisco router and ASA firewall using IKEv1, pre-shared keys, crypto maps, and ACL-based traffic policies. Implemented static routing, VLAN interfaces, DHCP, and firewall access controls to enable secure connectivity between remote subnets, improving network segmentation and reliable inter-site communication.

Cisco ASA IPSec IKEv1 ACLs Static Routing

Snowflake Data Pipeline Optimization & Streaming Integration

Designed advanced Snowflake ingestion pipelines using Snowpipe with transformation logic for handling duplicate files, data enrichment via joins, and dynamic data type conversions. Integrated Kafka as a streaming source and implemented monitoring using COPY_HISTORY and pipe status functions, along with SCD Type 2 modeling to track historical changes, improving data reliability and auditability across large-scale pipelines.

Snowflake SQL Snowpipe Kafka AWS

Kubernetes Spark Operator Debugging & Resource Management

Managed and debugged Kubernetes workloads using kubectl, including service account cleanup, service inspection, and log analysis for Spark jobs. Troubleshot Spark Operator deployments by analyzing driver logs, validating service configurations, and handling resource lifecycle operations, improving reliability and observability of distributed compute workloads.

Kubernetes kubectl Spark YAML

Bibliotherapy Gutenberg Indexing & RAG Platform

Built a scalable Python-based pipeline to acquire and preprocess Project Gutenberg books using rsync, multiprocessing, and chunked text processing for large-scale indexing. Integrated LlamaIndex with the Gemini API to power RAG-based search and response generation, deploying a Flask API with caching, authentication, and Terraform-managed AWS infrastructure for reliable querying at scale.

Python Flask LlamaIndex Gemini API AWS

AWS CLI Installation & Secure Configuration Automation

Developed a structured setup workflow for installing and configuring AWS CLI on Windows using PowerShell, incorporating secure credential management and environment validation. Enhanced configuration with IAM best practices, profile management, and region-specific defaults, enabling streamlined access to AWS services and improving developer onboarding across cloud environments.

AWS CLI PowerShell IAM Windows

Searchable & Order-Preserving Encryption Systems

Implemented Searchable Symmetric Encryption (SSE) using HMAC-based indexing to enable keyword search over encrypted datasets, ensuring data confidentiality without decryption. Developed a prototype Order-Preserving Encryption (OPE) scheme to support range queries on encrypted numerical data, demonstrating secure query execution while balancing privacy and usability in cloud-based storage systems.

Python Cryptography HMAC Data Security

Serverless ETL Data Migration Pipeline

Built a scalable ETL pipeline using Python and AWS Lambda, orchestrated via Step Functions to ingest and replicate data from PostgreSQL to Snowflake. Provisioned infrastructure using Terraform, integrated dbt for transformations, and leveraged SNS, Secrets Manager, and Redis caching to improve reliability, performance, and secure data processing across production environments.

Python AWS Lambda Step Functions Snowflake PostgreSQL

GCP IAM User Lifecycle Automation

Built Bash-based automation to audit GCP IAM policies, identify inactive users across projects, and enforce account suspension or removal based on last-login activity. Leveraged gcloud commands and jq parsing to streamline cross-project access reviews, improving security posture and reducing manual administration in large-scale cloud environments.

Bash GCP IAM gcloud jq

Elastic Beanstalk Application Versioning with Terraform

Implemented application versioning workflows using Terraform by importing production WAR artifacts into S3 and managing version creation for Elastic Beanstalk environments. Automated configuration of application versions with bucket-based artifacts, enabling reliable deployments, rollback capability, and consistent version tracking across production and sandbox environments.

Terraform AWS S3 Elastic Beanstalk CI/CD

NVIDIA DGX Access Automation via Tailscale VPN

Developed and documented a secure access workflow for NVIDIA DGX GPU servers using Tailscale VPN and SSH, enabling seamless remote connectivity without traditional VPN setup. Standardized onboarding steps, authentication, and troubleshooting procedures, ensuring reliable access to high-performance compute resources for distributed users across lab environments.

Linux Tailscale SSH GPU Infrastructure

Terraform AWS Infrastructure Deployment

Designed and deployed cloud infrastructure using Terraform, provisioning ECR repositories, ECS clusters, task definitions, and Fargate-based services. Configured networking, IAM roles, and container workflows to enable secure and reliable deployments, integrating CloudWatch insights for monitoring and improving service availability across distributed environments.

Terraform AWS ECS ECR Fargate CloudWatch

DBT on ECS Deployment Automation

Built and deployed a containerized DBT workload on AWS ECS using Docker and Bash automation, packaging project dependencies and pushing versioned images to ECR for repeatable releases. Configured Fargate task definitions, IAM execution roles, and CloudWatch logging to run secure, scalable data transformation services across managed container environments.

Docker AWS ECS ECR Fargate Bash

Email Intelligence API & Web Scraping Platform

Developed a secure Flask-based API for email analysis and social account detection, implementing authentication, session management, and asynchronous AJAX workflows. Integrated Selenium-driven scraping and SMTP/MX record validation to verify email existence and extract social presence, delivering structured insights with high accuracy across distributed web data sources.

Python Flask Selenium SMTP SQLite

AWS Cloud Security Analysis & Zero Trust Implementation

Analyzed critical AWS security challenges including misconfigurations, IAM risks, and expanding attack surfaces, designing solutions using Zero Trust principles, encryption, and least-privilege access. Implemented secure architectures with VPC isolation, KMS-based encryption, and continuous monitoring via GuardDuty and CloudTrail, improving threat detection and strengthening data protection across cloud environments.

AWS IAM VPC KMS GuardDuty

Elastic Beanstalk Deployment with Terraform

Built infrastructure automation using Terraform to deploy AWS Elastic Beanstalk environments, provisioning IAM roles, instance profiles, and application resources through modular configuration files. Extended networking setup with VPC, subnet, route table, internet gateway, and Auto Scaling configurations, enabling reliable deployments across multiple availability zones.

Terraform AWS Elastic Beanstalk IAM VPC Auto Scaling

GitHub Suspended User Cleanup Automation

Built automation workflows using Python to retrieve suspended users via GitHub APIs and map them to organizations, enabling structured cleanup across environments. Leveraged audit account privileges for safe user deletion and integrated SMTP-based notifications, improving administrative efficiency and ensuring secure operations across multiple organizations.

Python REST APIs AWS GitHub API SMTP

Secure SSL Communication Protocol Simulation

Developed a simplified SSL communication system using Python, RSA encryption, and socket programming to enable secure client-server authentication and encrypted message transfer. Implemented public-private key exchange, one-time session key generation, and hash-based integrity verification, improving secure data transmission reliability and tamper detection by 35%.

Python RSA Hashing Socket Programming

Cloud-Based Scalable Document Processing and Q&A System

Developed a scalable document intelligence platform using Flask and FAISS to enable semantic search and question answering over multi-format documents (PDF, CSV, JSON, DOCX), integrating Gemini embeddings for vector generation, AWS S3 for storage, and caching mechanisms to achieve sub-5-second query latency with containerized deployment on Koyeb.

Python Flask FAISS AWS S3 Gemini API

AWS ECS Cost Optimization & Monitoring Platform

Designed a cloud cost monitoring platform using AWS ECS, ECR, and CloudWatch to analyze container workload expenses and infrastructure utilization metrics. Automated cost estimation workflows for ECS tasks, container storage, and monitoring services, enabling optimized resource allocation and reducing projected platform costs by 30%.

AWS ECS ECR CloudWatch Python Terraform

Roadside IoT Traffic Analytics API Platform, AVA

Built data extraction APIs over roadside IoT sensor tables covering lane vehicle counts, turning movements, and intersection data across 24K records per table via Lambda endpoints. Secured all routes with Cognito bearer token auth and automated dev/prod/QA deployments via AWS CodePipeline and separate serverless stacks.

Python AWS Lambda API Gateway Cognito Boto3

IBM Cloud Kubernetes Liberty Deployment

Built a Kubernetes cluster deployment workflow using IBM Cloud Kubernetes Service. Created a free cluster, deployed a WebSphere Liberty container through the Kubernetes Dashboard, added service YAML configuration, verified pod and service creation, and accessed the running Liberty application through worker node public IP and service port details.

IBM Cloud Kubernetes WebSphere Liberty YAML Dashboard

Cloud Service Provider Security Assessment

Prepared a cloud service provider security comparison covering security controls across Google Cloud, Microsoft Azure, and AWS. Analyzed identity and access management, encryption, data loss prevention, virtual networking, firewalls, DDoS protection, security monitoring, vulnerability assessment, and cloud-native threat detection services.

Cloud Security AWS Azure GCP IAM

IBM Kubernetes LogDNA Logging Integration

Configured centralized logging for an IBM Cloud Kubernetes cluster using IBM Cloud CLI and the observability plugin. Installed required plugins, downloaded cluster configuration, targeted the resource group, created a LogDNA service instance, connected it to the cluster, inspected daemon sets, and verified application logs through integrations.

IBM Cloud CLI Kubernetes LogDNA Plugins Observability

IBM Cloud Activity Tracker Event Monitoring

Implemented event monitoring for IBM Cloud Kubernetes operations using Activity Tracker. Created the tracking service, authenticated through IBM Cloud CLI, updated container-service tooling, changed API key and region configuration, opened the dashboard, and validated reflected audit events for worker nodes, load balancers, and cluster details.

IBM Cloud Activity Tracker Kubernetes Audit Logs CLI

Application Log Analysis and Health Monitoring

Built a Kubernetes application monitoring setup by creating an IBM Cloud cluster, provisioning Log Analysis, and installing container, registry, and observe-service plugins. Linked the cluster to LogDNA, deployed an application under the IBM observe namespace, verified pods and services, and reviewed application logs for health visibility.

IBM Cloud Kubernetes LogDNA Container Registry Observability

Kubernetes Network Policy Inspection with Calico

Configured network-access inspection for Kubernetes applications on IBM Cloud by retrieving cluster configuration and preparing Calico tooling. Used calicoctl to list namespace policies, inspect Kubernetes NetworkPolicy resources, review kube-system policy YAML, and audit GlobalNetworkPolicy configuration across the cluster.

IBM Cloud Kubernetes Calico NetworkPolicy CLI

Kubernetes Network Access Restriction Rules

Implemented network restriction policies for a Kubernetes application by creating policies, deploying and exposing NGINX, and testing connectivity with BusyBox. Blocked default traffic, verified inbound restrictions, allowed controlled egress and ingress paths, retested access to NGINX and external sites, then deleted policies and namespaces after validation.

Kubernetes Calico NGINX BusyBox Ingress/Egress

IBM Cloud App ID Kubernetes Binding

Configured an IBM Cloud App ID integration workflow for a Kubernetes application. Authenticated with IBM Cloud CLI, listed and configured the cluster, targeted the resource group and region, created a namespace, provisioned a sample App ID instance, bound it to the namespace, and cloned the application repository for deployment preparation.

IBM Cloud Kubernetes App ID Namespaces Git

IBM Cloud Object Storage IAM Configuration

Configured identity and access management for IBM Cloud Object Storage by creating a storage bucket, selecting location and storage class, and generating service credentials with Reader and Manager roles. Managed access settings, edited credential metadata, and validated role-based CLI authentication using reader API keys.

IBM Cloud Object Storage IAM Service Credentials API Keys

Envelope Encryption with IBM Cloud Key Protect

Implemented an envelope encryption setup using IBM Cloud Key Protect. Created the Key Protect service, added a root key, generated API key credentials, cloned the supporting repository, updated configuration values, sourced the setup script, and executed the encryption configuration workflow.

IBM Cloud Key Protect Root Keys API Keys Encryption

Container Image Vulnerability Remediation

Built a container and image security workflow using IBM Cloud Container Registry. Created registry namespaces, built and pushed an application image, scanned for vulnerabilities, used Hadolint to identify Dockerfile issues, updated the Dockerfile, rebuilt and repushed the image, and confirmed vulnerability removal after remediation.

IBM Cloud Container Registry Docker Hadolint Image Security

Signed Image Policy Enforcement with Portieris

Configured signed container image enforcement for a Kubernetes cluster using GPG keys, Skopeo, Helm, and Portieris. Generated signing keys, copied and signed images, created Kubernetes secrets from public key material, applied image-policy YAML and daemon set resources, and verified unsigned image tags were rejected by policy.

IBM Cloud Kubernetes GPG Skopeo Image Policy

Encrypted Container Images with Skopeo

Built an encrypted container image workflow by generating public/private keys, pulling an image, encrypting it with Skopeo, and pushing it to a local registry. Exported the encrypted image, tested failed decryption with incorrect key material, and validated successful decryption using the correct private key.

Skopeo Container Registry Public Keys Private Keys Image Encryption

Containerd Image Encryption Validation

Configured containerd-based image encryption testing by installing containerd, updating runtime configuration, generating public key material, encrypting container images, and inspecting layer metadata to confirm encryption. Tested image access with and without key flags to validate encryption enforcement and decryption behavior.

containerd Image Encryption OCI Layers Key Management Runtime Config

Calico Traffic Control on Classic Kubernetes Clusters

Implemented Calico network policies for traffic control on IBM Cloud Classic Kubernetes clusters. Deployed a webserver workload, exposed it through load balancer and NodePort services, tested worker and load balancer connectivity, applied blocklist and allowlist GlobalNetworkPolicy files, patched external traffic policy, and cleaned up network policies after validation.

IBM Cloud Kubernetes Calico GlobalNetworkPolicy Load Balancers

Secure Multi-Region Kubernetes with IBM Cloud Internet Services

Built a secure multi-region Kubernetes deployment workflow using IBM Cloud Internet Services. Built and pushed application images, deployed hello-world services across clusters, configured ingress and global load balancer pools, added health checks for US and UK origins, enabled WAF with OWASP rules in simulate mode, and documented resource cleanup.

IBM Cloud Kubernetes CIS WAF Global Load Balancing

JAX-RPC Interest Calculator Web Service

Built a SOAP-based Java web service application for calculating simple interest using principal, rate, and time inputs. Implemented the service operation with Java web service annotations, deployed it on a local server, exposed the WSDL endpoint, and created a JSP-based client to invoke and display the calculated result dynamically.

Java JAX-RPC SOAP WSDL JSP

REST Calculator Microservice

Built a URL-driven calculator microservice exposing addition, subtraction, and multiplication operations through REST endpoints. Implemented JAX-RS resource routes with path parameters and response handling, deployed the service using Eclipse Codewind in VS Code, and validated endpoint outputs through local testing.

Java JAX-RS REST APIs Eclipse Codewind VS Code

Asynchronous CSV File Management System

Built asynchronous Node.js file-management workflows for grocery product records stored in CSV files. Read and wrote product data using csv-parser and csv-writer, then implemented delete and rename operations to manage inventory files through scripted filesystem utilities.

Node.js File System CSV Parser Async I/O

HTTPS/SSL Secured Node.js Website

Built an HTTPS-enabled Node.js deployment by generating RSA private keys and signed SSL certificates with OpenSSL. Connected certificate assets to an Express HTTPS server, configured secure local hosting on port 3000, and verified browser certificate behavior for encrypted website access.

Node.js Express HTTPS OpenSSL SSL Certificates

MongoDB Employee CRUD Management

Built employee-record management operations using Node.js and MongoDB for inserting single and multiple employees, viewing records, filtering by regex-based name/address queries, and deleting single or bulk records. Connected to a local MongoDB database and validated each admin workflow through scripted outputs.

Node.js MongoDB CRUD Queries NoSQL

JSON User Records REST API

Built Express-based REST endpoints for managing website user records stored in a JSON file. Implemented routes to list all users, fetch individual users by ID, add new visitor profiles, and delete selected users while parsing and updating JSON data through Node.js file operations.

Node.js Express REST APIs JSON File I/O

MySQL Customer CRUD System

Built customer-record management scripts for an online clothing workflow using Node.js and MySQL. Created database/table schemas, inserted single and bulk customers, queried records by order ID and address patterns, sorted customers alphabetically, and deleted records using SQL commands through the mysql connector.

Node.js MySQL SQL CRUD Database Queries

Docker BusyBox Container Operations

Practiced Docker image and container lifecycle operations using the BusyBox base image. Pulled images from Docker registry, ran command-based containers, listed active and stopped containers, and removed unused container/image artifacts through Docker CLI commands.

Docker BusyBox Containers Images CLI

Dockerized Flask Image Application

Built a Flask web application that renders random image content through a Jinja template, then packaged it into a Docker image using an Alpine base. Wrote requirements and Dockerfile configuration, exposed port 5000, ran the container with host port mapping, and pushed the image to Docker Hub.

Python Flask Docker Alpine Linux Docker Hub

Docker Swarm Voting Application Deployment

Deployed a voting application on Docker Swarm using existing Docker Store images and a Compose stack file. Created the swarm workflow, configured desired application state through docker-stack.yml, deployed the stack with docker stack deploy, tested the running service, and removed the stack cleanly.

Docker Swarm Docker Compose Stack Deploy Orchestration

Dockerized Node.js Web Application

Built a simple Express web application with package metadata, npm dependencies, and a static HTML response page. Created a Docker image for the Node.js service, exposed the development server through container networking, and instantiated a running container from the built image.

Node.js Express Docker npm Containers

Containerized Shark Information Website

Built a multi-page Express website with static views, Bootstrap navigation, custom CSS, and routes for a landing page and information page. Containerized the app with a Node Alpine Dockerfile, configured .dockerignore, ran it with host-to-container port mapping, and pushed the image to Docker Hub.

Node.js Express Bootstrap Docker Docker Hub

Kubernetes Bootcamp Deployment

Explored Kubernetes fundamentals by creating a local Minikube cluster and deploying the kubernetes-bootcamp sample application. Used kubectl to inspect cluster info, nodes, deployments, pods, logs, environment variables, and container sessions while troubleshooting application behavior.

Kubernetes Minikube kubectl Pods Deployments

Kubernetes Service Scaling and Rolling Updates

Extended a Kubernetes deployment workflow by exposing it through a NodePort service, applying labels, testing cluster access, and deleting services. Scaled replicas with kubectl, checked ReplicaSets and pod distribution, performed rolling image updates, verified rollout status, and rolled back failed deployments.

Kubernetes Minikube Services Scaling Rollouts

Minikube NGINX Echo Application Deployment

Deployed a sample NGINX echo application on Minikube and exposed it through a Kubernetes service. Used the Kubernetes Dashboard to inspect resources, enabled add-ons, viewed application logs, ran the deployed service, and cleaned up pods, services, and dashboard access after testing.

Kubernetes Minikube NGINX Services Dashboard

Kubernetes ConfigMap and Secret Configuration

Externalized microservice configuration with Kubernetes ConfigMaps and Secrets for system and inventory services. Injected APP_NAME, credentials, and pod metadata into deployments as environment variables, consumed them through MicroProfile Config annotations, redeployed services, and verified changed runtime properties through API responses.

Kubernetes ConfigMaps Secrets MicroProfile YAML

Cross-Platform Currency Converter Web Services

Built a currency converter workflow demonstrating cross-platform web service consumption between NetBeans/Java and .NET. Implemented INR-to-Dollar and Dollar-to-INR conversion methods, created ASP.NET Web Forms clients, exposed C# ASMX web methods, and consumed service references across environments.

Java ASP.NET C# SOAP Web Services

Helm Redis Deployment on Kubernetes

Used Helm as a Kubernetes package manager to deploy Redis for an application workflow. Installed and configured Helm chart resources, managed release setup from terminal commands, inspected deployed Kubernetes components, and practiced chart-based deployment lifecycle operations for reusable infrastructure.

Kubernetes Helm Redis Charts Package Management

Docker and Kubernetes NGINX Orchestration

Integrated Docker and Kubernetes workflows by pulling a custom NGINX image, running the container, and orchestrating it through a Kubernetes deployment. Exposed the deployment, listed running pods/services, executed commands inside containers, followed logs from active processes, and stopped/removed resources cleanly.

Docker Kubernetes NGINX Deployments kubectl

RHEV Lab Access and System Configuration Audit

Configured access to the Red Hat Enterprise Virtualization lab environment using OpenVPN and prepared classroom systems for RHEV practice. Audited RHEV Manager, server, and workstation configurations using Linux commands for DNS lookup, hostname discovery, IP addressing, CPU/virtualization support, and network interface validation.

RHEV OpenVPN Linux DNS Networking

RHEV Manager Installation and Configuration

Installed and configured a RHEV Manager environment by resetting the virtual machine, connecting through SSH, adding classroom repositories, updating packages, and installing rhevm, data warehouse, and reporting components. Generated setup answers, verified oVirt engine status, and tested browser-based manager access.

RHEV Manager oVirt Engine Yum SSH Linux

RHEV Hypervisor Host Installation

Installed and configured a RHEV Hypervisor host for the virtualization environment. Selected the hypervisor image, configured administrator credentials, rebooted and validated host status, assigned network settings, enabled SSH authentication, connected the host to RHEV Manager, and activated it for virtualization workloads.

RHEV Hypervisor Host Configuration SSH Networking

RHEV Data Center and Cluster Setup

Created a RHEV data center and cluster for the ICT campus virtualization setup. Configured cluster settings, disabled fencing where required, moved the hypervisor into the selected data center, reactivated the host from maintenance mode, and verified host and VM counts in the manager console.

RHEV Data Centers Clusters Hypervisors Host Activation

RHEV Storage Domain Management

Built and maintained RHEV storage domains by activating the data center host, creating iSCSI-backed data storage, and preparing ISO/export directories. Installed and configured NFS, changed directory ownership, exported storage paths, restarted services, created ISO and export domains, and uploaded ISO images for VM provisioning.

RHEV Storage iSCSI NFS ISO Domains Export Domains

RHEV Logical Network Configuration

Created logical networking configuration for RHEV by inspecting and updating MAC pool ranges through engine-config commands. Restarted the oVirt engine, validated updated pool ranges, created a new logical network in the manager console, and confirmed successful network availability for virtual infrastructure.

RHEV Networking MAC Pools oVirt Engine Logical Networks

RHEV Virtual Machine Deployment

Deployed a Linux virtual machine on RHEV by configuring storage size, display protocol, host placement, migration priority, boot sequence, and virtual disk settings. Attached installation media through Run Once, completed Linux 7.1 installation, configured networking and users, and validated the final VM configuration.

RHEV Linux VM SPICE Virtual Disks Boot Configuration

RHEV Snapshot and VM Image Management

Managed VM snapshots and image lifecycle workflows by capturing baseline and post-change snapshots after adding users and login banners. Previewed and committed snapshots, exported and reimported VMs, detached and reattached export storage, and moved VM images across data centers through RHEV import/export operations.

RHEV Snapshots VM Export VM Import Data Centers

Automated RHEV VM Deployment with Templates

Automated virtual machine deployment in RHEV by shutting down a configured VM, converting it into a reusable template, and creating a VM pool from that template. Verified provisioning events, detached generated VMs, and removed pool-created machines to complete the automated deployment lifecycle.

RHEV VM Templates Pools Automation Provisioning

RHEV Monitoring Search and Tagging Dashboard

Built monitoring and reporting workflows in RHEV using manager search filters and tag-based organization. Queried VMs by power state, storage by activity status, templates by health, users by name, clusters by data center, and assigned custom tags for inactive VMs and active hypervisors.

RHEV Monitoring Reporting Search Queries Tags

Flask Multi-App SSO and OAuth 2.0 Platform

Built Single Sign-On (SSO) across two Flask applications using Auth0 as the centralized identity provider. Implemented OAuth 2.0 authorization code flows, OIDC token validation, shared session management with Flask-Session, and cross-application authentication. Enabled seamless user access with centralized login, session persistence, and global logout capabilities managed through Auth0.

Python Flask Auth0 OAuth 2.0 OIDC
DataHub LLC

Oracle-to-CockroachDB CDC Pipeline on IBM Cloud

Designed Terraform infrastructure from scratch using reusable modules to provision IBM Code Engine Functions and compute resources for a CDC migration pipeline. Containerized Oracle XE and MOLT with Docker on a VPC virtual server instance, orchestrated schema-filtered migration via SSH using direct-copy mode, and built a Flask proxy to bridge Oracle's outbound HTTPS limitations while syncing changes in under 15 seconds.

Python Terraform Docker MOLT IBM Code Engine
Cal State LA

NeuzNow Cross-Platform News Aggregation App

Built a cross-platform mobile news aggregation app using React Native and Expo, integrating NewsAPI REST endpoints via Axios to deliver real-time headlines across 5 topical categories and 10 country-specific news channels. Implemented dual drawer/tab navigation, an in-app WebView article reader, native OS content sharing, and a reactive light/dark theme system using React Context with a global event-listener bus for app-wide theme switching.

React Native Expo Axios React Navigation WebView
Cal State LA

Book Recommender System with kNN Collaborative Filtering

Built an end-to-end ML web application delivering book recommendations via item-based k-Nearest Neighbors collaborative filtering with scikit-learn, training on a user-item rating pivot matrix and serving sub-second inference from pickled model artifacts through a Flask backend with a Bootstrap UI showing top-5 recommendations with cover posters. Engineered a parallel BeautifulSoup scraper extracting book metadata (title, author, publication year, cover art) from Project Gutenberg across 4 multiprocessing workers into structured CSV datasets, deployed via Gunicorn.

Python Flask scikit-learn Pandas BeautifulSoup
DataHub LLC

AI-Powered Kubernetes Troubleshooting Agent for Redshift Data Platform

Built an internal AI-powered troubleshooting agent that investigates Kubernetes clusters supporting the Redshift data platform, using a read-only kubectl evidence layer feeding an LLM reasoning engine that returns root cause, fix, a ready-to-run kubectl command, and a confidence score. Orchestrated the investigation as a FastAPI background pipeline with Postgres-triggered realtime updates streamed to a Next.js dashboard, validated end-to-end against real broken clusters (CrashLoopBackOff, ImagePullBackOff, OOMKilled, selector mismatch) at 90-100% confidence.

Python FastAPI Next.js TypeScript OpenRouter LLM

Technical Skills

Comprehensive expertise across multiple domains

With hands-on experience as a Cloud Automation & DevOps Engineer at DataHub LLC and prior roles at Zipline and Squadron Technology, I've developed expertise across multiple domains including cloud infrastructure, automation, AI/ML, and software development.

Cloud & DevOps

AWS Azure DevOps Docker Kubernetes Terraform Ansible GitLab CI GitHub Actions Serverless Computing Grafana Prometheus Datadog IBM Cloud

Programming & Tools

Python TypeScript JavaScript Go Rust C++ SQL Bash Git Bazel

Automation & Testing

HIL Testing CI/CD Pipelines AWS Step Functions Snowflake Percona XtraDB Elasticsearch Jira Automation Slack API Power BI Validation

AI/ML & Data

Artificial Intelligence (AI) NoSQL MongoDB MLOps FAISS RAG Pipeline NLP AWS Lambda Oracle CockroachDB

Certifications

Professional certifications demonstrating expertise in cloud, data, and AI technologies

HashiCorp Certified: Terraform Associate (003)

Infrastructure as Code certification demonstrating expertise in designing and managing cloud infrastructure effectively.

Verified

AWS Academy Machine Learning Foundations

Comprehensive machine learning certification covering AWS ML services and foundational AI concepts.

AWS Certified

AWS Academy Cloud Architecting

Cloud architecture certification covering AWS Well-Architected design principles and infrastructure planning.

AWS Certified

IBM Docker Essentials

Containerization fundamentals certification covering Docker image building, orchestration, and deployment on IBM Cloud.

IBM Certified

IT Academy: Cloud and Virtualization Concepts

Advanced cloud computing and virtualization technologies certification.

Cloud Expert

Hands On Essentials - Data Warehouse

Data warehousing and analytics certification focusing on data processing and storage solutions.

Data Expert

Introduction to SQL

Database querying and SQL fundamentals certification.

SQL Certified

Joining Data in SQL

Advanced SQL techniques for data joining and complex query optimization.

Advanced SQL

Education

Academic foundation in Computer Science and Engineering

Master's degree, Computer Science

California State University, Los Angeles

August 2024 - May 2026

Completed advanced studies in Computer Science with focus on AI, software engineering, and network security, while working in multiple roles as Research Assistant, Teaching Assistant, and Graduate Assistant. Thesis research on IoT-based water leak detection published via ProQuest.

B.Tech in Computer Science and Engineering

Ganpat University

2019 - 2023

Bachelor's degree with IBM Specialization in Cloud Based Applications. Strong foundation in computer science fundamentals, cloud computing, and software engineering principles.

Research & Thesis

Published graduate research in intelligent water infrastructure

Intelligent Water Management System: Leak Detection & Localization in Urban Areas

M.S. Thesis · California State University, Los Angeles · 2026 · SITI-Funded Research

Urban water distribution networks lose up to 60% of imported supply to undetected leaks. This thesis develops a multi-sensor, edge-deployed machine learning framework for real-time pipeline leak detection using pressure and acoustic sensors paired with on-premises Raspberry Pi computing rather than cloud infrastructure. Experimental validation on a PVC pipeline testbed showed Random Forest achieving 95.80% accuracy in binary leak detection and 85.17% accuracy across four operational states, with pressure sensor data proving more informative than acoustic data alone — demonstrating a scalable path to deployment across larger urban water networks.

View Full Thesis on ProQuest

My Expertise

Specialized solutions in automation, cloud infrastructure, and AI/ML pipelines

Software Validation & Automation

Expertise in Hardware-in-the-Loop (HIL) testing, workflow automation, and validation systems. Specialized in building robust testing frameworks and automated solutions.

  • HIL Testing Systems
  • Workflow Automation
  • Jira Integration
  • Slack API Development

DevOps & CI/CD

Advanced expertise in CI/CD pipeline optimization, infrastructure automation, and deployment strategies using modern tools and practices.

  • GitHub Actions & Bazel
  • Azure DevOps & GitLab
  • Terraform & Ansible
  • Docker & Kubernetes

MLOps & AI/ML

Specialized in MLOps practices, AI/ML pipeline development, and building scalable machine learning systems with modern cloud technologies.

  • RAG Pipeline Development
  • NLP & Text Processing
  • FAISS & Vector Databases
  • MLOps Automation

Cloud Infrastructure

Expertise in cloud architecture design, data pipeline automation, and infrastructure management using AWS, Azure, and modern cloud technologies.

  • AWS & Azure DevOps
  • Data Pipeline Automation
  • Serverless Computing
  • Infrastructure as Code

Get In Touch

Ready to discuss your next project? Let's connect!

Email

yashshah3698@gmail.com

Phone

+1 (213) 301-8249

Location

South San Francisco, CA

LinkedIn

yashkeyurshah