Yehor Brodskiy

Summary

DevOps and SRE engineer with more than 5 years building and operating production systems, from bare-metal Kubernetes to self-hosted LLM inference. Recent work: self-hosted, OpenAI-compatible LLM serving on open-weight models - a Rust batch-API gateway in front of vLLM, served on Kubernetes and across multiple GPUs over NVLink, hardened, monitored and handover-ready, including a fully air-gapped deployment for a confidential defense-sector client. I own the whole path, from hardware sizing to the inference engine, the API and the reliability layer, and write the application code around it too, including retrieval-augmented, natural-language-to-SQL assistants over complex retail schemas.

Experience

1. Senior Developer, The Parker Avery Group

   Mar 2022 - Present

   Full-time

   Enterprise systems integration for US retail and CPG: the Unified Demand Intelligence platform and Ask Udi.

   • Delivered a fully air-gapped, self-hosted deployment for a confidential defense-sector client (name withheld under NDA), with no public inbound exposure.
   • Served open-weight LLMs on Kubernetes and across multiple GPUs over NVLink.
   • Deployed and load-tested vLLM serving a quantized open-weight model (Gemma, 12B, 4-bit and FP8 variants) on a single 24 GB GPU. Tuned KV-cache dtype, sequence concurrency, GPU memory utilization and the structured-output backend to reach about 335 output tokens per second at 16-way concurrency with zero request preemptions.
   • Hardening and observability: bearer-token authentication with constant-time comparison, loopback-only exposure, Prometheus metrics and structured JSON logging.

   ProjectsThe Parker Avery GroupUnified Demand Intelligence

2. Senior Technical Consultant, Mobilauto

   2022 - 2024

   Contract

   I'd already moved to The Parker Avery Group when Mobilauto came back to life. I owned a lot of its parts, so I pretty much got pulled into a 2-year knowledge transfer.

3. Full Stack Engineer / DevOps (incl. SRE), Team Lead, Mobilauto

   Jan 2020 - Mar 2022

   Full-time

   Ran the taxi platform end to end: the Cabinet24 CRM, the Express Soft dispatch platform, Mobilauto Web, the gateway and the partner bridge. prpcow and rust-wasmpack-loader came out of this work as open source. It ended in spring 2022, with the full-scale invasion.

   • Designed low-cost infrastructure on Kubernetes (k0s) for high availability of every critical service.
   • Built a large-scale k0s environment supporting multiple deployment options, including automated setups in dedicated client VMs.
   • Built a program set for taxi services on Kubernetes (k0s) for deployment orchestration. Node.js backend (including worker threads), Kafka for driver-point delivery, Redis for cache, history and pub/sub, PostgreSQL, React frontend, full Asterisk and A2Billing telephony integration.
   • Led a team of six.

   ProjectsMobilautoCabinet24Express Softprpcowrust-wasmpack-loader

4. Full Stack Engineer / DevOps (incl. SRE), Qberry

   Apr 2019 - Dec 2019

   Full-time

   My first salaried job, at an outsourcing firm. Production reliability and product work.

   • Built many customer-requested environments: Docker-based, bare-metal, several cloud platforms, and Kubernetes clusters including air-gapped setups.
   • Customer projects (React and Vue frontends, Node.js including worker threads, MariaDB, MySQL and MongoDB), plus support for bare-metal servers including PowerDNS.
   • Built gamification add-ons (Node and RabbitMQ on the backend, React on the frontend).
   • Led 2 or more developers.

   ProjectsQberryPlaton P2P

5. Full Stack Engineer / DevOps (incl. SRE), Tech Lead, Cropman.io

   Jan 2019 - Apr 2019

   Own product

   A multi-image editor right in the browser. Built it with classmates from DAN.IT and sold it as a product.

   • Used Firebase Cloud Functions as compute for user requests, with everything else on Docker Compose.
   • An online batch photo editor (layers, crop, filters, watermarks). Node and Sharp (libvips) with Firebase for auth and storage, MongoDB, and a React frontend.
   • Led a team of four.

   ProjectsCropman.io

6. Freelance, Self-taught builds

   2015 - 2018

Skills

• OrchestrationKubernetes, K8s on bare metal (Talos, k0s), ArgoCD, Devtron, Custom CSI / Operators, k3s, Docker / Podman, CI/CD automation, Terraform, Ansible
• LLM servingvLLM, Ollama, Quantization (w4a16, FP8), Multi-GPU serving over NVLink, OpenAI-compatible APIs (Chat and Batch), Throughput and latency load-testing
• ObservabilitySigNoz, Datadog, Prometheus, Grafana, OpenReplay, Microsoft Clarity
• Cloud & hostingSelf-hosted infrastructure, Bare metal, Major clouds, Private, air-gapped and hybrid environments, EDGE computing
• LanguagesPython, Go, TypeScript / JavaScript, Rust, Java, C#
• RuntimesEdge runtimes, Bun, Node, WASM in the browser
• FrontendNext.js, React, Tailwind CSS, Angular, Vue, Nuxt.js
• Backend & messagingNode, prpcow, REST, RPC, GraphQL, WebSockets, gRPC, Protobuf, Spring, Microservices
• Multimedianginx-vod-module, HLS, Streaming pipelines
• Auth & identityKeycloak, Zitadel, OIDC / OAuth2, SSO / IdP federation
• CMSStrapi, Custom headless
• Data & AIpgvector, qdrant, OpenAI APIs, Langfuse, LangFlow, LangGraph, RAG / embeddings, LangChain, ClickHouse, Apache Spark, DuckDB
• Queues & gatewaysHigress, KubeMQ, Kafka, Valkey / Redis, RabbitMQ
• Realtime & telephonyCustom TURN / STUN with strong auth, Asterisk, A2Billing, WebRTC softphones
• DatabasesPostgreSQL, MySQL / MariaDB, SQL Server, Oracle DB, MongoDB, Cassandra, Couchbase, SQLite
• StorageS3 / MinIO, GCS, Azure Blob, B2, NFS / SMB, Ceph
• SecurityNetwork hardening, VPN-only and no-public-inbound topologies, Secrets management, Vulnerability scanning, Compliance controls

Education

• Kyiv Aviation Institute (National Aviation University)

  2021 - 2025

  Bachelor's, IoT

  Faculty of Electronics, Robotics, Monitoring and IoT Technologies. Average mark 89/100. Qualification work: Network Protocol for Remote Function Calls (RPC-like) as the primary seamless connection between EDGE devices in IoT.

• Kyiv Aviation Institute (National Aviation University)

  2025 - 2026

  Master's, Electronics, Robotics and IoT

  Faculty of Air navigation, Electronics and Telecommunications.

• DAN.IT Education

  2019 - 2021

  Full stack course

  Average mark 80/100.

Languages

• UkrainianNative
• EnglishC1/C2
• RussianNative