Muhammad Ibrahim

Senior Software Engineer, MLOps · Multiverse Computing

San Sebastián, Spain · Remote, EU/UK hours · ibrahimnd2000@gmail.com

Download PDF

Experience

Mid/Senior Software Engineer, MLOps / LLMOps · Multiverse Computing

Aug 2024 – Present

San Sebastián, Spain

  • Owned the GLM-5.3 serving stack end to end within 24 hours of joining: from crashing and failing benchmarks to passing a 200k-token SLA (64 concurrent users, 100% success, TTFT P90 34 s vs a 70 s limit).
  • Re-architected it as prefill/decode disaggregation with context-parallel prefill: same SLA on 5 nodes instead of 11, 65% more throughput, 3.6× per node.
  • Found and fixed silent correctness and stall bugs, each validated on GPUs before rollout: LMCache KV corruption (gibberish outputs from up to 16% to 0 of 2,000), a lost-completion race, a missing-key read hang, a load-failure stall (max ITL 575 s → 14.7 s).
  • Zero-downtime production rollouts; root-caused truncated streams and 503s to autoscaler terminations and Istio/Envoy keep-alive mismatches.
  • Owned the company-wide GPU job platform (SkyPilot): 0 failed jobs, EFA networking for ~2× faster training, NVIDIA MIG partitioning as code.
  • Secured $1.2M in contracts through live demos for AWS Accelerate; mentored 4 junior engineers (2 promoted within 6 months).

Junior Software Engineer · Multiverse Computing

Jun 2023 – Jul 2024

San Sebastián, Spain

  • CompactifAI: led a team of 6 building a 70%-compressed LLM, adopted by 3 enterprise clients for edge deployment.
  • Built an AWS Batch Monte Carlo simulation platform, cutting GPU costs by 25% ($50K/year).

Software Engineer · Bank Al Habib Ltd.

Sep 2022 – Jun 2023

Karachi, Pakistan

  • Automated 80% of loan-processing workflows (1,200+ loans/month), cutting processing time by 40%.
  • Built Java/Quarkus microservices handling 50K+ daily transactions with zero security incidents.

Software Engineer Intern · Tapal Tea

Jun 2021 – Aug 2021

Karachi, Pakistan

  • Built an Android RFID warehouse app and automated SAP HANA workflows (40% fewer data-entry errors).

Skills

LLM serving
vLLM, LMCache, prefill/decode disaggregation (NIXL over EFA RDMA), KV-cache offload, sharding and cache-aware routing; tensor, data, expert and context parallelism; MTP speculative decoding; FP8/NVFP4; CUDA graphs; FlashInfer
Performance
Nsight Systems/Compute, NCCL, py-spy, cost and queueing models, SLA benchmarking (TTFT, ITL, TPM), capacity sizing, A/B testing
Platform
Kubernetes, Helm, Argo CD, Karpenter, KEDA, Istio/Envoy; AWS (SageMaker HyperPod, EKS, EFA), Azure ML, GCP, Huawei Ascend; Terraform, SkyPilot; Prometheus/Grafana
AI engineering
Quantization (FP16/INT8/FP8/NVFP4), model compression, distributed training (DeepSpeed, Accelerate, torchrun, NeMo), agentic workflows, RAG, LLM evaluation
Languages
Python, C++, Go, Rust, TypeScript, Java, SQL, Bash

Publications

A. Tomut, S. S. Jahromi, A. Sarkar, … M. Ibrahim, … R. Orús. CompactifAI: Extreme Compression of Large Language Models using Quantum-Inspired Tensor Networks. arXiv:2401.14109, 2024.

Education

  • MS Computer Science (in progress)

    Georgia Institute of Technology · 2026 – 2029

  • BE Electrical & Computer Engineering

    NED University of Engineering and Technology, Karachi · 2018 – 2022

Certifications

  • AWS Certified Machine Learning – Specialty (2025)
  • Microsoft Azure AI Engineer Associate (2025)
  • AWS Certified Developer – Associate
  • TensorFlow Certified Developer

Languages

English (native) · Spanish (B2)