Job Description

SDG Group is a global enterprise data, analytics and AI consultancy. We design and build data and AI solutions for our clients. You will stand up and run the model-serving platform behind a production Agentic AI build: open-source models self-hosted on-premise with vLLM, a LiteLLM router in front, and a model garden spanning private cloud, a regional provider and a hyperscaler region, with routing driven by cost, performance and data sensitivity.

What you will do

  • Deploy and operate self-hosted open-source models on vLLM on-premise GPU infrastructure.

  • Build and run the LiteLLM routing layer and the model-garden register of approved models and the data each may receive.

  • Size and tune GPU serving (quantization, KV-cache and concurrency planning) so the on-premise footprint holds at load.

  • Wire multi-environment inference across private cloud, a regional provider and AWS Bedrock or Azure AI Foundry, with routing rules enforcing data residency.

  • Own observability, fallback, cost and performance of the serving layer.

What you bring

  • Solid MLOps or ML platform engineering, with real LLM serving experience (vLLM, TGI or equivalent).

  • A model gateway or router in production (LiteLLM or similar).

  • GPU infrastructure depth: CUDA, VRAM and KV-cache sizing, quantization trade-offs, and concurrency.

  • Kubernetes and containers, CI/CD, and cloud (AWS and/or Azure); monitoring and cost control.

Nice to have

  • Hands-on with open-weight models such as Qwen, GPT-OSS and Kimi.

  • Sovereign or data-residency-constrained deployments; Terraform or other infrastructure as code; telecom scale.

Why SDG Group

Own the serving and routing backbone of a large enterprise Agentic AI platform, including real on-premise GPU and multi-cloud model infrastructure. We welcome strong candidates regardless of current location, provided they can be based in Cairo and travel as the engagement requires.

 


Job Details

Role Level: Mid-Level Work Type: Full-Time
Country: United Arab Emirates City: Dubai
Company Website: http://www.sdggroup.com Job Function: DevOps & QA
Company Industry/
Sector:
Business Consulting and Services

What We Offer


About the Company

Searching, interviewing and hiring are all part of the professional life. The TALENTMATE Portal idea is to fill and help professionals doing one of them by bringing together the requisites under One Roof. Whether you're hunting for your Next Job Opportunity or Looking for Potential Employers, we're here to lend you a Helping Hand.

Report

Disclaimer: talentmate.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@talentmate.com.


Recent Jobs
View More Jobs
Talentmate Instagram Talentmate Facebook Talentmate YouTube Talentmate LinkedIn