Principal Engineer- Local AI Hardware AI

Requisition Number: 106401 

Principal Engineer/Arch II - Local AI/AI Implementation

Location: This is a hybrid opportunity in Delhi NCR, Hyderabad, Bangalore, Pune
Shift: US Aligned - night shift as per IST

Insight at a Glance 

• 14,000+ engaged teammates globally
• $8.2 billion in revenue in 2025
• Certified as a Great Place to work in 9 Countries in 2025
• Fortune 500 Company (No. 447) in 2025
• Received 25+ industry and partner awards in the past year

Now is the time to bring your expertise to Insight. We are not just a tech company; we are a people-first company. We believe that by unlocking the power of people and technology, we can accelerate transformation and achieve extraordinary results. As a Fortune 500 Solutions Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge, we guide organisations through complex digital decisions.  

About the role  

As a Principal Engineer/ Architect, you will help enterprise clients adopt local AI deployment and agentic workflows across edge and desktop AI hardware environments. We will count on you to unpack complex business challenges, define practical AI use cases, build proofs of concept, and enable client stakeholders to scale internal AI solutions. Along the way, you will get to:  

• Partner with enterprise stakeholders to identify business bottlenecks, map technical requirements, define high-impact AI use cases, and develop clear business and technical narratives. 

• Implement and optimize local AI environments on NVIDIA GB10 and Apple Silicon systems, addressing privacy, latency, cost, system dependencies, and secure data-handling needs. 

• Build functional AI prototypes, including command-line tools, function-calling solutions, and foundational agentic workflows, to demonstrate value and support executive buy-in. 

• Configure and troubleshoot Linux environments, local models, webhooks, REST APIs, networking components, and client integrations while coaching internal champions through AI adoption. 

What we’re looking for 

• Working familiarity with running local models on NVIDIA GB10 (Grace Blackwell / CUDA) and Apple Silicon (unified memory / MLX) hardware, alongside developer tools (e.g., Ollama, vLLM, LM Studio). 

• Understanding of core LLM mechanics, prompt design, API/Console usage, tool integration, and foundational agent patterns. 

• Comfortable navigating Linux terminal environments, writing Bash/Python automation scripts, and managing system dependencies/environments. 

• Solid understanding of TCP/IP, DNS, RESTful APIs, webhooks, local port forwarding, and secure network traffic basics. 

• Exceptional capacity for rapid self-directed learning and a curiosity to explore expanding AI frameworks. 

What you can expect  

We’re legendary for taking care of you, your family and to help you engage with your local community. We want you to enjoy a full, meaningful life and own your career at Insight. Some of our benefits include: 

• Freedom to work from another location—even an international destination—for up to 30 consecutive calendar days per year. 

• Medical Insurance 

• Health Benefits 

• Professional Development: Learning Platform and Certificate Reimbursement 

• Shift Allowance 

But what really sets us apart are our core values of Hunger, Heart, and Harmony, which guide everything we do, from building relationships with teammates, partners, and clients to making a positive impact in our communities.  

When you apply, please tell us the pronouns you use and any reasonable adjustments you may need during the interview process. 
 
At Insight, we celebrate diversity of skills and experience so even if you don’t feel like your skills are a perfect match - we still want to hear from you! 
 
Todays talent leads tomorrows success. Learn more about Insight:  
https://www.linkedin.com/company/insight/ 

Insight does not accept unsolicited resumes from recruiters or employment agencies. Unsolicited resumes will be treated as direct applications from the candidate, and recruiters or agencies who submit candidates for this position without a prior, written vendor agreement will not be eligible for any form of compensation, even if the candidate is hired. 

Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation or any other characteristic protected by law.

Insight India Location:Level 16, Tower B, Building No 14, Dlf Cyber City In It/Ites Sez, Sector 24 &25 A Gurugram Gurgaon Hr 122002 India