Software Engineer II

Overview

AI is the strategic bet for Microsoft. The Azure CoreAI Platform is right at the front end. Our project involves cutting edge technologies and problems. Joining the projects you will gain knowledge and experience about generative AI, large language model, transformers, GPU optimization, AI applications, etc. The AI business is also growing rapidly, and our products will directly face the impact of the large number of customers, which is continuously growing.

Within the AI Platform, the CoreAI team enables data scientists and developers to build quickly and easily, train, deploy, manage, and consume machine learning models.

The Core AI Model Scaling Platform team is hiring Software Engineers. The team designs, builds, and operates the largest scale engineering system in the industry for Large Language Models and GenAI Services. Key areas that we are working on

• Building and Scaling our Inferencing Cloud across our flagships AOAI Service and growing the Model as A Service model Families.
• Expand the Gen AI Model Offerings to more model providers, and best and latest models and provide a unified experience across AOAI and MAAS/MAAP for Azure AI customers
  
  

Responsibilities

• Collaborate with appropriate stakeholders (e.g., project manager, technical lead) to determine user requirements
• Leads discussions for architecture of products/solutions and creates proposals for architecture by testing design hypotheses
• Leads by example within the team by producing extensible and maintainable code. Applies debugging tools and examines logs to verify assumptions through writing and developing code
• Respond, resolve, and integrate customer feedback with agility and dedication
  
  

Qualifications

Required:

• Bachelors Degree in Computer Science, or related technical discipline and 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python or equivalent experience.
  
  

Preferred

• Experience on python, pytorch, LLMs, Generative AI
• Experience with distributed systems design and implementation
• Proficiency in Agile development practices and Continuous Integration/Continuous Deployment (CI/CD)
• Passion for machine learning, artificial intelligence, and data science, LLM Scaling, LLM Inferencing Engines
• Experience working on large-scale projects or applications
• Good communication skills and ability to collaborate with diverse remote teams
• Quick learner with a passion for solving complex and exciting problems
• Familiarity with Azure is a plus
  
  

#IDCAIPlatformHiring #CoreAIHiring

This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

---