Job Description
About Us
Since 1989, SHI International Corp. has helped organizations change the world through technology. We’ve grown every year since, and today we’re proud to be a $16 billion global provider of IT solutions and services.
Over 17,000 organizations worldwide rely on SHI’s concierge approach to help them solve what’s next. But the heartbeat of SHI is our employees – all 7,000 of them. If you join our team, you’ll enjoy:
Our commitment to diversity, as the largest minority- and woman-owned enterprise in the U.S.
Continuous professional growth and leadership opportunities.
Health, wellness, and financial benefits to offer peace of mind to you and your family.
World-class facilities and the technology you need to thrive – in our offices or yours.
Job Summary
The Principal Architect - AI & Datacenter serves as the organization’s senior-most technical advisor in AI-driven architectures and enterprise-scale compute, storage solutions. The Principal Architect combines deep technical mastery in artificial intelligence, high-performance datacenter design, and hybrid cloud integration with advanced business intelligence. The Principal Architect shapes strategic solution direction, leads major AI infrastructure pursuits, and guides field teams across regions to deliver transformational outcomes for customers adopting next-generation compute ecosystems.
Role Description
Lead Complex AI Infrastructure Pursuits: Serve as the chief architect and trusted technical strategist for multimillion-dollar AI and datacenter modernization opportunities, ensuring performance, scalability, and security alignment with enterprise goals.
Architect Advanced Compute Environments: Optimize end-to-end infrastructure—GPU clusters, fabric interconnects, and AI-optimized storage—for large model training and inference workloads across on-prem, edge, and cloud platforms.
Drive Strategic Customer Engagement: Co-develop digital transformation roadmaps with executive clients, emphasizing AI-ready datacenter evolution, sustainable energy efficiency, and workload orchestration.
Integrate Hybrid Cloud and AI Platforms: Design architectures leveraging NVIDIA DGX, HPE GreenLake, Dell APEX, or Red Hat OpenShift AI ecosystems to ensure seamless data mobility, workload elasticity, and cost-effective scaling.
Lead Proof-of-Concept and Benchmarking: Direct technical validation for AI workloads, including multi-tenant GPU performance testing, model training simulations, and inferencing benchmark optimization.
Influence Product and R&D Direction: Collaborate with infrastructure engineering, software development, and AI solution groups and OEM Partners to align field innovations with datacenter roadmap investments.
Mentor Next-Generation Architects: Build AI competency frameworks, train presales engineers in AI workload modeling, and elevate organizational acumen for data-driven presales execution.
Provide Thought Leadership: Attend SHI and Partner events as well as webinars providing relevant content in speaking roles. Attend partner meetings in an advisory capacity. Publish articles and blogs on SHI capabilities, industry innovations and trends.
Behaviors and Competencies
Willingness to Learn: Can apply new learning to daily work, encourage and facilitate learning in others, and actively make changes to work based on feedback.
Self-Development: Can demonstrate a commitment to continuous learning and adaptability to new ideas and methods.
Leadership: Can take ownership of complex team initiatives, collaborate with others in decision-making processes, and drive team performance.
Strategic Thinking: Can analyze complex situations, anticipate future trends, and align and integrate strategies across departments or functions.
Problem-Solving: Can proactively identify and take ownership of complex problem-solving initiatives, initiate preventative measures, collaborate with others to find solutions, and drive successful outcomes.
Analytical Thinking: Can use advanced analytical techniques to solve complex problems, draw insights, and communicate the solutions effectively.
Prioritization: Can take ownership of complex task management, collaborate with others to align priorities, and drive team efficiency.
Customer-Centric Mindset: Can take ownership of customer-centric initiatives, ensuring products and services align with customer needs. Collaborates with cross-functional teams to integrate customer feedback into product development.
Organization: Can oversee complex projects with multiple moving parts, ensure team alignment with organizational systems, and adapt to changing priorities.
Communication: Can effectively communicate complex ideas and information to diverse audiences, facilitate effective communication between others, and mentor others in effective communication.
Interpersonal Skills: Can communicate effectively, build relationships, resolve conflicts, influence others, and support others in developing their interpersonal skills in major situations.
Skill Level Requirements
Ability to design, implement, and configure robust AI solutions, ensuring alignment with strategic objectives and technical specifications. - Intermediate
Ability to design comprehensive AI system structures and frameworks to meet complex requirements. - Intermediate
The ability to design, implement, and support multi-tier applications and cloud-based architectures to meet organizational needs. - Intermediate
Demonstrates a working knowledge of current and evolving technologies including Cloud, Data Center, Storage, and Networking. - Intermediate
Ability to oversee and direct projects to completion, ensuring goals are met, resources are utilized efficiently, and stakeholders are satisfied. - Intermediate
The ability to understand and manage various infrastructure components (firewalls, load balancers, hypervisors, storage, monitoring, security) and use orchestration tools to develop comprehensive technical solutions. - Intermediate
The ability to write, debug, and maintain code in various scripting and programming languages to automate tasks and develop software solutions, specifically Python, Java, or C++. - Intermediate
Knowledgeable in MLOps practices and tools to enhance AI model deployment and operations. - Intermediate
Other Requirements
Completed Bachelor’s Degree in Computer Engineering , Data Science, or related field.
15+ years of experience in enterprise architecture, presales engineering, or datacenter solution design, including 5+ years dedicated to AI infrastructure or HPC systems .
Strong understanding of AI frameworks (TensorFlow, PyTorch , Triton Inference Server) and MLOps integration across hybrid infrastructures.
Proven experience designing and delivering large-scale AI/ML clusters, GPU cloud architectures, and fiber-connected computing fabrics.
Advanced communication and executive-level advisory skills with the ability to articulate complex technical strategies in business value terms.
Deep expertise in at least two domains:
· GPU/accelerator computing
· Data fabric design
· Container orchestration
· Power-efficient datacenter design
Ability to travel 25%
Preferred:
NVIDIA Certified Architect
TOGAF
AWS Solutions Architect Professional
Red Hat Certified Specialist in OpenShift AI, or equivalent
The estimated annual pay range for this position is $200,000 - $750,000 which includes a base salary and bonus. The compensation for this position is dependent on job-related knowledge, skills, experience, and market location and, therefore, will vary from individual to individual. Benefits may include, but are not limited to, medical, vision, dental, 401K, and flexible spending.
Equal Employment Opportunity – M/F/Disability/Protected Veteran Status
Since 1989, SHI International Corp. has helped organizations change the world through technology. We’ve grown every year since, and today we’re proud to be a $16 billion global provider of IT solutions and services.
Over 17,000 organizations worldwide rely on SHI’s concierge approach to help them solve what’s next. But the heartbeat of SHI is our employees – all 7,000 of them. If you join our team, you’ll enjoy:
Our commitment to diversity, as the largest minority- and woman-owned enterprise in the U.S.
Continuous professional growth and leadership opportunities.
Health, wellness, and financial benefits to offer peace of mind to you and your family.
World-class facilities and the technology you need to thrive – in our offices or yours.
Job Summary
The Principal Architect - AI & Datacenter serves as the organization’s senior-most technical advisor in AI-driven architectures and enterprise-scale compute, storage solutions. The Principal Architect combines deep technical mastery in artificial intelligence, high-performance datacenter design, and hybrid cloud integration with advanced business intelligence. The Principal Architect shapes strategic solution direction, leads major AI infrastructure pursuits, and guides field teams across regions to deliver transformational outcomes for customers adopting next-generation compute ecosystems.
Role Description
Lead Complex AI Infrastructure Pursuits: Serve as the chief architect and trusted technical strategist for multimillion-dollar AI and datacenter modernization opportunities, ensuring performance, scalability, and security alignment with enterprise goals.
Architect Advanced Compute Environments: Optimize end-to-end infrastructure—GPU clusters, fabric interconnects, and AI-optimized storage—for large model training and inference workloads across on-prem, edge, and cloud platforms.
Drive Strategic Customer Engagement: Co-develop digital transformation roadmaps with executive clients, emphasizing AI-ready datacenter evolution, sustainable energy efficiency, and workload orchestration.
Integrate Hybrid Cloud and AI Platforms: Design architectures leveraging NVIDIA DGX, HPE GreenLake, Dell APEX, or Red Hat OpenShift AI ecosystems to ensure seamless data mobility, workload elasticity, and cost-effective scaling.
Lead Proof-of-Concept and Benchmarking: Direct technical validation for AI workloads, including multi-tenant GPU performance testing, model training simulations, and inferencing benchmark optimization.
Influence Product and R&D Direction: Collaborate with infrastructure engineering, software development, and AI solution groups and OEM Partners to align field innovations with datacenter roadmap investments.
Mentor Next-Generation Architects: Build AI competency frameworks, train presales engineers in AI workload modeling, and elevate organizational acumen for data-driven presales execution.
Provide Thought Leadership: Attend SHI and Partner events as well as webinars providing relevant content in speaking roles. Attend partner meetings in an advisory capacity. Publish articles and blogs on SHI capabilities, industry innovations and trends.
Behaviors and Competencies
Willingness to Learn: Can apply new learning to daily work, encourage and facilitate learning in others, and actively make changes to work based on feedback.
Self-Development: Can demonstrate a commitment to continuous learning and adaptability to new ideas and methods.
Leadership: Can take ownership of complex team initiatives, collaborate with others in decision-making processes, and drive team performance.
Strategic Thinking: Can analyze complex situations, anticipate future trends, and align and integrate strategies across departments or functions.
Problem-Solving: Can proactively identify and take ownership of complex problem-solving initiatives, initiate preventative measures, collaborate with others to find solutions, and drive successful outcomes.
Analytical Thinking: Can use advanced analytical techniques to solve complex problems, draw insights, and communicate the solutions effectively.
Prioritization: Can take ownership of complex task management, collaborate with others to align priorities, and drive team efficiency.
Customer-Centric Mindset: Can take ownership of customer-centric initiatives, ensuring products and services align with customer needs. Collaborates with cross-functional teams to integrate customer feedback into product development.
Organization: Can oversee complex projects with multiple moving parts, ensure team alignment with organizational systems, and adapt to changing priorities.
Communication: Can effectively communicate complex ideas and information to diverse audiences, facilitate effective communication between others, and mentor others in effective communication.
Interpersonal Skills: Can communicate effectively, build relationships, resolve conflicts, influence others, and support others in developing their interpersonal skills in major situations.
Skill Level Requirements
Ability to design, implement, and configure robust AI solutions, ensuring alignment with strategic objectives and technical specifications. - Intermediate
Ability to design comprehensive AI system structures and frameworks to meet complex requirements. - Intermediate
The ability to design, implement, and support multi-tier applications and cloud-based architectures to meet organizational needs. - Intermediate
Demonstrates a working knowledge of current and evolving technologies including Cloud, Data Center, Storage, and Networking. - Intermediate
Ability to oversee and direct projects to completion, ensuring goals are met, resources are utilized efficiently, and stakeholders are satisfied. - Intermediate
The ability to understand and manage various infrastructure components (firewalls, load balancers, hypervisors, storage, monitoring, security) and use orchestration tools to develop comprehensive technical solutions. - Intermediate
The ability to write, debug, and maintain code in various scripting and programming languages to automate tasks and develop software solutions, specifically Python, Java, or C++. - Intermediate
Knowledgeable in MLOps practices and tools to enhance AI model deployment and operations. - Intermediate
Other Requirements
Completed Bachelor’s Degree in Computer Engineering , Data Science, or related field.
15+ years of experience in enterprise architecture, presales engineering, or datacenter solution design, including 5+ years dedicated to AI infrastructure or HPC systems .
Strong understanding of AI frameworks (TensorFlow, PyTorch , Triton Inference Server) and MLOps integration across hybrid infrastructures.
Proven experience designing and delivering large-scale AI/ML clusters, GPU cloud architectures, and fiber-connected computing fabrics.
Advanced communication and executive-level advisory skills with the ability to articulate complex technical strategies in business value terms.
Deep expertise in at least two domains:
· GPU/accelerator computing
· Data fabric design
· Container orchestration
· Power-efficient datacenter design
Ability to travel 25%
Preferred:
NVIDIA Certified Architect
TOGAF
AWS Solutions Architect Professional
Red Hat Certified Specialist in OpenShift AI, or equivalent
The estimated annual pay range for this position is $200,000 - $750,000 which includes a base salary and bonus. The compensation for this position is dependent on job-related knowledge, skills, experience, and market location and, therefore, will vary from individual to individual. Benefits may include, but are not limited to, medical, vision, dental, 401K, and flexible spending.
Equal Employment Opportunity – M/F/Disability/Protected Veteran Status
💡 Quick Summary
Seeking a career-building opportunity? The Principal Architect - AI & Datacenter- post position is now open for candidates interested in the IT Engineer & Developer Jobs sector. This role in New York City offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in IT Engineer & Developer Jobs is a plus.
