Back to Jobs

Principal Network Architect- AI Infrastructure

Remote, USA Full-time Posted 2026-06-21

What We Can Offer You At Nscale, you'll find a collaborative, supportive, and innovative environment where your contributions spark real impact. We're building something extraordinary, and we want you at the core. Highly competitive package (base + equity) with reviews every 12 months. 🚀 Join the fastest-growing tech startup, your chance to push boundaries, collaborate with brilliant minds, and make your mark on cutting-edge AI. ✨ Expect a dynamic progression plan tailored to your ambitions. Grow by trying new things, leading, challenging the status quo, and owning your impact, always with our full support. Human-First Flexibility: We treat you as humans first. 🫶🏽 Our flexible workplace trusts Nscalers to deliver, giving you the autonomy to shape your day around life's moments. About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior results by reducing the complexity of AI development. Our GPU cloud bolsters technical capabilities and directly supports strategic business outcomes, including cost management, rapid innovation, and environmental responsibility. We thrive on a culture of relentless innovation, ownership, and accountability, where every team member takes pride in their work and drives it with excellence and urgency. As an Nscaler, you’ll build trust through openness and transparency, where everyone is inspired to do their best work. If you join our team, you’ll be contributing to building the technology that powers the future. Role Overview Nscale is seeking a Network Architect Engineer to lead the evolution, reliability, and operational excellence of our global AI networking infrastructure. This role sits at the core of Nscale’s platform, where network performance directly impacts AI training outcomes. You will act as a technical authority across large-scale RDMA / Infiniband / RoCE fabrics, driving automation, availability improvements, and system-level design across a globally distributed GPU cloud. You will combine deep network protocol-level networking expertise with strong software and automation skills to operate and scale one of the most demanding AI networking environments in the industry. What You’ll Do Technical Leadership & Strategy Own the technical direction and operational lifecycle management of Nscale’s high-performance RDMA network fabrics Define long-term architecture, reliability strategy, and operational standards for AI interconnect networks Lead availability and performance improvement initiatives across globally distributed GPU clusters Act as a technical authority (SME) across networking, influencing platform-wide decisions Network Engineering & Operations Support design, build, and evolve large-scale Infiniband and RoCE fabrics Drive deep debugging and resolution of complex cross-layer issues (hardware, firmware, kernel, distributed workloads) Lead incident response and postmortems, ensuring systemic fixes and long-term improvements Define and enforce standards across: Congestion control and traffic engineering Routing (BGP, ECMP, fabric-level routing strategies) Firmware lifecycle and change management Network observability and telemetry Automation & Systems Development Develop and scale automation frameworks for network provisioning, validation, and operations Build tooling to support high-reliability, low-touch network operations at scale Improve operational efficiency across hundreds of thousands of endpoints and high-throughput links Cross-Functional Leadership Lead complex technical initiatives across Network, SRE, Compute, and Platform teams Serve as technical lead on critical programs, coordinating engineers and stakeholders Influence product and infrastructure roadmaps based on operational insights and customer needs Mentor senior engineers and raise the bar for technical rigor and execution What We’re Looking For Core Experience 10+ years of experience in network engineering in hyperscale, AI, or HPC environments Deep expertise in RDMA, Infiniband, and/or large-scale RoCE fabrics Strong understanding of: RDMA internals and performance tuning Congestion control and fabric failure modes Distributed system communication patterns Technical Skills Expert-level knowledge of data center networking protocols (BGP, OSPF, ECMP) Proven ability to debug multi-layer issues across network, system, and application layers Strong programming/scripting skills for automation (Python, Go, etc.) Experience designing high-scale, highly available network systems Leadership & Impact Demonstrated ability to lead complex technical programs without direct authority Experience acting as a senior escalation point for critical production issues Strong ability to drive cross-team alignment and execution Systems-level thinking balancing performance, reliability, scalability, and cost

Nice to Have

Experience with NVIDIA / Mellanox networking platforms Familiarity with distributed AI training frameworks and GPU communication patterns Experience building network observability systems at scale Background influencing infrastructure strategy in high-growth environments Equal Opportunities Statement We strongly encourage applications from people of colour, the LGBTQ+ community, people with disabilities, neurodivergent people, parents, carers, and people from lower socio-economic backgrounds. If there’s anything we can do to accommodate your specific situation, please let us know. The responsibilities outlined in this job description are not exhaustive and are intended to provide a general overview of the position. The employee may be required to perform additional duties, tasks, and responsibilities as assigned by management, consistent with the skills and qualifications required for the role. For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here. Apply To This Job

Similar Jobs

Future Internship Opportunities - Join our Talent Network

Remote, USA Full-time

Geotechnical Project Manager

Remote, USA Full-time

Technical Program Manager - Enterprise Security, Metrics and Business Intelligence

Remote, USA Full-time

Aviation Project Engineer

Remote, USA Full-time

Bridge Inspection Team Leader

Remote, USA Full-time

Project Manager - Railroad Civil Track Design

Remote, USA Full-time

Project Manager - Railroad Infrastructure - Texas

Remote, USA Full-time

Project Manager - Railroad Infrastructure - California

Remote, USA Full-time

Carrier Sales Rep(On-site in Belgrade)

Remote, USA Full-time

Customer Service Representative

Remote, USA Full-time

Senior Backend Engineer

Remote, USA Full-time

Experienced Full Stack Data Entry Specialist – Remote Operations for arenaflex

Remote, USA Full-time

Coca-Cola Remote Jobs (Data Entry) ? No Experience $25/Hr

Remote, USA Full-time

Senior Vice President, Brand Strategy

Remote, USA Full-time

Contracts & Grants Analyst (RSCH ADM 3)

Remote, USA Full-time

Lead Data Engineer - Big Data Solutions for Disney's Engagement and Retention Analytics Team ($24/Hour)

Remote, USA Full-time

Provider Contracting Manager - Cigna Healthcare - Seattle, WA

Remote, USA Full-time

Want ASSISTANT DEPUTY OF INSPECTIONS in West Palm Beach, FL

Remote, USA Full-time

Immediate Hiring: Customer Engineer - Dynamics CRM at arenaflex

Remote, USA Full-time

Experienced Customer Service Sales Representative – Life Insurance Benefits Advisor

Remote, USA Full-time