₦ NGN
Language
Currency
arrow_back Back to Jobs

AI Fabric Architect

Fal Ai · Remote

Full time Remote
description Job Description

fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at scale without compromise. For developers and enterprises, fal is the foundation that makes generative media not just possible, but practical: a unified platform where high-performance inference, orchestration, and observability come together to unlock new categories of AI-native products.

As generative media reshapes industries across a market projected to grow by hundreds of billions over the next decade, fal is becoming the ecosystem that ambitious teams build on.

About this role

You are the architect of the network that our GPU clusters run on. You own the fabric end to end, from the NIC in each GPU server through the spine and leaf across the AI fabric, and you know that in AI infrastructure the network is core to the machine. As fal brings its own GPU capacity online across multiple sites, you will define the fabric architecture every site is built from, and then personally make sure it gets built and performs. This is not an architecture-only role. We are a small team moving fast, and the right person is as comfortable writing a port map, tracing a bad optic, or tuning congestion control on the data center floor as they are setting technical direction.

What you will do:

  • Own the fabric architecture for every site: GPU backend fabric (InfiniBand and/or RoCEv2), and GPU frontend Fabric

  • Choose topologies and make the key calls: rail-optimized vs. other designs, InfiniBand vs. Ethernet, oversubscription ratios, and how the fabric scales from one pod to many

  • Turn the architecture into a repeatable network blueprint: cabling plans, port maps, fabric addressing and routing design, and a fabric bill of materials (switches, NICs, optics, cables)

  • Get hands-on with bring-up at each site: be on the floor for the first racks, validate cabling and firmware, configure the fabric manager and switches, and run performance acceptance (NCCL tests, burn-in) before capacity goes live

  • Tune for real workload performance: congestion control, PFC/ECN, adaptive routing, and NCCL settings for both inference and training traffic

  • Debug fabric problems wherever they show up, from a flapping link to a job that’s mysteriously slow

  • Evaluate and select AI Fabric vendors and hardware, and push back with data when something doesn’t meet spec

  • Collaborate across automation and software to help build network monitoring, telemetry, and automation that let a small team run a large fleet, and be the top escalation point for AI Fabric incidents

  • Document as you go so each new site is faster than the last, and help hire and mentor the network engineers who join after you

Qualifications:

  • 7+ years in data center or HPC networking, including direct responsibility for production GPU cluster fabrics

  • A track record of taking GPU fabrics from empty racks to production, with your own hands on the work, not only through vendors or integrators

  • Deep expertise in InfiniBand (NDR/XDR, UFM, subnet management) and/or RoCEv2 lossless Ethernet

  • Strong command of rail-optimized and Clos/fat-tree designs, BGP/ECMP, and EVPN/VXLAN

  • A clear understanding of how fabric design and tuning affect collective communication and real workload performance

  • Comfortable automating with Python, Ansible, or similar

  • Strong Linux skills and the ability to debug across the boundary between host, NIC, and fabric

  • Sound judgment on tradeoffs between cost, performance, reliability, and time to deploy

  • NVIDIA Quantum/Spectrum-X, ConnectX-7/8, BlueField-3 SuperNICs, and/or Broadcom Tomahawk 5-class Ethernet

  • 400G/800G OSFP optics, AOC/DAC, MPO trunking

Nice to have:

  • Experience at a neocloud, hyperscaler AI infrastructure team, NVIDIA networking, or an AI factory integrator

  • Experience with NVLink / NVL72-class rack-scale systems and how they change scale-out fabric design

  • Experience with GPUDirect RDMA and GPUDirect Storage networks

  • Experience building out multiple sites in parallel or on aggressive timelines

  • Willingness to travel frequently to data center sites, especially during build-outs

What we offer at fal:

  • Interesting and challenging work

  • Competitive salary and equity

  • A lot of learning and growth opportunities

  • We offer relocation assistance to San Francisco.

  • Health, dental, and vision insurance (US)

  • Regular team events and offsite

U.S. EQUAL EMPLOYMENT OPPORTUNITY INFORMATION:

fal provides equal employment opportunities to applicants and employees without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, or any other classification protected by applicable law.

Find Jobs in Germany on Arbeitnow

lightbulb_outline Skills Required
Engineering
Job Details
payment Salary: Negotiable
work Type: Full time
business Mode: Remote
label Category: Engineering
visibility Views: 1
people Applications: 0
lock

Members Only

Sign in or register to apply for this job.

Sign In to Apply
Get the EPELCON App v3.6.0
Invest, Learn & Earn on the go
Download APK
feedback Feedback