Systems engineer
Meta's AI Training and Inference Infrastructure is growing exponentially to support ever increasing uses cases of AI. This results in a dramatic scaling challenge that our engineers have to deal with on a daily basis. We need to build and evolve our network infrastructure that connects myriads of training accelerators like GPUs together. In addition, we need to ensure that the network is running smoothly and meets stringent performance and availability requirements of RDMA workloads that expects a loss-less fabric interconnect. To improve performance of these systems we constantly look for opportunities across stack: network fabric and host networking, comms lib and scheduling infrastructure.
AI/HPC Systems Performance Engineer Responsibilities:- Active member of a multi-disciplinary team to develop solutions for large scale training systems
- Responsible for the overall performance of the communication system, including performance benchmarking, monitoring and troubleshooting production issues
- Identify potential performance issues across the stack: comms lib, RDMA transport, host networking, scheduling and network fabric. Develop and deploy innovative solutions to address the performance issues
- Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
- BS/MS/PhD in relevant fields (EE, CS), with 2+ years work experience
- Experience with using communication libraries, such as MPI, NCCL, and UCX
- Experience with developing, evaluating and debugging host networking protocols such as RDMA
- Experience with triaging performance issues in complex scale-out distributed applications
- Understanding of AI training workloads and demands they exert on networks
- Understanding of RDMA congestion control mechanisms on IB and RoCE Networks
- Understanding of the latest artificial intelligence (AI) technologies
- Experience with machine learning frameworks such as PyTorch and TensorFlow
- Experience in developing systems software in languages like C++
Recommended Jobs
Diesel Locomotive Mechanic
Job Description Job Description Receives instructions regarding work to be done. Determines materials and required tools. Performs inspection utilizing diagnostic systems, analyzes trouble …
Healthcare Interpreters Needed in Austin, TX
Company: LanguageLine Solutions Onsite Division Position: Medical Interpreters Needed in Austin, TX Are you passionate about bridging communication barriers in healthcare? LanguageLine Soluti…
Microsoft D365 ERP (F&O) Functional Consultant, Senior Associate Save for Later Remove job
A career in our Microsoft Dynamics team will provide the opportunity to help our clients transform their technology landscape across Front, Back and Mid-Office functions leveraging Microsoft Dynami…
Accounts Receivable Clerk
Summary/Objective The accounts receivable clerk is responsible for the receipt and accounting of funds being paid to the organization. This role also serves as an auditor, ensuring that invoices are…
Sales Associate
Hublot is seeking a Sales Associate in Dallas to play a pivotal role in achieving boutique success through exceptional customer service and sales target achievement. The role demands a professional wi…
Lead software developer
WHO WE ARE: At Orion180, we don’t just stand out for what we do - we shine because of how we do it. By integrating cutting-edge, proprietary technology, innovative solutions, and compassion for s…
Coder III
Job Title: Coder III Location: Costa mesa, CA 92626 Duration: 3 months Position Summary: Reviews clinical documentation and diagnostic results and applies appropriate ICD-10-CM, and…
Application Software Engineer
SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today SpaceX is actively developing the technolog…
Senior Business/Facilities Planner - Baytown,Tx
About us At ExxonMobil, our vision is to lead in energy innovations that advance modern living and a net-zero future. As one of the world’s largest publicly traded energy and chemical comp…