Principal Software Engineer, Distributed Systems

At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration.

We value humility and believe in direct communication. Our team is inclusive, and our differing perspectives allow for better solutions. We are seeking individuals passionate about tackling challenges and are driven by execution.  Ready to come find your playground? Together, we can help shape the endless possibilities of AI. 

Location:

Hybrid, working on-site at our Santa Clara, CA, headquarters 3-5 days per week.

The Role: Principal Engineer/Technical Director, Distributed Systems

What You Will Do:

The Principal Engineer/Director role requires you to be part of the team that helps productize the SW stack for our AI compute engine. As part of the software team, you will lead the development, enhancement, and maintenance of the distributed systems software stack for scale-out of the next generation AI hardware. The d-Matrix software stack consists of runtime and lowering software. The runtime software consists of host drivers, inference serving engines, and embedded chip software that support execution of large language models across single cards, multiple cards on a node, and multiple nodes on and across racks in a data center. The distributed systems team builds software to enable scale-out. This includes support for data plane operations such as protocol translation hardware NICs, as well as control and management plane operations such as telemetry, monitoring, microservices, container orchestration, and datacenter network tooling.

You possess experience building large-scale systems for novel HW architectures. You possess a very strong understanding of scale-out and data communication collectives. You also have experience in

You have had past experience working across all aspects of a full-stack toolchain for an accelerator and understand the nuances of what it takes to optimize and trade off various aspects of hardware-software co-design. You are able to build and scale software deliverables in a tight development window. This role requires collaborating with the HW and SW architecture team, the compiler team, the data science numerics team, the SW test group, the benchmark group, and the teams developing the various simulator and emulation platforms.

What You Will Bring:

• BS Computer Science, Engineering, Math, Physics or related degree / MS Preferred The Role: Principal Engineer/Technical Director, Distributed Systems

• Strong grasp of computer architecture, data structures, system software, and machine learning fundamentals

• Leadership experience at manager or senior manager level with software for AI accelerator HW

• Proficient in C/C++ and Python development in Linux environment and using standard development tools

• Experience designing and implementing algorithms in high-level languages such as C/C++ and Python

• Experience with host bring-up of specialized hardware such as NICs, network FPGAs, and smart NICs

• Experience with distributed systems software such as message passing and MPI

• Experience with designing and integrating systems for reliability, high availability, fault tolerance, and failover

• Experience with cluster orchestration, including defining containers and integration with Kubernetes

• Experience with performance benchmarking and tuning of large-scale distributed systems

• Self-motivated team player with a strong sense of ownership and leadership

Desired:

• Prior startup, small team or incubation experience

• Experience scaling up large-scale machine learning systems, specifically large language models, using expert parallelism and data parallelism

• Work experience at a cloud provider or AI compute/subsystem company

Equal Opportunity Employment Policy

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication and a willingness to embrace challenges and learn together every day.

d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individual interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of al applicants. Thank you for your understanding and cooperation.