Senior AI Product Engineer, Backend

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior AI Product Engineer, Backend in the United States.

This role offers an exciting opportunity to build and scale high-performance backend systems for AI and LLM-powered applications. You will work on distributed services, APIs, and analytics platforms that process billions of data points, enabling engineers to ship reliable and impactful AI solutions. This position blends deep technical expertise with creativity, allowing you to prototype, optimize, and implement cutting-edge algorithms in a collaborative, remote-first environment. You will directly influence product innovation, work alongside customers and cross-functional teams, and help shape the future of AI observability and evaluation. The ideal candidate thrives in high-growth, technically challenging environments and is passionate about AI, backend engineering, and building systems that scale.

• Design, implement, and maintain scalable, high-performance backend services using Go, Python, Java, and TypeScript.
• Build APIs and infrastructure to support Machine Learning and LLM workflows, ensuring reliability and low-latency performance.
• Develop and maintain analytics and monitoring systems that process high-volume data streams.
• Prototype and optimize distributed services, including OLAP databases, message queues, and dimensionality reduction algorithms.
• Collaborate closely with product, design, and customer engineering teams to translate needs into backend solutions.
• Contribute to open-source frameworks and internal tools that advance platform capabilities.
• Support the development of in-house AI agents and tools that enhance ML and LLM observability.

• 5+ years of experience building high-performance backend systems.
• Strong programming skills in Go, Python, Java, and/or TypeScript/Node.
• Proven experience designing and operating complex SaaS platforms or distributed systems.
• Familiarity with cloud platforms and container orchestration, such as AWS, GCP, Azure, and Kubernetes.
• Enthusiasm for AI and LLM technologies, with a drive to stay current on emerging trends.
• Experience collaborating with cross-functional teams to deliver technically complex solutions.
• Strong problem-solving skills and ability to work independently in a remote-first environment.

• Experience with distributed stream processing frameworks (Kafka, Gazette, etc.).
• Familiarity with OLAP systems or system observability tools like Prometheus.
• Knowledge of ML or data science workflows.
• Hands-on experience working with large language models or developing AI products.

• Competitive salary range: $125,000–$225,000, plus equity.
• Comprehensive healthcare coverage (medical, dental, vision) and 401(k) plan.
• Unlimited paid time off and generous parental leave.
• Support for mental health and wellness initiatives.
• Remote-first work environment with optional NYC and SF offices.
• Monthly WFH stipend for co-working or home office needs.
• Opportunities to collaborate with leading AI engineers, researchers, and ethicists.

Why Apply Through Jobgether?

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

 Why Apply Through Jobgether? 

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1