Staff Software Engineer ( AI )

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Staff Software Engineer (AI) in United States.

This role places you at the forefront of building and scaling next-generation AI platform capabilities within a regulated, high-impact financial technology environment. As a senior technical leader, you will shape the architecture, standards, and long-term direction of AI systems powering customer-facing products. You will work at the intersection of platform engineering, applied AI, and cloud infrastructure, enabling reliable and scalable GenAI services across multiple product lines. The position combines deep hands-on engineering with strategic architectural influence across teams. You will help define how AI is designed, deployed, and governed at scale, ensuring safety, performance, and compliance. Working in a highly collaborative, remote-first engineering organization, you will partner closely with product, security, and data teams. Your contributions will directly influence the evolution of enterprise-grade AI capabilities in production.

Accountabilities

In this role, you will define and lead the technical direction of AI platform systems while contributing hands-on to backend and platform engineering. You will establish architectural standards, guide cross-team alignment, and ensure scalable and secure AI adoption across the organization. You will also play a key role in shaping model infrastructure, evaluation systems, and AI data pipelines as the platform evolves. Key responsibilities include:

Own and define the reference architecture for AI platform systems, including APIs, RAG pipelines, vector retrieval, and model serving infrastructure
Lead design standards, architectural reviews, and build-vs-buy decisions across AI and platform components
Develop and maintain scalable data pipelines and infrastructure supporting production AI services
Design and implement backend services in Python and REST APIs, with occasional full-stack contributions (React/TypeScript)
Build evaluation frameworks, observability systems, and performance monitoring for AI models and services
Integrate and manage LLM-based systems, including prompt management, response validation, and fallback strategies
Ensure compliance and security by design, collaborating with security teams on governance and regulatory requirements
Mentor engineers, lead technical discussions, and promote engineering excellence across teams
Partner with product and engineering leadership to define AI roadmap and platform evolution

Requirements

This position requires extensive experience in software engineering with strong exposure to AI systems, distributed architectures, and cloud platforms. You should be comfortable operating at a staff-level scope, influencing technical direction across multiple teams while delivering hands-on solutions. Strong communication, leadership, and system design skills are essential. Key requirements include:

8+ years of experience in software engineering with cross-team architectural influence
Proven experience delivering AI-powered or GenAI-based production systems
Strong proficiency in Python and RESTful API development (e.g., FastAPI or Django)
Experience with LLM integrations, RAG pipelines, prompt engineering, or evaluation frameworks
Solid understanding of distributed systems, cloud-native architecture, and scalable backend systems
Familiarity with AWS or similar cloud platforms and modern DevOps practices (CI/CD, Docker, Kubernetes)
Experience with vector databases and semantic search technologies (e.g., Pinecone, pgvector, OpenSearch)
Knowledge of MLOps/LLMOps concepts, model lifecycle, and production deployment practices
Ability to write architectural documentation (RFCs, ADRs) and communicate across technical and non-technical audiences
Experience mentoring engineers and contributing to engineering culture and standards
Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience

Benefits

Fully remote work environment
High-impact role shaping enterprise AI platform strategy
Opportunity to work on cutting-edge GenAI and LLM-based systems
Strong influence across architecture, engineering standards, and platform direction
Collaborative, cross-functional engineering culture
Exposure to regulated, large-scale financial technology systems
Career growth opportunities in senior technical leadership pathways

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

Staff Software Engineer ( AI )

Requirements

Benefits

USA Remote Jobs