Staff Data Engineer - Data Engineering

<div class="content-intro">Based in San Francisco, <a href="https://www.arine.io/" target="_blank">Arine</a> is a rapidly growing healthcare technology and clinical services company with a mission to ensure individuals receive the safest and most effective treatments for their unique and evolving healthcare needs. Frequently, medications cause more harm than good. Incorrect drugs and doses costs the US healthcare system over $528 billion in waste, avoidable harm, and hospitalizations each year. Arine is redefining what excellent healthcare looks like by solving these issues through our software platform (SaaS). We combine cutting edge data science, machine learning, AI, and deep clinical expertise to introduce a patient-centric view to medication management, and develop and deliver personalized care plans on a massive scale for patients and their care teams.Arine is committed to improving the lives and health of complex patients that have an outsized impact on healthcare costs and have traditionally been difficult to identify and address. These patients face numerous challenges including complicated prescribing issues across multiple medications and providers, medication challenges with many chronic diseases, and patient issues with access to care. Backed by leading healthcare investors and collaborating with top healthcare organizations and providers, we deliver recommendations and facilitate clinical interventions that lead to significant, measurable health improvements for patients and cost savings for customers. Why is Arine a Great Place to Work?:Outstanding Team and Culture - Our shared mission unites and motivates us to do our best work. We have a relentless passion and commitment to the innovation required to be the market leader in medication intelligence. Making a Proven Difference in Healthcare - We are saving patient lives, and enabling individuals to experience improved health outcomes, including significant reductions in hospitalizations and cost of care.Market Opportunity - Arine is backed by leading healthcare investors and was founded to tackle one of the largest healthcare problems today. Non-optimized medications therapies which cost the US 275,000 lives and $528 billion annually.Dramatic Growth - Arine is managing more than 18 million lives across prominent health plans after only 4 years in the market, and was ranked 236 on the 2024 Inc. 5000 list and was named the 5th fastest-growing company in the AI category.</div>The Role:As a key technical leader and team architect working in a fast-paced environment, you will drive the design, development, and optimization of scalable data ingestion pipelines within the Arine platform. Leveraging expert-level proficiency in Python and AWS, you will architect solutions that handle diverse file types and large-scale healthcare datasets. You will have a direct impact on building reusable, configurable tools set for handling data needs for the entire company.What You'll be Doing:<ul><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Act as the team architect by leading system design reviews, offering recommendations, conducting comprehensive peer reviews, and demonstrating expert-level proficiency in Python and AWS services </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Architecting and implementing scalable data ingestion pipelines handling different file types into Arine platform </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Develop reusable components that can be integrated into data pipelines to enhance efficiency and minimize future implementation time </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Creating configuration-driven, containerized toolsets that can be easily used and maintained by diverse engineering profiles </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Work collaboratively with cross-functional teams to ensure their data requirements are met through ETL components </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Implementing incremental data ingestion strategies for large-scale healthcare datasets </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Building monitoring and alerting systems for data ingestion processes and pipeline health </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Applying software engineering best practices including test-driven development and modular design to data infrastructure </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Refactoring and rebuilding existing data ingestion processes to improve scalability and operational efficiency </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Working with containerization technologies (Docker, Kubernetes) to create portable and maintainable data solutions </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Identify and escalate inefficiencies within and across teams </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Provide technical guidance, mentorship to junior engineers, and promote best practices and coding standards </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Author and support high-quality technical documentation, assisting junior engineers in doing the same </li></ul>Who You Are and What You Bring:<ul><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">10+ years of professional experience in data engineering with focus on large-scale data ingestion and infrastructure </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Deep expertise in Python programming and modern data engineering tools </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Experience creating an automated production grade ETL process using Python and SQL </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Strong understanding of ETL/ELT frameworks and distributed data processing </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Experience with data processing, validation, cleaning and debugging data sets </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Experience with API integration for seamless data exchange between systems </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Proven experience handling and processing various file types and formats, including specialized healthcare standards such as HL7, 834, 837, and NCPDP </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Experience integrating and consolidating data from diverse source systems into a unified repository, including data from EHR and claim systems, as well as from file-based and API integrations </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Experience with processing large data sets (over 10GB) </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Experience with incremental data processing and change data capture (CDC) methodologies </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Strong experience designing scalable data architectures in AWS environment </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Deep understanding of software engineering principles including test-driven development, loose coupling, single responsibility, and modular design </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Experience with containerization technologies (Docker, Kubernetes) and building configuration-driven, maintainable systems </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Proven ability to build tools and systems that can be operated by diverse engineering profiles through configuration rather than code changes </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Passion for building new and improving existing data infrastructure with robust, maintainable, and operationally excellent data systems </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Familiarity with healthcare data and regulatory environments (HIPAA compliance) is a plus </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Strong collaboration and communication skills; comfortable working with diverse technical and non-technical stakeholders </li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Excellent verbal and written communication skills with ability to explain technical infrastructure concepts to diverse audiences </li></ul>Remote Work Requirements:<ul><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">An established private work area that ensures information privacy</li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">A stable high-speed internet connection for remote work</li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">This role is remote, but you will be required to come to on-site meetings multiple times per year. This may be in the interview process, onboarding, and team meetings</li></ul>Perks:Joining Arine offers you a dynamic role and the opportunity to contribute to the company's growth and shape its future. You'll have unparalleled learning and growth prospects, collaborating closely with experienced Clinicians, Engineers, Software Architects, Data Scientists, and Digital Health Entrepreneurs.The posted range represents the expected base salary for this position and does not include any other potential components of the compensation package, benefits, and perks. Ultimately, the final pay decision will consider factors such as your experience, job level, location, and other relevant job-related criteria. The base salary range for this position is: $165,000-180,000/year.<div class="content-conclusion">Job Requirements:<ul><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Ability to pass a background check</li><li style="font-family: arial, helvetica, sans-serif; font-size: 10pt; line-height: 2;">Must live in and be eligible to work in the United States</li></ul>Information Security Roles and Responsibilities:All staff at Arine are expected to be part of its Information Security Management Program and undergo periodic training on Information Security Awareness and HIPAA guidelines. Each user is responsible to maintain a secure working environment and follow all policies and procedures. Upon hire, each person is assigned and must complete trainings before access is granted for their specific role within Arine.Arine is an equal opportunity employer. We are committed to creating a diverse and inclusive workplace where all employees are treated with fairness and respect. We do not discriminate on the basis of race, ethnicity, color, religion, gender, sexual orientation, age, disability, or any other legally protected status. Our hiring decisions and employment practices are based solely on qualifications, merit, and business needs. We encourage individuals from all backgrounds to apply and join us in our mission.Check our website at https://www.arine.io. This is a unique opportunity to join a growing start-up revolutionizing the healthcare industry!Job Offers: Arine uses the arine.io domain and email addresses for all official communications. If you received communication from any other domain, please consider it spam. Note to Recruitment Agencies: We appreciate your interest in finding talent for Arine, but please be advised that we do not accept unsolicited resumes from recruitment agencies. All resumes submitted to Arine without a prior written agreement in place will be considered property of Arine, and no fee will be paid in the event of a hire. Thank you for your understanding.</div>

Staff Data Engineer - Data Engineering

USA Remote Jobs