About the role
AgelessRx is seeking a detail-oriented and results-driven Experimentation Analyst to join our Data and Analytics team. In this role, you will be responsible for setting up, auditing, analyzing, and presenting results for our A/B and multivariate experiments across various product areas such as hero images, landing pages, funnels, and more. You will work closely with cross-functional teams, including Product, Engineering, and other stakeholders, to drive customer growth, enhance user engagement, and optimize the patient experience.
What you'll do
- Apply best practices for experiment design by supporting hypothesis definition, KPI selection, requirements gathering, experiment coordination, event audit, process documentation, and post-hoc analyses
- Analyze experiment results and compile post-hoc analyses to provide actional insights that inform product development decisions, including prioritizing new features, enhancements, and optimizations for user engagement, conversion, and retention
- Maintain and monitor the operational status of experiment queues, roadmaps, test schedules, and in-flight tests
- Work closely with the Product and Engineering teams to implement findings from testing
- Manage the full experiment lifecycle, including experiment queues, test schedules, and in-progress experiments, ensuring timely execution and accurate data collection
- Partner closely with product and engineering teams to communicate test findings and ensure successful implementation of test-driven insights
- Collaborate with cross-functional teams, including product management, design, and engineering, to understand business needs and translate them into effective experimentation strategies
- Troubleshoot experimental setups in collaboration with Engineering, including working on metric definitions, targeting segments, regular expressions, and data integrity issues
Qualifications
- Bachelor’s degree in Mathematics, Statistics, Physics, Engineering, Economics, Finance, or a related field
- At least 1 year of hands-on experience in implementing and analyzing A/B and multivariate experiments for ecommerce optimization or similar experience
- Proficiency with A/B testing platforms (experience with StatSig preferred) and basic understanding of HTML for experiment setup
- Working knowledge of databases using SQL
- Familiarity with web analytics tools (Heap or similar) for deriving actionable insights from user data is a plus
- Familiarity with data visualization and dashboarding tools (e.g. Tableau) to communicate findings effectively is a plus
- Familiarity with statical analysis tools such as Python, R, or similar is a plus
- Experience in ecommerce or telehealth industries is a plus
- Excellent written and verbal communication skills with the ability to translate complex analytical findings to diverse audiences