A/B Test Data Scientist (Website Experimentation)
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
One of our leading client is looking for A/B Test Data Scientist (Website Experimentation) in Austin TXKey ResponsibilitiesCore DutiesStrategy & DesignFormulate clear hypotheses and define primary/secondary metrics. Determine required sample sizes, power, and test duration.ExecutionOversee randomization and user segmentation. Partner with engineers to ensure proper tracking and data integrity.AnalysisApply statistical methods (p-values, confidence intervals) to determine significance. Conduct post-test deep dives to identify segment-specific impacts.Strategy & ReportingTranslate complex data into clear, actionable recommendations for stakeholders. Maintain an experimentation roadmap and archive learnings. Required Skills & Qualifications Statistical Expertise: Mastery of hypothesis testing, experimental design, and probability. Knowledge of Bayesian vs. Frequentist approaches is a plus.Programming: Proficiency in SQL for data extraction and Python or R for advanced statistical analysis.Tools: Experience with experimentation platforms (e.g., Optimizely, VWO, or LaunchDarkly) and web analytics (e.g., Google Analytics 4).Visualization: Ability to build dashboards in Tableau, Power BI, or Looker to monitor live tests.Soft Skills: Strong critical thinking and the ability to explain "why" a result occurred to non-technical partners. Experience & Education Education: Bachelor’s degree in a quantitative field (Statistics, Math, CS, Economics); Master’s or PhD preferred.Experience: 2–5 years in a data science or product analytics role, specifically focused on digital experimentation