Janice Ng
Senior Quantitative UX Researcher
Quantitative UX researcher with a PhD in Psychology and experience at Meta, Amazon, Qualtrics, and academic research. Specializes in behavioral modeling, causal inference, and survey + log-data integration to diagnose user friction, evaluate product changes, and influence product, engineering, and monetization strategy for large-scale platforms.
Select Experience
Senior UX Researcher, Monetization / Ads
Oct 2024 – Present
MetaRemote
-
Generated ad revenue by re-defining Facebook (FB) and Instagram (IG) in-app browser load-time targets
- Used survival modeling and k-fold cross-validation to identify where user drop-off risk increased along landing page latency, and pinpointed First Contentful Paint (FCP) as the engagement-relevant metric.
- Replaced inherited web-standard benchmarks with a behaviorally grounded load-speed target specific to FB+IG users, directly informing a design change that generated ad score gains in subsequent A/B testing.
-
Reclaimed leaked conversions by diagnosing why users complete purchases offsite after ad-click onsite
- Focused specifically on users who clicked an in-app ad then completed their purchase on an external browser within 7 days: proven buyers whose intent was never in question, making it possible to isolate platform friction from low purchase intent rather than conflating the two.
- Triangulated survey and behavioral data to identify friction across checkout flow, seller credibility, and reliability.
- Findings moved 2025-2026 browser priorities toward seller trust signals and transactional security onsite.
-
Validated Video Ad Chaining (VAC) rollout for millions of FB Reels users, clearing the path for continued expansion
- Built an AI-enabled causal evaluation pipeline spanning propensity score matching, doubly robust estimation, and Difference-in-Differences, delivering decision-ready evidence rather than descriptive sentiment reporting.
- Demonstrated VAC had no negative impact on user sentiment or engagement, enabling continued rollout.
-
Identified the Call-to-action (CTA) string now shown to millions of US+CA FB users on Reels: proven performance in production, more scalable than the prior incumbent, and directly seeded an upcoming LLM string generation framework
- Tested 10 CTA variants in a within x between mixed design across 2 surfaces, measuring noticeability (unprimed), engagement intent, post-click expectations, and creator acceptability.
- The winning string was later confirmed as the highest-CTR candidate in A/B testing and generalizes across product verticals, unblocking scaling that the prior incumbent's narrow framing prevented.
- The finding that commerce-led strings outperform discovery-led ones on every dimension directly informed development of an LLM-based bespoke string generation framework in H2.
-
Scaled Monetization UXR AI adoption from 48.5% to 93.3%, built a Claude Code-powered research repository for on-demand stakeholder insight retrieval, and authored vendor research quality guidance adopted Meta-wide
- As AI Ambassador, drove Monetization UXR AI adoption from 48.5% to 93.3% through structured programming and hands-on sessions.
- Built a research repository that auto-ingests findings from team Workplace posts, generates monthly leadership digests, and surfaces a searchable interface where stakeholders can query past insights and receive confidence-rated responses with UXR referrals for net-new needs.
- Negotiated $8.5K in vendor credit following a data quality incident and co-authored Meta-wide vendor quality guidance and a quantitative best-practices checklist now used across Meta.
UX Researcher, Messenger (Contract)
Feb 2023 – Aug 2023
MetaRemote
-
Established psychometric foundation for multi-country messaging app benchmarking
- Supported a multi-country benchmarking survey of messaging apps and developed the factor analysis plan used to assess psychometric properties of survey items across countries.
-
Translated Instagram feature log data into a stakeholder-ready adoption funnel
- Quantified awareness, usage conversion, and future intent for a new IG feature using log data, producing visualizations and implications that informed feature strategy.
-
Produced evidence-based design recommendations for improving perceived app speed
- Synthesized academic and internal research on UI patterns that create a faster perceived experience without changing objective latency, delivering design recommendations grounded in evidence.
Consumer Insights Manager, Ads
Aug 2022 – Jan 2023
AmazonSeattle, WA
-
Enabled abbreviated logo rollout across local advertising markets
- Led a multi-market logo recognition study that directly supported rollout of an abbreviated Amazon logo in local advertising campaigns, accelerating brand localization across markets.
-
Informed local campaign strategy across Mexico, Brazil and Australia through ongoing ad effectiveness measurement
- Managed multi-country ad effectiveness programs, delivering country-specific insights that informed campaign strategy and improvements in consumer perception and brand sentiment.
-
Identified highest- and lowest-performing ad campaigns, enabling smarter budget allocation and follow-up research on commonalities of high-performing campaigns
- Built a weighted attribution model from historical campaign data to pinpoint which marketing teams' ads performed most and least effectively across overlapping campaign flights.
Market Research Consultant, Brand Tracking
Sep 2021 – Jul 2022
QualtricsSeattle, WA
-
Contributed $300K+ in new revenue and $16K in renewals through end-to-end brand tracking programs
- Executed large-scale brand tracking programs from design through sustainment. Ongoing methodological consultation improved client satisfaction and generated renewal revenue.
-
Raised team research capability through advanced statistics training
- Led internal training sessions on advanced statistical concepts to strengthen methodological capability across the practice.
Education
Doctor of Philosophy
Psychology
University of Illinois Urbana-Champaign
J. McVicker Hunt Award for Excellence in Graduate Research
Master of Science
Psychology
University of Illinois Urbana-Champaign
NSF Graduate Fellowship Honorable Mention
Bachelor of Science
Psychology
University of Illinois Urbana-Champaign
Outstanding Undergraduate Student Award
Skills
Statistical Methods
Research Design
Tools