User Experience Optimization:From Heuristic Intervention to Unified Value Modeling
In the evolution of Search, Ads, and Recommendation systems, User Experience (UX) is an unavoidable core challenge. In this article, we quantify UX as LT (Life Time), specifically referring to user retention (e.g., the number of days a user opens the app within a 7-day window).
Unlike pure content recommendation, which seeks to maximize total watch time, optimization in commercial or marketing-oriented sectors (Ads, E-commerce, Live Streaming) is about maximizing business value (Cost, GMV, etc.) while staying above a "UX Redline." More accurately, it is about maximizing the efficiency of exchanging "Unit LT" for "Business Metrics."
We typically use Holdout Experiments (Reverse Experiments) to measure how a business strategy affects LT. The factors influencing these results are multifaceted:
- Explicit Factors: These are the most direct and well-known, involving the position and density of business items (e.g., start_pos, gap, load).
- Implicit Factors: Supply quality and ranking accuracy. The quality and diversity of ad creatives or live-streaming content determine the appeal of the distribution queue. If supply is insufficient or ranking is inaccurate, users are less likely to be attracted to the platform.
- Opportunity Cost (Backfill Logic): A frequently overlooked point. A holdout experiment compares the "Business Queue" with a "Backfill Queue" (usually the organic recommendation queue). The final impact on LT is essentially:
\[\Delta LT = LT_{Business} - LT_{Backfill}\]
The negative impact on LT is minimized only when the business content is as attractive as—or more attractive than—the organic content it replaces.
While improving supply and ranking accuracy are the fundamental drivers for LT, they take time to yield results. In day-to-day engineering, adjusting load, start pos, and gap remains the most immediate lever. Furthermore, we must establish strict defensive mechanisms to prevent short-term gains from masking long-term, cumulative UX damage.
This article explores the evolution of UX optimization through three stages: Short-term Defense (Heuristic Protection), Mid-term Tuning (Experience Modeling), and Long-term Alignment (Unified Value Modeling).
