📊 A/B 測試儀表板

Search Entry Optimization A/B Test

📅 實驗期間: 2026-03-02 ~ 2026-04-18

📈 指標導航

📊 [Overall Summary]

📋 所有指標最新統計摘要

指標名稱 實驗組 實驗組累計平均 控制組累計平均 差異 P值 顯著性 實驗組樣本數 控制組樣本數
All Notification Total Pv Count treatment 1029139.0000 1081716.0000 -4.86% 0.0000 ✅ 84,344 84,180
All Source Pv Count treatment 37.6766 38.2035 -1.38% 0.3861 ❌ 84,344 84,180
Forum Search Entry Click Count treatment 0.0490 0.0498 -1.63% 0.2699 ❌ 84,344 84,180
Forum Search Entry Click Rate treatment 0.2062 0.2077 -0.71% 0.4561 ❌ 84,344 84,180
Heartbeat Duration treatment 10868.6398 10703.4691 +1.54% 0.0905 ❌ 84,344 84,180
Inapp Total Pv Count treatment 315735.0000 405384.0000 -22.11% 0.0000 ✅ 84,344 84,180
Lt1 Retained Day treatment 0.6648 0.6643 +0.07% 0.7553 ❌ 84,034 83,834
Lt3 Retained Day treatment 1.9644 1.9639 +0.03% 0.9111 ❌ 83,568 83,358
Lt7 Retained Day treatment 4.5441 4.5445 -0.01% 0.9717 ❌ 82,560 82,308
Notification Entry Conversion Count treatment 0.3113 0.4343 -28.32% 0.0000 ✅ 84,344 84,180
Notification Entry Conversion Rate treatment 0.3035 0.4560 -33.45% 0.0000 ✅ 84,344 84,180
Notification Pv Count treatment 3.7434 4.8156 -22.27% 0.0000 ✅ 84,344 84,180
Notification Pv Per User treatment 0.1918 0.2482 -22.71% 0.0000 ✅ 84,344 84,180
Push Notification Pv Count treatment 8.6422 8.2929 +4.21% 0.0044 ✅ 84,344 84,180
Push Notification Pv Per User treatment 0.4429 0.4274 +3.62% 0.0000 ✅ 84,344 84,180
Push Total Pv Count treatment 728925.0000 698102.0000 +4.42% 0.0000 ✅ 84,344 84,180
Search Default Page Total Pv Count treatment 27145.0000 25071.0000 +8.27% 0.0000 ✅ 84,344 84,180
Search Default Page View Count treatment 0.0165 0.0154 +7.45% 0.0058 ✅ 84,344 84,180
Search Entry Click Count treatment 4.8229 4.2459 +13.59% 0.0000 ✅ 84,344 84,180
Search Entry Click Rate treatment 0.6041 0.5433 +11.18% 0.0000 ✅ 84,344 84,180
Search Overall Success Rate treatment 0.6975 0.7689 -9.28% 0.0000 ✅ 5,254 4,640
Search Post Success Rate treatment 0.6443 0.7114 -9.44% 0.0000 ✅ 5,254 4,640
Search Pv Count treatment 19.4145 19.1817 +1.21% 0.4209 ❌ 84,344 84,180
Search Pv Per User treatment 0.9950 0.9887 +0.64% 0.5312 ❌ 84,344 84,180
Search Submission Rate treatment 0.5050 0.5490 -8.03% 0.0000 ✅ 5,254 4,640
Search Total Pv Count treatment 1637515.0000 1614738.0000 +1.41% 0.0000 ✅ 84,344 84,180

📊 各實驗組詳細數據

以下按實驗組分別顯示所有指標的表現，方便專注查看單一組別

🔬 treatment

指標名稱 實驗組累計平均 控制組累計平均 差異 P值 顯著性 實驗組樣本數 控制組樣本數
All Notification Total Pv Count 1029139.0000 1081716.0000 -4.86% 0.0000 ✅ 84,344 84,180
All Source Pv Count 37.6766 38.2035 -1.38% 0.3861 ❌ 84,344 84,180
Forum Search Entry Click Count 0.0490 0.0498 -1.63% 0.2699 ❌ 84,344 84,180
Forum Search Entry Click Rate 0.2062 0.2077 -0.71% 0.4561 ❌ 84,344 84,180
Heartbeat Duration 10868.6398 10703.4691 +1.54% 0.0905 ❌ 84,344 84,180
Inapp Total Pv Count 315735.0000 405384.0000 -22.11% 0.0000 ✅ 84,344 84,180
Lt1 Retained Day 0.6648 0.6643 +0.07% 0.7553 ❌ 84,034 83,834
Lt3 Retained Day 1.9644 1.9639 +0.03% 0.9111 ❌ 83,568 83,358
Lt7 Retained Day 4.5441 4.5445 -0.01% 0.9717 ❌ 82,560 82,308
Notification Entry Conversion Count 0.3113 0.4343 -28.32% 0.0000 ✅ 84,344 84,180
Notification Entry Conversion Rate 0.3035 0.4560 -33.45% 0.0000 ✅ 84,344 84,180
Notification Pv Count 3.7434 4.8156 -22.27% 0.0000 ✅ 84,344 84,180
Notification Pv Per User 0.1918 0.2482 -22.71% 0.0000 ✅ 84,344 84,180
Push Notification Pv Count 8.6422 8.2929 +4.21% 0.0044 ✅ 84,344 84,180
Push Notification Pv Per User 0.4429 0.4274 +3.62% 0.0000 ✅ 84,344 84,180
Push Total Pv Count 728925.0000 698102.0000 +4.42% 0.0000 ✅ 84,344 84,180
Search Default Page Total Pv Count 27145.0000 25071.0000 +8.27% 0.0000 ✅ 84,344 84,180
Search Default Page View Count 0.0165 0.0154 +7.45% 0.0058 ✅ 84,344 84,180
Search Entry Click Count 4.8229 4.2459 +13.59% 0.0000 ✅ 84,344 84,180
Search Entry Click Rate 0.6041 0.5433 +11.18% 0.0000 ✅ 84,344 84,180
Search Overall Success Rate 0.6975 0.7689 -9.28% 0.0000 ✅ 5,254 4,640
Search Post Success Rate 0.6443 0.7114 -9.44% 0.0000 ✅ 5,254 4,640
Search Pv Count 19.4145 19.1817 +1.21% 0.4209 ❌ 84,344 84,180
Search Pv Per User 0.9950 0.9887 +0.64% 0.5312 ❌ 84,344 84,180
Search Submission Rate 0.5050 0.5490 -8.03% 0.0000 ✅ 5,254 4,640
Search Total Pv Count 1637515.0000 1614738.0000 +1.41% 0.0000 ✅ 84,344 84,180

📊 All Notification Total Pv Count

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 1081716.0000 - 84,180 - -
treatment 1029139.0000 -4.86% 84,344 0.0000 ✅

📊 All Source Pv Count

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 38.2035 - 84,180 - -
treatment 37.6766 -1.38% 84,344 0.3861 ❌

📊 Forum Search Entry Click Count

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 0.0498 - 84,180 - -
treatment 0.0490 -1.63% 84,344 0.2699 ❌

📊 Forum Search Entry Click Rate

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 0.2077 - 84,180 - -
treatment 0.2062 -0.71% 84,344 0.4561 ❌

📊 Heartbeat Duration

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 10703.4691 - 84,180 - -
treatment 10868.6398 +1.54% 84,344 0.0905 ❌

📊 Inapp Total Pv Count

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 405384.0000 - 84,180 - -
treatment 315735.0000 -22.11% 84,344 0.0000 ✅

📊 Lt1 Retained Day

📋 最新統計摘要 (2026-04-19)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 0.6643 - 83,834 - -
treatment 0.6648 +0.07% 84,034 0.7553 ❌

📊 Lt3 Retained Day

📋 最新統計摘要 (2026-04-21)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 1.9639 - 83,358 - -
treatment 1.9644 +0.03% 83,568 0.9111 ❌

📊 Lt7 Retained Day

📋 最新統計摘要 (2026-04-25)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 4.5445 - 82,308 - -
treatment 4.5441 -0.01% 82,560 0.9717 ❌

📊 Notification Entry Conversion Count

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 0.4343 - 84,180 - -
treatment 0.3113 -28.32% 84,344 0.0000 ✅

📊 Notification Entry Conversion Rate

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 0.4560 - 84,180 - -
treatment 0.3035 -33.45% 84,344 0.0000 ✅

📊 Notification Pv Count

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 4.8156 - 84,180 - -
treatment 3.7434 -22.27% 84,344 0.0000 ✅

📊 Notification Pv Per User

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 0.2482 - 84,180 - -
treatment 0.1918 -22.71% 84,344 0.0000 ✅

📊 Push Notification Pv Count

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 8.2929 - 84,180 - -
treatment 8.6422 +4.21% 84,344 0.0044 ✅

📊 Push Notification Pv Per User

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 0.4274 - 84,180 - -
treatment 0.4429 +3.62% 84,344 0.0000 ✅

📊 Push Total Pv Count

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 698102.0000 - 84,180 - -
treatment 728925.0000 +4.42% 84,344 0.0000 ✅

📊 Search Default Page Total Pv Count

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 25071.0000 - 84,180 - -
treatment 27145.0000 +8.27% 84,344 0.0000 ✅

📊 Search Default Page View Count

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 0.0154 - 84,180 - -
treatment 0.0165 +7.45% 84,344 0.0058 ✅

📊 Search Entry Click Count

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 4.2459 - 84,180 - -
treatment 4.8229 +13.59% 84,344 0.0000 ✅

📊 Search Entry Click Rate

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 0.5433 - 84,180 - -
treatment 0.6041 +11.18% 84,344 0.0000 ✅

📊 Search Overall Success Rate

📋 最新統計摘要 (2026-04-16)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 0.7689 - 4,640 - -
treatment 0.6975 -9.28% 5,254 0.0000 ✅

📊 Search Post Success Rate

📋 最新統計摘要 (2026-04-16)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 0.7114 - 4,640 - -
treatment 0.6443 -9.44% 5,254 0.0000 ✅

📊 Search Pv Count

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 19.1817 - 84,180 - -
treatment 19.4145 +1.21% 84,344 0.4209 ❌

📊 Search Pv Per User

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 0.9887 - 84,180 - -
treatment 0.9950 +0.64% 84,344 0.5312 ❌

📊 Search Submission Rate

📋 最新統計摘要 (2026-04-16)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 0.5490 - 4,640 - -
treatment 0.5050 -8.03% 5,254 0.0000 ✅

📊 Search Total Pv Count

📋 最新統計摘要 (2026-04-18)

實驗組 累計平均 差異 樣本數 P值 (vs Control) 顯著性
control 1614738.0000 - 84,180 - -
treatment 1637515.0000 +1.41% 84,344 0.0000 ✅

🤖 由 A/B 測試框架自動生成 | 生成時間: 2026-04-17 13:36:32