16.2 · KPI per Modul/Fitur
Dokumen ini merinci KPI spesifik untuk setiap modul dan fitur utama ELJoy. KPI ini merupakan turunan dari metrik keberhasilan produk secara keseluruhan (lihat 16.1 · Metrik Keberhasilan Produk) yang diaplikasikan pada level modul agar setiap tim memiliki target yang jelas dan terukur.
Assessment System (Bagian 4)
4.1 · Ice Breaker Assessment
| KPI | Target | Cara Mengukur |
|---|---|---|
| Completion rate | > 80% dari yang memulai | Analytics: started vs completed |
| Average completion time | 3-5 menit | Timestamp tracking |
| Drop-off rate per pertanyaan | < 10% per pertanyaan | Funnel analytics |
| User satisfaction score | > 4.0/5.0 | Post-assessment micro-survey |
4.2 · Universal Assessment
| KPI | Target | Cara Mengukur |
|---|---|---|
| Completion rate | > 60% dari Ice Breaker completers | Funnel analytics |
| Average completion time | 10-15 menit | Timestamp tracking |
| CEFR level accuracy vs manual assessment | > 85% agreement | Periodic sampling & expert review |
| Repeat assessment rate (re-take) | < 15% | Internal tracking |
4.3 · Adaptive Confirmation Assessment
| KPI | Target | Cara Mengukur |
|---|---|---|
| Completion rate | > 80% dari yang memulai | Analytics tracking |
| Confirmation accuracy (user agrees with result) | > 90% | Post-assessment feedback |
| Average completion time | 5-8 menit | Timestamp tracking |
| Level adjustment rate (naik/turun dari Universal) | 10-20% | Internal data comparison |
4.4 · Continuous Assessment
| KPI | Target | Cara Mengukur |
|---|---|---|
| Assessment trigger frequency | 1x per minggu (otomatis) | System logs |
| User awareness of level change | > 80% melihat notifikasi | Notification open rate |
| False positive rate (naik level padahal belum siap) | < 5% | Expert review sampling |
4.5 · Profil Kemampuan Pengguna (Learner Profile)
| KPI | Target | Cara Mengukur |
|---|---|---|
| Profile view rate per user per week | > 2x | Page view analytics |
| Skill Radar data completeness | > 90% dimensi terisi | Internal data check |
| User understanding of profile (comprehension) | > 80% paham | In-app survey sampling |
Learning Journey (Bagian 5)
5.1 · Personalized Learning Blueprint
| KPI | Target | Cara Mengukur |
|---|---|---|
| Blueprint generation success rate | > 99% | System error logs |
| User acceptance of Blueprint | > 85% tidak melakukan reset | Blueprint reset tracking |
| Blueprint-to-first-mission time | < 2 menit | Timestamp tracking |
5.2 · Learning Objective & Learning Path
| KPI | Target | Cara Mengukur |
|---|---|---|
| % user yang menyelesaikan Learning Objective pertama | > 50% dalam 2 minggu | Progress tracking |
| Average objectives completed per month | > 2 | Internal tracking |
| Path relevance score (user feedback) | > 4.0/5.0 | Periodic survey |
5.3 · Mission System (Daily & Progression)
| KPI | Target | Cara Mengukur |
|---|---|---|
| Daily mission completion rate | > 60% dari DAU | Mission completion logs |
| Average missions completed per user per week | > 3 | Internal tracking |
| Mission variety satisfaction | > 3.5/5.0 | In-app feedback |
| Streak maintenance (> 7 hari berturut) | > 20% dari active users | Streak tracking |
5.4 · Evidence of Mastery
| KPI | Target | Cara Mengukur |
|---|---|---|
| Evidence achieved per user per month | > 2 | Internal tracking |
| Evidence share rate (social sharing) | > 10% dari evidence earned | Share action tracking |
| Time-to-first-evidence | < 14 hari dari registrasi | Timestamp tracking |
5.5 · Progress Tracking & Level Progression
| KPI | Target | Cara Mengukur |
|---|---|---|
| Dashboard view rate | > 3x per minggu per user | Page view analytics |
| % user yang naik sub-level per bulan | > 20% | Level tracking |
| % user yang naik full level per 3 bulan | > 10% | Level tracking |
| Progress data accuracy | > 99% | Automated data validation |
AI Companion (Bagian 6)
6.1 · AI Companion: Peran & Perilaku
| KPI | Target | Cara Mengukur |
|---|---|---|
| AI response relevance score | > 4.0/5.0 | User feedback per interaction |
| AI personality consistency | > 90% on-brand | Periodic manual review |
| User engagement with AI (interactions per session) | > 5 exchanges | Conversation logs |
6.2 · Konteks & Memori AI
| KPI | Target | Cara Mengukur |
|---|---|---|
| Context recall accuracy | > 85% | Automated testing + sampling |
| Personalization relevance | > 80% user merasa dipahami | Periodic survey |
| Context loading latency | < 500ms | Performance monitoring |
6.3 · Evaluasi & Feedback dari AI
| KPI | Target | Cara Mengukur |
|---|---|---|
| Feedback helpfulness rating | > 4.0/5.0 | Post-feedback thumbs up/down |
| Feedback accuracy (grammar/pronunciation) | > 90% | Expert review sampling |
| User action after feedback (retry/improve) | > 60% | Behavioral tracking |
6.4 · AI sebagai Motivator & Coach
| KPI | Target | Cara Mengukur |
|---|---|---|
| Motivational message engagement rate | > 40% click/response | Interaction tracking |
| Return rate after motivational nudge | > 30% | Re-engagement tracking |
| User sentiment toward AI coaching | Positive (> 70% positive sentiment) | NLP sentiment analysis on feedback |
6.5 · Batasan & Etika AI
| KPI | Target | Cara Mengukur |
|---|---|---|
| Off-topic/inappropriate response rate | < 0.1% | Automated moderation + user reports |
| User safety incident rate | 0 critical incidents | Incident tracking system |
| Guardrail trigger rate | Within expected range (1-3%) | System logs |
Speaking Practice Engine (Bagian 7)
7.1 · Framework & Alur Standar Latihan
| KPI | Target | Cara Mengukur |
|---|---|---|
| Session start-to-completion rate | > 70% | Funnel analytics |
| Average session duration | 10-20 menit | Session timing |
| Sessions per user per week | > 3 | Session counting |
7.2 · Mode: Repeat After Me / MyMicry & Shadowing
| KPI | Target | Cara Mengukur |
|---|---|---|
| Pronunciation accuracy improvement per session | > 5% improvement | Score comparison start vs end |
| Completion rate per exercise | > 85% | Exercise tracking |
| Repeat attempts per sentence | 1.5-3x (healthy range) | Attempt counting |
7.3 · Mode: Role Play & Daily Life Conversation
| KPI | Target | Cara Mengukur |
|---|---|---|
| Average conversation turns per session | > 8 turns | Conversation logs |
| Vocabulary usage diversity (unique words) | Growing trend per user | NLP analysis |
| Scenario completion rate | > 65% | Scenario tracking |
7.4 · Mode: Storytelling, Opinion Giving & Discussion
| KPI | Target | Cara Mengukur |
|---|---|---|
| Average speaking duration per attempt | > 30 detik (increasing trend) | Audio duration tracking |
| Coherence score improvement | Positive trend | AI evaluation scoring |
| User confidence rating (self-assessment) | > 3.5/5.0 | Post-exercise survey |
7.5 · Mode: Debate, Problem Solving & Creative Modes
| KPI | Target | Cara Mengukur |
|---|---|---|
| Argument structure score | Improving trend | AI evaluation |
| Critical thinking indicators | Positive trend | AI analysis |
| User satisfaction with advanced modes | > 3.5/5.0 | Post-exercise survey |
7.6 · Sistem Evaluasi per Mode Latihan
| KPI | Target | Cara Mengukur |
|---|---|---|
| Evaluation consistency (same input = similar score) | > 90% consistency | Automated testing |
| User agreement with evaluation | > 75% | Thumbs up/down feedback |
| Evaluation generation latency | < 3 detik | Performance monitoring |
Content Management (Bagian 8)
8.1 – 8.5 · Hierarki Konten, Speaking Content, Communication Toolkit, CEFR Eligibility & Content Library
| KPI | Target | Cara Mengukur |
|---|---|---|
| Content coverage per CEFR level | > 90% topics covered | Content audit |
| Content freshness (% updated in last 6 months) | > 70% | Content timestamp tracking |
| Content relevance score (user rating) | > 4.0/5.0 | In-app content rating |
| Content error/bug report rate | < 1% dari content items | User report tracking |
| Time-to-publish (new content) | < 48 jam dari approval | CMS workflow tracking |
| Content utilization rate (% konten yang digunakan) | > 60% | Analytics tracking |
Membership & Monetisasi (Bagian 9)
9.1 · Model Membership (Free vs Member)
| KPI | Target | Cara Mengukur |
|---|---|---|
| Free-to-paid conversion rate | > 5% | Funnel analytics |
| Time-to-conversion (registration → paid) | < 14 hari (median) | Timestamp tracking |
| Free user engagement (to drive conversion) | > 3 sessions/week | Session tracking |
9.2 · Paket Berlangganan & Harga
| KPI | Target | Cara Mengukur |
|---|---|---|
| Most popular plan ratio | Annual > 40% | Plan distribution analytics |
| Plan upgrade rate (monthly → annual) | > 15% | Subscription tracking |
| Price sensitivity (churn after price change) | < 5% incremental churn | Cohort analysis |
9.3 · Pembayaran & Billing
| KPI | Target | Cara Mengukur |
|---|---|---|
| Payment success rate | > 95% | Payment gateway logs |
| Payment failure recovery rate | > 50% retry success | Retry tracking |
| Refund/dispute rate | < 2% | Financial reporting |
| Billing-related support tickets | < 5% dari total tickets | Support ticket classification |
User Management & Profil (Bagian 10)
10.1 · Registrasi & Autentikasi
| KPI | Target | Cara Mengukur |
|---|---|---|
| Registration completion rate | > 90% dari yang memulai | Funnel analytics |
| Registration time (form start → complete) | < 2 menit | Timestamp tracking |
| Login success rate | > 98% | Auth system logs |
| Password reset completion rate | > 80% | Auth flow tracking |
10.2 · Profil Pengguna & Preferensi
| KPI | Target | Cara Mengukur |
|---|---|---|
| Profile completion rate | > 60% mengisi semua field | Profile data completeness check |
| Preference update frequency | > 1x per bulan | Profile edit tracking |
10.3 · Progress Dashboard
| KPI | Target | Cara Mengukur |
|---|---|---|
| Dashboard load time | < 2 detik | Performance monitoring |
| Dashboard visit frequency | > 3x per minggu | Page view analytics |
| Dashboard feature utilization | > 50% fitur digunakan | Feature usage tracking |
10.4 · Notifikasi & Pengingat
| KPI | Target | Cara Mengukur |
|---|---|---|
| Push notification opt-in rate | > 60% | Permission tracking |
| Notification open rate | > 15% | Notification analytics |
| Re-engagement rate from notification | > 10% | Session attribution |
| Unsubscribe/opt-out rate | < 5% per bulan | Notification preference tracking |
Administration & CMS (Bagian 11)
11.1 · Admin Dashboard
| KPI | Target | Cara Mengukur |
|---|---|---|
| Dashboard load time | < 3 detik | Performance monitoring |
| Admin daily active usage | > 80% dari admin team | Admin login tracking |
| Data accuracy (real-time vs batch) | Lag < 5 menit | Data pipeline monitoring |
11.2 · Content Management System (CMS)
| KPI | Target | Cara Mengukur |
|---|---|---|
| Content creation throughput | > 10 items/week | CMS production tracking |
| Content review-to-publish cycle time | < 48 jam | Workflow timestamp tracking |
| CMS uptime | > 99.5% | Uptime monitoring |
11.3 · User & Membership Management
| KPI | Target | Cara Mengukur |
|---|---|---|
| Support ticket resolution time | < 24 jam (average) | Support system tracking |
| User issue self-resolution rate | > 40% | Help center analytics |
11.4 · Analytics & Reporting
| KPI | Target | Cara Mengukur |
|---|---|---|
| Report generation time | < 30 detik | Performance monitoring |
| Data export success rate | > 99% | Export logs |
| Reporting coverage (% KPI yang ter-track) | > 90% | Data audit |
Ringkasan Target Utama per Modul
| Modul | KPI Utama | Target |
|---|---|---|
| Assessment System | Completion rate & accuracy | > 80% completion, > 85% accuracy |
| Learning Journey | Mission completion & level progression | > 60% daily completion, > 20% sub-level/bulan |
| AI Companion | Response relevance & user satisfaction | > 4.0/5.0 rating |
| Speaking Practice | Session completion & improvement | > 70% completion, measurable improvement |
| Content Management | Coverage & freshness | > 90% coverage, > 70% updated |
| Membership | Conversion & retention | > 5% free-to-paid, < 30% churn |
| User Management | Registration & engagement | > 90% reg completion, > 3x dashboard/week |
| Admin & CMS | Operational efficiency | < 48 jam publish cycle, > 99.5% uptime |
Catatan Implementasi
-
Prioritas Tracking: Tidak semua KPI perlu di-track dari Day 1. Prioritaskan berdasarkan fase development:
- MVP: Acquisition, Activation, dan core Engagement metrics
- Post-MVP: Retention, Revenue, dan detailed module KPIs
- Mature: Learning Outcomes dan advanced analytics
-
Review Cadence: KPI di-review setiap 2 minggu untuk operational metrics dan bulanan untuk strategic metrics.
-
Target Adjustment: Target di atas adalah baseline awal. Setelah 3 bulan data terkumpul, target akan di-adjust berdasarkan benchmark aktual.