Community Testing & Delivery Report
Nervos Brain
Spark Program delivery summary: a deployable Nervos / CKB community knowledge system prototype with retrieval, citations, reply context, and rating feedback.
Executive Summary
A deployable, answerable, feedback-ready community knowledge system prototype is complete.
The current version is ready for Spark community testing delivery. The DAO phase can focus on speed, coverage, and verifiability.
Average across all real-group ratings; aggregated by answer: 3.75 / 5.
8 real users + 8 supplemental test personas.
Rating buttons and failure-case logging were validated in the real group.
4-5 ratings account for 63.0%; lower scores mainly mark data gaps, boundary cases, and noisy test messages.
System Capabilities
The core loop is connected, from chat entry points and retrieval stores to feedback.
Current entry points are working; the long-term positioning is a knowledge system.
Docs, forum content, and GitHub code form the retrieval foundation.
Deployment, configuration, data, runtime, and troubleshooting docs are complete.
Talk and GitHub refresh paths are ready.
Test Coverage
Real group testing + supplemental runs cover about 16 testing perspectives.
The official test group recorded 60 answers; June 22 added 4 answers from 2 testers that day.
Quality Result
Both real ratings and supplemental runs show that 4-5 scores dominate.
27 ratings.
24 rated answers.
4-5 score share.
40 fixed runs.
Real-group Ratings 3.67 / 5
Supplemental Run Ratings 3.83 / 5
17 of 27 real ratings are 4-5, or 63.0%.
Lower scores mainly locate boundaries and data gaps; they do not mean the core Q&A is unusable.
Real testing and supplemental runs agree: a usable MVP has been established.
Response Time
Direct answers are fast; complex RAG questions are the DAO-phase optimization focus.
P90 41.4s
P90 199.7s
P90 118s
The xUDT contract-review run took 1104.2s originally; retest was about 133.75s, while retrieval itself was about 0.8s. This looks more like an occasional long generation, reflection, self-check, and citation-assembly chain.
Only one extreme long-chain case appeared across multiple testing days, and the retest dropped significantly.
The main lever is not retrieval speed, but bounding generation, reflection, self-check, and citation assembly.
Move complex questions from “can answer” to “answers reliably within a controlled time budget.”
Capability Validation
Core capabilities are validated; a few vertical topics move into the DAO-phase backlog.
Representative Strong Cases
High-score cases cover technical explanation, deployment paths, safety guidance, and product discussion.
CKB Cell & Scripts
Explains cells, lock scripts, transaction flow, and dead cells at the coding level, with stable multi-turn context.
Fiber Node Agent Deployment
Covers node, wallet, channels, RPC / SDK control, and key-isolation guidance.
CCC TypeScript Transfer
Organizes the answer around project setup, transaction construction, input completion, fee completion, and sending.
Wallet Safety
Refuses private keys and seed phrases clearly, while giving safer alternatives for scam checks.
Data-limit Disclosure
Clearly states it cannot browse the latest web pages and recommends checking official primary sources.
Product Discussion
Provides structured analysis for CKB growth, prediction markets, cold start, and risk boundaries.
Test -> Fix -> Delivery
Internal testing drove multiple productization fixes; the delivery build is more stable than the recruitment build.
Language, citations, reply context, and recall boundaries surfaced in real group chats.
Core visible issues are fixed; remaining speed work moves to the DAO backlog.
The delivery build is more stable than the initial recruitment-test version and better suited for acceptance.
Known Boundaries
Boundaries are now DAO-phase backlog items, not delivery blockers.
The current version supports real group Q&A, basic technical explanation, data retrieval, reply follow-ups, and feedback collection. Boundary issues are suitable for continued DAO-phase work.
DAO Roadmap
From Spark prototype to long-term community knowledge infrastructure.
- Time budget for complex chains
- Bound post-reflection
- Citation parsing mechanism
- Automated regression tests
- Structured ecosystem project data
- Talk metadata and governance data
- More GitHub example entry points
- Spore / DOB / xUDT vertical enhancement
- Community data contribution flow
- Public evaluation and quality dashboard
- Continuous incremental updates
- DAO operations and feedback loop
Final Acceptance
The current version is suitable as the Nervos Brain community-testing delivery build.
Real group Q&A, follow-ups, and rating feedback are working; core Nervos / CKB knowledge Q&A has reached usable prototype quality; reports, test sets, deployment docs, and future enhancement directions are clear.