2025 R&D Journal¶
Overview¶
First year of R&D work on Rose - an agentic platform for inbound marketing.
Timeline: July - December 2025
Phases¶
Phase 1: Foundation (July-September)¶
Hypothesis: Monolithic prompt with standard RAG can handle B2B conversations.
- July: LangChain, LightRAG, TenantAwareNeo4JStorage
- August: Redis history, widget configuration
- September: MongoDB Atlas, reranking, metrics collection
Outcome: Infrastructure ceiling confirmed. Need specialized handling.
Phase 2: Visitor Intelligence (October-November)¶
Hypothesis: Understanding WHO visits improves conversion.
Rationale: September metrics showed technical questions convert 3x better than general questions. Without visitor identification, all conversations treated equally - missing opportunity to personalize for enterprise visitors.
- October: Visitor profiling, profile merge, dynamic questions
- November: 5-tier enrichment, interest signals, suggested answers
Outcome: +50% engagement, +58% conversation depth, +9% conversion.
Phase 3: Agentic Structure & Dialog State (December)¶
Hypothesis: Structured dialog state and parallel agent nodes improve conversation quality.
- December: Dialog state extraction, agent configuration, graph structure refinement
Outcome: Production-ready agentic architecture with 11 parallel nodes. Foundation for intent-based routing (Q1 2026).
Measured Business Impact (Q4 2025)¶
Initial Engagement Rate¶
Engaged Conversations (2+ turns)¶
Conversion Rate (Interaction to Form Submitted)¶
Summary¶
| Metric | Oct 2025 | Dec 2025 | Improvement |
|---|---|---|---|
| Initial Engagement | 1.24% | 1.86% | +50% |
| Engaged Conversations | 29.24% | 46.32% | +58% |
| Conversion Rate | 2.89% | 3.15% | +9% |
| Visitor Identification | 35% | 72% | +106% |
Monthly Entries¶
| Month | Main Focus | Key Hypothesis |
|---|---|---|
| July | Foundation & Architecture | Monolithic prompt + LightRAG |
| August | Production & Redis | Per-site configuration |
| September | MongoDB & Metrics | Systematic metrics collection |
| October | Visitor Profiling | LLM inference + enrichment |
| November | Enrichment & Signals | 5-tier pipeline + interest detection |
| December | Agentic Structure | Dialog state & parallel nodes |
R&D Innovations¶
| Component | Complexity | Status |
|---|---|---|
| TenantAwareNeo4JStorage | Very High | Production |
| Multi-Agent LangGraph | Very High | Production |
| 5-Tier Enrichment Pipeline | High | Production |
| Interest Signals Detection | High | Production |
| Intent Router | Medium | POC |