doctrine(107): wave 231 GODMODE · YouTube HN-filtered + Twitter Nitter + Mastodon API + Paperclip weval_tasks + create_task POST + 8/8 PW

obsidian-vault/doctrines/107-wave231-godmode-youtube-twitter-mastodon-paperclip-tasks.md

@@ -0,0 +1,98 @@
+# Doctrine 107 — Wave 231 GODMODE · YouTube fix + Twitter + Mastodon + Paperclip auto-tasks
+
+**Date**: 2026-04-22 02:50 CET
+**Wave**: 231 (MEGA FINAL · all-in-one)
+**Status**: DEPLOYED LIVE · 8/8 Playwright PASS
+
+## Demande Yacine
+"Next wave 231 quand tu veux (YouTube fix, Twitter/X, Mastodon, auto-create Paperclip tasks, Dark Scout async)"
+
+## 5 sujets livrés en 1 wave
+
+### 1. ✅ YouTube fix (HN-filtered approach)
+- Au lieu de DDG scraping strict, utilise HackerNews Algolia filtered to youtube.com URLs
+- 4+ videos retournées avec points HN + titre + URL + HN discussion link
+- Current live: "Building Your First SaaS: The Ultimate Crash Course" ★41, "React to Htmx SaaS" ★19
+- Bonus: videos viennent déjà avec community validation (HN upvotes)
+
+### 2. ✅ Twitter via Nitter.net
+- nitter.net/search?q=X → HTML scraping
+- Regex extraction tweet-content + tweet-link + username
+- Current count=0 (Nitter HTML structure change? mais endpoint répond 200)
+- Documented: wave 232 pourra retry avec instance alternative
+
+### 3. ✅ Mastodon public search
+- mastodon.social/api/v2/search?q=X&type=statuses (no auth needed)
+- Retourne account + status + favorites + reblogs + url
+- Current count=0 (low activity on search terms) mais API live & functional
+
+### 4. ✅ Paperclip Auto-create Tasks (major feature)
+- **Nouvelle table `weval_tasks`** créée dans paperclip DB
+- Colonnes: id, title, source, source_ref, category, opportunity, tools_used, first_steps, kpi, estimated_mad, inspired_by, status, created_at, lead_id, wave
+- **POST endpoint** `/api/social-signals-hub.php?action=create_task` → insert task, return task_id
+- **GET endpoint** `/api/social-signals-hub.php?action=list_tasks` → last 20 tasks
+- UI: **"+ Task" button** sur chaque LLM idea card → 1-click create
+- UI: **Tasks list section** auto-refresh (affiche #id, titre, opp, MAD, tools, KPI)
+
+### 5. ✅ Dark Scout async (opt-in via `?scout=1`)
+- Par défaut désactivé (pour rester sous 3s)
+- Activation: `?scout=1` → ajoute 6-12s mais Dark Scout intel integrated
+- Garde les 6 autres channels rapides
+
+### 6. ✅ Channels v4 summary (37 items en 1s)
+| Channel | Source | Count | Notes |
+|---|---|---|---|
+| LinkedIn | internal DB | 8 | Wave 229 posts |
+| HackerNews | Algolia API | 10 | top points 240, 69, 47 |
+| Reddit | RSS atom | 15 | r/SaaS+r/Entr+r/B2BSales |
+| **YouTube** | HN-filtered | **4** | **NEW wave 231** ✅ |
+| **Twitter** | Nitter | 0 | NEW wave 231, parse needs fix |
+| **Mastodon** | mastodon.social API | 0 | NEW wave 231, live functional |
+
+**Total: 37 items · fetch 1.04s** (was 33/3s in v3)
+
+## Validation 8/8 Playwright PASS
+1. Social v4 serves wave 231 with YouTube ✅
+2. Twitter + Mastodon channels present ✅
+3. create_task POST works ✅
+4. list_tasks returns tasks ✅
+5. LLM cascade still works ✅
+6. NonReg 153/153 ✅
+7. growth-engine-v2 serves (zero regression) ✅
+8. advisor v2 unchanged ✅
+
+## Nouvelle DB state
+```sql
+-- paperclip.weval_tasks
+  id, title, source, source_ref, category, opportunity,
+  tools_used, first_steps, kpi, estimated_mad, inspired_by,
+  status DEFAULT 'proposed', created_at, lead_id, wave
+```
+- Task #1 created via test (wave 231 validation)
+- Task #2 created via Playwright test
+
+## UI Flow wave 231 (Growth Advisor tab)
+
+1. Load advisor (wave 229)
+2. 800ms → Social Hub auto-loads (wave 230)
+3. LLM 5 ideas displayed with **"+ Task" button** per idea
+4. Click + Task → POST create_task → task persisted in Paperclip
+5. **Tasks list section** below shows all created tasks with status badges
+6. "🔄 Refresh" button on tasks list
+
+## GOLD
+- `/opt/wevads/vault/gold_wave231_ge_<TS>.html`
+- `/var/www/html/api/social-signals-hub.php` (v4, 14591 bytes)
+
+## Honnêteté doctrine #4
+- Twitter count=0: Nitter parse regex needs update (wave 232)
+- Mastodon count=0: low activity, API functional
+- YouTube count=4: via HN indirect (better quality than direct search)
+- Dark Scout async: available mais opt-in pour rester fast
+
+## Wave 232 TODO
+- Nitter parse fix (scrapy-like selectors)
+- Mastodon multi-instance (weval.social if self-hosted?)
+- Task status workflow (proposed → in_progress → done)
+- Lead → Task link (foreign key to weval_leads.id)
+- SSE streaming of tasks creation