{"title":"Arsitektur Synapse","slug":"architecture","category":"concepts","summary":"Bagaimana Synapse dibangun — Fastify, PostgreSQL, FTS5, embeddings, MCP server.","audience":["human","llm"],"tags":["architecture","design","components"],"difficulty":"intermediate","updated":"2026-06-27","word_count":429,"read_minutes":2,"lang":"id","translated":true,"requested_lang":"id","content_markdown":"\n# Arsitektur Synapse\n\nSynapse adalah API memori multi-tenant yang dibangun di atas Fastify, PostgreSQL\ndengan FTS5, dan layanan embeddings opsional untuk pencarian semantik.\n\n## Arsitektur Tingkat Tinggi\n\n```\n┌──────────────────────────────────────────────────────────┐\n│                       Clients                            │\n├──────────────┬──────────────┬──────────────┬─────────────┤\n│  LLM Agents  │  Web Browsers│  MCP Clients │  Webhooks   │\n│  (curl/SDK)  │  (humans)    │ (Claude/etc) │  (external) │\n└──────┬───────┴──────┬───────┴──────┬───────┴──────┬──────┘\n       │              │              │              │\n       └──────────────┴──────────────┴──────────────┘\n                              │\n                              ▼\n              ┌───────────────────────────────┐\n              │    Synapse API (Fastify)      │\n              │    port 12800                 │\n              │    - REST endpoints           │\n              │    - Auth (Mind Key / JWT)    │\n              │    - Rate limiting            │\n              │    - Static file serving      │\n              └───────────────┬───────────────┘\n                              │\n              ┌───────────────┼───────────────┐\n              ▼               ▼               ▼\n       ┌─────────────┐ ┌─────────────┐ ┌─────────────┐\n       │ PostgreSQL  │ │ Embeddings  │ │ MCP Server  │\n       │ + FTS5      │ │ Service     │ │ (separate)  │\n       │             │ │ (optional)  │ │ port 13100  │\n       │ - memories  │ │             │ │             │\n       │ - tasks     │ │ - generate  │ │ - 79 tools  │\n       │ - chat      │ │   embeddings│ │ - stdio/SSE │\n       │ - scripts   │ │             │ │ - WebSocket │\n       └─────────────┘ └─────────────┘ └─────────────┘\n```\n\n## Komponen Inti\n\n### 1. Synapse API (Fastify)\n\nServer HTTP utama. Menangani:\n\n- Endpoint REST (`/memory`, `/chat`, `/mind/tasks`, dll.)\n- Autentikasi (Mind Key untuk agen, JWT untuk manusia)\n- Rate limiting (hanya autentikasi `?key=`)\n- Penyajian file statis (web UI di `/human`, `/docs`, dll.)\n- Pengiriman webhook\n\nDibangun dengan **Fastify 5** untuk performa. Berjalan di port 12800 di produksi.\n\n### 2. PostgreSQL dengan FTS5\n\nPenyimpanan data utama. Menggunakan PostgreSQL dengan ekstensi FTS5 untuk\npencarian teks penuh.\n\n**Tabel utama:**\n\n| Tabel | Tujuan |\n|-------|---------|\n| `users` | Akun pengguna |\n| `minds` | Cakupan mind (masing-masing memiliki Mind Key) |\n| `memories` | Catatan memori dengan tabel virtual FTS5 |\n| `tasks` | Manajemen tugas |\n| `chat_messages` | Riwayat chat |\n| `scripts` | Skrip persisten |\n| `webhooks` | Pendaftaran webhook |\n| `cron_jobs` | Tugas terjadwal |\n| `variables` | Key-value store |\n| `audit_log` | Jejak audit |\n\n**FTS5** memungkinkan pencarian teks penuh sub-milidetik di seluruh konten memori.\nLihat [Pencarian FTS5](/docs/concepts/fts5-search) untuk detail.\n\n### 3. Layanan Embeddings (Opsional)\n\nUntuk pencarian semantik, Synapse membuat vektor embeddings dari konten memori.\nIni disimpan bersama memori dan digunakan untuk pencarian kesamaan.\n\n- Provider: dapat dikonfigurasi (OpenAI, model lokal, dll.)\n- Disimpan sebagai kolom `vector` di tabel `memories`\n- Digunakan oleh endpoint `/memory/semantic-search`\n- Lihat [Pencarian Semantik](/docs/concepts/semantic-search)\n\n### 4. MCP Server (Layanan Terpisah)\n\nSynapse MCP server berjalan sebagai proses terpisah (port 13100). Server ini:\n\n- Mengekspos 79 alat melalui Model Context Protocol\n- Mendukung transport stdio, HTTP/SSE, dan WebSocket\n- Menerjemahkan pemanggilan alat MCP menjadi pemanggilan API Synapse\n- Multi-tenant: satu Mind Key per sesi\n\n### 5. Browser Proxy (Layanan Terpisah)\n\nUntuk otomasi browser, layanan terpisah berbasis Playwright berjalan di port 13000.\nMCP server dapat memanggil ini untuk alat `browser_*`.\n\n### 6. SSH Proxy (Layanan Terpisah)\n\nUntuk perintah remote berbasis SSH, layanan terpisah berjalan di port 12900.\n\n## Model Multi-Tenancy\n\n```\nUser Account (email + password)\n  │\n  ├── Mind 1 (Mind Key 1)\n  │   ├── Memories\n  │   ├── Tasks\n  │   ├── Chat\n  │   └── Scripts\n  │\n  ├── Mind 2 (Mind Key 2)\n  │   └── ... (isolated from Mind 1)\n  │\n  └── Mind 3 (Mind Key 3)\n      └── ...\n```\n\nSetiap mind sepenuhnya terisolasi. Mind Key memberikan akses ke tepat satu mind.\nJWT memberikan akses ke akun pengguna (untuk mengelola mind).\n\nLihat [Multi-Tenancy](/docs/concepts/multi-tenancy) untuk detail.\n\n## Alur Permintaan\n\n### Permintaan Penyimpanan Memori\n\n```\n1. Client sends POST /memory with Authorization: Bearer mk_xxx\n2. Fastify receives request\n3. Auth middleware validates Mind Key, attaches mind_id to request\n4. Memory route handler:\n   a. Validate JSON body (zod schema)\n   b. Insert into memories table\n   c. Update FTS5 index\n   d. (Async) Generate embedding if embeddings enabled\n   e. Trigger webhooks for memory.store event\n5. Return { id, status: \"stored\" }\n```\n\n### Permintaan Pencarian Memori\n\n```\n1. Client sends GET /memory/search?q=docker\n2. Auth middleware validates Mind Key\n3. Memory route handler:\n   a. Parse query (FTS5 syntax)\n   b. Execute FTS5 MATCH against memories table\n   c. Filter by mind_id (tenant isolation)\n   d. Rank by relevance\n   e. Return results\n```\n\n## Deployment\n\nSynapse di-deploy sebagai container Docker. Lihat `docker-compose.yml`:\n\n```yaml\nservices:\n  synapse:\n    image: registry.gitlab.com/schaefer-services/synapse:latest\n    ports:\n      - \"12800:12800\"\n    environment:\n      - DATABASE_URL=postgres://...\n      - JWT_SECRET=...\n      - SYNAPSE_HOST=0.0.0.0\n      - SYNAPSE_PORT=12800\n    depends_on:\n      - postgres\n  \n  postgres:\n    image: postgres:16\n    volumes:\n      - pgdata:/var/lib/postgresql/data\n    environment:\n      - POSTGRES_DB=synapse\n      - POSTGRES_PASSWORD=...\n```\n\n## Karakteristik Performa\n\n| Operasi | Latensi | Throughput |\n|-----------|---------|------------|\n| Penyimpanan memori | ~5ms | 1000+ req/s |\n| Recall memori | ~20ms | 500 req/s |\n| Pencarian FTS5 | ~10ms | 800 req/s |\n| Pencarian semantik | ~50ms | 200 req/s |\n| Polling chat | ~5ms | 2000 req/s |\n\n## Langkah Berikutnya\n\n- [Model Memori](/docs/concepts/memory-model)\n- [Multi-Tenancy](/docs/concepts/multi-tenancy)\n- [Pencarian FTS5](/docs/concepts/fts5-search)\n","content_html":"<h1>Arsitektur Synapse</h1>\n<p>Synapse adalah API memori multi-tenant yang dibangun di atas Fastify, PostgreSQL\ndengan FTS5, dan layanan embeddings opsional untuk pencarian semantik.</p>\n<h2>Arsitektur Tingkat Tinggi</h2>\n<pre><code class=\"hljs language-plaintext\">┌──────────────────────────────────────────────────────────┐\n│                       Clients                            │\n├──────────────┬──────────────┬──────────────┬─────────────┤\n│  LLM Agents  │  Web Browsers│  MCP Clients │  Webhooks   │\n│  (curl/SDK)  │  (humans)    │ (Claude/etc) │  (external) │\n└──────┬───────┴──────┬───────┴──────┬───────┴──────┬──────┘\n       │              │              │              │\n       └──────────────┴──────────────┴──────────────┘\n                              │\n                              ▼\n              ┌───────────────────────────────┐\n              │    Synapse API (Fastify)      │\n              │    port 12800                 │\n              │    - REST endpoints           │\n              │    - Auth (Mind Key / JWT)    │\n              │    - Rate limiting            │\n              │    - Static file serving      │\n              └───────────────┬───────────────┘\n                              │\n              ┌───────────────┼───────────────┐\n              ▼               ▼               ▼\n       ┌─────────────┐ ┌─────────────┐ ┌─────────────┐\n       │ PostgreSQL  │ │ Embeddings  │ │ MCP Server  │\n       │ + FTS5      │ │ Service     │ │ (separate)  │\n       │             │ │ (optional)  │ │ port 13100  │\n       │ - memories  │ │             │ │             │\n       │ - tasks     │ │ - generate  │ │ - 79 tools  │\n       │ - chat      │ │   embeddings│ │ - stdio/SSE │\n       │ - scripts   │ │             │ │ - WebSocket │\n       └─────────────┘ └─────────────┘ └─────────────┘</code></pre><h2>Komponen Inti</h2>\n<h3>1. Synapse API (Fastify)</h3>\n<p>Server HTTP utama. Menangani:</p>\n<ul>\n<li>Endpoint REST (<code>/memory</code>, <code>/chat</code>, <code>/mind/tasks</code>, dll.)</li>\n<li>Autentikasi (Mind Key untuk agen, JWT untuk manusia)</li>\n<li>Rate limiting (hanya autentikasi <code>?key=</code>)</li>\n<li>Penyajian file statis (web UI di <code>/human</code>, <code>/docs</code>, dll.)</li>\n<li>Pengiriman webhook</li>\n</ul>\n<p>Dibangun dengan <strong>Fastify 5</strong> untuk performa. Berjalan di port 12800 di produksi.</p>\n<h3>2. PostgreSQL dengan FTS5</h3>\n<p>Penyimpanan data utama. Menggunakan PostgreSQL dengan ekstensi FTS5 untuk\npencarian teks penuh.</p>\n<p><strong>Tabel utama:</strong></p>\n<table>\n<thead>\n<tr>\n<th>Tabel</th>\n<th>Tujuan</th>\n</tr>\n</thead>\n<tbody><tr>\n<td><code>users</code></td>\n<td>Akun pengguna</td>\n</tr>\n<tr>\n<td><code>minds</code></td>\n<td>Cakupan mind (masing-masing memiliki Mind Key)</td>\n</tr>\n<tr>\n<td><code>memories</code></td>\n<td>Catatan memori dengan tabel virtual FTS5</td>\n</tr>\n<tr>\n<td><code>tasks</code></td>\n<td>Manajemen tugas</td>\n</tr>\n<tr>\n<td><code>chat_messages</code></td>\n<td>Riwayat chat</td>\n</tr>\n<tr>\n<td><code>scripts</code></td>\n<td>Skrip persisten</td>\n</tr>\n<tr>\n<td><code>webhooks</code></td>\n<td>Pendaftaran webhook</td>\n</tr>\n<tr>\n<td><code>cron_jobs</code></td>\n<td>Tugas terjadwal</td>\n</tr>\n<tr>\n<td><code>variables</code></td>\n<td>Key-value store</td>\n</tr>\n<tr>\n<td><code>audit_log</code></td>\n<td>Jejak audit</td>\n</tr>\n</tbody></table>\n<p><strong>FTS5</strong> memungkinkan pencarian teks penuh sub-milidetik di seluruh konten memori.\nLihat <a href=\"/docs/concepts/fts5-search\">Pencarian FTS5</a> untuk detail.</p>\n<h3>3. Layanan Embeddings (Opsional)</h3>\n<p>Untuk pencarian semantik, Synapse membuat vektor embeddings dari konten memori.\nIni disimpan bersama memori dan digunakan untuk pencarian kesamaan.</p>\n<ul>\n<li>Provider: dapat dikonfigurasi (OpenAI, model lokal, dll.)</li>\n<li>Disimpan sebagai kolom <code>vector</code> di tabel <code>memories</code></li>\n<li>Digunakan oleh endpoint <code>/memory/semantic-search</code></li>\n<li>Lihat <a href=\"/docs/concepts/semantic-search\">Pencarian Semantik</a></li>\n</ul>\n<h3>4. MCP Server (Layanan Terpisah)</h3>\n<p>Synapse MCP server berjalan sebagai proses terpisah (port 13100). Server ini:</p>\n<ul>\n<li>Mengekspos 79 alat melalui Model Context Protocol</li>\n<li>Mendukung transport stdio, HTTP/SSE, dan WebSocket</li>\n<li>Menerjemahkan pemanggilan alat MCP menjadi pemanggilan API Synapse</li>\n<li>Multi-tenant: satu Mind Key per sesi</li>\n</ul>\n<h3>5. Browser Proxy (Layanan Terpisah)</h3>\n<p>Untuk otomasi browser, layanan terpisah berbasis Playwright berjalan di port 13000.\nMCP server dapat memanggil ini untuk alat <code>browser_*</code>.</p>\n<h3>6. SSH Proxy (Layanan Terpisah)</h3>\n<p>Untuk perintah remote berbasis SSH, layanan terpisah berjalan di port 12900.</p>\n<h2>Model Multi-Tenancy</h2>\n<pre><code class=\"hljs language-plaintext\">User Account (email + password)\n  │\n  ├── Mind 1 (Mind Key 1)\n  │   ├── Memories\n  │   ├── Tasks\n  │   ├── Chat\n  │   └── Scripts\n  │\n  ├── Mind 2 (Mind Key 2)\n  │   └── ... (isolated from Mind 1)\n  │\n  └── Mind 3 (Mind Key 3)\n      └── ...</code></pre><p>Setiap mind sepenuhnya terisolasi. Mind Key memberikan akses ke tepat satu mind.\nJWT memberikan akses ke akun pengguna (untuk mengelola mind).</p>\n<p>Lihat <a href=\"/docs/concepts/multi-tenancy\">Multi-Tenancy</a> untuk detail.</p>\n<h2>Alur Permintaan</h2>\n<h3>Permintaan Penyimpanan Memori</h3>\n<pre><code class=\"hljs language-plaintext\">1. Client sends POST /memory with Authorization: Bearer mk_xxx\n2. Fastify receives request\n3. Auth middleware validates Mind Key, attaches mind_id to request\n4. Memory route handler:\n   a. Validate JSON body (zod schema)\n   b. Insert into memories table\n   c. Update FTS5 index\n   d. (Async) Generate embedding if embeddings enabled\n   e. Trigger webhooks for memory.store event\n5. Return { id, status: &quot;stored&quot; }</code></pre><h3>Permintaan Pencarian Memori</h3>\n<pre><code class=\"hljs language-plaintext\">1. Client sends GET /memory/search?q=docker\n2. Auth middleware validates Mind Key\n3. Memory route handler:\n   a. Parse query (FTS5 syntax)\n   b. Execute FTS5 MATCH against memories table\n   c. Filter by mind_id (tenant isolation)\n   d. Rank by relevance\n   e. Return results</code></pre><h2>Deployment</h2>\n<p>Synapse di-deploy sebagai container Docker. Lihat <code>docker-compose.yml</code>:</p>\n<pre><code class=\"hljs language-yaml\"><span class=\"hljs-attr\">services:</span>\n  <span class=\"hljs-attr\">synapse:</span>\n    <span class=\"hljs-attr\">image:</span> <span class=\"hljs-string\">registry.gitlab.com/schaefer-services/synapse:latest</span>\n    <span class=\"hljs-attr\">ports:</span>\n      <span class=\"hljs-bullet\">-</span> <span class=\"hljs-string\">&quot;12800:12800&quot;</span>\n    <span class=\"hljs-attr\">environment:</span>\n      <span class=\"hljs-bullet\">-</span> <span class=\"hljs-string\">DATABASE_URL=postgres://...</span>\n      <span class=\"hljs-bullet\">-</span> <span class=\"hljs-string\">JWT_SECRET=...</span>\n      <span class=\"hljs-bullet\">-</span> <span class=\"hljs-string\">SYNAPSE_HOST=0.0.0.0</span>\n      <span class=\"hljs-bullet\">-</span> <span class=\"hljs-string\">SYNAPSE_PORT=12800</span>\n    <span class=\"hljs-attr\">depends_on:</span>\n      <span class=\"hljs-bullet\">-</span> <span class=\"hljs-string\">postgres</span>\n  \n  <span class=\"hljs-attr\">postgres:</span>\n    <span class=\"hljs-attr\">image:</span> <span class=\"hljs-string\">postgres:16</span>\n    <span class=\"hljs-attr\">volumes:</span>\n      <span class=\"hljs-bullet\">-</span> <span class=\"hljs-string\">pgdata:/var/lib/postgresql/data</span>\n    <span class=\"hljs-attr\">environment:</span>\n      <span class=\"hljs-bullet\">-</span> <span class=\"hljs-string\">POSTGRES_DB=synapse</span>\n      <span class=\"hljs-bullet\">-</span> <span class=\"hljs-string\">POSTGRES_PASSWORD=...</span></code></pre><h2>Karakteristik Performa</h2>\n<table>\n<thead>\n<tr>\n<th>Operasi</th>\n<th>Latensi</th>\n<th>Throughput</th>\n</tr>\n</thead>\n<tbody><tr>\n<td>Penyimpanan memori</td>\n<td>~5ms</td>\n<td>1000+ req/s</td>\n</tr>\n<tr>\n<td>Recall memori</td>\n<td>~20ms</td>\n<td>500 req/s</td>\n</tr>\n<tr>\n<td>Pencarian FTS5</td>\n<td>~10ms</td>\n<td>800 req/s</td>\n</tr>\n<tr>\n<td>Pencarian semantik</td>\n<td>~50ms</td>\n<td>200 req/s</td>\n</tr>\n<tr>\n<td>Polling chat</td>\n<td>~5ms</td>\n<td>2000 req/s</td>\n</tr>\n</tbody></table>\n<h2>Langkah Berikutnya</h2>\n<ul>\n<li><a href=\"/docs/concepts/memory-model\">Model Memori</a></li>\n<li><a href=\"/docs/concepts/multi-tenancy\">Multi-Tenancy</a></li>\n<li><a href=\"/docs/concepts/fts5-search\">Pencarian FTS5</a></li>\n</ul>\n","urls":{"html":"/docs/concepts/architecture","text":"/docs/concepts/architecture?format=text","json":"/docs/concepts/architecture?format=json","llm":"/docs/concepts/architecture?format=llm"},"translations_available":["en","zh","hi","es","fr","ar","pt","ru","ja","de","it","ko","nl","pl","tr","sv","vi","th","id","uk"]}