2f7b0194a5
Two structural fixes for demo concurrency (3 single-slot suppliers thrashed
under Open WebUI's ~3 conversations per message):
Multi-slot suppliers (MAX_CHAT_SESSIONS, default 1):
- SupplierState is now capacity-aware: a Set of active escrow refs with
free-until-full status semantics, ref-scoped release(ref) (also fixes the
latent bug where handler catch-alls released another request's slot), and
a walletMutex serializing every wallet-spending chain op — Claim, Submit,
and wallet-health consolidation queue instead of racing the single
working/collateral UTxO. /status gains active_sessions/max_sessions.
Entry-ticket settle mode (CHAT_SETTLE_MODE=ticket, default full, both sides):
- The buyer's escrow post at session open is the ONLY chain op. The supplier
verifies the Open escrow as an entry ticket but never Claims/Submits
(/v1/chat/start → {status:"ticket"}; /v1/chat/end → receipt-less
{status:"ended"}); no hard-cap timer, so sessions may outlive deliver_by.
Used tickets can't reopen sessions (records retained; 409 session_exists).
- Buyer SDK: startChat/endChat are settle-mode aware, driven by the
supplier's response — mixed-mode rollout windows settle correctly.
- Gateway: ticket closes bill cost 0; the sweeper Reclaims Open tickets
after deliver_by WITHOUT closing live sessions (the conversation and its
affinity mirror survive their reclaimed ticket), gates reclaims on
deliver_by, and keeps an in-process settled-refs memory so terminal
indexer rows aren't retried every sweep forever.
Deployment (kimi-chat trio + gateway): ticket mode, 8 slots per supplier,
idle policy gateway 10 min / supplier 15 min (fixes the inversion where the
supplier idle-closed before the gateway janitor).
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
91 lines
3.9 KiB
YAML
91 lines
3.9 KiB
YAML
# deploy/mainnet/docker-compose.supplier-kimi-chat.yml — Supplier — MAINNET
|
|
# (OpenRouter / Kimi K2.6 — MULTI-TURN CHAT capability `llm.chat.v1`)
|
|
#
|
|
# The chat-session sibling of docker-compose.supplier-kimi.yml. Same image,
|
|
# same OpenRouter backend (moonshotai/kimi-k2.6), but CAPABILITY_KIND=chat-session
|
|
# so it mounts /v1/chat/{start,message,end} (escrow bookends, off-chain
|
|
# streaming turns) instead of the one-off /v1/chat/completions route.
|
|
#
|
|
# A SEPARATE process/advert from the one-off Kimi supplier on purpose: the
|
|
# chat session holds the supplier's single-slot lock for the whole conversation
|
|
# (minutes), which would starve one-off traffic if co-hosted.
|
|
#
|
|
# Coexists with:
|
|
# - marketplace-mainnet-supplier-kimi (one-off llm.text.generate.v1, mp-suppliers-kimi.vector.apexfusion.org)
|
|
#
|
|
# Pre-flight:
|
|
# 1. DNS A-record: mp-suppliers-kimi-chat.vector.apexfusion.org → host IP
|
|
# 2. supplier/.env.kimi-chat written on host (chmod 600) with at minimum:
|
|
# SUPPLIER_PRIV_KEY_HEX, OPENAI_API_KEY, OGMIOS_URL, NETWORK_ID=1,
|
|
# VECTOR_ZERO_TIME_MS, ESCROW_REF_UTXO, ADVERT_REF_UTXO, ADVERT_REF,
|
|
# LIVE_CHAIN=1
|
|
# The advert must be posted with --capability-id llm.chat.v1 and a large
|
|
# --max-processing-ms (~1800000) so Claim+Submit both land before deliver_by.
|
|
# 3. Networks already exist (created by the canonical supplier compose):
|
|
# docker network create marketplace-mainnet-net # one-shot
|
|
# # traefik-net is created by the Traefik project
|
|
|
|
name: marketplace-mainnet-supplier-kimi-chat
|
|
|
|
services:
|
|
supplier:
|
|
build:
|
|
context: ../..
|
|
dockerfile: supplier/Dockerfile
|
|
container_name: marketplace-mainnet-supplier-kimi-chat
|
|
restart: unless-stopped
|
|
env_file:
|
|
# Self-contained env for the Kimi-chat variant — separate from
|
|
# ../../supplier/.env.kimi (the one-off Kimi supplier). Holds this
|
|
# supplier's distinct SUPPLIER_PRIV_KEY_HEX, ADVERT_REF (an llm.chat.v1
|
|
# advert), OPENAI_API_KEY, and the shared mainnet plumbing.
|
|
- path: ../../supplier/.env.kimi-chat
|
|
required: false
|
|
environment:
|
|
# Multi-turn chat session capability (mounts /v1/chat/{start,message,end}).
|
|
CAPABILITY_KIND: chat-session
|
|
LLM_BACKEND: openai
|
|
# No /v1 suffix — supplier/src/openai.ts appends /v1/chat/completions.
|
|
OPENAI_BASE_URL: https://openrouter.ai/api
|
|
# Kimi K2.6 generations can be slow; mirror the one-off Kimi compose.
|
|
OPENAI_TIMEOUT_MS: "300000"
|
|
# 2.5 min idle end (supplier Submits the transcript): single-slot
|
|
# suppliers must free up quickly for the shared demo endpoint (the
|
|
# gateway transparently reopens a session on the next turn).
|
|
CHAT_IDLE_TIMEOUT_MS: "900000"
|
|
CHAT_SETTLE_MODE: ticket
|
|
MAX_CHAT_SESSIONS: "8"
|
|
PORT: "8080"
|
|
# Enable LiveOgmiosProvider so Claim/Submit actually broadcast.
|
|
LIVE_CHAIN: "1"
|
|
# NETWORK_ID and OGMIOS_URL intentionally not pinned here — they MUST
|
|
# come from the operator-provided supplier/.env.kimi-chat on a mainnet host.
|
|
healthcheck:
|
|
test: ["CMD-SHELL", "wget -qO- http://localhost:8080/healthz >/dev/null || exit 1"]
|
|
interval: 20s
|
|
timeout: 5s
|
|
retries: 3
|
|
start_period: 15s
|
|
networks:
|
|
- marketplace-mainnet-net
|
|
- traefik-net
|
|
labels:
|
|
- "traefik.enable=true"
|
|
- "traefik.docker.network=traefik-net"
|
|
- "traefik.http.routers.mp-suppliers-kimi-chat-mainnet.entrypoints=web"
|
|
- "traefik.http.routers.mp-suppliers-kimi-chat-mainnet.rule=Host(`mp-suppliers-kimi-chat.vector.apexfusion.org`)"
|
|
- "traefik.http.services.mp-suppliers-kimi-chat-mainnet.loadbalancer.server.port=8080"
|
|
logging:
|
|
driver: json-file
|
|
options:
|
|
max-size: "10m"
|
|
max-file: "3"
|
|
|
|
networks:
|
|
marketplace-mainnet-net:
|
|
external: true
|
|
name: marketplace-mainnet-net
|
|
traefik-net:
|
|
external: true
|
|
name: traefik-net
|