mirror of
https://github.com/block/buzz.git
synced 2026-11-06 09:21:45 +00:00
## Why PR #6503 bundled a broader context compiler with several prompt-shape and telemetry changes, making it difficult to isolate whether paired XML-like top-level boundaries improve agent behavior. This keeps the follow-up experiment focused on framing only. ## What - Replace top-level standing and per-turn bracket headers with paired tags while preserving inner section content and event/message framing - Carry only metadata already present in dynamic headers as attributes, such as thread counts, truncation, event type, and batch count - Preserve every section body verbatim so the model executes the exact bytes reviewed in Desktop - Keep routing metadata, event content, batching, and delivery behavior unchanged - Teach Desktop diagnostics to parse the new framing while retaining compatibility with archived bracket-framed sessions; ambiguous paired boundaries render as the complete captured prompt ## Risk Assessment Medium — the change is limited to agent prompt framing and diagnostic parsing, but it affects both standing context and every dynamic agent turn. Bodies and delivery behavior remain unchanged, and compatibility parsing remains for prior sessions. ## References - Follow-up to #6503, scoped only to the paired-tag framing hypothesis ## Update — 2026-08-24 - Addressed review feedback by removing entity encoding/decoding from the execution and diagnostic paths. - Added regressions for literal closing tags, placeholders, entity-looking text, ampersands, and authored boundary whitespace. - Verified `cargo test -p buzz-acp` (805 unit + 9 integration), Desktop tests (5,412 before the main sync; 5,439 in the pre-push gate), Desktop typechecking, and Tauri clippy/tests. - Live local relay startup and message ingestion passed. The live ACP reply step is blocked locally because installed Goose 1.0.23 no longer provides the documented `goose acp` command and no alternate ACP adapter is installed. --- **Update Aug 25, 12:13 EDT:** Extended paired tags to per-turn top-level sections. - Converted context, conversation/thread context, event batches, and steer/interrupt boundaries without changing their inner bodies. - Preserved existing header metadata as attributes only; added no new prompt metadata. - Verified 806 Buzz ACP unit tests plus 9 integration tests, 5,441 Desktop tests, Desktop typechecking and formatting, and all differential pre-push lanes. --- **Update Aug 25, 13:58 EDT:** Addressed framing review feedback. - Updated operational base instructions to reference the emitted `<context>` section and added a regression guard against stale `[Context]` instructions. - Restored batched steer/interrupt cardinality in Desktop diagnostic titles with focused coverage for both paths. - Verified 807 Buzz ACP unit tests plus 9 integration tests, 5,442 Desktop tests, Desktop typechecking and formatting, and every differential pre-push lane including Tauri clippy/tests. --- **Update Aug 25, 15:37 EDT:** Hardened legacy transcript compatibility. - Semantic standing-context parsing now requires paired framing at the start and complete input consumption. - Historical bracket-framed personas keep literal balanced tag examples in their original section; malformed or mixed current framing displays as the complete captured prompt. - Added regressions for the reported legacy persona case and trailing unframed text; verified 60 focused parser tests, 5,444 full Desktop tests, formatting, and typechecking. --- **Update Aug 25, 16:31 EDT:** Preserved slash-command prompt block boundaries. - Desktop now sets aside a valid connector-facing slash-command block only when the following block begins recognized paired framing, parses the semantic blocks normally, and retains the command as visible Prompt metadata. - Added an end-to-end transcript regression using the production three-block ACP shape, including the user bubble, author pubkey, event ID, and grouped prompt context. - Verified 113 combined transcript tests, 5,445 full Desktop tests, formatting, typechecking, and all applicable pre-push lanes. Generated with Codex --------- Signed-off-by: Salman Mohammed <smohammed@squareup.com>
252 lines
9.8 KiB
Rust
252 lines
9.8 KiB
Rust
//! Fetch the agent's NIP-AE `core` engram at session creation and render it
|
|
//! into a prompt section.
|
|
//!
|
|
//! Scope per Tyler's spec:
|
|
//! - Fire one synchronous query for the core head when a *new* session is born.
|
|
//! - If a body is found, emit `<core-memory>…</core-memory>`.
|
|
//! - If no body is found, emit an onboarding nudge so the agent learns how
|
|
//! to set its own core.
|
|
//! - On any *error* (transport, parse), log and emit nothing. We must not
|
|
//! mistake a relay outage for "no core" — that would invite the agent to
|
|
//! overwrite real, just-unreachable memory with a fresh profile.
|
|
//! - Either way, session creation is never blocked.
|
|
|
|
use buzz_core::engram::{conversation_key, d_tag, select_head, validate_and_decrypt, Body};
|
|
use buzz_core::kind::KIND_AGENT_ENGRAM;
|
|
use nostr::{Event, Keys, PublicKey};
|
|
|
|
use crate::relay::RestClient;
|
|
|
|
/// Onboarding nudge for new agents with no core yet.
|
|
///
|
|
/// Wording is from Tyler's brief: "No core memory found. Use `buzz mem`
|
|
/// to create a core memory. Ask your user about yourself."
|
|
pub const ONBOARDING_NUDGE: &str = "No core memory found. \
|
|
Use `buzz mem set core \"…\"` to create one (it will hold your identity, \
|
|
rules, and goals across sessions). Ask your user about yourself.";
|
|
|
|
/// Build the rendered prompt section for the agent's core.
|
|
///
|
|
/// Returns:
|
|
/// - `Some(profile_section)` when a valid core exists,
|
|
/// - `Some(nudge_section)` when the relay confirmed absence,
|
|
/// - `None` when the fetch failed (transport, parse, decrypt) — the caller
|
|
/// should inject no section in that case so the agent doesn't conclude
|
|
/// memory is empty.
|
|
pub async fn build_core_section(
|
|
rest: &RestClient,
|
|
agent_keys: &Keys,
|
|
owner: &PublicKey,
|
|
) -> Option<String> {
|
|
match fetch_core_body(rest, agent_keys, owner).await {
|
|
Ok(Some(profile)) => Some(crate::prompt_framing::semantic_section(
|
|
"core-memory",
|
|
&profile,
|
|
)),
|
|
Ok(None) => Some(crate::prompt_framing::semantic_section(
|
|
"core-memory",
|
|
ONBOARDING_NUDGE,
|
|
)),
|
|
Err(reason) => {
|
|
tracing::warn!(
|
|
target: "engram::core",
|
|
"core fetch failed: {reason} — emitting no section to avoid \
|
|
confusing a relay outage with an absent core"
|
|
);
|
|
None
|
|
}
|
|
}
|
|
}
|
|
|
|
/// Query the relay for the core head and decode it. Returns:
|
|
/// - `Ok(Some(profile))` if a valid core body was found,
|
|
/// - `Ok(None)` only if the relay confirmed absence (empty result set),
|
|
/// - `Err(reason)` if the relay returned candidates we could not parse,
|
|
/// verify, or decrypt — those are NOT treated as absence (would let an
|
|
/// unreadable but real core be silently overwritten by the onboarding nudge),
|
|
/// - `Err` for transport / parse errors.
|
|
async fn fetch_core_body(
|
|
rest: &RestClient,
|
|
agent_keys: &Keys,
|
|
owner: &PublicKey,
|
|
) -> Result<Option<String>, String> {
|
|
let k_c = conversation_key(agent_keys.secret_key(), owner);
|
|
let d = d_tag(&k_c, buzz_core::engram::CORE_SLUG);
|
|
|
|
let filter = nostr::Filter::new()
|
|
.kind(nostr::Kind::Custom(KIND_AGENT_ENGRAM as u16))
|
|
.author(agent_keys.public_key())
|
|
.custom_tags(nostr::SingleLetterTag::lowercase(nostr::Alphabet::D), [d])
|
|
.custom_tags(
|
|
nostr::SingleLetterTag::lowercase(nostr::Alphabet::P),
|
|
[owner.to_hex()],
|
|
)
|
|
.limit(16);
|
|
|
|
let value = rest
|
|
.query(&[filter])
|
|
.await
|
|
.map_err(|e| format!("relay query failed: {e}"))?;
|
|
let arr = value
|
|
.as_array()
|
|
.ok_or_else(|| "relay query returned non-array".to_string())?;
|
|
decode_core_body(arr, agent_keys, owner)
|
|
}
|
|
|
|
/// Pure decoder: given the relay's JSON array, decide whether we have a
|
|
/// readable core, confirmed absence, or an ambiguous unreadable-state.
|
|
///
|
|
/// - Empty array → `Ok(None)` (confirmed absence; caller renders the nudge).
|
|
/// - At least one event decrypts → use the winning head's body.
|
|
/// * Body::Core → `Ok(Some(profile))`
|
|
/// * Body::Tombstone or unexpected shape → `Ok(None)` (treat as absent).
|
|
/// - Non-empty array but nothing decrypts → `Err` (fail closed; caller
|
|
/// emits no section, so the agent does not assume memory is empty and
|
|
/// try to overwrite a real-but-unreadable core).
|
|
fn decode_core_body(
|
|
arr: &[serde_json::Value],
|
|
agent_keys: &Keys,
|
|
owner: &PublicKey,
|
|
) -> Result<Option<String>, String> {
|
|
if arr.is_empty() {
|
|
return Ok(None);
|
|
}
|
|
let mut valid_with_body: Vec<(Event, Body)> = Vec::with_capacity(arr.len());
|
|
let mut candidates_seen = 0usize;
|
|
let mut last_decrypt_err: Option<String> = None;
|
|
for ev_json in arr {
|
|
let event: Event = match serde_json::from_value(ev_json.clone()) {
|
|
Ok(e) => e,
|
|
Err(_) => continue,
|
|
};
|
|
if event.verify().is_err() {
|
|
continue;
|
|
}
|
|
candidates_seen += 1;
|
|
match validate_and_decrypt(
|
|
&event,
|
|
&agent_keys.public_key(),
|
|
owner,
|
|
agent_keys.secret_key(),
|
|
owner,
|
|
) {
|
|
Ok(body) => valid_with_body.push((event, body)),
|
|
Err(e) => {
|
|
last_decrypt_err = Some(e.to_string());
|
|
continue;
|
|
}
|
|
}
|
|
}
|
|
if valid_with_body.is_empty() {
|
|
if candidates_seen > 0 {
|
|
return Err(format!(
|
|
"{candidates_seen} core candidate(s) returned but none decryptable (last error: {})",
|
|
last_decrypt_err.as_deref().unwrap_or("unknown")
|
|
));
|
|
}
|
|
return Err(
|
|
"relay returned core candidate(s) that could not be parsed or verified".to_string(),
|
|
);
|
|
}
|
|
let events: Vec<Event> = valid_with_body.iter().map(|(e, _)| e.clone()).collect();
|
|
// `select_head` returns `None` only on an empty iterator, which we
|
|
// ruled out above.
|
|
let Some(head) = select_head(events) else {
|
|
return Ok(None);
|
|
};
|
|
let head_id = head.id;
|
|
let body = valid_with_body
|
|
.into_iter()
|
|
.find(|(e, _)| e.id == head_id)
|
|
.map(|(_, b)| b);
|
|
match body {
|
|
Some(Body::Core { profile }) => Ok(Some(profile)),
|
|
// A tombstone or unexpectedly-shaped head means "no usable core."
|
|
_ => Ok(None),
|
|
}
|
|
}
|
|
|
|
#[cfg(test)]
|
|
mod tests {
|
|
use super::*;
|
|
use buzz_core::engram::{build_event, Body};
|
|
use serde_json::json;
|
|
|
|
/// Empty array → confirmed absence → Ok(None), so the caller emits the
|
|
/// onboarding nudge. This is the only path that maps to "no core."
|
|
#[test]
|
|
fn decode_empty_array_is_confirmed_absence() {
|
|
let agent = Keys::generate();
|
|
let owner = Keys::generate();
|
|
let out = decode_core_body(&[], &agent, &owner.public_key()).unwrap();
|
|
assert_eq!(out, None);
|
|
}
|
|
|
|
/// Happy path: a real, decryptable core event yields the profile.
|
|
#[test]
|
|
fn decode_valid_core_returns_profile() {
|
|
let agent = Keys::generate();
|
|
let owner = Keys::generate();
|
|
let body = Body::Core {
|
|
profile: "I am Sami.".to_string(),
|
|
};
|
|
let ev = build_event(&agent, &owner.public_key(), &body, 1_700_000_000).unwrap();
|
|
let arr = vec![serde_json::to_value(&ev).unwrap()];
|
|
let out = decode_core_body(&arr, &agent, &owner.public_key()).unwrap();
|
|
assert_eq!(out.as_deref(), Some("I am Sami."));
|
|
}
|
|
|
|
/// Regression: when the relay returns a kind:30174 event addressed to
|
|
/// this agent that we cannot decrypt (here: encrypted to a *different*
|
|
/// owner's key, so the MAC fails for this agent↔owner pair), we MUST
|
|
/// return Err and NOT Ok(None). Returning Ok(None) would cause the
|
|
/// harness to emit the onboarding nudge, inviting the agent to overwrite
|
|
/// a real-but-unreadable core.
|
|
#[test]
|
|
fn decode_undecryptable_candidate_is_err_not_absent() {
|
|
let agent = Keys::generate();
|
|
let owner = Keys::generate();
|
|
let wrong_owner = Keys::generate();
|
|
// Build an engram encrypted to wrong_owner (not owner). It will pass
|
|
// sig verification but fail MAC/decrypt for the agent↔owner pair.
|
|
let body = Body::Core {
|
|
profile: "secret".to_string(),
|
|
};
|
|
let ev = build_event(&agent, &wrong_owner.public_key(), &body, 1_700_000_000).unwrap();
|
|
let arr = vec![serde_json::to_value(&ev).unwrap()];
|
|
let result = decode_core_body(&arr, &agent, &owner.public_key());
|
|
assert!(result.is_err(), "expected Err, got: {result:?}");
|
|
let msg = result.unwrap_err();
|
|
assert!(msg.contains("decryptable"), "got: {msg}");
|
|
}
|
|
|
|
/// An unexpectedly-shaped head (here: a Memory body in what was supposed
|
|
/// to be the core slot) is a legitimate, decryptable "no usable core" —
|
|
/// Ok(None). Real `rm core` is refused at the CLI, so this is a defensive
|
|
/// branch for malformed data on the wire.
|
|
#[test]
|
|
fn decode_non_core_body_is_absent() {
|
|
let agent = Keys::generate();
|
|
let owner = Keys::generate();
|
|
let body = Body::Memory {
|
|
slug: "mem/x".to_string(),
|
|
value: None,
|
|
};
|
|
let ev = build_event(&agent, &owner.public_key(), &body, 1_700_000_000).unwrap();
|
|
let arr = vec![serde_json::to_value(&ev).unwrap()];
|
|
let out = decode_core_body(&arr, &agent, &owner.public_key()).unwrap();
|
|
assert_eq!(out, None);
|
|
}
|
|
|
|
/// Non-empty array with only garbage entries (not even parseable as
|
|
/// events) is also treated as a fetch error, not absence.
|
|
#[test]
|
|
fn decode_unparseable_candidates_is_err() {
|
|
let agent = Keys::generate();
|
|
let owner = Keys::generate();
|
|
let arr = vec![json!({"not": "an event"}), json!("garbage")];
|
|
let result = decode_core_body(&arr, &agent, &owner.public_key());
|
|
assert!(result.is_err(), "expected Err, got: {result:?}");
|
|
}
|
|
}
|