mirror of
https://github.com/block/buzz.git
synced 2026-10-27 04:30:52 +00:00
5dc693aeaf
Huddle audio was embedded in the v0 desktop client, forcing other clients to duplicate its protocol and codec behavior. This extracts `buzz-audio-client` so v1 can depend on a pinned library revision without building the v0 application. The crate owns the bounded v2 audio handshake, roster parsing, wire format, Opus sender, and per-peer NetEQ jitter buffer. The v0 human and agent senders use it, and the desktop retains room admission, identity/signing, TLS policy, device routing, mute, and teardown. Receive decoding preserves v1's support for 120 ms Opus packets. No relay protocol changes, speech models, or model downloads are included. Docker builder stages include CMake because cargo-chef compiles the workspace dependency graph. Dependency security: Opus 0.4 replaces the unmaintained `audiopus_sys` backend with `opusic-sys`. NetEQ is pinned exactly to 0.8.3 because its published Rust sources never reference its declared ringbuf dependency. RUSTSEC-2026-0293 is documented as unreachable for this audited source, and a wrapper restriction rejects every other consumer of vulnerable ringbuf versions. Independent review confirmed the scope; re-audit/remove the exception when changing NetEQ. NetEQ 0.9.1 still declares ringbuf 0.3, so a version bump alone does not remove it. Local `cargo deny check` passes with this constrained exception. Validation: - All 21 shared-crate tests pass, including real loopback WebSocket authentication/cancellation, real Opus-to-NetEQ playback, malformed input, and 120 ms decoding. These tests are included in `just test-unit`. - Shared-crate, root workspace, and desktop Tauri Clippy pass; `just desktop-tauri-check` passes. - The desktop Tauri test workspace passes; native two-person listening/device checks remain separate. - All mandatory push checks pass at `d06bac5dc`, including the complete Rust unit gate and desktop workspace checks. Existing agent timing and relay log-capture tests failed under concurrent load, passed separately, and passed in the full serial test run; no tests or hooks were skipped. - One test-only fixture change allows cold Perl startup before the escaped-process test's inner timeout (2 seconds instead of 300 ms). Its independent 5-second watchdog, 300-second surviving pipe writer, and all assertions remain intact. All eight process-helper tests pass; independent review confirmed this still tests bounded drain completion. - Dependency inspection confirms the library brings in no desktop application, Tauri, identity store, relay server, or speech-model crates. - Independent source review found no correctness blockers. Draft: a native two-person call, mute/leave/cancellation, and microphone/speaker switching still need a runtime tryout and human review. Full `just ci` was stopped during the unrelated mobile toolchain download because of disk pressure; it is not a passing gate. Consumer integration is tracked in block/buzz-app#489. --------- Signed-off-by: kenny lopez <klopez4212@gmail.com>
57 lines
1.9 KiB
Rust
57 lines
1.9 KiB
Rust
use buzz_audio_client::{
|
|
encoder::{AudioEncoder, FRAME_SAMPLES},
|
|
jitter::PeerJitterBuffer,
|
|
wire::{parse_relay_frame, FrameHeader, V2_HEADER_LEN},
|
|
};
|
|
|
|
#[test]
|
|
fn encoded_media_plays_through_the_shared_receiver() {
|
|
let mut encoder = AudioEncoder::new().unwrap();
|
|
let mut receiver = PeerJitterBuffer::new(7).unwrap();
|
|
let samples: Vec<f32> = (0..FRAME_SAMPLES)
|
|
.map(|n| (n as f32 * 0.1).sin() * 0.1)
|
|
.collect();
|
|
for seq in 0..8 {
|
|
let payload = encoder.encode(&samples).unwrap();
|
|
let frame = [vec![7], payload].concat();
|
|
let (peer, header, opus) = parse_relay_frame(&frame).unwrap();
|
|
assert_eq!(peer, 7);
|
|
assert_eq!(header.seq, seq);
|
|
assert_eq!(header.ts_48k, u32::from(seq) * 960);
|
|
receiver
|
|
.insert_packet(header.seq, header.ts_48k, opus)
|
|
.unwrap();
|
|
}
|
|
let mut energy = 0.0_f32;
|
|
for _ in 0..20 {
|
|
let (pcm, _) = receiver.get_audio().unwrap();
|
|
assert_eq!(pcm.len(), 480);
|
|
assert!(pcm.iter().all(|s| s.is_finite()));
|
|
energy += pcm.iter().map(|s| s * s).sum::<f32>();
|
|
}
|
|
assert!(
|
|
energy > 0.01,
|
|
"voice must survive actual Opus and jitter decoding"
|
|
);
|
|
}
|
|
|
|
#[test]
|
|
fn invalid_input_does_not_advance_clock_and_short_frames_are_padded() {
|
|
let mut encoder = AudioEncoder::new().unwrap();
|
|
for samples in [vec![], vec![0.; 961], vec![f32::NAN], vec![f32::INFINITY]] {
|
|
assert!(encoder.encode(&samples).is_err());
|
|
}
|
|
let encoded = encoder.encode(&[0.1; 120]).unwrap();
|
|
let (header, _) = FrameHeader::parse(&encoded).unwrap();
|
|
assert_eq!(header.seq, 0);
|
|
assert_eq!(header.ts_48k, 0);
|
|
let mut decoder = opus::Decoder::new(48000, opus::Channels::Mono).unwrap();
|
|
let mut pcm = [0.0; 5760];
|
|
assert_eq!(
|
|
decoder
|
|
.decode_float(&encoded[V2_HEADER_LEN..], &mut pcm, false)
|
|
.unwrap(),
|
|
960
|
|
);
|
|
}
|