mirror of
https://github.com/block/buzz.git
synced 2026-11-14 13:21:02 +00:00
On iOS, Buzz's HTTP traffic now uses HTTP/2. Dart's `dart:io` client speaks only HTTP/1.1, so every feature's client opened its own connections to the relay, which sits behind Cloudflare and offers HTTP/2. On a slow link those extra handshakes, and the HTTP/1.1 head-of-line queueing, are a large share of cold-start time. ### What changes - iOS HTTP goes through two app-wide `NSURLSession`s via [cupertino_http](https://pub.dev/packages/cupertino_http) (`lib/shared/http/app_http_client.dart`): one for API traffic (relay queries, NIP-11, account, admission, pairing) and one for media (image/video/voice downloads and uploads). Requests to a host multiplex over one connection per session. Media has its own session so image bytes can't starve queries on a shared HTTP/2 connection: in prototype measurements with a single shared session, the channel-list batch query finished *later* than on HTTP/1.1. - Callers keep owning and closing their clients; on iOS `close()` leaves the shared session open. Both sessions are ephemeral with no URL cache and no cookies, so apart from the protocol (and native gzip, inflated off the Dart isolate) behavior matches `dart:io`. - Android, and tests, keep `http.Client()` unchanged, including `http.runWithClient` overrides. - Because closing a client no longer cancels a request on a shared session, the relay query client (both `/query` posts and bounded snapshot reads) and the dev push-lease fetch abort their request on timeout instead. - Non-`https` requests (`http://` media and community icons from other clients, local dev relays) stay on the handle's own `dart:io` client, because App Transport Security would block cleartext loads through URLSession. An HTTPS URL that redirects to `http://` is the one case that newly fails on iOS (URLSession follows the redirect and ATS blocks the downgrade); we accept that rather than follow redirects in Dart. - URLSession failures arrive as `NSErrorClientException`, not `SocketException`, so pairing and invite-join error messages now also recognize `NSURLErrorDomain` offline, TLS and timeout codes. - cupertino_http 3.0.1+ requires native_toolchain_c 0.19 and hooks 2.x, so `buzz_secp256k1` moves to those. Its build hook compiles unchanged. ### What gets better, and what doesn't get worse - **Better:** on a slow link, requests reuse one warm connection per session instead of paying TCP+TLS setup each time, so they complete where `main` times out (see the table). On Wi-Fi, small queries are slightly faster. - **Not worse:** request semantics, caching (none) and cookies (none) match `dart:io`; Android and tests are untouched; timed-out requests are aborted so they can't keep using bandwidth on the shared connection; offline errors keep their friendly messages. The accepted regression is HTTPS-to-HTTP redirects on iOS, above. WebSockets stay on `dart:io`. Android (Cronet) is a possible follow-up using the same seam. ### Validation Added tests: shared-session handles don't close the session; off iOS the transport honors `http.runWithClient`; NSURLError code classification; timed-out relay queries and bounded snapshot reads abort their request; cleartext requests stay off the shared session. Focused existing validation: full mobile suite (the only failures are 11 push/notification tests that fail identically on `main` on the same machine), `flutter analyze`, `buzz_secp256k1` package tests (27/27), and an iOS release build. On-device A/B on an iPhone 12 mini against the internal prod relay over WARP, comparing cold starts of `main` and this branch (profile builds with local-only request timing, 3 cold starts each): | | `main` | this branch | |---|---|---| | Wi-Fi: first query done (median) | 0.31s | 0.25s | | Wi-Fi: small-query latency (median) | 0.22s | 0.18s | | NLC Edge: requests completed in 90s | 0, 0, 0 (29–30 failed) | 12, 14, 16 (5–7 failed) | | NLC Edge: first request done | never | 6.3–7.0s | On Wi-Fi the two are about even. Under Edge, every HTTP/1.1 request on `main` hit its timeout while still opening a connection, and each retry started a fresh TCP+TLS handshake. The branch reuses one connection, so queries complete. Connection counts weren't measured on the device, since no proxy was in the path. Cold-cache demo on an iOS simulator (this branch, app caches and cached prefs wiped before launch): avatars, community icons, channel lists, public channel images, a DM image and custom emoji, video playback, reactions, and an image and video upload with progress all load. The DM image and clip are synthetic test media. https://github.com/user-attachments/assets/039d1a25-46f2-4e0e-b147-f96d0cfabd40 buzz-review-completed (agent review and device validation done; the human-test step is not applicable under Tom's standing exception for mobile changes) --------- Signed-off-by: Tom Brow <tomb@squareup.com> Co-authored-by: Tom Brow <tomb@squareup.com> Co-authored-by: studio <dc2fc481343672df31a689840c09299972e704dac592e0da6f18486646a7ee3e@buzz.block.builderlab.xyz> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
148 lines
5.0 KiB
Dart
148 lines
5.0 KiB
Dart
import 'dart:convert';
|
||
|
||
import 'package:flutter/foundation.dart';
|
||
import 'package:hooks_riverpod/hooks_riverpod.dart';
|
||
import 'package:http/http.dart' as http;
|
||
|
||
import '../../shared/deeplink/deep_link.dart';
|
||
import '../../shared/hosted/hosted_environment.dart';
|
||
import '../../shared/http/app_http_client.dart';
|
||
import '../../shared/utils/bounded_fetch.dart';
|
||
import 'agent_avatar_picker.dart';
|
||
|
||
/// Creates the HTTP client that fetches a card's `agent.json`; overridden in
|
||
/// tests.
|
||
final agentCardClientProvider = Provider<http.Client Function()>(
|
||
(ref) => newAppHttpClient,
|
||
);
|
||
|
||
/// Largest `agent.json` accepted, far above any real card.
|
||
const maxAgentCardBytes = 2 * 1024 * 1024;
|
||
|
||
/// Why a card's draft could not be loaded, worded for the user.
|
||
class AgentCardException implements Exception {
|
||
const AgentCardException(this.message);
|
||
|
||
final String message;
|
||
|
||
@override
|
||
String toString() => 'AgentCardException: $message';
|
||
}
|
||
|
||
/// Initial, fully editable values for [CreateAgentPage], from a link.
|
||
///
|
||
/// Unlike an unfinished setup in `RemoteAgentController.pending`, a draft has
|
||
/// created nothing: every field stays editable and nothing is persisted.
|
||
class AgentCreationDraft {
|
||
const AgentCreationDraft({
|
||
required this.name,
|
||
required this.instructions,
|
||
this.avatar,
|
||
this.modelId,
|
||
this.reasoningEffort,
|
||
});
|
||
|
||
final String name;
|
||
final String instructions;
|
||
|
||
/// Card avatar, or null to let the form pick its usual default.
|
||
final AgentAvatarSelection? avatar;
|
||
|
||
/// Requested model, applied only if the live catalog lists it.
|
||
final String? modelId;
|
||
|
||
/// Requested effort, applied only if the chosen model supports it.
|
||
final String? reasoningEffort;
|
||
|
||
/// Fetches [link]'s card from this build's avatars CDN and reads its draft.
|
||
static Future<AgentCreationDraft> fetch(
|
||
AgentCreationDeepLink link,
|
||
http.Client client,
|
||
) async {
|
||
final cdn = HostedEnvironment.avatarsCdnOrigin;
|
||
if (cdn == null) {
|
||
throw const AgentCardException(
|
||
'Agent cards aren’t available in this build.',
|
||
);
|
||
}
|
||
// The id is opaque; pathSegments percent-encodes anything path-unsafe.
|
||
final url = cdn.replace(pathSegments: [link.cardId, 'agent.json']);
|
||
final BoundedResponse response;
|
||
try {
|
||
response = await boundedGet(
|
||
client,
|
||
url,
|
||
maxBytes: maxAgentCardBytes,
|
||
headers: const {'accept': 'application/json'},
|
||
// A redirect could lead off the CDN; treat it as unavailable.
|
||
followRedirects: false,
|
||
);
|
||
} on ResponseTooLargeException {
|
||
throw const AgentCardException('This agent card is too large.');
|
||
} on Exception {
|
||
throw const AgentCardException(
|
||
'Couldn’t load this agent card. Check your connection and reopen the '
|
||
'link.',
|
||
);
|
||
}
|
||
if (response.statusCode == 403 || response.statusCode == 404) {
|
||
throw const AgentCardException('This agent card isn’t available.');
|
||
}
|
||
if (response.statusCode != 200) {
|
||
debugPrint('agents: agent card HTTP ${response.statusCode}');
|
||
throw const AgentCardException(
|
||
'Couldn’t load this agent card. Try again later.',
|
||
);
|
||
}
|
||
final Object? json;
|
||
try {
|
||
json = jsonDecode(utf8.decode(response.bytes));
|
||
} on FormatException {
|
||
throw const AgentCardException('This agent card is invalid.');
|
||
}
|
||
if (json is! Map<String, dynamic>) {
|
||
throw const AgentCardException('This agent card is invalid.');
|
||
}
|
||
return parseAgentCard(json, link.cardId);
|
||
}
|
||
|
||
/// Reads a card's draft from its `agent.json`. `id` (matching [cardId]),
|
||
/// `name` and `avatarUrl` (an https URL) are required; `instructions`,
|
||
/// `model` and `reasoningEffort` are optional and left for the user when
|
||
/// absent or blank. A missing required field, or a known field of the wrong
|
||
/// type, makes the card invalid. Any other key, including `v` and
|
||
/// `description` (agents have no description to prefill), is ignored
|
||
/// whatever its type, so Builderlab can add fields without breaking
|
||
/// released apps.
|
||
static AgentCreationDraft parseAgentCard(
|
||
Map<String, dynamic> json,
|
||
String cardId,
|
||
) {
|
||
const invalid = AgentCardException('This agent card is invalid.');
|
||
if (json['id'] != cardId) throw invalid;
|
||
final name = json['name'];
|
||
final avatarUrl = json['avatarUrl'];
|
||
if (name is! String || name.trim().isEmpty || avatarUrl is! String) {
|
||
throw invalid;
|
||
}
|
||
final avatar = Uri.tryParse(avatarUrl);
|
||
if (avatar == null || avatar.scheme != 'https' || avatar.host.isEmpty) {
|
||
throw invalid;
|
||
}
|
||
String? optional(String key) {
|
||
final value = json[key];
|
||
if (value != null && value is! String) throw invalid;
|
||
final text = (value as String?)?.trim();
|
||
return text == null || text.isEmpty ? null : text;
|
||
}
|
||
|
||
return AgentCreationDraft(
|
||
name: name.trim(),
|
||
instructions: optional('instructions') ?? '',
|
||
avatar: AgentAvatarSelection.url(avatarUrl),
|
||
modelId: optional('model'),
|
||
reasoningEffort: optional('reasoningEffort'),
|
||
);
|
||
}
|
||
}
|