feat(local): maple start — standalone local observability binary

[Makisuo]

Overview

Adds maple start: a single, distributable binary that runs a local OTLP ingest endpoint + embedded storage + a purpose-built telemetry UI — a Jaeger/Grafana-style local tool that reuses Maple's real ingest pipeline, real ClickHouse schema, real SQL query layer, and real visualization components, without shipping the heavy multi-tenant SaaS frontend (no Clerk, billing, agents, or Cloudflare).

This PR is the full feature across the planned phases; the three commits build on each other.

What's in it

Backend — apps/ingest (maple bin, local feature)

• New WriteMode::Local + chdb module owning a single embedded chDB session (in-process ClickHouse — no server, no Docker). All bootstrap/insert/query calls serialized through one writer.
• Reuses the existing OTLP decode + encode_traces/logs/metrics row-building (zero mapping divergence from the Tinybird path), batched per datasource.
• Bootstraps the real generated ClickHouse DDL (local-schema.sql) on startup — base tables and materialized views, so chDB derives the rest on INSERT.
• POST /local/query runs SQL through chDB; GET /* serves the embedded SPA via rust-embed. Single pinned tenant (OrgId = "local").

Shared components — packages/ui

• Extracted the trace-timeline waterfall + supporting types/utils/icons from apps/web so both apps share them. span-tree.ts exposes buildTraceDetail/buildSpanTree with branded TraceId/SpanId.

Frontend — apps/local-ui (new minimal React + Vite SPA)

• Hash-routed trace list → trace detail (waterfall) → logs.
• Data layer builds ClickHouse SQL via @maple/query-engine (CH.compile) pinned to the local org and posts to /local/query. useInfiniteQuery + @tanstack/react-virtual for logs.
• No router/Clerk/Cloudflare deps.

Build & distribution

• scripts/build-local-binary.sh: builds the SPA → syncs into apps/ingest/ui-dist/ (rust-embed bakes it in) → cargo build --features local --bin maple → bundles libchdb.so beside the binary and rewrites the dynamic-load path (install_name_tool @rpath/@loader_path on macOS, patchelf $ORIGIN on Linux) → relocatable 2-file bundle.
• .github/workflows/local-binary-release.yml: builds on native runners per triple (aarch64/x86_64 × darwin/linux), ad-hoc codesigns macOS, tars maple + libchdb.so with a sha256, publishes to a GitHub release on v* tags.

Why native runners (no cross-compilation)

chdb-rust's build.rs downloads a host-specific prebuilt libchdb.so and links it. Cross-compiling would link the wrong architecture's engine, so each target is built on a matching native runner.

Verification

• Phase 4 verified end-to-end against real chDB data in the browser: trace list (method/service badges), trace-detail waterfall (parent→child hierarchy, duration bars, status, span detail panel), logs (severity colors, newest-first, virtualized). No console errors.
• Relocatable bundle confirmed to run standalone on macOS arm64 with no DYLD_LIBRARY_PATH.

Reviewer notes

• macOS notarization is deferred — release bundles are only ad-hoc signed (documented in the workflow + release notes). Production Developer ID + notarization needs APPLE_* secrets not configured here.
• The release workflow can't be validated locally — it's written-then-pushed; first CI run will confirm the Linux-arm64 libchdb download path in particular.
• apps/ingest/ui-dist/ is now a build artifact: only .gitkeep is tracked (rust-embed needs the folder to exist); the generated SPA output is gitignored. The previously-tracked stale ui-dist/index.html is removed.

🤖 Generated with Claude Code

[pullfrog]

This run croaked 😵

The workflow encountered an error before any progress could be reported. Please check the link below for details.

  ^{｜ Rerun failed job ➔ ｜ View workflow run ｜ via Pullfrog ｜ 𝕏}

[github-actions]

Ingest Rust Test + Benchmark Results

Commit: c2f1ddab47b3ed2f68fbeb5c14f248dcbc60d1a6

Load Benchmark — tinybird mode, median of 3 run(s) vs main

Metric	main (median)	PR (median)	Delta
Requests/sec	2412.92	2268.52	-6.0% worse
Rows/sec	24129.23	22685.17	-6.0% worse
p50 latency	25.83 ms	27.66 ms	+7.1% worse
p95 latency	28.34 ms	30.43 ms	+7.4% worse
p99 latency	30.40 ms	32.74 ms	+7.7% worse
Export catch-up	0.026 s	0.026 s	-0.6% better
Max RSS	97.58 MiB	96.01 MiB	-1.6% better
Failures	0	0	same

Same code path on both sides (same LOAD_TEST_INGEST_MODE), so the delta column is meaningful. Numbers come from ubuntu-latest, which is noisy — treat single-digit-percent deltas as noise.

PR load benchmark JSON (per-iteration)

[
  {
    "ingest_mode": "tinybird",
    "requests": 2000,
    "successes": 2000,
    "failures": 0,
    "rows_sent": 20000,
    "rows_exported": 20000,
    "imports": 24,
    "duration_seconds": 0.897704576,
    "export_catchup_seconds": 0.025471513,
    "request_rps": 2227.904428104419,
    "row_rps": 22279.044281044193,
    "p50_ms": 27.729,
    "p95_ms": 31.516,
    "p99_ms": 34.113,
    "max_rss_mb": 96.75390625,
    "max_cpu_percent": 75.0,
    "avg_cpu_percent": 54.15
  },
  {
    "ingest_mode": "tinybird",
    "requests": 2000,
    "successes": 2000,
    "failures": 0,
    "rows_sent": 20000,
    "rows_exported": 20000,
    "imports": 25,
    "duration_seconds": 0.881633053,
    "export_catchup_seconds": 0.026095632,
    "request_rps": 2268.5174894412676,
    "row_rps": 22685.174894412674,
    "p50_ms": 27.665,
    "p95_ms": 30.425,
    "p99_ms": 32.744,
    "max_rss_mb": 95.90625,
    "max_cpu_percent": 75.0,
    "avg_cpu_percent": 45.8
  },
  {
    "ingest_mode": "tinybird",
    "requests": 2000,
    "successes": 2000,
    "failures": 0,
    "rows_sent": 20000,
    "rows_exported": 20000,
    "imports": 24,
    "duration_seconds": 0.816166996,
    "export_catchup_seconds": 0.026171473,
    "request_rps": 2450.478896845763,
    "row_rps": 24504.788968457626,
    "p50_ms": 25.621,
    "p95_ms": 27.202,
    "p99_ms": 28.461,
    "max_rss_mb": 96.0078125,
    "max_cpu_percent": 80.3,
    "avg_cpu_percent": 56.8
  }
]

main load benchmark JSON (per-iteration)

[
  {
    "ingest_mode": "tinybird",
    "requests": 2000,
    "successes": 2000,
    "failures": 0,
    "rows_sent": 20000,
    "rows_exported": 20000,
    "imports": 25,
    "duration_seconds": 0.895887909,
    "export_catchup_seconds": 0.026263043,
    "request_rps": 2232.4221366403103,
    "row_rps": 22324.221366403104,
    "p50_ms": 28.031,
    "p95_ms": 31.086,
    "p99_ms": 32.759,
    "max_rss_mb": 97.1875,
    "max_cpu_percent": 75.0,
    "avg_cpu_percent": 45.8
  },
  {
    "ingest_mode": "tinybird",
    "requests": 2000,
    "successes": 2000,
    "failures": 0,
    "rows_sent": 20000,
    "rows_exported": 20000,
    "imports": 25,
    "duration_seconds": 0.828870368,
    "export_catchup_seconds": 0.025845742,
    "request_rps": 2412.9225476184474,
    "row_rps": 24129.225476184474,
    "p50_ms": 25.832,
    "p95_ms": 28.341,
    "p99_ms": 30.403,
    "max_rss_mb": 99.15234375,
    "max_cpu_percent": 80.3,
    "avg_cpu_percent": 60.15
  },
  {
    "ingest_mode": "tinybird",
    "requests": 2000,
    "successes": 2000,
    "failures": 0,
    "rows_sent": 20000,
    "rows_exported": 20000,
    "imports": 23,
    "duration_seconds": 0.814727958,
    "export_catchup_seconds": 0.026269159,
    "request_rps": 2454.807129621051,
    "row_rps": 24548.07129621051,
    "p50_ms": 25.498,
    "p95_ms": 27.858,
    "p99_ms": 28.268,
    "max_rss_mb": 97.578125,
    "max_cpu_percent": 80.7,
    "avg_cpu_percent": 57.0
  }
]

WAL-acked microbench (cargo bench --bench ingest_bench)

   Compiling maple-ingest v0.1.0 (/home/runner/work/maple/maple/apps/ingest)
    Finished `bench` profile [optimized] target(s) in 32.24s
     Running benches/ingest_bench.rs (target/release/deps/ingest_bench-56e0fe315b7f3811)
Gnuplot not found, using plotters backend
test ingest_accept/logs_10_rows_wal_ack ... bench:      467413 ns/iter (+/- 7714)
test ingest_accept/traces_10_spans_wal_ack ... bench:      503311 ns/iter (+/- 23826)

cargo test

    Updating crates.io index
   Compiling maple-ingest v0.1.0 (/home/runner/work/maple/maple/apps/ingest)
    Finished `test` profile [unoptimized + debuginfo] target(s) in 6.73s
     Running unittests src/lib.rs (target/debug/deps/maple_ingest-8b9e9fc61a910385)

running 22 tests
test telemetry::tests::apply_attribute_mappings_rewrites_span_attributes ... ok
test otel::tests::build_resource_sets_runtime_and_sdk_type ... ok
test telemetry::tests::hex_empty_for_zero_ids ... ok
test telemetry::tests::log_encoder_matches_tinybird_row_shape ... ok
test telemetry::tests::logs_severity_text_falls_back_to_mapped_number ... ok
test telemetry::tests::logs_emit_exactly_the_jsonpaths_declared_in_datasources_ts ... ok
test telemetry::tests::custom_datasource_names_propagate_to_frames ... ok
test telemetry::tests::logs_use_observed_time_when_time_unix_nano_is_zero ... ok
test telemetry::tests::metrics_emit_exactly_the_jsonpaths_declared_in_datasources_ts ... ok
test telemetry::tests::metric_encoder_matches_all_tinybird_datasource_shapes ... ok
test telemetry::tests::metrics_summary_data_points_are_dropped ... ok
test telemetry::tests::sampling_keeps_errors_even_when_ratio_low ... ok
test telemetry::tests::timestamp_has_nano_precision ... ok
test telemetry::tests::timestamps_match_clickhouse_datetime64_nine_format ... ok
test telemetry::tests::trace_encoder_matches_tinybird_row_shape ... ok
test telemetry::tests::traces_emit_exactly_the_jsonpaths_declared_in_datasources_ts ... ok
test telemetry::tests::wal_partial_drain_advances_cursor_without_truncating ... ok
test telemetry::tests::wal_round_trips_frame ... ok
test telemetry::tests::wal_truncates_after_full_drain_allowing_further_appends ... ok
test telemetry::tests::pipeline_e2e_exports_gzip_ndjson_to_fake_tinybird ... ok
test telemetry::tests::pipeline_e2e_exports_metrics_to_fake_tinybird ... ok
test telemetry::tests::pipeline_e2e_exports_traces_to_fake_tinybird ... ok

test result: ok. 22 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.09s

     Running unittests src/bin/load_test.rs (target/debug/deps/load_test-3ae74910c06cd17d)

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

     Running unittests src/main.rs (target/debug/deps/maple_ingest-c2f428c94e6b99e8)

running 18 tests
test tests::cloudflare_validation_payload_is_detected ... ok
test tests::cloudflare_log_record_maps_body_severity_and_attributes ... ok
test tests::cloudflare_timestamps_support_rfc3339_unix_and_unix_nano ... ok
test tests::d1_response_parses_empty_results_as_no_match ... ok
test tests::d1_response_parses_failure_with_errors ... ok
test tests::d1_truthy_accepts_int_and_bool_self_managed ... ok
test tests::enrichment_overwrites_tenant_fields ... ok
test tests::d1_response_parses_success_with_rows ... ok
test tests::cloudflare_ndjson_payload_parses_multiple_records ... ok
test tests::non_self_managed_goes_to_shared_pool ... ok
test tests::hash_is_deterministic ... ok
test tests::extract_ingest_key_returns_sentinel_literal_unchanged ... ok
test tests::self_managed_degrades_to_shared_when_endpoint_unset ... ok
test tests::resolve_ingest_key_returns_self_managed_true_when_active_settings_row ... ok
test tests::resolve_ingest_key_returns_none_when_hash_missing ... ok
test tests::self_managed_goes_to_self_managed_pool_when_configured ... ok
test tests::sentinel_token_matches_only_exact_literal ... ok
test tests::resolve_ingest_key_returns_self_managed_false_when_no_settings_row ... ok

test result: ok. 18 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s

   Doc-tests maple_ingest

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s