Restructures /docs/ by reader purpose (tutorials, how-to, reference, design), adds the new-user-progression and operator-recipe content the prior layout lacked, runs an accuracy pass against current source across the pre-existing design docs, and rewrites the gateway feature-set documentation end-to-end around its actual operational profile (a niche feature designed for systems already serving DHCP/DNS to a LAN, with two independent halves — outbound LAN→mesh, inbound mesh→LAN — sharing one nftables table, one binary, and one control socket). Top-level README and getting-started rewritten around two equally-weighted deployment modes (overlay on existing IP networks; ground-up over non-IP transports). ## Additions - 11 new tutorials in docs/tutorials/: an 8-step new-user progression from single-daemon test-mesh peering through to a ground-up two-device mesh, an IPv6-adapter side-trip walkthrough, an Advanced Tutorials index, and a hand-held OpenWrt walk-through for fips-gateway deployment that exercises both halves of the feature. - 12 new how-tos in docs/how-to/: firewall activation, Nostr discovery (resolve / advertise / open across five scenarios), Tor onion (directory + control_port modes), UDP buffer tuning, unprivileged-user setup, persistent identity, host aliases, Bluetooth LE peering, MTU diagnostics, manual Linux-host gateway deployment (covers both halves), gateway troubleshooting (organised by half), and a section index. - 9 new reference docs in docs/reference/: configuration, wire formats, control-socket protocol, four CLI references (fips, fipsctl, fipstop, fips-gateway), security posture matrix, and Nostr events catalog. Configuration and wire-formats are renamed-and-extended from prior design/ versions; the other seven are net-new. - 6 new design docs: fips-concepts, fips-architecture, and fips-prior-work split out of the deleted fips-intro.md; consolidated fips-mmp and fips-mtu aggregations; and a new generic port-advertisement-and-nat-traversal doc (Nostr-signaled port advertisement plus UDP NAT-traversal protocol, FIPS as an example implementation, suitable for eventual NIP submission). - Top-level docs/getting-started.md walking through the binary-installer-only Install story. - packaging/common/hosts pre-populated with the eight public test-mesh nodes so shortnames resolve out of the box on every fresh install. ## Changes - 23 wire-format diagrams relocated to reference/diagrams/ alongside the wire-formats move. - 4 design diagrams corrected against source code (fips-protocol-stack, fips-identity-derivation, fips-coordinate-discovery, fips-routing-decision). - 10 pre-existing design docs reconciled with current source. Numeric corrections: stale link-MMP report bounds (now [1s, 5s] with 200 ms cold-start floor); UDP default MTU (now 1280, IPv6 minimum); node_addr formula (SHA-256(pubkey)[..16]); Noise patterns (IK at link, XK at session); peer-ACL semantics (strict allowlist requires ALL in peers.deny); daemon DNS upstream ([::1]:5354); on-the-wire bloom-filter size (1,071 bytes); obsolete Cargo-feature references (PR #79 dropped them) removed. - Transport framing tightened across the docs: TCP is for UDP-filtered networks (not NAT traversal); Tor is a deployment mode (not failover); WebSocket dropped (not a shipped FIPS transport); WiFi promoted to Implemented via Ethernet in infrastructure mode; classic-Bluetooth row removed (BLE is the only Bluetooth-mode transport). - docs/design/fips-gateway.md rewritten end-to-end to lead with the niche-feature framing and the two-halves structure. Title moved from "FIPS Outbound LAN Gateway" to "FIPS Gateway"; architecture section describes the common machinery (the fips-gateway service, the nftables table, the control socket) before splitting into separate "Outbound Half" and "Inbound Half" sections of equal weight; security considerations split per-half; no Future Work section (speculative directions live in the project tracker, not in protocol design docs). Inbound port forwarding is a first-class half rather than a buried "Implemented Extensions" subsection. - Gateway terminology unified across all gateway docs as a separate Linux service running alongside the fips daemon (its own systemd unit / OpenWrt init script). Container- pattern terms (sidecar) are reserved for the Docker/Kubernetes sidecar deployment examples — the testing/sidecar/ tree, examples/k8s-sidecar/, examples/sidecar-nostr-relay/, examples/wireguard-sidecar-macos/, and the related CHANGELOG / top-level README entries — where the term carries its standard container meaning. - Net-new design body content: rekey section in fips-mesh-layer (Noise IK msg1/msg2 over the established link, K-bit cutover, drain window, smaller-NodeAddr-wins tie-breaker on dual-init); Mesh Size Estimation and Antipoison FPR Cap sections in fips-bloom-filters; Mesh-Interface Query Filter subsection in fips-ipv6-adapter; failure-suppression knobs and clock- skew tolerance in fips-nostr-discovery; loop-rejection and mid-chain ancestor swap added to spanning-tree propagation / stability rules; Priority Chain in fips-mesh-operation renumbered to match the routing-decision diagram. - Top-level README: dropped the stale nostr-discovery cargo-feature parenthetical. docs/README.md and the four section READMEs (tutorials, how-to, reference, design) refreshed for the new structure; index rows reflect both halves of the gateway feature and the new fips-gateway CLI reference. - Cargo.toml [package.metadata.deb] assets path updated for the fips-security.md move; .gitignore /reference/ rule anchored to repo root so docs/reference/ is trackable. - packaging/openwrt-ipk/files/etc/fips/fips.yaml configuration-doc URL updated to the new docs/reference/configuration.md location. ## Deletions - docs/design/fips-intro.md (split into the three new intro design docs). - docs/design/document-relationships.svg (orphan, no longer referenced). - docs/proposals/ tree removed; the only proposal it contained (the Nostr UDP hole-punch protocol) was rewritten as the new generic design/port-advertisement-and-nat-traversal.md.
10 KiB
Resolve Peer Addresses via Nostr
After
persistent-identity, your daemon has
a stable npub and is peered with test-us01 over a hard-coded
UDP address (test-us01.fips.network:2121). That static
address works fine until test-us01 moves to a new IP, swaps
ports, or starts publishing additional endpoints you'd want to
reach. The npub is stable; the set of network endpoints behind
it may not be.
This tutorial shows the smallest useful step toward Nostr- mediated discovery: keep the peer entry but drop its address, let your daemon ask public Nostr relays for the peer's current endpoint, and verify the link still works. You will not be publishing anything yourself yet — this is the consume-only case.
The whole exercise should take about ten minutes.
What you'll build
┌──────────────────────────┐
│ Nostr relays │
│ relay.damus.io │
│ nos.lol │
│ offchain.pub │
└────────────▲─────────────┘
"what's test-us01's │ signed advert
current address?" │ (Kind 37195)
│ from test-us01
┌───────────────────────┐ │
│ your fips daemon │ ─────────┘
│ peers: │
│ - test-us01 npub │ ─── dial resolved UDP ──▶ test-us01
│ via_nostr: true │
└───────────────────────┘
You'll change two things in /etc/fips/fips.yaml:
- Add a
node.discovery.nostrblock that turns the consume- side of Nostr discovery on. - Edit the existing
test-us01peer entry to drop its hard- codedaddresses:block and addvia_nostr: true.
After restart, the daemon will fetch test-us01's current
advert from the relays, use the endpoint listed there, and
peer normally.
How Nostr discovery resolves an address
Every FIPS daemon with node.discovery.nostr.advertise: true
publishes a signed Nostr event (Kind 37195) listing the
transport endpoints it is willing to accept connections on.
The event is signed by the daemon's secret key, so anyone
who has the corresponding npub can verify the advert really
came from that node.
test-us01 runs with advertise: true. Its current advert is
visible to any Nostr client.
Identity is stable; endpoints are not. A peer's npub is a long-lived identifier — it is who they are. Their UDP address, port, or transport choice is metadata that may change. Nostr discovery lets you bind your peer entry to the npub and lets the relay tell your daemon the current endpoint at dial time.
There are two halves to this — consuming adverts (looking up peers by npub) and publishing adverts (being lookup-able). This tutorial covers only the consume half.
Consume vs. publish. This tutorial enables only the consume side: your daemon queries relays to resolve peers by npub. It does not publish an advert of its own — others still cannot find you by your npub yet. The next tutorial (
advertise-your-node) handles the publish side.
Step 1: Confirm your starting state
You should currently have:
-
A persistent npub from persistent-identity. Confirm:
sudo fipsctl show status | grep '"npub"' -
A working static peering with
test-us01. Confirm:sudo fipsctl show peersExpect
test-us01listed withconnectivityactive and atransport_addrof roughly217.77.8.91:2121.
If either of those isn't true, finish the previous two tutorials first; the Nostr discovery layer is built on top of that working state.
Step 2: Enable the consume side of Nostr discovery
Open /etc/fips/fips.yaml and add a discovery block under
node::
node:
identity:
persistent: true
discovery:
nostr:
enabled: true
advertise: false
Two knobs, one job each:
enabled: trueturns on the Nostr discovery runtime — the daemon connects to a default relay set (wss://relay.damus.io,wss://nos.lol,wss://offchain.pub) and is now able to query and consume adverts.advertise: falsekeeps the publish side off. Your daemon will not publish an advert of its own at this stage. (This is the default, but it is good practice to make the choice explicit while you're learning.)
Step 3: Switch the peer entry to via_nostr
Find the peers: block you added during
join-the-test-mesh and change it from
this:
peers:
- npub: "npub1qmc3cvfz0yu2hx96nq3gp55zdan2qclealn7xshgr448d3nh6lks7zel98"
alias: "test-us01"
addresses:
- transport: udp
addr: "test-us01.fips.network:2121"
connect_policy: auto_connect
to this:
peers:
- npub: "npub1qmc3cvfz0yu2hx96nq3gp55zdan2qclealn7xshgr448d3nh6lks7zel98"
alias: "test-us01"
via_nostr: true
connect_policy: auto_connect
What changed: the addresses: list is gone, replaced by
via_nostr: true. The npub stays — it is what the daemon
matches against the advert publisher's pubkey.
Save the file.
Step 4: Restart the daemon
sudo systemctl restart fips
sudo systemctl status fips
The status output should show active (running) within a
couple of seconds. The Nostr discovery runtime starts alongside
the rest of the daemon, fetches test-us01's advert from the
default relays, and uses the endpoint listed there to dial.
The resolution itself happens at debug-log level, so you will
not see it in the default-level journal. The user-facing way to
confirm everything worked is fipsctl show peers in the next
step. (To watch the resolution in the journal, run the daemon
manually with RUST_LOG=fips::discovery::nostr=debug; not
necessary for this tutorial.)
Step 5: Verify the resolved endpoint
sudo fipsctl show peers
test-us01 should appear with connectivity active and a
transport_addr reflecting the address that was resolved from
the advert — 217.77.8.91:2121 at time of writing. That field
is the strong signal: nothing in your config gave the daemon
that IP, yet there it is.
You can confirm independently that the address came from the
advert. The advert is a public Nostr event — anyone can fetch
it. With the nak Nostr CLI installed:
nak req -k 37195 -d "fips-overlay-v1" \
-a 06f11c31227938ab98ba982280d2826f66a063f9efe7e342e81d6a76c677d7ed \
--limit 1 wss://relay.damus.io
(That hex pubkey is the same identity as
npub1qmc3...zel98 — Nostr filters take hex.) The content
field of the returned event lists the endpoints array; one
of its entries should match what fipsctl show peers is
using. That is what your daemon just did, signed and verified
by the Nostr layer.
Step 6: Confirm reachability still works
ping6 -c 4 test-us01.fips
Expect four replies, exactly as in join-the-test-mesh (which used the full npub form). Nothing about the data plane has changed; only the way you discovered the endpoint to dial.
What you've learned
- Adverts are signed. Every Nostr discovery advert is signed by the publisher's secret key, so the address you resolved through a public relay is trustworthy in the same sense the peer's npub is.
via_nostrreplaces a static address. A peer entry with noaddresses:block andvia_nostr: truedirects the daemon to look the endpoint up at dial time.- The relay set is small and public. Three default relays today; the daemon round-robins queries across them. No central FIPS infrastructure is involved.
- Static and Nostr can mix. You replaced the static
address with
via_nostrhere, but you could have kept both — when both are present, static endpoints are tried first and Nostr-resolved endpoints are appended as a fallback. Useful when you want a fast-path direct dial but a resilient fallback.
Troubleshooting
If the link does not come up:
- No advert on the relays. If the peer's daemon is
offline or has
advertise: false, no advert exists for your daemon to consume. Verify withnak(Step 5) — if the query returns nothing, that is the problem and it is on the peer's side. Re-add the staticaddresses:entry as a fallback while you wait for the peer to come back up. - Relay reachability.
Connected to relaylines should appear for at least one of the three default relays. If none do, your network may be filtering outbound WebSocket traffic or DNS for those hostnames. Check the journal for TLS/DNS errors. - Stale cache. The daemon caches resolved endpoints briefly. If a peer's advert changes mid-session and you hit a stale entry, restart the daemon to force a fresh query.
- Persistent identity not on. If the journal shows
Using ephemeral identity (new keypair each start), the daemon falls back to ephemeral and the consume-side may not behave as expected. Re-check persistent-identity Step 2.
What's next
-
Advertise your own node. advertise-your-node publishes your daemon's UDP endpoint on Nostr so other operators can add you to their
peers:list withvia_nostr: trueand reach you the way you just reachedtest-us01. Includes a section onudp:natNAT traversal for symmetric-NAT networks. -
Discover peers with no prior configuration. open-discovery switches your daemon to
policy: openso the ambient namespace itself populates your peer list — no staticpeers:entries required (the static ones can stay too; the two mechanisms run in parallel).
For the operator-style scenario reference covering all five shapes of Nostr discovery side-by-side (consume-only, publish-direct, publish-Tor, NAT traversal, open):
- ../how-to/enable-nostr-discovery.md — five scenarios with minimal YAML fragments.
For the design and security model:
- ../design/fips-nostr-discovery.md — discovery runtime architecture, advert format, threat model.
For the wire-format details:
- ../reference/nostr-events.md — Kind 37195 advert format, Kind 21059 traversal signaling, Kind 10050 inbox-relay list.