chore(NODE-1953): Implement new dynamic route provider

[blind-oracle]

A bit simplified version of DynamicRouteProvider from agent-rs. It takes into account both node latency & reliability to pick the best nodes, uses Weighted Round Robin to do that.

Entity roles are as follows:

• FetcherManager fetches a fresh list of API BNs using Arc<dyn FetchesNodes> (AgentFetcher is included to implement that trait) and sends this list down a channel
• RouteProviderManager gets a copy of it to share it with DynamicRouteProvider so that it knows how many total nodes there are (required for RouteProvider trait)
• HealthCheckManager also receives the same list and spawns HealthCheckActors for each node to perform healthchecks using Arc<dyn ChecksHealth> (HttpHealthChecker is included to do that using an HTTP client). Once the set of healthy nodes changes (and also periodically) it sends the healthy node list (along with latency/reliability stats) down a channel. When the list is updated it figures out which nodes are added/removed and stops & spawns the corresponding actors.
• RoutesManager receives this list, processes and builds a snapshot of URLs for the DynamicRouteProvider to use and shares it using ArcSwap
• DynamicRouteProvider implements the actual RouteProvider trait & uses WRR in the RouteSnapshot to respond to URL queries.

[zeropath-ai]

✅ No security or compliance issues detected. Reviewed everything up to 1e57956.

Security Overview

• 🔎 Scanned files: 14 changed file(s)
• 🔗 Scan Link: https://zeropath.com/app/repositories/2f4ca4b6-3e66-473c-8350-2a581fad9f23?scanId=8f8b3cc9-a3de-4880-a103-d629cbb9bf63&codeScanTypes=PrScan&tab=issues

Detected Code Changes

| Change Type | Relevant files

... (code changes summary truncated to fit VCS comment limits.)

[Copilot]

Pull request overview

This PR replaces the previous ic_bn_lib dynamic route provider integration with an in-repo dynamic route provider that discovers API boundary nodes, health-checks them, and selects routes using weighted round-robin based on latency and reliability.

Changes:

• Introduces a new dynamic routing subsystem (FetcherManager → HealthCheckManager → RoutesManager → DynamicRouteProvider) under src/routing/ic/route_provider/.
• Switches IC routing setup to use Hyper-based clients/services and updates mainnet root subnet ID handling to a Principal constant.
• Adds a local WRR implementation and tests for WRR, health checking, fetching, and route selection.

Reviewed changes

Copilot reviewed 12 out of 13 changed files in this pull request and generated 10 comments.

Show a summary per file

File	Description
src/routing/ic/routing_table_manager.rs	Updates tests to use the new MAINNET_ROOT_SUBNET_ID constant type.
src/routing/ic/route_provider/wrr.rs	Adds a weighted round-robin implementation used by the new route snapshot.
src/routing/ic/route_provider/routes.rs	Adds route snapshot building and ranking logic (latency/reliability → weights) plus tests.
src/routing/ic/route_provider/provider.rs	Adds DynamicRouteProvider and task orchestration managers implementing RouteProvider.
src/routing/ic/route_provider/mod.rs	Adds the new route provider module API and wiring via setup_route_provider.
src/routing/ic/route_provider/health.rs	Adds HTTP health checker + per-node health actors + manager producing HealthyNode snapshots.
src/routing/ic/route_provider/fetcher.rs	Adds agent-based node discovery fetcher + manager publishing refreshed node lists.
src/routing/ic/route_provider.rs	Removes the old route provider wiring (previous ic_bn_lib dynamic routing builder usage).
src/routing/ic/mod.rs	Changes MAINNET_ROOT_SUBNET_ID to a Principal constant and updates imports.
src/routing/ic/http_service.rs	Switches derive usage to derive_new::new.
src/core.rs	Rewires startup to build Hyper clients/services and pass them into the new route provider setup.
Cargo.toml	Adds thiserror dependency used by the new route provider module.
Cargo.lock	Locks thiserror version.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Pull request overview

Copilot reviewed 13 out of 14 changed files in this pull request and generated 8 comments.

[Bownairo]

A lot of these are just questions, but I think I've mostly got it 🙂. The roles in the description were really helpful to guide the review.

[Bownairo]

I just realized ic-agent still has its own DynamicRouteProvider and the rest of the stack. If that's in use elsewhere, does this one deserve a new name? Or will that one be cleared out?

[blind-oracle]

I just realized ic-agent still has its own DynamicRouteProvider and the rest of the stack. If that's in use elsewhere, does this one deserve a new name? Or will that one be cleared out?

It's gated under a very-secret _internal_dynamic-routing feature and nobody really uses it (except Caffeine I think). Probably at some point we can either remove it or replace it with this new version.

[blind-oracle]

@Bownairo Thanks for the review 👍