solana-transaction-metrics-tracker

RPC

Breaking

• --public-tpu-address and --public-tpu-forwards-address CLI arguments and setPublicTpuForwardsAddress, setPublicTpuAddress RPC methods now specify QUIC ports, not UDP.
• Blockstore PerfSamples column legacy format removed.
  • The PerfSamples column format was updated in agave v1.15 to write PerfSampleV2. The old format, PerfSampleV1, will no longer be supported for fallback reads as of v4.0.
• Blockstore transaction metadata column legacy format support removed.
  • The TransactionStatus, TransactionMemos, and AddressSignatures columns were updated in v1.18 to write a new key format. The old key format will no no longer be supported for fallback reads as of v4.0
• getSignaturesForAddress returns an error with code -32020 if the before or until signatures are not found, rather than a successful response with an empty array

Changes

• Added --enable-scheduler-bindings which binds an IPC server at <ledger-path>/scheduler_bindings.ipc for external schedulers to connect to.
• Added clientId field to each node in getClusterNodes response

Validator

Breaking

• Removed deprecated arguments
  • --accounts-db-clean-threads
  • --accounts-db-hash-threads
  • --accounts-db-read-cache-limit-mb
  • --accounts-hash-cache-path
  • --cuda
  • --disable-accounts-disk-index
  • --dev-halt-at-slot
  • --monitor (exit subcommand)
  • --transaction-struct
  • --wait-for-exit (exit subcommand)
  • --tpu-coalesce-ms
  • --tpu-disable-quic
  • --tpu-enable-udp
• --block-verification-method blockstore-processor is no longer supported. Remove the argument or switch to --block-verification-method unified-scheduler instead.
• Removed support for ingestion of transactions via UDP. QUIC is now the only option.
• All monorepo crates falling outside the backward compatibility policy are now part of the Agave Unstable API and their symbols have been made private. Enable the agave-unstable-api crate feature to acknowledge use of an interface that may break without warning.
• Linux Capability handling has been hardened wrt requirements for configuring XDP (#9133)
  • It is now an explicit error + exit(1) if the process has not been permitted a capability required by the current configuration
  • A warning is logged if the process has been permitted capabilities not required by any configuration supported by the binary
  • All permitted capabilities not required by the current configuration are now dropped at startup. This includes all validator subcommands which never require capabilities
  • Operations which require capabilities are now performed on the main thread and capabilities dropped before any other threads are spawned, with two exceptions
    1. One thread retains cap_net_admin in order to reinitialize its netlink socket upon error
    2. If any niceness flags are passed, all threads retain cap_sys_nice, which has been the case since those feature were originally added
  • Updated instructions for permitting Linux Capabilities for the validator process are as follow. Either of these two options is supported. Choose whichever best fits your operational procedures

    • Add the following to the [Service] section of you Systemd service file

      # Permit Linux Capabilities required to configure XDP
      AmbientCapabilities=CAP_NET_RAW CAP_NET_ADMIN CAP_BPF CAP_PERFMON
      
      # Disallow inheritance of any Linux Capabilities not required by any configuration
      CapabilityBoundingSet=CAP_NET_RAW CAP_NET_ADMIN CAP_BPF CAP_PERFMON
      

    -- OR --

    • set xattr capabilities directly on the binary file. note that this step must be repeated every time that the binary file is replaced

      sudo setcap cap_net_raw,cap_net_admin,cap_bpf,cap_perfmon=p /path/to/agave-validator
      

• Interpretation of the Version struct fields in gossip ContactInfo has been changed to support communicating semver prerelease notation. Implementations lacking this support will observe a larger than expected min version field from node publishing from a prerelease version. The new interpretation is as follows:
  • The top two bits (14 and 15) of the minor field are now reserved for prerelease status
  • Prerelease status bit values are; 3 - alpha, 2 - beta, 1 - release candidate (rc), 0 - stable
  • When prerelease status bits are non-zero, the Version::patch field is interpreted as the prerelease number and the actual patch value is implicitly zero
  • Examples:
    • { min: 0x0001, patch: 0x0003 } -> X.1.3
    • { min: 0x4002, patch: 0x0002 } -> X.2.0-rc.2
    • { min: 0x8003, patch: 0x0001 } -> X.3.0-beta.1
    • { min: 0xC004, patch: 0x0000 } -> X.4.0-alpha.0
• Blockstore SlotMeta and Index columns legacy format removed.
  • The Index column was updated in v2.2 to write IndexV2.
  • The SlotMeta column format was updated in v3.1 to write SlotMetaV2.
  • The old formats, SlotMetaV1 and IndexV1, will no longer be supported for fallback reads as of v4.0

Deprecations

• Using mmap for --accounts-db-access-storages-method is now deprecated.
• The --enable-accounts-disk-index flag is now deprecated. Use --accounts-index-limit instead. To retain the same behavior, use --accounts-index-limit minimal.

Changes

• agave-validator exit now saves bank state before exiting. This enables restarts from local state when snapshot generation is disabled.
• Added --accounts-index-limit to specify the memory limit of the accounts index.
• Snapshot archive unpacking now uses direct I/O by default to improve performance by bypassing the OS page cache. Use --no-accounts-db-snapshots-direct-io to opt out if your file system does not support O_DIRECT. Direct I/O will be extended to snapshot creation in a future release.
• --block-production-method central-scheduler is now deprecated and will be removed in a future release. Use central-scheduler-greedy instead.

CLI

Breaking

• Removed deprecated arguments
  • --use-quic
  • --use-udp

Deprecations

• The ping command is deprecated and will be removed in v4.1.

Changes

• Support Trezor hardware wallets using usb://trezor

Platform tools

Breaking

• cargo-build-sbf --debug now generates a file program.so.debug instead of program.debug.
• cargo-build-sbf --debug places all debug related objects inside target/deploy/debug.

Geyser

Changes

• Account update notifications have their fields populated from the account values post transaction execution. This means notifications for closed accounts (accounts with a balance of zero lamports) will no longer have their owner/data/etc manually zeroed out. Note that if the on-chain program does zero out any fields itself, those will remain zeroed out in the notification.

Test Validator

Changes

• Now shows TPU QUIC address instead of TPU UDP in the dashboard.

RPC

Breaking

• Added a slot property to EpochRewardsPeriodActiveErrorData
• Added error data containing a slot property to RpcCustomError::SlotNotEpochBoundary

Changes

• The subscription server now prioritizes processing received messages before sending out responses. This ensures that new subscription requests and time-sensitive messages like PING opcodes take priority over notifications.

Validator

Breaking

• When XDP is enabled, the validator process requires the CAP_NET_RAW, CAP_NET_ADMIN, CAP_BPF, and CAP_PERFMON capabilities. These can be configured in the systemd service file by setting CapabilityBoundingSet=CAP_NET_RAW CAP_NET_ADMIN CAP_BPF CAP_PERFMON under the [Service] section or directly on the binary with the command sudo setcap cap_net_raw,cap_net_admin,cap_bpf,cap_perfmon=p <path/to/agave-validator> (this command must be run each time the binary is replaced)
• Enabling XDP zero copy on systems configured with LACP bond requires manually passing --experimental-retransmit-xdp-interface <real-interface> (e.g.: eno17395np0 not bond0), as zero copy is only available on physical interfaces.
• Require increased memlock limits - recommended setting is LimitMEMLOCK=2000000000 in systemd service configuration. Lack of sufficient limit (on Linux) will cause startup error.
• Remove deprecated arguments
  • --accounts-index-memory-limit-mb
  • --accountsdb-repl-bind-address, --accountsdb-repl-port, --accountsdb-repl-threads, --enable-accountsdb-repl
  • --disable-quic-servers, --enable-quic-servers
  • --etcd-cacert-file, --etcd-cert-file, --etcd-domain-name, --etcd-endpoint, --etcd-key-file, --tower-storage
  • --no-check-vote-account
  • --no-rocksdb-compaction, --rocksdb-compaction-interval-slots, --rocksdb-max-compaction-jitter-slots
  • --replay-slots-concurrently
    • Use --replay-forks-threads with a value of 4 to match preexisting behavior
  • --rpc-pubsub-max-connections, --rpc-pubsub-max-fragment-size, --rpc-pubsub-max-in-buffer-capacity, --rpc-pubsub-max-out-buffer-capacity, --enable-cpi-and-log-storage, --minimal-rpc-api
  • --skip-poh-verify
• Deprecated snapshot archive formats have been removed and are no longer loadable.
• Using --snapshot-interval-slots 0 to disable generating snapshots has been removed. Use --no-snapshots instead.
• Validator will now bind all ports within provided --dynamic-port-range, including the client ports. A range of at least 25 ports is recommended to avoid failures to bind during startup.
• Agave and agave-ledger-tool can no longer operate with legacy shreds. Legacy shreds have not been in circulation since the activation of https://explorer.solana.com/address/GV49KKQdBNaiv2pgqhS2Dy3GWYJGXMTVYbYkdk91orRy. This change may break operations with old ledgers that may still contain legacy shreds.

Changes

• --transaction-structure view is now the default.
• The default full snapshot interval is now 100,000 slots.
• SOLANA_BANKING_THREADS environment variable is no longer supported. Use --block-prouduction-num-workers instead.
• By default, agave-validator exit will now wait for the validator process to terminate before returning. The --wait-for-exit flag has been deprecated, but operators can still opt out with the new --no-wait-for-exit flag.