void/ZeroTierOne
2
0
Fork 0
mirror of https://github.com/zerotier/ZeroTierOne.git synced 2025-08-02 23:12:51 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

Add network ID to upstream lookup, cleanup, release notes for 1.16.

Browse source
This commit is contained in:
Adam Ierymenko 2025-07-15 13:54:10 -04:00
parent 697011df7b
commit 58c80ff0ab
No known key found for this signature in database
GPG key ID: C8877CF2D7A5D7F3
10 changed files with 136 additions and 253 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

226
RELEASE-NOTES.md
View file

@ -1,14 +1,35 @@
ZeroTier Release Notes ZeroTier Release Notes
====== ======
# 2024-10-23 -- Version 1.14.2 ## 2025-07-XX -- Version 1.16.0
* Network-Specific Relays
* It is now possible to designate one or more nodes as network-specific relays to be used in preference to roots for relayed traffic between members of a network. These nodes need not necessarily be members of the network.
* "Moons" are now removed in favor of network-specific relays. They have been considered deprecated and not recommended for over a year.
* License Changes
* The core (`node/` and `include/`) and the service (`service/` and `osdep/`) are now under the Mozilla Public License (MPL).
* The network controller (`controller/`) remains under the BUSL with a commercial use restriction and *is not built into the service by default*. Building this into the service changes the license -- `zerotier-one` built with the controller is BUSL licensed, not MPL, but without the controller it is MPL (an OSI compatible license).
* HELLO packets are now encrypted by default -- they do not contain any secret data, just version and public keys, but in some cases them being sent in plaintext violated reqirements.
* Small Fixes
* Code has been reformatted using `clang-format` with a `.clang-format` definition in the repo. Typing `make clang-format` executes this against all main core and service C++ files.
* Bridges are no longer counted toward multicast limits.
* A flow designation issue in bridged traffic under multipath scenarios has been fixed.
* Library version updates for OIDC and other features.
* Repository cleanup.
* Other minor bug fixes.
----
# 1.14
## 2024-10-23 -- Version 1.14.2
* Fix for missing entitlement on macOS Sequoia. * Fix for missing entitlement on macOS Sequoia.
* Fix for a problem correctly parsing local.conf to enable low bandwidth mode. * Fix for a problem correctly parsing local.conf to enable low bandwidth mode.
* Increment versions of some dependent libraries. * Increment versions of some dependent libraries.
* Other fixes. * Other fixes.
# 2024-09-12 -- Version 1.14.1 ## 2024-09-12 -- Version 1.14.1
* Multithreaded packet I/O support! Currently this is just for Linux and must * Multithreaded packet I/O support! Currently this is just for Linux and must
be enabled in local.conf. It will likely make the largest difference on small be enabled in local.conf. It will likely make the largest difference on small
@ -24,7 +45,7 @@ ZeroTier Release Notes
to network controllers when networks are joined so it can be displayed to to network controllers when networks are joined so it can be displayed to
network admins and in the future used in policy checking and inventory operations. network admins and in the future used in policy checking and inventory operations.
# 2024-05-02 -- Version 1.14.0 ## 2024-05-02 -- Version 1.14.0
* Linux I/O performance improvements under heavy load * Linux I/O performance improvements under heavy load
* Improvements to multipath * Improvements to multipath
@ -33,18 +54,22 @@ ZeroTier Release Notes
* Controller API enhancements: node names and other node meta-data * Controller API enhancements: node names and other node meta-data
* Other bug fixes * Other bug fixes
# 2023-09-12 -- Version 1.12.2 ----
# 1.12 and Older
## 2023-09-12 -- Version 1.12.2
* More improvements to macOS full tunnel mode. * More improvements to macOS full tunnel mode.
* Faster recovery after changes to physical network settings. * Faster recovery after changes to physical network settings.
# 2023-08-25 -- Version 1.12.1 ## 2023-08-25 -- Version 1.12.1
* Minor release to fix a port binding issue in Linux. * Minor release to fix a port binding issue in Linux.
* Update Debian dependencies. * Update Debian dependencies.
* No changes for other platforms. * No changes for other platforms.
# 2023-08-23 -- Version 1.12.0 ## 2023-08-23 -- Version 1.12.0
* Experimental Windows ARM64 support * Experimental Windows ARM64 support
* Fix numerous sleep/wake issues on macOS and other platforms * Fix numerous sleep/wake issues on macOS and other platforms
@ -54,17 +79,17 @@ ZeroTier Release Notes
* Numerous macOS DNS fixes * Numerous macOS DNS fixes
* 10-30% speed improvement on Linux * 10-30% speed improvement on Linux
# 2023-03-23 -- Version 1.10.6 ## 2023-03-23 -- Version 1.10.6
* Prevent binding temporary ipv6 addresses on macos (#1910) * Prevent binding temporary ipv6 addresses on macos (#1910)
* Prevent path-learning loops (#1914) * Prevent path-learning loops (#1914)
* Prevent infinite loop of UAC prompts in tray app * Prevent infinite loop of UAC prompts in tray app
# 2023-03-10 -- Version 1.10.5 ## 2023-03-10 -- Version 1.10.5
* Fix for high CPU usage bug on Windows * Fix for high CPU usage bug on Windows
# 2023-03-07 -- Version 1.10.4 ## 2023-03-07 -- Version 1.10.4
* SECURITY FIX (Windows): this version fixes a file permission problem on * SECURITY FIX (Windows): this version fixes a file permission problem on
Windows that could allow non-privileged users on a Windows system to read Windows that could allow non-privileged users on a Windows system to read
@ -73,11 +98,10 @@ ZeroTier Release Notes
instance without appropriate local permissions. This issue is not remotely instance without appropriate local permissions. This issue is not remotely
exploitable unless a remote user can read arbitrary local files, and does exploitable unless a remote user can read arbitrary local files, and does
not impact other operating systems. not impact other operating systems.
* Fix a bug in the handling of multiple IP address assignments to virtual * Fix a bug in the handling of multiple IP address assignments to virtual
interfaces on macOS. interfaces on macOS.
# 2023-02-15 -- Version 1.10.3 ## 2023-02-15 -- Version 1.10.3
* Fix for duplicate paths in client. Could cause connectivity issues. Affects all platforms. * Fix for duplicate paths in client. Could cause connectivity issues. Affects all platforms.
* Fix for Ethernet Tap MTU setting, would not properly apply on Linux. * Fix for Ethernet Tap MTU setting, would not properly apply on Linux.
@ -89,7 +113,7 @@ ZeroTier Release Notes
* Fix bug that prevented setting of custom TCP relay address. * Fix bug that prevented setting of custom TCP relay address.
* Build script improvements and bug fixes. * Build script improvements and bug fixes.
# 2022-11-01 -- Version 1.10.2 ## 2022-11-01 -- Version 1.10.2
* Fix another SSO "stuck client" issue in zeroidc. * Fix another SSO "stuck client" issue in zeroidc.
* Expose root-reported external IP/port information via the local JSON API for better diagnostics. * Expose root-reported external IP/port information via the local JSON API for better diagnostics.
@ -100,12 +124,12 @@ ZeroTier Release Notes
Note that releases are coming few and far between because most of our dev effort is going into version 2. Note that releases are coming few and far between because most of our dev effort is going into version 2.
# 2022-06-27 -- Version 1.10.1 ## 2022-06-27 -- Version 1.10.1
* Fix an issue that could cause SSO clients to get "stuck" on stale auth URLs. * Fix an issue that could cause SSO clients to get "stuck" on stale auth URLs.
* A few other SSO related bug fixes. * A few other SSO related bug fixes.
# 2022-06-07 -- Version 1.10.0 ## 2022-06-07 -- Version 1.10.0
* Fix formatting problem in `zerotier-cli` when using SSO networks. * Fix formatting problem in `zerotier-cli` when using SSO networks.
* Fix a few other minor bugs in SSO signin to prepare for general availability. * Fix a few other minor bugs in SSO signin to prepare for general availability.
@ -114,11 +138,11 @@ Note that releases are coming few and far between because most of our dev effort
* Use system default browser for SSO login so all your plugins, MFA devices, password managers, etc. will work as you have them configured. * Use system default browser for SSO login so all your plugins, MFA devices, password managers, etc. will work as you have them configured.
* Minor fix for bonding/multipath. * Minor fix for bonding/multipath.
# 2022-05-10 -- Version 1.8.10 ## 2022-05-10 -- Version 1.8.10
* Fixed a bug preventing SSO sign-on on Windows. * Fixed a bug preventing SSO sign-on on Windows.
# 2022-04-25 -- Version 1.8.9 ## 2022-04-25 -- Version 1.8.9
* Fixed a long-standing and strange bug that was causing sporadic "phantom" packet authentication failures. Not a security problem but could be behind sporadic reports of link failures under some conditions. * Fixed a long-standing and strange bug that was causing sporadic "phantom" packet authentication failures. Not a security problem but could be behind sporadic reports of link failures under some conditions.
* Fixed a memory leak in SSO/OIDC support. * Fixed a memory leak in SSO/OIDC support.
@ -127,26 +151,26 @@ Note that releases are coming few and far between because most of our dev effort
* Fixed a deadlock bug on leaving SSO/OIDC managed networks. * Fixed a deadlock bug on leaving SSO/OIDC managed networks.
* Added some new Linux distributions to the build subsystem. * Added some new Linux distributions to the build subsystem.
# 2022-04-11 -- Version 1.8.8 ## 2022-04-11 -- Version 1.8.8
* Fix a local privilege escalation bug in the Windows installer. * Fix a local privilege escalation bug in the Windows installer.
* Dependency fix for some Ubuntu versions. * Dependency fix for some Ubuntu versions.
* No changes for other platforms. Windows upgrade recommended, everyone else optional. * No changes for other platforms. Windows upgrade recommended, everyone else optional.
# 2022-03-30 -- Version 1.8.7 ## 2022-03-30 -- Version 1.8.7
* Fix for dependency installations in Windows MSI package. * Fix for dependency installations in Windows MSI package.
* Fix for desktop UI setup when run by a non-super-user. * Fix for desktop UI setup when run by a non-super-user.
* Bug fix in local OIDC / SSO support for auth0 and other providers. * Bug fix in local OIDC / SSO support for auth0 and other providers.
* Other minor fixes for e.g. old Linux distributions. * Other minor fixes for e.g. old Linux distributions.
# 2022-03-04 -- Version 1.8.6 ## 2022-03-04 -- Version 1.8.6
* Fixed an issue that could cause the UI to be non-responsive if not joined to any networks. * Fixed an issue that could cause the UI to be non-responsive if not joined to any networks.
* Fix dependency issues in Debian and RedHat packages for some distributions (Fedora, Mint). * Fix dependency issues in Debian and RedHat packages for some distributions (Fedora, Mint).
* Bumped the peer cache serialization version to prevent "coma" issues on upgrade due to changes in path logic behaving badly with old values. * Bumped the peer cache serialization version to prevent "coma" issues on upgrade due to changes in path logic behaving badly with old values.
# 2022-02-22 -- Version 1.8.5 ## 2022-02-22 -- Version 1.8.5
* Plumbing under the hood for endpoint device SSO support. * Plumbing under the hood for endpoint device SSO support.
* Fix in LinuxEthernetTap to tap device support on very old (2.6) Linux kernels. * Fix in LinuxEthernetTap to tap device support on very old (2.6) Linux kernels.
@ -154,7 +178,7 @@ Note that releases are coming few and far between because most of our dev effort
* Merge a series of changes by Joseph Henry (of ZeroTier) that should fix some edge cases where ZeroTier would "forget" valid paths. * Merge a series of changes by Joseph Henry (of ZeroTier) that should fix some edge cases where ZeroTier would "forget" valid paths.
* Minor multipath improvements for automatic path negotiation. * Minor multipath improvements for automatic path negotiation.
# 2021-11-30 -- Version 1.8.4 ## 2021-11-30 -- Version 1.8.4
* Fixed an ugly font problem on some older macOS versions. * Fixed an ugly font problem on some older macOS versions.
* Fixed a bug that could cause the desktop tray app control panel to stop opening after a while on Windows. * Fixed a bug that could cause the desktop tray app control panel to stop opening after a while on Windows.
@ -162,7 +186,7 @@ Note that releases are coming few and far between because most of our dev effort
* Fixed installation on 32-bit Windows 10. * Fixed installation on 32-bit Windows 10.
* Fixed a build flags issue that could cause ZeroTier to crash on older ARM32 CPUs. * Fixed a build flags issue that could cause ZeroTier to crash on older ARM32 CPUs.
# 2021-11-15 -- Version 1.8.3 ## 2021-11-15 -- Version 1.8.3
* Remove problematic spinlock, which was only used on x86_64 anyway. Just use pthread always. * Remove problematic spinlock, which was only used on x86_64 anyway. Just use pthread always.
* Fix fd leak on MacOS that caused non-responsiveness after some time. * Fix fd leak on MacOS that caused non-responsiveness after some time.
@ -170,14 +194,14 @@ Note that releases are coming few and far between because most of our dev effort
* Fix regression that could prevent managed routes from being deleted. * Fix regression that could prevent managed routes from being deleted.
* DesktopUI: Remove NSDate:now() call, now works on MacOS 10.13 or newer! * DesktopUI: Remove NSDate:now() call, now works on MacOS 10.13 or newer!
# 2021-11-08 -- Version 1.8.2 ## 2021-11-08 -- Version 1.8.2
* Fix multicast on linux. * Fix multicast on linux.
* Fix a bug that could cause the tap adapter to have the wrong MAC on Linux. * Fix a bug that could cause the tap adapter to have the wrong MAC on Linux.
* Update build flags to possibly support MacOS older than 10.14, but more work needs to be done. It may not work yet. * Update build flags to possibly support MacOS older than 10.14, but more work needs to be done. It may not work yet.
* Fix path variable setting on Windows. * Fix path variable setting on Windows.
# 2021-10-28 -- Version 1.8.1 ## 2021-10-28 -- Version 1.8.1
* Fix numerous UI issues from 1.8.0 (never fully released). * Fix numerous UI issues from 1.8.0 (never fully released).
* Remove support for REALLY ancient 1.1.6 or earlier network controllers. * Remove support for REALLY ancient 1.1.6 or earlier network controllers.
@ -187,7 +211,7 @@ Note that releases are coming few and far between because most of our dev effort
* NOTE: Windows 7 is no longer supported! Windows 7 users will have to use version 1.6.5 or earlier. * NOTE: Windows 7 is no longer supported! Windows 7 users will have to use version 1.6.5 or earlier.
# 2021-09-15 -- Version 1.8.0 (preview release only) ## 2021-09-15 -- Version 1.8.0 (preview release only)
* A *completely* rewritten desktop UI for Mac and Windows! * A *completely* rewritten desktop UI for Mac and Windows!
* Implement a workaround for one potential source of a "coma" bug, which can occur if buggy NATs/routers stop allowing the service to communicate on a given port. ZeroTier now reassigns a new secondary port if it's offline for a while unless a secondary port is manually specified in local.conf. Working around crummy buggy routers is an ongoing effort. * Implement a workaround for one potential source of a "coma" bug, which can occur if buggy NATs/routers stop allowing the service to communicate on a given port. ZeroTier now reassigns a new secondary port if it's offline for a while unless a secondary port is manually specified in local.conf. Working around crummy buggy routers is an ongoing effort.
@ -198,32 +222,32 @@ Note that releases are coming few and far between because most of our dev effort
* Check if DNS servers need to be applied on macOS * Check if DNS servers need to be applied on macOS
* Upgrade json.hpp dependency to version 3.10.2 * Upgrade json.hpp dependency to version 3.10.2
# 2021-09-21 -- Version 1.6.6 ## 2021-09-21 -- Version 1.6.6
* Backport COM hash check mitigation against network member impersonation. * Backport COM hash check mitigation against network member impersonation.
# 2021-04-13 -- Version 1.6.5 ## 2021-04-13 -- Version 1.6.5
* Fix a bug in potential network path filtering that could in some circumstances lead to "software laser" effects. * Fix a bug in potential network path filtering that could in some circumstances lead to "software laser" effects.
* Fix a printf overflow in zerotier-cli (not exploitable or a security risk) * Fix a printf overflow in zerotier-cli (not exploitable or a security risk)
* Windows now looks up the name of ZeroTier devices instead of relying on them having "ZeroTier" in them. * Windows now looks up the name of ZeroTier devices instead of relying on them having "ZeroTier" in them.
# 2021-02-15 -- Version 1.6.4 ## 2021-02-15 -- Version 1.6.4
* The groundhog saw his shadow, which meant that the "connection coma" bug still wasn't gone. We think we found it this time. * The groundhog saw his shadow, which meant that the "connection coma" bug still wasn't gone. We think we found it this time.
# 2021-02-02 -- Version 1.6.3 ## 2021-02-02 -- Version 1.6.3
* Likely fix for GitHub issue #1334, an issue that could cause ZeroTier to * Likely fix for GitHub issue #1334, an issue that could cause ZeroTier to
go into a "coma" on some networks. go into a "coma" on some networks.
* Also groundhog day * Also groundhog day
# 2020-11-30 -- Version 1.6.2 ## 2020-11-30 -- Version 1.6.2
* Fix an ARM hardware AES crypto issue (not an exploitable vulnerability). * Fix an ARM hardware AES crypto issue (not an exploitable vulnerability).
* Fix a Linux network leave hang due to a mutex deadlock. * Fix a Linux network leave hang due to a mutex deadlock.
# 2020-11-24 -- Version 1.6.1 ## 2020-11-24 -- Version 1.6.1
This release fixes some minor bugs and other issues in 1.6.0. This release fixes some minor bugs and other issues in 1.6.0.
@ -233,7 +257,7 @@ This release fixes some minor bugs and other issues in 1.6.0.
* Merged CLI options for controlling bonded devices into the beta multipath code. * Merged CLI options for controlling bonded devices into the beta multipath code.
* Updated Windows driver with Microsoft cross-signing to fix issues on some Windows systems. * Updated Windows driver with Microsoft cross-signing to fix issues on some Windows systems.
# 2020-11-19 -- Version 1.6.0 ## 2020-11-19 -- Version 1.6.0
Version 1.6.0 is a major release that incorporates back-ported features from the 2.0 branch, which is still under development. It also fixes a number of issues. Version 1.6.0 is a major release that incorporates back-ported features from the 2.0 branch, which is still under development. It also fixes a number of issues.
@ -274,7 +298,7 @@ Known issues that are not yet fixed in this beta:
We're trying to fix all these issues before the 1.6.0 release. Stay tuned. We're trying to fix all these issues before the 1.6.0 release. Stay tuned.
# 2019-08-30 -- Version 1.4.6 ## 2019-08-30 -- Version 1.4.6
* Update default root list to latest * Update default root list to latest
* ARM32 platform build and flag fixes * ARM32 platform build and flag fixes
@ -283,19 +307,19 @@ We're trying to fix all these issues before the 1.6.0 release. Stay tuned.
* Windows service now looks for service command line arguments * Windows service now looks for service command line arguments
* Fixed a bug that could cause excessive queued multicasts * Fixed a bug that could cause excessive queued multicasts
# 2019-08-23 -- Version 1.4.4 ## 2019-08-23 -- Version 1.4.4
* Change license from GPL3 to BSL 1.1, see LICENSE.txt * Change license from GPL3 to BSL 1.1, see LICENSE.txt
* Fix an issue with the "ipauth" rule and auto-generated unforgeable IPv6 addresses * Fix an issue with the "ipauth" rule and auto-generated unforgeable IPv6 addresses
* Fix socket/bind errors setting IPs and routes on Linux * Fix socket/bind errors setting IPs and routes on Linux
# 2019-08-12 -- Version 1.4.2 ## 2019-08-12 -- Version 1.4.2
* Fix high CPU use bug on some platforms * Fix high CPU use bug on some platforms
* Fix issues with PostgreSQL controller DB (only affects Central) * Fix issues with PostgreSQL controller DB (only affects Central)
* Restore backward compatibility with MacOS versions prior to 10.13 * Restore backward compatibility with MacOS versions prior to 10.13
# 2019-07-29 -- Version 1.4.0 ## 2019-07-29 -- Version 1.4.0
### Major Changes ### Major Changes
@ -313,20 +337,20 @@ We're trying to fix all these issues before the 1.6.0 release. Stay tuned.
* Fixed numerous other small issues and bugs such as ARM alignment issues causing crashes on some devices. * Fixed numerous other small issues and bugs such as ARM alignment issues causing crashes on some devices.
* Windows now sets the adapter name such that it is consistent in both the Windows UI and command line utilities. * Windows now sets the adapter name such that it is consistent in both the Windows UI and command line utilities.
# 2018-07-27 -- Version 1.2.12 ## 2018-07-27 -- Version 1.2.12
* Fixed a bug that caused exits to take a long time on Mac due to huge numbers of redundant attempts to delete managed routes. * Fixed a bug that caused exits to take a long time on Mac due to huge numbers of redundant attempts to delete managed routes.
* Fixed a socket limit problem on Windows that caused the ZeroTier service to run out of sockets, causing the UI and CLI to be unable to access the API. * Fixed a socket limit problem on Windows that caused the ZeroTier service to run out of sockets, causing the UI and CLI to be unable to access the API.
* Fixed a threading bug in the ZeroTier Core, albeit one that never manifested on the regular ZeroTier One service/client. * Fixed a threading bug in the ZeroTier Core, albeit one that never manifested on the regular ZeroTier One service/client.
* Fixed a bug that could cause the service to crash if an authorized local client accessed an invalid URL via the control API. (Not exploitable since you needed admin access anyway.) * Fixed a bug that could cause the service to crash if an authorized local client accessed an invalid URL via the control API. (Not exploitable since you needed admin access anyway.)
# 2018-05-08 -- Version 1.2.10 ## 2018-05-08 -- Version 1.2.10
* Fix bug loading `moons.d/` files for federated root operation. * Fix bug loading `moons.d/` files for federated root operation.
* Fix compile problem with ZT_DEBUG on some versions of `clang` * Fix compile problem with ZT_DEBUG on some versions of `clang`
* Fix slow network startup bug related to loading of `networks.d/` cache files * Fix slow network startup bug related to loading of `networks.d/` cache files
# 2018-04-27 -- Version 1.2.8 ## 2018-04-27 -- Version 1.2.8
* Linux version once again builds with PIE (position independent executable) flags * Linux version once again builds with PIE (position independent executable) flags
* Fixed bug in zerotier-idtool file sign and verify * Fixed bug in zerotier-idtool file sign and verify
@ -334,7 +358,7 @@ We're trying to fix all these issues before the 1.6.0 release. Stay tuned.
* Merged alpha NetBSD support (mostly untested, so YMMV) * Merged alpha NetBSD support (mostly untested, so YMMV)
* Merged several minor typo and one-liner bug fixes * Merged several minor typo and one-liner bug fixes
# 2018-04-17 -- Version 1.2.6 ## 2018-04-17 -- Version 1.2.6
* Features and Core Improvements * Features and Core Improvements
* Path selection has been overhauled to improve path stability, simplify code, and prepare for multi-path and trunking in the next major release. * Path selection has been overhauled to improve path stability, simplify code, and prepare for multi-path and trunking in the next major release.
@ -369,7 +393,7 @@ We're trying to fix all these issues before the 1.6.0 release. Stay tuned.
* Multicast now works on Android in most cases! Android apps can send and receive multicast and subscribe to multicast group IPs. Note that in some cases the app must bind to the specific correct interface for this to work. * Multicast now works on Android in most cases! Android apps can send and receive multicast and subscribe to multicast group IPs. Note that in some cases the app must bind to the specific correct interface for this to work.
* IPv6 can be disabled in UI for cases where it causes problems. * IPv6 can be disabled in UI for cases where it causes problems.
# 2017-04-20 -- Version 1.2.4 ## 2017-04-20 -- Version 1.2.4
* Managed routes are now only bifurcated for the default route. This is a change in behavior, though few people will probably notice. Bifurcating all managed routes was causing more trouble than it was worth for most users. * Managed routes are now only bifurcated for the default route. This is a change in behavior, though few people will probably notice. Bifurcating all managed routes was causing more trouble than it was worth for most users.
* Up to 2X crypto speedup on x86-64 (except Windows, which will take some porting) and 32-bit ARM platforms due to integration of fast assembly language implementations of Salsa20/12 from the [supercop](http://bench.cr.yp.to/supercop.html) code base. These were written by Daniel J. Bernstein and are in the public domain. My MacBook Pro (Core i5 2.8ghz) now does almost 1.5GiB/sec Salsa20/12 per core and a Raspberry Pi got a 2X boost. 64-bit ARM support and Windows support will take some work but should not be too hard. * Up to 2X crypto speedup on x86-64 (except Windows, which will take some porting) and 32-bit ARM platforms due to integration of fast assembly language implementations of Salsa20/12 from the [supercop](http://bench.cr.yp.to/supercop.html) code base. These were written by Daniel J. Bernstein and are in the public domain. My MacBook Pro (Core i5 2.8ghz) now does almost 1.5GiB/sec Salsa20/12 per core and a Raspberry Pi got a 2X boost. 64-bit ARM support and Windows support will take some work but should not be too hard.
@ -379,128 +403,12 @@ We're trying to fix all these issues before the 1.6.0 release. Stay tuned.
* Fixed an issue causing build problems on some MIPS architecture systems. * Fixed an issue causing build problems on some MIPS architecture systems.
* Fixed Windows forgetting routes on sleep/wake or in some other circumstances. (GitHub issue #465) * Fixed Windows forgetting routes on sleep/wake or in some other circumstances. (GitHub issue #465)
# 2017-03-17 -- Version 1.2.2 ## 2017-03-17 -- Version 1.2.2
* A bug causing unreliable multicast propagation (GitHub issue #461). * A bug causing unreliable multicast propagation (GitHub issue #461).
* A crash in ARM binaries due to a build chain and flags problem. * A crash in ARM binaries due to a build chain and flags problem.
* A bug in the network controller preventing members from being listed (GitHub issue #460). * A bug in the network controller preventing members from being listed (GitHub issue #460).
# 2017-03-14 -- Version 1.2.0 ## 2017-03-14 -- Version 1.2.0
Version 1.2.0 is a major milestone release representing almost nine months of work. It includes our rules engine for distributed network packet filtering and security monitoring, federated roots, and many other architectural and UI improvements and bug fixes. Version 1.2.0 is a major milestone release representing almost nine months of work. It includes our rules engine for distributed network packet filtering and security monitoring, federated roots, and many other architectural and UI improvements and bug fixes.
## New Features in 1.2.0
### The ZeroTier Rules Engine
The largest new feature in 1.2.0, and the product of many months of work, is our advanced network rules engine. With this release we achieve traffic control, security monitoring, and micro-segmentation capability on par with many enterprise SDN solutions designed for use in advanced data centers and corporate networks.
Rules allow you to filter packets on your network and vector traffic to security observers. Security observation can be performed in-band using REDIRECT or out of band using TEE.
Tags and capabilities provide advanced methods for implementing fine grained permission structures and micro-segmentation schemes without bloating the size and complexity of your rules table.
See the [rules engine announcement blog post](https://www.zerotier.com/blog/?p=927) for an in-depth discussion of theory and implementation. The [manual](https://www.zerotier.com/manual.shtml) contains detailed information on rule, tag, and capability use, and the `rule-compiler/` subfolder of the ZeroTier source tree contains a JavaScript function to compile rules in our human-readable rule definition language into rules suitable for import into a network controller. (ZeroTier Central uses this same script to compile rules on [my.zerotier.com](https://my.zerotier.com/).)
### Root Server Federation
It's now possible to create your own root servers and add them to the root server pool on your nodes. This is done by creating what's called a "moon," which is a signed enumeration of root servers and their stable points on the network. Refer to the [manual](https://www.zerotier.com/manual.shtml) for instructions.
Federated roots achieve a number of things:
* You can deploy your own infrastructure to reduce dependency on ours.
* You can deploy roots *inside your LAN* to ensure that network connectivity inside your facility still works if the Internet goes down. This is the first step toward making ZeroTier viable as an in-house SDN solution.
* Roots can be deployed inside national boundaries for countries with data residency laws or "great firewalls." (As of 1.2.0 there is still no way to force all traffic to use these roots, but that will be easy to do in a later version.)
* Last but not least this makes ZeroTier somewhat less centralized by eliminating any hard dependency on ZeroTier, Inc.'s infrastructure.
Our roots will of course remain and continue to provide zero-configuration instant-on deployment, a secure global authority for identities, and free traffic relaying for those who can't establish peer to peer connections.
### Local Configuration
An element of our design philosophy is "features are bugs." This isn't an absolute dogma but more of a guiding principle. We try as hard as we can to avoid adding features, especially "knobs" that must be tweaked by a user.
As of 1.2.0 we've decided that certain knobs are unavoidable, and so there is now a `local.conf` file that can be used to configure them. See the ZeroTier One documentation for these. They include:
* Blacklisting interfaces you want to make sure ZeroTier doesn't use for network traffic, such as VPNs, slow links, or backplanes designated for only certain kinds of traffic.
* Turning uPnP/NAT-PMP on or off.
* Configuring software updates on Windows and Mac platforms.
* Defining trusted paths (the old trusted paths file is now deprecated)
* Setting the ZeroTier main port so it doesn't have to be changed on the command line, which is very inconvenient in many cases.
### Improved In-Band Software Updates
A good software update system for Windows and Mac clients has been a missing feature in previous versions. It does exist but we've been shy about using it so far due to its fragility in some environments.
We've greatly improved this mechanism in 1.2.0. Not only does it now do a better job of actually invoking the update, but it also transfers updates in-band using the ZeroTier protocol. This means it can work in environments that do not allows http/https traffic or that force it through proxies. There's also now an update channel setting: `beta` or `release` (the default).
Software updates are authenticated three ways:
1. ZeroTier's own signing key is used to sign all updates and this signature is checked prior to installation. ZeroTier, Inc.'s signatures are performed on an air-gapped machine.
2. Updates for Mac and Windows are signed using Apple and Microsoft (DigiCert EV) keys and will not install unless these signatures are also valid.
3. The new in-band update mechanism also authenticates the source of the update via ZeroTier's built-in security features. This provides transport security, while 1 and 2 provide security of the update at rest.
Updates are now configurable via `local.conf`. There are three options: `disable`, `download`, and `apply`. The third (apply) is the default for official builds on Windows and Mac, making updates happen silently and automatically as they do for popular browsers like Chrome and Firefox. Updates are disabled by default on Linux and other Unix-type systems as these are typically updated through package managers.
### Path Link Quality Awareness
Version 1.2.0 is now aware of the link quality of direct paths with other 1.2.0 nodes. This information isn't used yet but is visible through the JSON API. (Quality always shows as 100% with pre-1.2.0 nodes.) Quality is measured passively with no additional overhead using a counter based packet loss detection algorithm.
This information is visible from the command line via `listpeers`:
200 listpeers XXXXXXXXXX 199.XXX.XXX.XXX/9993;10574;15250;1.00 48 1.2.0 LEAF
200 listpeers XXXXXXXXXX 195.XXX.XXX.XXX/45584;467;7608;0.44 290 1.2.0 LEAF
The first peer's path is at 100% (1.00), while the second peer's path is suffering quite a bit of packet loss (0.44).
Link quality awareness is a precursor to intelligent multi-path and QoS support, which will in future versions bring us to feature parity with SD-WAN products like Cisco iWAN.
### Security Improvements
Version 1.2.0 adds anti-DOS (denial of service) rate limits and other hardening for improved resiliency against a number of denial of service attack scenarios.
It also adds a mechanism for instantaneous credential revocation. This can be used to revoke certificates of membership instantly to kick a node off a network (for private networks) and also to revoke capabilities and tags. The new controller sends revocations by default when a peer is de-authorized.
Revocations propagate using a "rumor mill" peer to peer algorithm. This means that a controller need only successfully send a revocation to at least one member of a network with connections to other active members. At this point the revocation will flood through the network peer to peer very quickly. This helps make revocations more robust in the face of poor connectivity with the controller or attempts to incapacitate the controller with denial of service attacks, as well as making revocations faster on huge networks.
### Windows and Macintosh UI Improvements (ZeroTier One)
The Mac has a whole new UI built natively in Objective-C. It provides a pulldown similar in appearance and operation to the Mac WiFi task bar menu.
The Windows UI has also been improved and now provides a task bar icon that can be right-clicked to manage networks. Both now expose managed route and IP permissions, allowing nodes to easily opt in to full tunnel operation if you have a router configured on your network.
### Ad-Hoc Networks
A special kind of public network called an ad-hoc network may be accessed by joining a network ID with the format:
ffSSSSEEEE000000
| | | |
| | | Reserved for future use, must be 0
| | End of port range (hex)
| Start of port range (hex)
Reserved ZeroTier address prefix indicating a controller-less network
Ad-hoc networks are public (no access control) networks that have no network controller. Instead their configuration and other credentials are generated locally. Ad-hoc networks permit only IPv6 UDP and TCP unicast traffic (no multicast or broadcast) using 6plane format NDP-emulated IPv6 addresses. In addition an ad-hoc network ID encodes an IP port range. UDP packets and TCP SYN (connection open) packets are only allowed to destination ports within the encoded range.
For example `ff00160016000000` is an ad-hoc network allowing only SSH, while `ff0000ffff000000` is an ad-hoc network allowing any UDP or TCP port.
Keep in mind that these networks are public and anyone in the entire world can join them. Care must be taken to avoid exposing vulnerable services or sharing unwanted files or other resources.
### Network Controller (Partial) Rewrite
The network controller has been largely rewritten to use a simple in-filesystem JSON data store in place of SQLite, and it is now included by default in all Windows, Mac, Linux, and BSD builds. This means any desktop or server node running ZeroTier One can now be a controller with no recompilation needed.
If you have data in an old SQLite3 controller we've included a NodeJS script in `controller/migrate-sqlite` to migrate data to the new format. If you don't migrate, members will start getting `NOT_FOUND` when they attempt to query for updates.
## Major Bug Fixes in 1.2.0
* **The Windows HyperV 100% CPU bug is FINALLY DEAD**: This long-running problem turns out to have been an issue with Windows itself, but one we were triggering by placing invalid data into the Windows registry. Microsoft is aware of the issue but we've also fixed the triggering problem on our side. ZeroTier should now co-exist quite well with HyperV and should now be able to be bridged with a HyperV virtual switch.
* **Segmentation faults on musl-libc based Linux systems**: Alpine Linux and some embedded Linux systems that use musl libc (a minimal libc) experienced segmentation faults. These were due to a smaller default stack size. A work-around that sets the stack size for new threads has been added.
* **Windows firewall blocks local JSON API**: On some Windows systems the firewall likes to block 127.0.0.1:9993 for mysterious reasons. This is now fixed in the installer via the addition of another firewall exemption rule.
* **UI crash on embedded Windows due to missing fonts**: The MSI installer now ships fonts and will install them if they are not present, so this should be fixed.
## Other Improvements in 1.2.0
* **Improved dead path detection**: ZeroTier is now more aggressive about expiring paths that do not seem to be active. If a path seems marginal it is re-confirmed before re-use.
* **Minor performance improvements**: We've reduced unnecessary memcpy's and made a few other performance improvements in the core.
* **Linux static binaries**: For our official packages (the ones in the download.zerotier.com apt and yum repositories) we now build Linux binaries with static linking. Hopefully this will stop all the bug reports relating to library inconsistencies, as well as allowing our deb packages to run on a wider variety of Debian-based distributions. (There are far too many of these to support officially!) The overhead for this is very small, especially since we built our static versions against musl-libc. Distribution maintainers are of course free to build dynamically linked versions for inclusion into distributions; this only affects our official binaries.

2
node/Bond.cpp
View file

@ -13,11 +13,11 @@
#include "Bond.hpp" #include "Bond.hpp"
#include "Node.hpp"
#include "Switch.hpp" #include "Switch.hpp"
#include <cinttypes> // for PRId64, etc. macros #include <cinttypes> // for PRId64, etc. macros
#include <cmath> #include <cmath>
#include <cstdio>
#include <string> #include <string>
// FIXME: remove this suppression and actually fix warnings // FIXME: remove this suppression and actually fix warnings

31
node/NetworkConfig.hpp
View file

@ -27,7 +27,6 @@
#include <stdint.h> #include <stdint.h>
#include <stdlib.h> #include <stdlib.h>
#include <string.h>
#include <vector> #include <vector>
/** /**
@ -378,28 +377,6 @@ class NetworkConfig {
return false; return false;
} }
inline std::vector<Address> alwaysContactAddresses() const
{
std::vector<Address> r;
for (unsigned int i = 0; i < specialistCount; ++i) {
if ((specialists[i] & (ZT_NETWORKCONFIG_SPECIALIST_TYPE_NETWORK_RELAY | ZT_NETWORKCONFIG_SPECIALIST_TYPE_MULTICAST_REPLICATOR)) != 0) {
r.push_back(Address(specialists[i]));
}
}
return r;
}
inline unsigned int alwaysContactAddresses(Address ac[ZT_MAX_NETWORK_SPECIALISTS]) const
{
unsigned int c = 0;
for (unsigned int i = 0; i < specialistCount; ++i) {
if ((specialists[i] & (ZT_NETWORKCONFIG_SPECIALIST_TYPE_NETWORK_RELAY | ZT_NETWORKCONFIG_SPECIALIST_TYPE_MULTICAST_REPLICATOR)) != 0) {
ac[c++] = specialists[i];
}
}
return c;
}
inline void alwaysContactAddresses(Hashtable<Address, std::vector<InetAddress> >& a) const inline void alwaysContactAddresses(Hashtable<Address, std::vector<InetAddress> >& a) const
{ {
for (unsigned int i = 0; i < specialistCount; ++i) { for (unsigned int i = 0; i < specialistCount; ++i) {
@ -427,14 +404,6 @@ class NetworkConfig {
{ {
return (networkId != 0); return (networkId != 0);
} }
inline bool operator==(const NetworkConfig& nc) const
{
return (memcmp(this, &nc, sizeof(NetworkConfig)) == 0);
}
inline bool operator!=(const NetworkConfig& nc) const
{
return (! (*this == nc));
}
/** /**
* Add a specialist or mask flags if already present * Add a specialist or mask flags if already present

8
node/Node.cpp
View file

@ -15,7 +15,6 @@
#include "../version.h" #include "../version.h"
#include "Address.hpp" #include "Address.hpp"
#include "Buffer.hpp"
#include "Constants.hpp" #include "Constants.hpp"
#include "ECC.hpp" #include "ECC.hpp"
#include "Identity.hpp" #include "Identity.hpp"
@ -184,6 +183,7 @@ Node::~Node()
Mutex::Lock _l(_networks_m); Mutex::Lock _l(_networks_m);
_networks.clear(); // destroy all networks before shutdown _networks.clear(); // destroy all networks before shutdown
} }
// Explicitly call destructors then free memory for all other objects.
if (RR->sa) { if (RR->sa) {
RR->sa->~SelfAwareness(); RR->sa->~SelfAwareness();
} }
@ -251,7 +251,7 @@ class _PingPeersThatNeedPing {
, _tPtr(tPtr) , _tPtr(tPtr)
, _alwaysContact(alwaysContact) , _alwaysContact(alwaysContact)
, _now(now) , _now(now)
, _bestCurrentUpstream(RR->topology->getUpstreamPeer()) , _bestCurrentUpstream(RR->topology->getUpstreamPeer(0))
{ {
} }
@ -340,9 +340,9 @@ ZT_ResultCode Node::processBackgroundTasks(void* tptr, int64_t now, volatile int
try { try {
_lastPingCheck = now; _lastPingCheck = now;
// Get designated VL1 upstreams // Get designated VL1 upstreams (roots)
Hashtable<Address, std::vector<InetAddress> > alwaysContact; Hashtable<Address, std::vector<InetAddress> > alwaysContact;
RR->topology->getUpstreamsToContact(alwaysContact); RR->topology->getRootsToContact(alwaysContact);
// Uncomment to dump stats // Uncomment to dump stats
/* /*

2
node/Peer.cpp
View file

@ -19,8 +19,8 @@
#include "InetAddress.hpp" #include "InetAddress.hpp"
#include "Metrics.hpp" #include "Metrics.hpp"
#include "Network.hpp" #include "Network.hpp"
#include "Node.hpp"
#include "Packet.hpp" #include "Packet.hpp"
#include "RingBuffer.hpp"
#include "SelfAwareness.hpp" #include "SelfAwareness.hpp"
#include "Switch.hpp" #include "Switch.hpp"
#include "Trace.hpp" #include "Trace.hpp"

2
node/Peer.hpp
View file

@ -20,12 +20,10 @@
#include "AtomicCounter.hpp" #include "AtomicCounter.hpp"
#include "Bond.hpp" #include "Bond.hpp"
#include "Constants.hpp" #include "Constants.hpp"
#include "Hashtable.hpp"
#include "Identity.hpp" #include "Identity.hpp"
#include "InetAddress.hpp" #include "InetAddress.hpp"
#include "Metrics.hpp" #include "Metrics.hpp"
#include "Mutex.hpp" #include "Mutex.hpp"
#include "Node.hpp"
#include "Packet.hpp" #include "Packet.hpp"
#include "Path.hpp" #include "Path.hpp"
#include "RuntimeEnvironment.hpp" #include "RuntimeEnvironment.hpp"

5
node/Switch.cpp
View file

@ -14,7 +14,6 @@
#include "Switch.hpp" #include "Switch.hpp"
#include "../include/ZeroTierOne.h" #include "../include/ZeroTierOne.h"
#include "../version.h"
#include "Constants.hpp" #include "Constants.hpp"
#include "InetAddress.hpp" #include "InetAddress.hpp"
#include "Metrics.hpp" #include "Metrics.hpp"
@ -27,14 +26,12 @@
#include "Trace.hpp" #include "Trace.hpp"
#include <algorithm> #include <algorithm>
#include <stdexcept>
#include <stdio.h> #include <stdio.h>
#include <stdlib.h> #include <stdlib.h>
#include <utility>
namespace ZeroTier { namespace ZeroTier {
Switch::Switch(const RuntimeEnvironment* renv) : RR(renv), _lastBeaconResponse(0), _lastCheckedQueues(0), _lastUniteAttempt(8) // only really used on root servers and upstreams, and it'll grow there just fine Switch::Switch(const RuntimeEnvironment* renv) : RR(renv), _lastBeaconResponse(0), _lastCheckedQueues(0), _lastUniteAttempt(8)
{ {
} }

57
node/Topology.cpp
View file

@ -14,12 +14,11 @@
#include "Topology.hpp" #include "Topology.hpp"
#include "Buffer.hpp" #include "Buffer.hpp"
#include "Constants.hpp"
#include "Network.hpp" #include "Network.hpp"
#include "NetworkConfig.hpp"
#include "Node.hpp" #include "Node.hpp"
#include "RuntimeEnvironment.hpp" #include "RuntimeEnvironment.hpp"
#include "Switch.hpp" #include "Switch.hpp"
#include "Trace.hpp"
namespace ZeroTier { namespace ZeroTier {
@ -146,15 +145,24 @@ Identity Topology::getIdentity(void* tPtr, const Address& zta)
return Identity(); return Identity();
} }
SharedPtr<Peer> Topology::getUpstreamPeer() SharedPtr<Peer> Topology::getUpstreamPeer(const uint64_t nwid)
{ {
const int64_t now = RR->node->now(); const int64_t now = RR->node->now();
unsigned int bestq = ~((unsigned int)0); unsigned int bestq = ~((unsigned int)0);
const SharedPtr<Peer>* best = (const SharedPtr<Peer>*)0; const SharedPtr<Peer>* best = (const SharedPtr<Peer>*)0;
// If this is related to a network, check for a network specific relay.
if (nwid) {
SharedPtr<Network> network = RR->node->network(nwid);
if (network) {
//
}
}
// If this is unrelated to a network OR there is no network-specific relay, send via a root.
{
Mutex::Lock _l2(_peers_m); Mutex::Lock _l2(_peers_m);
Mutex::Lock _l1(_upstreams_m); Mutex::Lock _l1(_upstreams_m);
for (std::vector<Address>::const_iterator a(_upstreamAddresses.begin()); a != _upstreamAddresses.end(); ++a) { for (std::vector<Address>::const_iterator a(_upstreamAddresses.begin()); a != _upstreamAddresses.end(); ++a) {
const SharedPtr<Peer>* p = _peers.get(*a); const SharedPtr<Peer>* p = _peers.get(*a);
if (p) { if (p) {
@ -165,12 +173,13 @@ SharedPtr<Peer> Topology::getUpstreamPeer()
} }
} }
} }
if (best) {
if (! best) {
return SharedPtr<Peer>();
}
return *best; return *best;
} }
}
return SharedPtr<Peer>();
}
bool Topology::isUpstream(const Identity& id) const bool Topology::isUpstream(const Identity& id) const
{ {
@ -245,6 +254,38 @@ bool Topology::isProhibitedEndpoint(const Address& ztaddr, const InetAddress& ip
return false; return false;
} }
void Topology::getRootsToContact(Hashtable<Address, std::vector<InetAddress> >& eps) const
{
Mutex::Lock _l(_upstreams_m);
for (std::vector<World::Root>::const_iterator i(_planet.roots().begin()); i != _planet.roots().end(); ++i) {
if (i->identity != RR->identity) {
std::vector<InetAddress>& ips = eps[i->identity.address()];
for (std::vector<InetAddress>::const_iterator j(i->stableEndpoints.begin()); j != i->stableEndpoints.end(); ++j) {
if (std::find(ips.begin(), ips.end(), *j) == ips.end()) {
ips.push_back(*j);
}
}
}
}
for (std::vector<World>::const_iterator m(_moons.begin()); m != _moons.end(); ++m) {
for (std::vector<World::Root>::const_iterator i(m->roots().begin()); i != m->roots().end(); ++i) {
if (i->identity != RR->identity) {
std::vector<InetAddress>& ips = eps[i->identity.address()];
for (std::vector<InetAddress>::const_iterator j(i->stableEndpoints.begin()); j != i->stableEndpoints.end(); ++j) {
if (std::find(ips.begin(), ips.end(), *j) == ips.end()) {
ips.push_back(*j);
}
}
}
}
}
for (std::vector<std::pair<uint64_t, Address> >::const_iterator m(_moonSeeds.begin()); m != _moonSeeds.end(); ++m) {
eps[m->second];
}
}
bool Topology::addWorld(void* tPtr, const World& newWorld, bool alwaysAcceptNew) bool Topology::addWorld(void* tPtr, const World& newWorld, bool alwaysAcceptNew)
{ {
if ((newWorld.type() != World::TYPE_PLANET) && (newWorld.type() != World::TYPE_MOON)) { if ((newWorld.type() != World::TYPE_PLANET) && (newWorld.type() != World::TYPE_MOON)) {

36
node/Topology.hpp
View file

@ -16,7 +16,6 @@
#include "../include/ZeroTierOne.h" #include "../include/ZeroTierOne.h"
#include "Address.hpp" #include "Address.hpp"
#include "Constants.hpp"
#include "Hashtable.hpp" #include "Hashtable.hpp"
#include "Identity.hpp" #include "Identity.hpp"
#include "InetAddress.hpp" #include "InetAddress.hpp"
@ -26,9 +25,7 @@
#include "World.hpp" #include "World.hpp"
#include <algorithm> #include <algorithm>
#include <stdexcept>
#include <stdio.h> #include <stdio.h>
#include <string.h>
#include <utility> #include <utility>
#include <vector> #include <vector>
@ -112,9 +109,10 @@ class Topology {
/** /**
* Get the current best upstream peer * Get the current best upstream peer
* *
* @param nwid Network ID or 0 if this is to send something unrelated to a specific network
* @return Upstream or NULL if none available * @return Upstream or NULL if none available
*/ */
SharedPtr<Peer> getUpstreamPeer(); SharedPtr<Peer> getUpstreamPeer(const uint64_t nwid);
/** /**
* @param id Identity to check * @param id Identity to check
@ -155,35 +153,7 @@ class Topology {
* *
* @param eps Hash table to fill with addresses and their stable endpoints * @param eps Hash table to fill with addresses and their stable endpoints
*/ */
inline void getUpstreamsToContact(Hashtable<Address, std::vector<InetAddress> >& eps) const void getRootsToContact(Hashtable<Address, std::vector<InetAddress> >& eps) const;
{
Mutex::Lock _l(_upstreams_m);
for (std::vector<World::Root>::const_iterator i(_planet.roots().begin()); i != _planet.roots().end(); ++i) {
if (i->identity != RR->identity) {
std::vector<InetAddress>& ips = eps[i->identity.address()];
for (std::vector<InetAddress>::const_iterator j(i->stableEndpoints.begin()); j != i->stableEndpoints.end(); ++j) {
if (std::find(ips.begin(), ips.end(), *j) == ips.end()) {
ips.push_back(*j);
}
}
}
}
for (std::vector<World>::const_iterator m(_moons.begin()); m != _moons.end(); ++m) {
for (std::vector<World::Root>::const_iterator i(m->roots().begin()); i != m->roots().end(); ++i) {
if (i->identity != RR->identity) {
std::vector<InetAddress>& ips = eps[i->identity.address()];
for (std::vector<InetAddress>::const_iterator j(i->stableEndpoints.begin()); j != i->stableEndpoints.end(); ++j) {
if (std::find(ips.begin(), ips.end(), *j) == ips.end()) {
ips.push_back(*j);
}
}
}
}
}
for (std::vector<std::pair<uint64_t, Address> >::const_iterator m(_moonSeeds.begin()); m != _moonSeeds.end(); ++m) {
eps[m->second];
}
}
/** /**
* @return Vector of active upstream addresses (including roots) * @return Vector of active upstream addresses (including roots)