gyptazy<p>Not even bad the latency (this is just about latency, not overall bandwidth which reaches the full 4.9Gbit via 2x 2.5Gbit links).</p><p>Taken inside a Debian VM running on a Proxmox node connected to the storage:</p><p>GMKTec G9 NAS<br>2x 2.5Gbit<br>NFS 4.2 (with pNFS)<br>2x WD Back SN7100 NVMe<br>Mirror mode ZFS</p><p>While this are already pretty awesome latencies, let's see how it performs with SPDK and NVMe-oF (TCP). </p><p><a href="https://mastodon.gyptazy.com/tags/homelab" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>homelab</span></a> <a href="https://mastodon.gyptazy.com/tags/proxmox" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>proxmox</span></a> <a href="https://mastodon.gyptazy.com/tags/storage" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>storage</span></a> <a href="https://mastodon.gyptazy.com/tags/zfs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>zfs</span></a> <a href="https://mastodon.gyptazy.com/tags/gmktec" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>gmktec</span></a> <a href="https://mastodon.gyptazy.com/tags/gmktecg9" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>gmktecg9</span></a> <a href="https://mastodon.gyptazy.com/tags/latency" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>latency</span></a> <a href="https://mastodon.gyptazy.com/tags/freebsd" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>freebsd</span></a> <a href="https://mastodon.gyptazy.com/tags/NFS" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>NFS</span></a> <a href="https://mastodon.gyptazy.com/tags/SPDK" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SPDK</span></a> <a href="https://mastodon.gyptazy.com/tags/NVMe" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>NVMe</span></a> <a href="https://mastodon.gyptazy.com/tags/NVMEoF" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>NVMEoF</span></a></p>