Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
NFS astonishingly low performance [SOLVED]
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Off the Wall
View previous topic :: View next topic  
Author Message
mounty1
l33t
l33t


Joined: 06 Jul 2006
Posts: 839
Location: Queensland

PostPosted: Sun Sep 20, 2020 9:56 am    Post subject: NFS astonishingly low performance [SOLVED] Reply with quote

My current NFS server is this Supermicro motherboard in a custom case with a ZFS RAIDZ2 pool spread across four 500 GiB SATA HDDs, via the onboard controller. E3-1220v2 CPU and 16 GiB RAM.

I am investigating replacing this with an HP DL380 G7 with two X5660 CPUs, 48 GiB RAM and a RAIDZ2 pool spread across four 500 GiB SAS HDDs via an LSI SAS3081E-R controller (as the supplied P410i won't allow HBA).

My test is using a low-spec. Dell/Wyse thin client running Gentoo (gotta get that in here) with an NFS root and an NFS $HOME, both on the RAIDZ2 zpool.

When served by the Supermicro, an ls -ltr of $HOME takes 0.4 seconds. When served by the HP, it takes 40.7 seconds. This is consistent and reproducible. What is wrong with the DL380?
_________________
Michael Mounteney


Last edited by mounty1 on Mon Sep 21, 2020 8:22 pm; edited 1 time in total
Back to top
View user's profile Send private message
e3k
Guru
Guru


Joined: 01 Oct 2007
Posts: 516
Location: Inner Space

PostPosted: Sun Sep 20, 2020 5:53 pm    Post subject: Reply with quote

don't want to be a smart ass here but: my experience with file systems (ZFS, EXT34) is that the performance goes down with time. found the 'shake' program to reduce fragmentation. but personally if it got bad after years i just did a backup and then recreate the FS + copy the backup back on the disk.
_________________

Flux & Contemplation - Portrait of an Artist in Isolation

Back to top
View user's profile Send private message
SiberianSniper
Guru
Guru


Joined: 06 Apr 2006
Posts: 371
Location: Dayton, OH, USA

PostPosted: Mon Sep 21, 2020 8:12 pm    Post subject: Reply with quote

I'd suspect a two order of magnitude slowdown isn't due to a filesystem accumulating cruft. If you run ls on the DL380 directly, does it also take a long time, or just through NFS?
Back to top
View user's profile Send private message
mounty1
l33t
l33t


Joined: 06 Jul 2006
Posts: 839
Location: Queensland

PostPosted: Mon Sep 21, 2020 8:22 pm    Post subject: Reply with quote

SiberianSniper wrote:
I'd suspect a two order of magnitude slowdown isn't due to a filesystem accumulating cruft. If you run ls on the DL380 directly, does it also take a long time, or just through NFS?

Only through NFS.

I've set some performance-tuning parameters, that were already set on the Supermicro, also on the HP. They have eliminated the difference in performance. Really.

Just for the record, here is the tuning. This is on OmniOS, an OpenSolaris derivative:
Code:
sharectl set -p servers=512 nfs
sharectl set -p lockd_servers=128 nfs
sharectl set -p lockd_listen_backlog=256 nfs

set atime=off rpool/ROOT rpool/swap rpool/dump
set sync=disabled rpool/ROOT rpool/swap rpool/dump

_________________
Michael Mounteney
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Off the Wall All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum