zfs - NFS Performance

Er meint:
Code: 
ifconfig $NIC -tso
Die Revisionen, die in 10-STABLE das TSO-Problem beheben, waren:
- r264442
- r265414
Es reicht an sich sogar eine, sie beheben das Problem jeweils auf anderen Seiten. r264442 verlängert die TSO-Queue der Treiber von 32 auf 35, r265414 sorgt dafür, dass der NFS-Server die 32 Segmente nicht überschreitet.
 
NET.TcpipHeapSize ist aber wichtig für die Problem behebung. :)
und was für einen Produktiv Server setzt du den ein.

Gruss

Jörg
 
Also gut, das PDF hab ich mir durchgelesen konnte aber nichts nennenswertes entdecken (oder ich habs übersehen)
TSO habe ich deaktiviert ohne einen Unterschied festzustellen
recordsize geändert ohne Ergebnis (verschiedene Werte)
NET.TcpipHeapSize habe ich noch nicht geändert - könnte das echt daran liegen? Die "normale" Netzwerkverbindung läuft ohne Probleme
VMware ESXi 5.1.0 (799733)

@Yamagi Ist denn absehbar wann es als Release zur verfügung steht oder könnte man 10-STABLE ohne große bedenken auch Produktiv einsetzten? Die Definition von Entwicklungszweig ist mir bewusst, jedoch hab ich mich bisher nur auf "RELEASE" bewegt weswegen ich das nicht abschätzten kann.
 
NET.TcpipHeapSize = ja

und seite 20 überprüfen und einstellungen gegebenenfalls anpassen.

Zudem würde mich deine HW vom Storage und ESXI interessieren würdest du diese mal Posten.

Gruß

Jörg
 
Ok dann probiere ich mal die vorgeschlagenen Werte.

Zur Hardware:

Storage
Code: 
CPU: Intel(R) Core(TM)2 Duo CPU     E8400  @ 3.00GHz (3000.01-MHz K8-class CPU)
Mainboard: Asus P5K-V
RAM: 4x 2GB DDR2 800MHZ
em0: <Intel(R) PRO/1000 Legacy Network Connection 1.0.4>
ada0: <MKNSSDCR120GB-DX 506ABBF0> ATA-8 SATA 3.x device
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 114473MB (234441648 512 byte sectors: 16H 63S/T 16383C)
ada1: <Hitachi HDS721010CLA330 JP4OA3MA> ATA-8 SATA 2.x device
ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada1: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C)
ada2: <Hitachi HDS721010CLA330 JP4OA3MA> ATA-8 SATA 2.x device
ada2: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada2: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C)
ada3: <Hitachi HDS721010CLA330 JP4OA3MA> ATA-8 SATA 2.x device
ada3: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada3: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C)
ada4: <Hitachi HDS721010CLA330 JP4OA3MA> ATA-8 SATA 2.x device
ada4: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada4: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C)

ESXi - die Rechnung finde ich gerade nicht
Code: 
CPU: Intel Xeon E3-1230 V2 @ 3.3GHz
Mainboard: Supermicro X9SCL/X9SCM
RAM: 32GB
 
HW höst sich gut an, aber beachte das ein Produktives System auch das Storage mit ECC Speicher betrieben werden sollte,
zudem wären 12-32 GB bessser für das Storage, wenn DEDUP geplant ist sogar mehr.

Grüße

Jörg
 
@joergpc:
Ist halt eine alte Maschine die wir noch rumstehen hatten, die verträgt weder mehr RAM noch ECC - bei einer neuen werde ich darauf so oder so bestehen ;)

So ich hab jetzt 10.0-p3 frisch installiert, die Sector size auf 4k gestellt (gnop, ashift ist 12) und eine andere neue SSD als SLog hinzugefügt, ebenso hab ich beim ESXi einige Flags geändert.
Code: 
Net.TcpipHeapsize           32
NFS.HeartbeatTimeout        5
Nfs.Sendbuffersize          264
Nfs.Receivebuffersize       256
Nfs.heartbeatfrequency      20
Nfs.heartbeatdelta          12
Nfs.heartbeatmaxfailures    10

Was genau nun das Problem behoben hat kann ich leider nicht sagen da es eine komplette Neuinstallation war aber das "burst"-artige übertragen übers Netz ist nicht mehr gegeben :) Performance ist Top, bevor ich jedoch jetzt alles abschließe und es wieder Produktiv nehme würde ich gerne ein paar Dinge geklärt haben.

1. Die SSD (SanDisk SSD 64GB, SATA 6Gb/s) erreicht beim schreiben "nur" ~120Mb/s (dd if=/dev/zero of=/dev/ada0 bs=1G) obwohl sie bis zu 450Mb/s schaffen sollte und an einem SATA 3.0 Port hängt (HighPoint Rocket 620 Controller). Der Controller ist an einem PCIe 2.0 x1 Port angeschlossen der laut Specs. maximal 500 MB/s schaffen sollte. Lesend kommt die SSD so angeschlossen auf ca 170Mb/s - es funktioniert zwar alles aber ich wüsste trotzdem gern woran das liegt.

2. Diesmal hab ich anstelle eines RAID01 ein RaidZ-1 Pool erstellt, soweit so gut jedoch verwirrt mich die Kapazitätsangabe etwas. Rein rechnerisch sollten 2.7 TB zur verfügung stehen, zfs list bestätigt das auch jedoch wird unter zpool list und zpool iostat was ganz anderes angegeben. Seht selbst:
Code: 
root@stor01:/home/ohaucke # zpool status tank
  pool: tank
state: ONLINE
  scan: none requested
config:

        NAME           STATE     READ WRITE CKSUM
        tank           ONLINE       0     0     0
          raidz1-0     ONLINE       0     0     0
            gpt/disk1  ONLINE       0     0     0
            gpt/disk2  ONLINE       0     0     0
            gpt/disk3  ONLINE       0     0     0
            gpt/disk4  ONLINE       0     0     0
        logs
          gpt/log0     ONLINE       0     0     0

errors: No known data errors
root@stor01:/home/ohaucke # zpool list
NAME   SIZE  ALLOC   FREE    CAP  DEDUP  HEALTH  ALTROOT
tank  3.62T   275G  3.36T     7%  1.00x  ONLINE  -
root@stor01:/home/ohaucke # zfs list
NAME              USED  AVAIL  REFER  MOUNTPOINT
tank              200G  2.40T   232K  /tank
tank/datastore2   200G  2.40T   200G  /tank/datastore2
tank/files        244K  2.40T   244K  /tank/files
root@stor01:/home/ohaucke # zpool iostat -v
                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      2    384   243K  31.2M
  raidz1        275G  3.36T      2    141   243K  15.2M
    gpt/disk1      -      -      1     67  62.0K  5.24M
    gpt/disk2      -      -      1     61  58.6K  5.24M
    gpt/disk3      -      -      1     67  63.9K  5.24M
    gpt/disk4      -      -      1     61  60.1K  5.24M
logs               -      -      -      -      -      -
  gpt/log0       40K  59.5G      0    243    107  16.0M
-------------  -----  -----  -----  -----  -----  -----
kann mir das irgendwer näher erklären?

3. Mir ist bewusst das bei NFS die Daten die geschrieben werden in transaction groups zusammen gefasst werden und bei erreichen des Limits (Zeit oder Größe/Menge) die Daten auf die Platten geschrieben werden, aber mir kommt das etwas merkwürdig vor, hier schreibe ich eine 2Gb Datei über NFS:
Code: 
                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      2    422   224K  34.3M
  raidz1        275G  3.36T      2    155   224K  16.7M
    gpt/disk1      -      -      1     74  57.4K  5.76M
    gpt/disk2      -      -      1     67  54.4K  5.75M
    gpt/disk3      -      -      1     74  58.7K  5.76M
    gpt/disk4      -      -      1     67  55.2K  5.75M
logs               -      -      -      -      -      -
  gpt/log0     1.05M  59.5G      0    266    118  17.6M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      0      0      0      0
  raidz1        275G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0     1.05M  59.5G      0      0      0      0
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T     34    114  4.35M  1006K
  raidz1        275G  3.36T     34    112  4.35M   982K
    gpt/disk1      -      -     23     48  1.20M   417K
    gpt/disk2      -      -     19     48   970K   382K
    gpt/disk3      -      -     22     53  1.37M   437K
    gpt/disk4      -      -     22     49  1.47M   421K
logs               -      -      -      -      -      -
  gpt/log0     1.27M  59.5G      0      1      0  23.8K
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T     53     14  6.63M   189K
  raidz1        275G  3.36T     53      0  6.63M      0
    gpt/disk1      -      -     33      0  1.82M      0
    gpt/disk2      -      -     31      0  1.63M      0
    gpt/disk3      -      -     27      0  1.41M      0
    gpt/disk4      -      -     22      0  1.26M      0
logs               -      -      -      -      -      -
  gpt/log0     1.27M  59.5G      0     14      0   189K
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T     33     53  4.24M  3.50M
  raidz1        275G  3.36T     33      0  4.24M      0
    gpt/disk1      -      -     22      0  1.00M      0
    gpt/disk2      -      -     23      0   974K      0
    gpt/disk3      -      -     28      0  1.25M      0
    gpt/disk4      -      -     25      0  1.05M      0
logs               -      -      -      -      -      -
  gpt/log0     1.27M  59.5G      0     53      0  3.50M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      2      6   381K  39.7K
  raidz1        275G  3.36T      2      0   381K      0
    gpt/disk1      -      -      2      0   131K      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      2      0   131K      0
    gpt/disk4      -      -      2      0   119K      0
logs               -      -      -      -      -      -
  gpt/log0     1.27M  59.5G      0      6      0  39.7K
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T     24    323  3.12M  24.0M
  raidz1        275G  3.36T     24      0  3.12M      0
    gpt/disk1      -      -     12      0   571K      0
    gpt/disk2      -      -     11      0   527K      0
    gpt/disk3      -      -     24      0  1.07M      0
    gpt/disk4      -      -     24      0   998K      0
logs               -      -      -      -      -      -
  gpt/log0     1.27M  59.5G      0    323      0  24.0M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      6    623   861K  47.9M
  raidz1        275G  3.36T      6    489   861K  38.5M
    gpt/disk1      -      -      2    197   127K  13.4M
    gpt/disk2      -      -      3    170   169K  13.4M
    gpt/disk3      -      -      6    191   296K  13.4M
    gpt/disk4      -      -      6    187   269K  13.3M
logs               -      -      -      -      -      -
  gpt/log0     68.2M  59.4G      0    133      0  9.37M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T     16    329  2.12M  24.4M
  raidz1        275G  3.36T     16      0  2.12M      0
    gpt/disk1      -      -      7      0   351K      0
    gpt/disk2      -      -      8      0   395K      0
    gpt/disk3      -      -     16      0   746K      0
    gpt/disk4      -      -     16      0   679K      0
logs               -      -      -      -      -      -
  gpt/log0     68.2M  59.4G      0    329      0  24.4M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      2    129   381K  9.28M
  raidz1        275G  3.36T      2      0   381K      0
    gpt/disk1      -      -      2      0   131K      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      2      0   131K      0
    gpt/disk4      -      -      2      0   119K      0
logs               -      -      -      -      -      -
  gpt/log0     68.2M  59.4G      0    129      0  9.28M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T     13    382  1.75M  28.5M
  raidz1        275G  3.36T     13      0  1.75M      0
    gpt/disk1      -      -      8      0   396K      0
    gpt/disk2      -      -      6      0   304K      0
    gpt/disk3      -      -     13      0   615K      0
    gpt/disk4      -      -     13      0   559K      0
logs               -      -      -      -      -      -
  gpt/log0     68.2M  59.4G      0    382      0  28.5M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      2     80   379K  5.27M
  raidz1        275G  3.36T      2      0   379K      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      1      0  87.0K      0
    gpt/disk3      -      -      2      0   130K      0
    gpt/disk4      -      -      1      0  79.1K      0
logs               -      -      -      -      -      -
  gpt/log0     68.2M  59.4G      0     80      0  5.27M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T     10    974  1.33M  89.7M
  raidz1        275G  3.36T     10    620  1.33M  63.6M
    gpt/disk1      -      -      4    294   213K  21.9M
    gpt/disk2      -      -      5    245   255K  21.9M
    gpt/disk3      -      -     10    293   468K  22.0M
    gpt/disk4      -      -     10    292   425K  21.9M
logs               -      -      -      -      -      -
  gpt/log0      185M  59.3G      0    354      0  26.1M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      0     99      0  6.61M
  raidz1        275G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0      185M  59.3G      0     99      0  6.61M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      0    413      0  30.4M
  raidz1        275G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0      185M  59.3G      0    413      0  30.4M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      0    513      0  37.0M
  raidz1        275G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0      185M  59.3G      0    513      0  37.0M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      0    366      0  27.0M
  raidz1        275G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0      185M  59.3G      0    366      0  27.0M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      0  1.53K      0   159M
  raidz1        275G  3.36T      0  1.13K      0   130M
    gpt/disk1      -      -      0    560      0  44.7M
    gpt/disk2      -      -      0    558      0  44.6M
    gpt/disk3      -      -      0    558      0  44.6M
    gpt/disk4      -      -      0    458      0  44.6M
logs               -      -      -      -      -      -
  gpt/log0      185M  59.3G      0    404      0  29.8M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      0    149   127K  10.8M
  raidz1        275G  3.36T      0      0   127K      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0  43.6K      0
    gpt/disk3      -      -      0      0  43.6K      0
    gpt/disk4      -      -      0      0  39.7K      0
logs               -      -      -      -      -      -
  gpt/log0      352M  59.2G      0    149      0  10.8M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      0      0      0      0
  raidz1        275G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0      352M  59.2G      0      0      0      0
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      0    447      0  33.0M
  raidz1        275G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0      352M  59.2G      0    447      0  33.0M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            275G  3.36T      0    450      0  33.1M
  raidz1        275G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0      352M  59.2G      0    450      0  33.1M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T      0  1.29K      0   128M
  raidz1        276G  3.36T      0    927      0  98.1M
    gpt/disk1      -      -      0    431      0  33.9M
    gpt/disk2      -      -      0    429      0  33.8M
    gpt/disk3      -      -      0    433      0  33.9M
    gpt/disk4      -      -      0    359      0  33.8M
logs               -      -      -      -      -      -
  gpt/log0      407M  59.1G      0    390      0  29.5M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T      0    514      0  37.7M
  raidz1        276G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0      407M  59.1G      0    514      0  37.7M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T      0    463      0  33.7M
  raidz1        276G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0      407M  59.1G      0    463      0  33.7M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T      0    467      0  33.8M
  raidz1        276G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0      407M  59.1G      0    467      0  33.8M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T      0    355      0  25.7M
  raidz1        276G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0      407M  59.1G      0    355      0  25.7M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T      0  1.74K      0   188M
  raidz1        276G  3.36T      0  1.37K      0   159M
    gpt/disk1      -      -      0    676      0  54.9M
    gpt/disk2      -      -      0    674      0  54.8M
    gpt/disk3      -      -      0    668      0  54.8M
    gpt/disk4      -      -      0    544      0  54.8M
logs               -      -      -      -      -      -
  gpt/log0      407M  59.1G      0    384      0  28.3M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T      0    171      0  12.9M
  raidz1        276G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      3      0  15.5K
    gpt/disk2      -      -      0      3      0  15.5K
    gpt/disk3      -      -      0      3      0  15.5K
    gpt/disk4      -      -      0      3      0  15.5K
logs               -      -      -      -      -      -
  gpt/log0      458M  59.1G      0    171      0  12.9M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T      0      0      0      0
  raidz1        276G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0      458M  59.1G      0      0      0      0
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T      0    455      0  33.3M
  raidz1        276G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0      458M  59.1G      0    455      0  33.3M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T      0    359      0  26.6M
  raidz1        276G  3.36T      0      0      0      0
    gpt/disk1      -      -      0      0      0      0
    gpt/disk2      -      -      0      0      0      0
    gpt/disk3      -      -      0      0      0      0
    gpt/disk4      -      -      0      0      0      0
logs               -      -      -      -      -      -
  gpt/log0      458M  59.1G      0    359      0  26.6M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T      0  1.26K      0   125M
  raidz1        276G  3.36T      0    867      0  93.1M
    gpt/disk1      -      -      0    408      0  32.1M
    gpt/disk2      -      -      0    334      0  32.0M
    gpt/disk3      -      -      0    414      0  32.1M
    gpt/disk4      -      -      0    414      0  32.1M
logs               -      -      -      -      -      -
  gpt/log0      449M  59.1G      0    419      0  32.3M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T    213    478  26.5M  35.3M
  raidz1        276G  3.36T    213      0  26.5M      0
    gpt/disk1      -      -    204      0  8.71M      0
    gpt/disk2      -      -    204      0  8.03M      0
    gpt/disk3      -      -    115      0  4.90M      0
    gpt/disk4      -      -    113      0  4.83M      0
logs               -      -      -      -      -      -
  gpt/log0      449M  59.1G      0    478      0  35.3M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T    285    522  35.3M  37.4M
  raidz1        276G  3.36T    285      0  35.3M      0
    gpt/disk1      -      -    162      0  6.85M      0
    gpt/disk2      -      -    156      0  6.58M      0
    gpt/disk3      -      -    269      0  11.5M      0
    gpt/disk4      -      -    264      0  10.4M      0
logs               -      -      -      -      -      -
  gpt/log0      449M  59.1G      0    522      0  37.4M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T    263    476  32.7M  34.6M
  raidz1        276G  3.36T    263      0  32.7M      0
    gpt/disk1      -      -    133      0  5.66M      0
    gpt/disk2      -      -    129      0  5.57M      0
    gpt/disk3      -      -    263      0  11.2M      0
    gpt/disk4      -      -    261      0  10.2M      0
logs               -      -      -      -      -      -
  gpt/log0      449M  59.1G      0    476      0  34.6M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T    241    438  30.0M  31.7M
  raidz1        276G  3.36T    241      0  30.0M      0
    gpt/disk1      -      -    142      0  6.05M      0
    gpt/disk2      -      -    133      0  5.61M      0
    gpt/disk3      -      -    226      0  9.70M      0
    gpt/disk4      -      -    219      0  8.60M      0
logs               -      -      -      -      -      -
  gpt/log0      449M  59.1G      0    438      0  31.7M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T     66  1.58K  8.12M   176M
  raidz1        276G  3.36T     66  1.46K  8.12M   167M
    gpt/disk1      -      -     55    701  2.45M  57.5M
    gpt/disk2      -      -     61    698  2.53M  57.4M
    gpt/disk3      -      -     31    705  1.38M  57.5M
    gpt/disk4      -      -     41    575  1.77M  57.5M
logs               -      -      -      -      -      -
  gpt/log0      449M  59.1G      0    130      0  8.79M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T    239    422  29.7M  31.5M
  raidz1        276G  3.36T    239      0  29.7M      0
    gpt/disk1      -      -    240      3  10.3M  16.0K
    gpt/disk2      -      -    236      3  9.25M  16.0K
    gpt/disk3      -      -    123      3  5.32M  16.0K
    gpt/disk4      -      -    116      3  4.98M  16.0K
logs               -      -      -      -      -      -
  gpt/log0      460M  59.1G      0    422      0  31.5M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T    245    443  30.5M  32.4M
  raidz1        276G  3.36T    245      0  30.5M      0
    gpt/disk1      -      -    244      0  10.4M      0
    gpt/disk2      -      -    242      0  9.47M      0
    gpt/disk3      -      -    118      0  5.10M      0
    gpt/disk4      -      -    126      0  5.37M      0
logs               -      -      -      -      -      -
  gpt/log0      460M  59.1G      0    443      0  32.4M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T    217    380  26.9M  27.5M
  raidz1        276G  3.36T    217      0  26.9M      0
    gpt/disk1      -      -    195      0  8.41M      0
    gpt/disk2      -      -    193      0  7.58M      0
    gpt/disk3      -      -    128      0  5.46M      0
    gpt/disk4      -      -    130      0  5.45M      0
logs               -      -      -      -      -      -
  gpt/log0      460M  59.1G      0    380      0  27.5M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T    163    280  20.4M  20.7M
  raidz1        276G  3.36T    163      0  20.4M      0
    gpt/disk1      -      -     81      0  3.52M      0
    gpt/disk2      -      -     91      0  3.87M      0
    gpt/disk3      -      -    160      0  6.87M      0
    gpt/disk4      -      -    155      0  6.10M      0
logs               -      -      -      -      -      -
  gpt/log0      460M  59.1G      0    280      0  20.7M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T     95  1.21K  11.9M   129M
  raidz1        276G  3.36T     95  1.03K  11.9M   115M
    gpt/disk1      -      -     50    499  2.19M  39.8M
    gpt/disk2      -      -     44    409  1.89M  39.8M
    gpt/disk3      -      -     95    499  4.08M  39.8M
    gpt/disk4      -      -     94    493  3.71M  39.8M
logs               -      -      -      -      -      -
  gpt/log0      503M  59.0G      0    185      0  13.5M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T    289    549  35.9M  38.6M
  raidz1        276G  3.36T    289      0  35.9M      0
    gpt/disk1      -      -    143      0  6.18M      0
    gpt/disk2      -      -    147      0  6.26M      0
    gpt/disk3      -      -    287      0  12.3M      0
    gpt/disk4      -      -    287      0  11.2M      0
logs               -      -      -      -      -      -
  gpt/log0      503M  59.0G      0    549      0  38.6M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T    252    449  31.4M  32.6M
  raidz1        276G  3.36T    252      0  31.4M      0
    gpt/disk1      -      -    158      0  6.79M      0
    gpt/disk2      -      -    153      0  6.37M      0
    gpt/disk3      -      -    222      0  9.49M      0
    gpt/disk4      -      -    219      0  8.70M      0
logs               -      -      -      -      -      -
  gpt/log0      503M  59.0G      0    449      0  32.6M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T    263    479  32.7M  34.7M
  raidz1        276G  3.36T    263      0  32.7M      0
    gpt/disk1      -      -    198      0  8.49M      0
    gpt/disk2      -      -    197      0  7.97M      0
    gpt/disk3      -      -    193      0  8.28M      0
    gpt/disk4      -      -    196      0  7.95M      0
logs               -      -      -      -      -      -
  gpt/log0      503M  59.0G      0    479      0  34.7M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T    230    410  28.6M  29.8M
  raidz1        276G  3.36T    230      0  28.6M      0
    gpt/disk1      -      -    203      0  8.71M      0
    gpt/disk2      -      -    205      0  8.14M      0
    gpt/disk3      -      -    139      0  5.96M      0
    gpt/disk4      -      -    140      0  5.85M      0
logs               -      -      -      -      -      -
  gpt/log0      503M  59.0G      0    410      0  29.8M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T     71  1.42K  8.86M   155M
  raidz1        276G  3.36T     71  1.30K  8.86M   146M
    gpt/disk1      -      -     55    625  2.40M  50.4M
    gpt/disk2      -      -     52    512  2.20M  50.3M
    gpt/disk3      -      -     48    627  2.15M  50.4M
    gpt/disk4      -      -     49    621  2.12M  50.3M
logs               -      -      -      -      -      -
  gpt/log0      503M  59.0G      0    126      0  8.75M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T    245    425  30.5M  32.6M
  raidz1        276G  3.36T    245      0  30.5M      0
    gpt/disk1      -      -    180      0  7.71M      0
    gpt/disk2      -      -    169      0  6.87M      0
    gpt/disk3      -      -    191      0  8.21M      0
    gpt/disk4      -      -    191      0  7.67M      0
logs               -      -      -      -      -      -
  gpt/log0      467M  59.0G      0    425      0  32.6M
-------------  -----  -----  -----  -----  -----  -----

                  capacity     operations    bandwidth
pool           alloc   free   read  write   read  write
-------------  -----  -----  -----  -----  -----  -----
tank            276G  3.36T    269    456  33.4M  34.4M
  raidz1        276G  3.36T    269      0  33.4M      0
    gpt/disk1      -      -    191      0  8.19M      0
    gpt/disk2      -      -    195      0  7.94M      0
    gpt/disk3      -      -    212      0  9.10M      0
    gpt/disk4      -      -    204      0  8.21M      0
logs               -      -      -      -      -      -
  gpt/log0      467M  59.0G      0    456      0  34.4M
-------------  -----  -----  -----  -----  -----  -----
 
Zu 2: die zpool-Angaben beziehen sich auf die Kapazität des Pools und nicht der Dateisysteme. Die Parity-Platten werden da miteingerechnet.
 
Hallo, super das es läuft,

eine 64 GB SSD ist immer langsamer, erst so ab 128 GB und bei den neuen sogar erst ab 256 GB erreichen sie ihre max Transferrate.

Ich würde aus Garantie und Erfahrung immer eine Intel oder Samsung Pro (840) nehmen, sieht man auch an 5 Jahre Garantie.

Zu deiner HW, nun Produktiv ist diese HW eigentlich nicht, für eine Testumgebung ok,
denn du wirst gefragt warum deine Storage nach einem RAM Fehler für mehrere Std/Tage nicht zur Verfügung steht,
bedenke dass alle VM auf dem Storage dann Down sind, am besten per mail mit deiner Geschäftsleitung/Abteilungsleitung explizit hinweisen.

Gruß

Jörg
 
Du musst dich einloggen oder registrieren, um hier zu antworten.
Zurück
Oben