Hp

P840/4gb fbwc 上 SSD RAID 10 的寫入性能問題

  • May 2, 2017

我有一個使用 P840/4gb fbwc RAID 控制器的 RAID10 陣列中的 4x512GB Samsung SSD 850 的新系統。當我從網路(10 Gbit/s)下載文件時,寫入速度不是很好。我嘗試使用 wget 下載一個 1000MB 的文件:

Saving to: ‘1000mb.bin’

1000mb.bin                                       100%[=========================================================================================================>]   1000M   383MB/s   in 2.6s

寫入速度 383Mbyte/s

編輯:將相同的文件下載到 /dev/null 時,我得到了 10Gbit/s 的全速。案例是下載和儲存該大小的文件。

此外,當我嘗試使用 dd 寫入文件時,速度與塊大小 512byte 相同:

dd if=/dev/zero of=bench.bin bs=512 count=10000K
10240000+0 records in
10240000+0 records out
5242880000 bytes (5.2 GB) copied, 14.6632 s, 358 MB/s

然而,塊大小 4k 提供了更好的性能:

dd if=/dev/zero of=bench.bin bs=4k count=1000K
1024000+0 records in
1024000+0 records out
4194304000 bytes (4.2 GB) copied, 3.02447 s, 1.4 GB/s

所以我嘗試了各種不同的設置,比如記憶體、SSD 智能路徑等。但我沒有看到太大的不同。任何想法如何提高寫入速度?

控制器的目前設置:

Smart Array P840 in Slot 1
  Bus Interface: PCI
  Slot: 1
  Serial Number: 
  Cache Serial Number: 
  RAID 6 (ADG) Status: Enabled
  Controller Status: OK
  Hardware Revision: B
  Firmware Version: 4.52
  Rebuild Priority: High
  Expand Priority: Medium
  Surface Scan Delay: 3 secs
  Surface Scan Mode: Idle
  Parallel Surface Scan Supported: Yes
  Current Parallel Surface Scan Count: 1
  Max Parallel Surface Scan Count: 16
  Queue Depth: Automatic
  Monitor and Performance Delay: 60  min
  Elevator Sort: Enabled
  Degraded Performance Optimization: Disabled
  Inconsistency Repair Policy: Disabled
  Wait for Cache Room: Disabled
  Surface Analysis Inconsistency Notification: Disabled
  Post Prompt Timeout: 15 secs
  Cache Board Present: True
  Cache Status: OK
  Cache Ratio: 10% Read / 90% Write
  Drive Write Cache: Disabled
  Total Cache Size: 4.0 GB
  Total Cache Memory Available: 3.8 GB
  No-Battery Write Cache: Disabled
  SSD Caching RAID5 WriteBack Enabled: True
  SSD Caching Version: 2
  Cache Backup Power Source: Batteries
  Battery/Capacitor Count: 1
  Battery/Capacitor Status: OK
  SATA NCQ Supported: True
  Spare Activation Mode: Activate on physical drive failure (default)
  Controller Temperature (C): 44
  Cache Module Temperature (C): 37
  Number of Ports: 2 Internal only
  Encryption: Disabled
  Express Local Encryption: False
  Driver Name: hpsa
  Driver Version: 3.4.4
  Driver Supports HP SSD Smart Path: True
  PCI Address (Domain:Bus:Device.Function): 0000:06:00.0
  Negotiated PCIe Data Rate: PCIe 3.0 x8 (7880 MB/s)
  Controller Mode: RAID
  Controller Mode Reboot: Not Required
  Latency Scheduler Setting: Disabled
  Current Power Mode: MaxPerformance
  Host Serial Number: 
  Sanitize Erase Supported: False
  Primary Boot Volume: logicaldrive 1 
  Secondary Boot Volume: logicaldrive 2

Physical Drives
     physicaldrive 2I:1:1 (port 2I:box 1:bay 1, Solid State SATA, 512.1 GB, OK)
     physicaldrive 2I:1:2 (port 2I:box 1:bay 2, Solid State SATA, 512.1 GB, OK)
     physicaldrive 2I:1:3 (port 2I:box 1:bay 3, Solid State SATA, 512.1 GB, OK)
     physicaldrive 2I:1:4 (port 2I:box 1:bay 4, Solid State SATA, 512.1 GB, OK)
     None attached

  Array: A
     Interface Type: Solid State SATA
     Unused Space: 0  MB (0.0%)
     Used Space: 1.9 TB (100.0%)
     Status: OK
     MultiDomain Status: OK
     Array Type: Data
     HP SSD Smart Path: disable



     Logical Drive: 1
        Size: 953.8 GB
        Fault Tolerance: 1+0
        Heads: 255
        Sectors Per Track: 32
        Cylinders: 65535
        Strip Size: 256 KB
        Full Stripe Size: 512 KB
        Status: OK
        MultiDomain Status: OK
        Caching:  Enabled
        Unique Identifier: 
        Disk Name: /dev/sda
        Mount Points: /boot 487 MB Partition Number 2, / 14.0 GB Partition Number 7
        OS Status: LOCKED
        Logical Drive Label: 
        Mirror Group 1:
           physicaldrive 2I:1:1 (port 2I:box 1:bay 1, Solid State SATA, 512.1 GB, OK)
           physicaldrive 2I:1:2 (port 2I:box 1:bay 2, Solid State SATA, 512.1 GB, OK)
        Mirror Group 2:
           physicaldrive 2I:1:3 (port 2I:box 1:bay 3, Solid State SATA, 512.1 GB, OK)
           physicaldrive 2I:1:4 (port 2I:box 1:bay 4, Solid State SATA, 512.1 GB, OK)
        Drive Type: Data
        LD Acceleration Method: Controller Cache

任何幫助表示讚賞:)


更新:我們通過從 ext4 切換到 xfs 實現了性能提升。感謝所有回答的人。

我建議將磁碟的 TagQue 增加到 256+。無論如何,應該理解 /dev/null 不需要中斷,而 SmartArray 的物理 IO 則需要。在您的範例中,具有 512B 塊大小的 380MB/s 生成 778,240 IOps。SA840 可以提供大約。基準配置 (24xSSD RAID0) 中 1M IO/s。概括一下:如果使用小塊,則不應期望高吞吐量 - 更改工具/設置以確保塊 128kB+ 用於在單個 SA840 上具有高達 5GB/s 的性能。

引用自:https://serverfault.com/questions/845054