Symptom
User might see lots of drive high latency events for different drive slots in the GUI event log.
Warning 2024-01-27 17:43:27 0x12081D02 Enclosure Slot: 1 High-latency drive found (response time: 485 ms; high-latency requests: 9; last I/O direction: write).
Warning 2024-01-27 18:27:57 0x12081D02 Enclosure Slot: 7 High-latency drive found (response time: 245 ms; high-latency requests: 8; last I/O direction: write).
Warning 2024-01-27 18:28:03 0x12081D02 Enclosure Slot: 8 High-latency drive found (response time: 264 ms; high-latency requests: 9; last I/O direction: write).
Warning 2024-01-27 18:28:11 0x12081D02 Enclosure Slot: 5 High-latency drive found (response time: 209 ms; high-latency requests: 9; last I/O direction: write).
Warning 2024-01-27 18:39:35 0x12081D02 Enclosure Slot: 3 High-latency drive found (response time: 492 ms; high-latency requests: 9; last I/O direction: write).
2024-01-27 19:43:41 0x12081D02 Enclosure Slot: 2 High-latency drive found (response time: 421 ms; high-latency requests: 8; last I/O direction: write).
Warning 2024-01-27 20:39:22 0x12081D02 Enclosure Slot: 4 High-latency drive found (response time: 530 ms; high-latency requests: 7; last I/O direction: write).
Warning 2024-01-27 20:39:28 0x12081D02 Enclosure Slot: 6 High-latency drive found (response time: 297 ms; high-latency requests: 9; last I/O direction: write).
Conditions when the problem occurs
Customers may observe these high latency events in the event log under the following conditions:
- After upgrading the firmware.
- When using new machines.
Diagnosis
- Analysis of the Problem
Diagnostic tests and event logs were reviewed, revealing that the system generated numerous high latency events. The logs indicated high response times and multiple high-latency requests for various drive slots, primarily during write operations. - Possible Causes
- Firmware misinterpretation of drive responses.
- System firmware bugs leading to erroneous event generation.
- Common Scenarios
- After upgrading the firmware, users may start seeing high latency events.
- New machines exhibiting high latency warnings despite normal operations.
- Supporting Evidence
Specific log entries showed warnings such as:Warning 2024-01-27 17:43:27 0x12081D02 Enclosure Slot: 1 High-latency drive found (response time: 485 ms; high-latency requests: 9; last I/O direction: write).
–> This indicates that the system logged high latency events inaccurately.
Solution
Upgraded firmware to latest version
- Backup Important Data:
Before proceeding with the firmware upgrade, ensure you have backed up all important data to prevent any potential data loss. - Export Configuration File:
Export the current configuration file to preserve your system settings. This can be useful in case you need to restore the system settings after the upgrade. - Check Current Firmware Version:
Before upgrading, verify your current firmware version to ensure it needs updating. - Download Latest Firmware:
Access the latest firmware version from the official website or the provided link. - Follow Upgrade Instructions:
Carefully follow the firmware upgrade instructions provided in the documentation to avoid any issues during the upgrade process. - Verify Upgrade:
After upgrading, verify that the firmware update was successful by checking the firmware version again. - Monitor for Issues:
Post-upgrade, monitor the system to ensure that high latency events no longer occur.
Please refer to the link to download the latest firmware.