Recently, maybe within the last week, my Server 2016 installation has had extremely slow write speeds. I have two drives in my system. A SSD (C:) and an HDD (D:) and both have been generating Storage errors in the event log. Specifically StorDiag EventID
504, whenever a large files are being written (I've copied an example below). When observing the speeds of a large write, I can see that initially it's fine, but after a few seconds a major slow down takes place, and from then on the speed is very inconsistent.
Such a write can generate 30 or more 504 errors. There are also associated errors in the NTFS log, such as Event ID 149 which says that IO failures have taken place (also copied below).
Because this is suddenly happening to both my drives simultaneously, I doubt its a driver issue or a hardware failure issue. My initial Google searches have only related the 504 errors to Card Readers and other removable media, but not disk drives. The 504
and 149 errors implies that write operations are failing, but I just can't see why. My system is fully upgraded, and the Windows reports that drives have the latest drivers. I'll include my system configuration below.
If anyone has an idea as to what my problem is or how to troubleshoot, I would really appreciate the help. Thank you.
--------
System Configuration:
OS Name Microsoft Windows Server 2016 Datacenter
Version 10.0.14393 Build 14393
System Type x64-based PC
Processor Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz,
3401 Mhz, 4 Core(s),8 Logical Processor(s)
BIOS Version/Date American Megatrends Inc. 0301, 9/16/2011
SMBIOS Version 2.6
BIOS Mode Legacy
Motherboard ASUSTeK Computer INC.
Platform Role Workstation
Secure Boot State Unsupported
Installed Physical Memory (RAM) 16.0 GB DDR3
Total Virtual Memory 18.3 GB
Available Virtual Memory 12.5 GB
Page File Space 2.38 GB
C Drive: Boot Drive
Model INTEL SSDSA2CW120G3 (SATA SSD)
Bytes/Sector 512
Size 111.79 GB (120,031,511,040 bytes)
Free Space 44.94 GB (48,249,929,728 bytes)
D Drive:
Model ST2000DL003-9VT166 (SATA HDD)
Bytes/Sector 512
Size 1.82 TB (2,000,396,321,280 bytes)
Free Space 746.33 GB (801,364,180,992 bytes)
-------------
StorDiag Event ID 504
Log Name: Microsoft-Windows-Storage-ClassPnP/Operational
Source: Microsoft-Windows-StorDiag
Date: 6/12/2019 00:53:30
Event ID: 504
Task Category: Class
Level: Error
Keywords: Device I/O control request
User: computer\Administrator
Computer: my.computer.net
Description:
Completing a failed IOCTL request.
Event Xml:<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event"><System><Provider Name="Microsoft-Windows-StorDiag" Guid="{F5D05B38-80A6-4653-825D-C414E4AB3C68}" /><EventID>504</EventID><Version>1</Version><Level>2</Level><Task>200</Task><Opcode>101</Opcode><Keywords>0x800000040000000</Keywords><TimeCreated SystemTime="2019-06-12T04:53:30.284022800Z" /><EventRecordID>997253</EventRecordID><Correlation /><Execution ProcessID="1784" ThreadID="2336" /><Channel>Microsoft-Windows-Storage-ClassPnP/Operational</Channel><Computer>my.computer.net</Computer><Security UserID="S-1-5-21-4150441485-2800377868-2508223801-500" /></System><EventData><Data Name="DeviceGUID">{D393DD4A-6271-DA94-0AA1-DD1DE3F36251}</Data><Data Name="DeviceNumber">0</Data><Data Name="Vendor">NULL</Data><Data Name="Model">ST2000DL003-9VT166</Data><Data Name="FirmwareVersion">CC32</Data><Data Name="SerialNumber"> 6YD0GE9Q</Data><Data Name="IrpStatus">0x80000011</Data><Data Name="IoctlControlCode">0x7c088</Data></EventData></Event>
--------------
NTFS Event ID 149
In the past 3603 seconds we had IO failures.
This may indicate a failing disk.
High latency IO count: 7
Failed writes: 0
Failed reads: 0
Bad clusters relocated: 0
Volume Id: {139daef3-0000-0000-0000-100000000000}
Volume name: C:
Is boot volume: true