Hello All,
SETUP:
In our organisation we installed 2 node, 2-way mirror, all NVme S2D. On top of S2D we have SOFS role, and we have second "Compute" cluster witch saves all VHD's on that share. Vhd are stored on Volume01, general share is on Volume02,
Backup Volume03 (all with dedicated SOFS role).
Problem that we face was not noticed until we migrated all of our VM from old cluster to new one. So now our problem is even worse than before.
PROBLEM:
When we copy files on any of our shares "some" files "cannot" be deleted. We delete files and they lose all Security (no owner or any other security) but files are still visible on storage but we cannot do anything with them. For
first we thought it is security rights issue but then we tried to "Take offline" one of Cluster volumes and bring it online. And problematic files disappear.
Problem still persist and we cannot take our volume offline and online just for deleting files !! ...files that wont be deleted are in most cases .iso, .exe, but there was some .pdf and so on. What is Interesting, we were doing some test for user folder
redirection (documents, desktop, pictures), and if user puts same file (that won t be deleted) inside redirected folder user can delete it and there is no problem. But if you access same file outside user machine a try to delete it ... \\sofs01\volume02\share\folder_redirection\user\desktop\file.zip (and i give myself ownership or without same problem) after i click delete file disappears for second or two and appears again, but file is unusable. Can t do nothing with it. User can't see it in it's shared folder cannot copy new file with same
name or extansion i that folder either, while i can still see file on \\sofs01\volume02\share\folder_redirection\user\desktop\file.zip path outside users pc. So we turn of and on volume and file is no more.
Some details of S2D:
Get-ClusterS2D | FL
CacheMetadataReserveBytes : 34359738368
CacheModeHDD : ReadWrite
CacheModeSSD : WriteOnly
CachePageSizeKBytes : 16
CacheState : Disabled
Name : HCLSS2D01
ScmUse : Cache
State : Enabled
------------------------------
Get-VirtualDisk
FriendlyName ResiliencySettingName FaultDomainRedundancy OperationalStatus HealthStatus Size FootprintOnPool StorageEfficiency
------------ --------------------- --------------------- ----------------- ------------ ---- --------------- -----------------
Volume02 Mirror 1 OK Healthy 4 TB 8 TB 49,99%
Volume03 Mirror 1 OK Healthy 2 TB 4 TB 49,98%
Volume01 Mirror 1 OK Healthy 10 TB 20 TB 50,00%
ClusterPerformanceHistory Mirror 1 OK Healthy 16 GB 34 GB 47,06%
--------------------------------------
Get-StoragePool -FriendlyName "S2D on HCLSS2D01" | FL
ObjectId : {1}\\HCLSS2D01\root/Microsoft/Windows/Storage/Providers_v2\SPACES_StoragePool.ObjectId="{2c461cff-2d46-4283-8baf-f08f9ebe9d51}:S
P:{e2e70bb7-158f-4273-88a6-528eef21e90e}"
PassThroughClass :
PassThroughIds :
PassThroughNamespace :
PassThroughServer :
UniqueId : {e2e70bb7-158f-4273-88a6-528eef21e90e}
AllocatedSize : 35235911696384
ClearOnDeallocate : False
EnclosureAwareDefault : False
FaultDomainAwarenessDefault : StorageScaleUnit
FriendlyName : S2D on HCLSS2D01
HealthStatus : Healthy
IsClustered : True
IsPowerProtected : True
IsPrimordial : False
IsReadOnly : False
LogicalSectorSize : 4096
MediaTypeDefault : Unspecified
Name :
OperationalStatus : OK
OtherOperationalStatusDescription :
OtherUsageDescription : Reserved for S2D
PhysicalSectorSize : 4096
ProvisioningTypeDefault : Fixed
ReadOnlyReason : None
RepairPolicy : Parallel
ResiliencySettingNameDefault : Mirror
RetireMissingPhysicalDisks : Never
Size : 102385846321152
SupportedProvisioningTypes : Fixed
SupportsDeduplication : True
ThinProvisioningAlertThresholds : {70}
Usage : Other
Version : Windows Server 2019
WriteCacheSizeDefault : Auto
WriteCacheSizeMax : 18446744073709551614
WriteCacheSizeMin : 0
PSComputerName :
----------------
All disks healthy and operational status OK.
Please Help, we are out of ideas and this problem only happends on brand new high availability S2D.
Thanks all helpers in advance :)