FAS2620 Ontap 9.7P22 - Copy Offload (ODX) not working | NetApp | Page 1

tidal radish Jul 3, 2024, 12:30 PM

#

Hey,

New here 🙂
First I want to apologize if my English isn't perfect.
I have FAS2620 with Ontap 9.7P22

The problem is we have a lot of small files and sometimes we need to copy specific folder aside, this takes lots of time since it's a lot of files, big folder size.
Another thing I've notice is when we copy the folder aside I see the same inbound/outbound traffic on my Windows NIC card.
Now this making things a lot slower so I read that there is an option "Copy Offload (ODX)" which I can enable on the vserver, on my PC when I connect to share should be SMB3.1 and ODX should be enabled on my Windows

#

This is the configuration of the vserver on the NetApp:
Vserver:
Cluster::*> vserver cifs options show -vserver Test_Cifs_Prod

Vserver: Test_Cifs_Prod

Client Session Timeout: 900
Copy Offload Enabled: true
Default Unix Group: -
Default Unix User: pcuser
Guest Unix User: -
Are Administrators mapped to 'root': true
Is Advanced Sparse File Support Enabled: true
Is Fsctl File Level Trim Enabled: true
Direct-Copy Copy Offload Enabled: true
Export Policies Enabled: false
Grant Unix Group Permissions to Others: false
Is Advertise DFS Enabled: true
Is Client Duplicate Session Detection Enabled: true
Is Client Version Reporting Enabled: false
Is DAC Enabled: -
Is Fake Open Support Enabled: true
Is Hide Dot Files Enabled: false
Is Large MTU Enabled: true
Is Local Auth Enabled: true
Is Local Users and Groups Enabled: true
Is Multichannel Enabled: false
Is NetBIOS over TCP (port 139) Enabled: true
Is NBNS over UDP (port 137) Enabled: true
Is Referral Enabled: false
Is Search Short Names Support Enabled: false
Is Trusted Domain Enumeration And Search Enabled: true
Is UNIX Extensions Enabled: false
Is Use Junction as Reparse Point Enabled: true
Max Multiplex Count: 255
Max Connections per Multichannel Session: 32
Max LIFs per Multichannel Session: 256
Max Same User Session Per Connection: 2050
Max Same Tree Connect Per Session: 4096
Max Opens Same File Per Tree: 800
Max Watches Set Per Tree: 100
Is Path Component Cache Enabled: true
NT ACLs on UNIX Security Style Volumes Enabled: true
Read Grants Exec: disabled
Read Only Delete: disabled
Reported File System Sector Size: 4096
Restrict Anonymous: no-restriction
Shadowcopy Dir Depth: 5
Shadowcopy Enabled: true
SMB1 Enabled: true
Max Buffer Size for SMB1 Message: 65535
SMB2 Enabled: true
SMB3 Enabled: true
SMB3.1 Enabled: true
Map Null User to Windows User or Group: -
WINS Servers: -
Report Widelink as Reparse Point Versions: SMB1
Max Credits to Grant: 128

#

This is to check if my Windows has this feature enabled:
PS C:\WINDOWS\system32> Get-ItemProperty hklm:\system\currentcontrolset\control\filesystem -Name "FilterSupportedFeaturesMode"

FilterSupportedFeaturesMode : 0
PSPath : Microsoft.PowerShell.Core\Registry::HKEY_LOCAL_MACHINE\system\currentcontrolset\control\f
ilesystem
PSParentPath : Microsoft.PowerShell.Core\Registry::HKEY_LOCAL_MACHINE\system\currentcontrolset\control
PSChildName : filesystem
PSDrive : HKLM
PSProvider : Microsoft.PowerShell.Core\Registry

This is also on my Windows to see the version of SMB I use:
PS C:\WINDOWS\system32> Get-SmbConnection

ServerName ShareName UserName Credential Dialect NumOpens

example.local DATA domain\user domain\user 3.1.1 1

Seems like everything is okay but still not copying on the Netapp Itself.

#

I've censored some data so you will see names like
example, domain, user instead of real names.

#

Any idea what I'm doing wrong or what should I do I will very appreciate.
Maybe upgrade Firmware? although I'm scared cause I'm new in the company I now work for and the hardware warranty is expired .

fallow cairn Jul 3, 2024, 1:08 PM

#

some features are incompatible with ODX. For example if you have compression enabled and the compression type is secondary, ODX will be disabled

Requirements for using ODX

Before you can use ODX for copy offloads with your storage virtual machine (SVM), you need to be aware of certain requirements.

tidal radish Jul 3, 2024, 1:17 PM

#

fallow cairn some features are incompatible with ODX. For example if you have compression ena...

Thank you for your reply.
you mean compression on the NetApp itself?

I'm checking it...

#

don't know how but i'm on it 🙂

fallow cairn Jul 3, 2024, 1:20 PM

#

yeah, set advanced; volume efficiency show -vserver ... -volume ... -fields compression-type

tidal radish Jul 3, 2024, 1:22 PM

#

Cluster::*> volume show -volume svm_prod_cifs -fields compression
Error: Ambiguous argument. Possible matches include:
Fields:
compression-space-saved
compression-space-saved-percent

fallow cairn Jul 3, 2024, 1:23 PM

#

if that's not it, then I have no idea. I know ODX was a bit tricky to get working in the past but these days it should be pretty straightforward. in fact I had it "just work" on a 2620 system yesterday

tidal radish Jul 3, 2024, 1:23 PM

#

"compression-type" not exists

fallow cairn Jul 3, 2024, 1:23 PM

#

did you do the set advanced?

tidal radish Jul 3, 2024, 1:24 PM

#

set -privilege advanced

#

will do again

fallow cairn Jul 3, 2024, 1:24 PM

#

also it's volume efficiency show and not volume show

tidal radish Jul 3, 2024, 1:24 PM

#

don't remember if reconnected

#

okay, i was on advanced mode

#

okay okay

#

checking

#

says compression-type = secondary

#

it is not supported then

#

i wonder if i can change the type of the volume without losing data

#

I found it's possible 🙂

fallow cairn Jul 3, 2024, 1:35 PM

#

yeah you "just" have to uncompress all data, change the compression type, and then re-compress everything. might take a few hours (or days, depending on the size of the data 😉 )

#

we did that in the past a couple of times. it's annoying but doable online without impact

tidal radish Jul 3, 2024, 1:36 PM

#

Yes I've found the command for changing it but I wonder something... I saw in the link you gave me it says

#

only compression group size 8K is supported.

#

this is what i'm trying to find out right now

fallow cairn Jul 3, 2024, 1:38 PM

#

yeah. when re-enabling compression after undoing it all, you should be in diag mode (set diag) and then there's a flag -application-io-size 8K to the volume efficiency modify command. I think 8K is also the default, but just to make sure I would suggest you add it to the command as well

tidal radish Jul 3, 2024, 1:38 PM

#

Thank you hug

#

🙂

hot mantle Jul 3, 2024, 1:39 PM

#

Copy offload won't necessarily improve performance.

#

NFS might do better on Linux just because it's more efficient with better caching.

#

Or I'd use a utility like Robocopy/XCP where you can multithread the copy.

fallow cairn Jul 3, 2024, 1:40 PM

#

hot mantle Copy offload won't necessarily improve performance.

it usually does, but not very much I agree. I could get like 250mb/s through a single 1g link when copying from one volume to another on the same filer

#

I think it was basically limited by the speed of the disks at this point

#

...as the ONTAP system still has to actually do the copy (i.e. no reflinking/WAFL pointer magic in the backend)

tidal radish Jul 3, 2024, 1:43 PM

#

The user is running Windows
he has mapped drive to some \fqdn\sharename
and he want to copy big folders with a lot of small files aside as a backup.

the reason why is complicate for me to explain
but then he sits like an hour or even more doing nothing just waiting for it to finish.

i thought i saw on his network card 150mbps in+out all the time during the copy.

i believe if all will be directly on the netapp it will take less time, don't know how much less but.... less
🙂

#

250mbps he get this speed if he copy new file like 5GB ISO file to the share

fallow cairn Jul 3, 2024, 1:45 PM

#

yeah so you can assume ODX will get you maximum around that speed also

hot mantle Jul 3, 2024, 1:51 PM

#

If he's across a WAN ODX makes sense.

#

Again for faster speeds use XCP/Robocopy, and make sure the client is as close to the filer as possible.

#FAS2620 Ontap 9.7P22 - Copy Offload (ODX) not working