Shadow copy services - path error on windows 7 using gpfs

Discussion:

Orlando Richards

2012-04-20 15:30:41 UTC

Hi there,

I've come across an obscure problem on a Windows 7 client when accessing
shadow copies on our samba server, which uses GPFS as the underlying
file system.

I'm using:
GPFS 3.4.0-12 (also tested with 3.4.0-7)
samba 3.6.4 from the sernet repos (also tested with 3.5.14)
RHEL 5.6 (also tested on 5.8, 6.2)
ctdb 1.0.114.4-1

The task I'm trying to perform is to copy a folder out of the shadow
copy, and place it somewhere else (say, on the desktop, which is stored
on local disk). However, when doing so I get an error window up which says:

-----
Item Not Found
Could not find this item

This is no longer located in
\\myserver.com\isg\@GMT-2012.04.20-12.00.00\iti\unix\users. Verify the
item's location and try again.

| Try Again | Cancel |
-----

"@GMT-2012.04.20-12.00.00" is the snapshot name, "isg" is the share name.

When performing the same operation under Windows XP, it works fine.

When pulling individual files out (rather than folders), it works fine.

I've attached log level = 10 dumps of the process from both the windows
XP machine (log.winxp) and the windows 7 machine (log.win7)

The big difference (my uneducated eye) can see in the logs is the
presence of the following entries in the win7 logs:

smbd_check_open_rights: Could not get acl on
@GMT-2012.04.20-12.00.00/iti/unix/users/orichard:
NT_STATUS_OBJECT_NAME_NOT_FOUND

and similar - in this context:

[2012/04/20 16:05:32.409101, 5] smbd/open.c:2597(open_directory)
open_directory: opening directory
@GMT-2012.04.20-12.00.00/iti/unix/users/orichard, access_mask = 0x81,
share_access = 0x7 create_options = 0x0, create_disposition = 0x1,
file_attributes = 0x10
[2012/04/20 16:05:32.409308, 10] modules/vfs_gpfs.c:259(gpfs_get_nfs4_acl)
gpfs_get_nfs4_acl invoked for
@GMT-2012.04.20-12.00.00/iti/unix/users/orichard
[2012/04/20 16:05:32.409518, 8] modules/vfs_gpfs.c:242(gpfs_getacl_alloc)
smbd_gpfs_getacl failed with No such file or directory
[2012/04/20 16:05:32.409647, 9] modules/vfs_gpfs.c:265(gpfs_get_nfs4_acl)
gpfs_getacl failed for
@GMT-2012.04.20-12.00.00/iti/unix/users/orichard with No such file or
directory
[2012/04/20 16:05:32.409857, 10] smbd/open.c:117(smbd_check_open_rights)
smbd_check_open_rights: Could not get acl on
@GMT-2012.04.20-12.00.00/iti/unix/users/orichard:
NT_STATUS_OBJECT_NAME_NOT_FOUND
[2012/04/20 16:05:32.410085, 10] smbd/open.c:2719(open_directory)
open_directory: smbd_check_open_rights on file
@GMT-2012.04.20-12.00.00/iti/unix/users/orichard failed with
NT_STATUS_OBJECT_NAME_NOT_FOUND
[2012/04/20 16:05:32.410250, 10] smbd/open.c:3429(create_file_unixpath)
create_file_unixpath: NT_STATUS_OBJECT_NAME_NOT_FOUND
[2012/04/20 16:05:32.410440, 10] smbd/open.c:3702(create_file_default)
create_file: NT_STATUS_OBJECT_NAME_NOT_FOUND
[2012/04/20 16:05:32.410630, 3] smbd/error.c:81(error_packet_set)
error packet at smbd/error.c(161) cmd=162 (SMBntcreateX)
NT_STATUS_OBJECT_NAME_NOT_FOUND

I'm a bit lost at this stage! - can anyone help?

Cheers,
Orlando.
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: log.win7.gz
Type: application/x-gzip
Size: 19396 bytes
Desc: not available
URL: <http://lists.samba.org/pipermail/samba-technical/attachments/20120420/55a1ee06/attachment.bin>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: log.winxp.gz
Type: application/x-gzip
Size: 24061 bytes
Desc: not available
URL: <http://lists.samba.org/pipermail/samba-technical/attachments/20120420/55a1ee06/attachment-0001.bin>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: testparm.gz
Type: application/x-gzip
Size: 3453 bytes
Desc: not available
URL: <http://lists.samba.org/pipermail/samba-technical/attachments/20120420/55a1ee06/attachment-0002.bin>

Nimrod Sapir

2012-09-13 15:26:25 UTC

Permalink

Post by Orlando Richards
Hi there,
I've come across an obscure problem on a Windows 7 client when accessing
shadow copies on our samba server, which uses GPFS as the underlying
file system.
GPFS 3.4.0-12 (also tested with 3.4.0-7)
samba 3.6.4 from the sernet repos (also tested with 3.5.14)
RHEL 5.6 (also tested on 5.8, 6.2)
ctdb 1.0.114.4-1
The task I'm trying to perform is to copy a folder out of the shadow
copy, and place it somewhere else (say, on the desktop, which is stored

Sorry for replying for such an old thread, but I had the exact same problem
lately, and the solution may be interesting to other people here. After some
research I realized that gpfs tries to resolve the paths of the snapshots
without those paths being translated by the shadow_copy module first. The
solution is very simple - put the shadow_copy2 module first in the list of vfs
modules in smb.conf. replace:

vfs objects = gpfs, fileid, shadow_copy2

with:
vfs objects = shadow_copy2, gpfs, fileid

This seems to be working for me, although I would be happy receive feedback from
other users.

Seems that there is a usability issue here. I don't see how it can be prevented
with the existing design of the vfs module logic, but it should at least be
documented.

Orlando Richards

2012-09-14 14:45:31 UTC

Permalink

Hi Nimrod,

Thanks for that - I must have missed your reply behind the 4.0.0 release
candidate announcements!

I had a go at your suggestion - but it didn't seem to help at all. I
also patched up to the latest release of 3.5 (3.5.17) to be sure, but
still no luck.

For reference - I'd love to see your full samba config (testparm -sv) -
mine's attached if you're interested.

--
Orlando

Hi Orlando
I replied to your question through the web, and thought I would forward
this to you directly, in case you don't follow the mailing list.
If this issue is still relevant - see below the solution which worked
for me. I would be happy to hear if it solves the issue in your
environment too.
Thanks
Nimrod Sapir
IBM - XIV, Israel
NAS Development Team
Office: +972-3-689-7763
Cell: +972-54-7726-320
----- Forwarded by Nimrod Sapir/Israel/IBM on 13/09/2012 18:33 -----
From: Nimrod Sapir/Israel/IBM at IBMIL
To: samba-technical at lists.samba.org,
Date: 13/09/2012 18:30
Subject: Re: Shadow copy services - path error on windows 7 using gpfs
Sent by: samba-technical-bounces at lists.samba.org
------------------------------------------------------------------------

Sorry for replying for such an old thread, but I had the exact same problem
lately, and the solution may be interesting to other people here. After some
research I realized that gpfs tries to resolve the paths of the snapshots
without those paths being translated by the shadow_copy module first. The
solution is very simple - put the shadow_copy2 module first in the list
of vfs
vfs objects = gpfs, fileid, shadow_copy2
vfs objects = shadow_copy2, gpfs, fileid
This seems to be working for me, although I would be happy receive
feedback from
other users.
Seems that there is a usability issue here. I don't see how it can be
prevented
with the existing design of the vfs module logic, but it should at least be
documented.

--
--
Dr Orlando Richards
Information Services
IT Infrastructure Division
Unix Section
Tel: 0131 650 4994

The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
-------------- next part --------------
[root at nasfe08 ~]# testparm -sv
Load smb config files from /etc/samba/smb.conf
rlimit_max: increasing rlimit_max (1024) to minimum Windows limit (16384)
Processing section "[chss]"
Processing section "[cmvm]"
Processing section "[cse]"
Processing section "[isg]"
Processing section "[ext]"
Processing section "[csg]"
Processing section "[nsu]"
Processing section "[sas]"
Loaded services file OK.
Server role: ROLE_DOMAIN_MEMBER
[global]
dos charset = CP850
unix charset = UTF-8
display charset = LOCALE
workgroup = ED
realm = ED.AC.UK
netbios name = ECDFTESTNAS
netbios aliases =
netbios scope =
server string = ECDF Test NAS Cluster
interfaces =
bind interfaces only = No
security = ADS
auth methods =
encrypt passwords = Yes
update encrypted = No
client schannel = Auto
server schannel = Auto
allow trusted domains = Yes
map to guest = Never
null passwords = No
obey pam restrictions = No
password server = 192.168.149.43 192.168.97.66 192.168.97.20 192.168.97.21 192.168.97.33
smb passwd file = /etc/samba/smbpasswd
private dir = /etc/samba
passdb backend = tdbsam
algorithmic rid base = 1000
root directory =
guest account = nobody
enable privileges = No
pam password change = No
passwd program =
passwd chat = *new*password* %n\n *new*password* %n\n *changed*
passwd chat debug = No
passwd chat timeout = 2
check password script =
username map =
password level = 0
username level = 0
unix password sync = No
restrict anonymous = 0
lanman auth = No
ntlm auth = Yes
client NTLMv2 auth = No
client lanman auth = No
client plaintext auth = No
client use spnego principal = No
preload modules =
dedicated keytab file =
kerberos method = default
map untrusted to domain = No
log level = 0
syslog = 1
syslog only = No
log file = /var/log/samba/%m.log
max log size = 1000
debug timestamp = Yes
debug prefix timestamp = No
debug hires timestamp = Yes
debug pid = No
debug uid = No
debug class = No
enable core files = Yes
smb ports = 445 139
large readwrite = Yes
max protocol = NT1
min protocol = CORE
min receivefile size = 0
read raw = Yes
write raw = Yes
disable netbios = No
reset on zero vc = No
acl compatibility = auto
defer sharing violations = Yes
nt pipe support = Yes
nt status support = Yes
announce version = 4.9
announce as = NT
max mux = 50
max xmit = 16644
name resolve order = lmhosts wins host bcast
max ttl = 259200
max wins ttl = 518400
min wins ttl = 21600
time server = No
unix extensions = No
use spnego = Yes
client signing = auto
server signing = No
client use spnego = Yes
client ldap sasl wrapping = plain
enable asu support = No
svcctl list =
deadtime = 0
getwd cache = Yes
keepalive = 300
lpq cache time = 30
max smbd processes = 0
paranoid server security = Yes
max disk size = 0
max open files = 16384
socket options = TCP_NODELAY
use mmap = Yes
hostname lookups = No
name cache timeout = 660
ctdbd socket =
cluster addresses =
clustering = Yes
ctdb timeout = 0
load printers = No
printcap cache time = 750
printcap name = /etc/printcap
cups server =
cups encrypt = No
cups connection timeout = 30
iprint server =
disable spoolss = No
addport command =
enumports command =
addprinter command =
deleteprinter command =
show add printer wizard = Yes
os2 driver map =
mangling method = hash2
mangle prefix = 1
max stat cache size = 256
stat cache = Yes
machine password timeout = 604800
add user script =
rename user script =
delete user script =
add group script =
delete group script =
add user to group script =
delete user from group script =
set primary group script =
add machine script =
shutdown script =
abort shutdown script =
username map script =
logon script =
logon path = \\%N\%U\profile
logon drive =
logon home = \\%N\%U
domain logons = No
init logon delayed hosts =
init logon delay = 100
os level = 99
lm announce = Auto
lm interval = 60
preferred master = No
local master = Yes
domain master = Auto
browse list = Yes
enhanced browsing = Yes
dns proxy = Yes
wins proxy = No
wins server = 192.168.13.14
wins support = No
wins hook =
kernel oplocks = Yes
lock spin time = 200
oplock break wait time = 0
ldap admin dn =
ldap delete dn = No
ldap group suffix =
ldap idmap suffix =
ldap machine suffix =
ldap passwd sync = no
ldap replication sleep = 1000
ldap suffix =
ldap ssl = start tls
ldap ssl ads = No
ldap deref = auto
ldap follow referral = Auto
ldap timeout = 15
ldap connection timeout = 2
ldap page size = 1024
ldap user suffix =
ldap debug level = 0
ldap debug threshold = 10
eventlog list =
add share command =
change share command =
delete share command =
preload =
lock directory = /var/lib/samba
state directory = /var/lib/samba
cache directory = /var/lib/samba
pid directory = /var/run/samba
utmp directory =
wtmp directory =
utmp = No
default service =
message command =
get quota command =
set quota command =
remote announce =
remote browse sync =
socket address = 0.0.0.0
nmbd bind explicit broadcast = Yes
homedir map = auto.home
afs username map =
afs token lifetime = 604800
log nt token command =
time offset = 0
NIS homedir = No
registry shares = No
usershare allow guests = No
usershare max shares = 0
usershare owner only = Yes
usershare path = /var/lib/samba/usershares
usershare prefix allow list =
usershare prefix deny list =
usershare template share =
panic action =
perfcount module =
host msdfs = Yes
passdb expand explicit = No
idmap backend = tdb2
idmap alloc backend =
idmap cache time = 604800
idmap negative cache time = 120
idmap uid = 1000-2000000
idmap gid = 1000-2000000
template homedir = /exports/nas/public/templatehome
template shell = /bin/bash
winbind separator = \
winbind cache time = 660
winbind reconnect delay = 5
winbind max clients = 200
winbind enum users = No
winbind enum groups = No
winbind use default domain = Yes
winbind trusted domains only = No
winbind nested groups = Yes
winbind expand groups = 1
winbind nss info = template
winbind refresh tickets = No
winbind offline logon = Yes
winbind normalize names = No
winbind rpc only = No
create krb5 conf = Yes
shadow:basedir = /exports/nas
shadow:snapdir = .snapshots
shadow:fixinodes = yes
idmap : script = /exports/nas/private/ecdf-system/NAS/samba/private/idmap.sh
nfs4: acedup = dontcare
nfs4: chown = yes
nfs4: mode = simple
gpfs:getrealfilename = no
gpfs:sharemodes = No
fileid:mapping = fsname
comment =
path =
username =
invalid users =
valid users =
admin users =
read list =
write list =
printer admin =
force user =
force group =
read only = Yes
acl check permissions = Yes
acl group control = Yes
acl map full control = Yes
create mask = 0744
force create mode = 00
security mask = 0777
force security mode = 00
directory mask = 0755
force directory mode = 00
directory security mask = 0777
force directory security mode = 00
force unknown acl user = Yes
inherit permissions = No
inherit acls = No
inherit owner = No
guest only = No
administrative share = No
guest ok = No
only user = No
hosts allow =
hosts deny =
allocation roundup size = 1048576
aio read size = 0
aio write size = 0
aio write behind =
ea support = No
nt acl support = Yes
profile acls = No
map acl inherit = Yes
afs share = No
smb encrypt = auto
block size = 1024
change notify = Yes
directory name cache size = 100
kernel change notify = Yes
max connections = 0
min print space = 0
strict allocate = No
strict sync = No
sync always = No
use sendfile = Yes
write cache size = 0
max reported print jobs = 0
max print jobs = 1000
printable = No
printing = cups
cups options =
print command =
lpq command = %p
lprm command =
lppause command =
lpresume command =
queuepause command =
queueresume command =
printer name =
use client driver = No
default devmode = Yes
force printername = No
printjob username = %U
default case = lower
case sensitive = Auto
preserve case = Yes
short preserve case = Yes
mangling char = ~
hide dot files = Yes
hide special files = No
hide unreadable = No
hide unwriteable files = No
delete veto files = No
veto files =
hide files =
veto oplock files =
map archive = No
map hidden = No
map system = No
map readonly = no
mangled names = Yes
store dos attributes = No
dmapi support = No
browseable = Yes
access based share enum = No
blocking locks = Yes
csc policy = manual
fake oplocks = No
locking = Yes
oplocks = Yes
level2 oplocks = Yes
oplock contention limit = 2
posix locking = Yes
strict locking = Auto
share modes = Yes
dfree cache time = 0
dfree command =
copy =
preexec =
preexec close = No
postexec =
root preexec =
root preexec close = No
root postexec =
available = Yes
volume =
fstype = NTFS
set directory = No
wide links = Yes
follow symlinks = Yes
dont descend =
magic script =
magic output =
delete readonly = No
dos filemode = No
dos filetimes = Yes
dos filetime resolution = No
fake directory create times = No
vfs objects = shadow_copy2, gpfs, fileid
msdfs root = No
msdfs proxy =

[chss]
comment = College of Humanities and Social Sciences
path = /exports/nas/exports/chss
valid users = "@ED\Domain Users"
read only = No

[cmvm]
comment = College of Medicine and Veterinary Medicine
path = /exports/nas/exports/cmvm
valid users = "@ED\Domain Users"
read only = No

[cse]
comment = College of Science and Engineering
path = /exports/nas/exports/cse
valid users = "@ED\Domain Users"
read only = No

[isg]
comment = Information Services Group
path = /exports/nas/exports/isg
valid users = "@ED\Domain Users"
read only = No

[ext]
comment = External Groups
path = /exports/nas/exports/ext
valid users = "@ED\Domain Users"
read only = No

[csg]
comment = Corporate Services
path = /exports/nas/exports/csg
valid users = "@ED\Domain Users"
read only = No

[nsu]
comment = Non-Specific Units
path = /exports/nas/exports/nsu
valid users = "@ED\Domain Users"
read only = No

[sas]
comment = Student and Academic Services
path = /exports/nas/exports/sas
valid users = "@ED\Domain Users"
read only = No

Nimrod Sapir

2012-10-16 16:05:06 UTC

Permalink

Hi Orlando

Sorry for taking a while to reply, I was on a long vacation...

Looking at your configuration, I can see that you are only using SMB1.
However, the problem I was having only occurred when using SMB2 supporting
client and server. I still believe the issues we both have are somehow
related, but the symptoms seem to be a bit different. Anyway, here is the
output of my basic configuration.

Nimrod Sapir
IBM - XIV, Israel
NAS Development Team
Office: +972-3-689-7763
Cell: +972-54-7726-320

From: Orlando Richards <orlando.richards at ed.ac.uk>
To: Nimrod Sapir/Israel/IBM at IBMIL,
Cc: samba-technical at lists.samba.org
Date: 14/09/2012 17:46
Subject: Re: Fw: Shadow copy services - path error on windows 7 using

gpfs

Hi Nimrod,
Thanks for that - I must have missed your reply behind the 4.0.0 release
candidate announcements!
I had a go at your suggestion - but it didn't seem to help at all. I
also patched up to the latest release of 3.5 (3.5.17) to be sure, but
still no luck.
For reference - I'd love to see your full samba config (testparm -sv) -
mine's attached if you're interested.
--
Orlando

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1338 bytes
Desc: not available
URL: <Loading Image...

>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: testparm.txt
URL: <http://lists.samba.org/pipermail/samba-technical/attachments/20121016/2b0dba3a/attachment-0001.txt>

Orlando Richards

2013-01-30 12:20:57 UTC

Permalink

Hi all,

Just an update on this - this is now working on the 3.6.10 release, with
the modules ordered as Nimrod suggests (though I haven't tried with them
the other way around).

Cheers,
Orlando

Hi Orlando
Sorry for taking a while to reply, I was on a long vacation...
Looking at your configuration, I can see that you are only using SMB1.
However, the problem I was having only occurred when using SMB2
supporting client and server. I still believe the issues we both have
are somehow related, but the symptoms seem to be a bit different.
Anyway, here is the output of my basic configuration.
Nimrod Sapir
IBM - XIV, Israel
NAS Development Team
Office: +972-3-689-7763
Cell: +972-54-7726-320

gpfs

Hi Nimrod,
Thanks for that - I must have missed your reply behind the 4.0.0 release
candidate announcements!
I had a go at your suggestion - but it didn't seem to help at all. I
also patched up to the latest release of 3.5 (3.5.17) to be sure, but
still no luck.
For reference - I'd love to see your full samba config (testparm -sv) -
mine's attached if you're interested.
--
Orlando