| View previous topic :: View next topic |
| Author |
Message |
mactinosx
RAID 5
Joined: 07 Mar 2009
Posts: 18
|
 Posted: Wed Aug 26, 2009 9:18 am Post subject: error "Too many open files in system" |
 |
|
Hi all,
I have set up my Xsan 2 successfully and ready to migrate all our data from the old system to the new Xsan environment. I mounted the old data Volume (MacOS Xserve 10.4 RAID) with afp on the Desktop of my fileserver (2x 3GHz Quad-Core Intel Xeon 16 GB RAM). i open the terminal log in as root and hit the cvcp copy command:
| Code: | | cvcp -R /Volumes/Old_data/2005/ /Volumes/Xsan/ |
after a while the cvcp process stops en gives the following error:
| Code: | | cvcp: Cannot open input file '/Volumes/Old_data/2005/menutriangledown.gif' - error "Too many open files in system" |
Does anyone know how to tackle this error?
The strangest thing is: It is not always the same file. Sometimes it is a .jpg file and then it is a .gif file. And sometimes I've got no error..
(our Xsan configuration)
- 2 XSAN metadata controller (MacOS X 10.5.6)
- Xserve fileserver Reshare (MacOS X 10.5.6) AFP, SMB, ODM
- Xserve (MacOS X 10.5.6)
- Qlogic SanBox 5206 Fiber Channel Switch
- 3Com Gigabit network switch Metadata
- 2 x 16 TB VTraks
Thanx for the help!  |
|
| Back to top |
|
 |
MattG
Xsan Master
Joined: 15 Apr 2005
Posts: 456
|
| Posted: Wed Aug 26, 2009 10:06 am Post subject: |
|
|
cvcp is used to get multi-threaded performance when copying something on of off an Xsan volume, or between Xsan volumes.
Since the copy is coming off of an AFP server to an Xsan Volume, why not use cp instead? You might be getting the errors because the multi-thread copy can't open the file as many times as it would like through AFP. |
|
| Back to top |
|
|
abstractrude
Xsan Master
Joined: 13 Mar 2008
Posts: 860
|
| Posted: Wed Aug 26, 2009 12:37 pm Post subject: |
|
|
| MattG has an interesting point. That being said I have used cvcp over AFP connect but just for fun. One thing though, what is the -R switch. trying just doing cvcp -v instead. |
|
| Back to top |
|
|
mactinosx
RAID 5
Joined: 07 Mar 2009
Posts: 18
|
| Posted: Thu Aug 27, 2009 2:20 am Post subject: kATSFontTestSeverityFatalError |
|
|
Hi, Thanks for the quick respons!
Yesterday before i went to sleep, i turned on copy command again.
When i waked up i saw that the whole mdc1 server crashed and restarted spontaneously and failed over to the mdc2 server.
I quicly looked in the mdc1 logfile (see code below) and saw that the crash has something to do with many and many Fonts and .zip files what he is "scanning".
I saw also a "kATSFontTestSeverityFatalError"... Ow no! That smells like that SpotLight issue ..
| Code: | 8/26/09 6:29:05 PM /System/Library/Frameworks/CoreServices.framework/Frameworks/Metadata.framework/Versions/A/Support/mdworker[20096] zip importer countered an error (3) scanning "/Volumes/xsan/2005_/Aangeleverd.zip".
8/26/09 6:29:05 PM /System/Library/Frameworks/CoreServices.framework/Frameworks/Metadata.framework/Versions/A/Support/mdworker[20096] FontImporter: Validation failed - "/Volumes/xsan/2005/Fontsmap/Myriad Bold".
8/26/09 6:29:05 PM /System/Library/Frameworks/CoreServices.framework/Frameworks/Metadata.framework/Versions/A/Support/mdworker[20096] FontImporter: Validation Result - "<CFArray 0x3b28550 [0xa00011a0]>{type = mutable-small, count = 1, values = (
0 : <CFString 0x352f14 [0xa00011a0]>{contents = "kATSFontTestSeverityFatalError"}
)}". |
There are several articles I've seen, but what is the best way to migrate my data to the xsan in a way that Spotlight is not going to be very mad?
 |
|
| Back to top |
|
|
cedge318
Could work for Apple
Joined: 12 Jan 2009
Posts: 47
|
| Posted: Thu Aug 27, 2009 3:26 am Post subject: Re: kATSFontTestSeverityFatalError |
|
|
| mactinosx wrote: |
There are several articles I've seen, but what is the best way to migrate my data to the xsan in a way that Spotlight is not going to be very mad?
|
I doubt you need to be indexing your zipped up font files en masse. You should be able to, and I'd start with Matt's recommendation that you use something other than cvcp for the copy given that it's going over AFP. But, if you do that and it doesn't work, try creating a file called .metadata_never_index into each directory with a large number of these zipped files. Then mdworker won't have to do overtime to open the zip and import the fonts... Because of the leading . in the file name it will be hidden to users and you can always find and exec an rm on them when you're finished. |
|
| Back to top |
|
|
abstractrude
Xsan Master
Joined: 13 Mar 2008
Posts: 860
|
| Posted: Thu Aug 27, 2009 11:20 am Post subject: |
|
|
| so you never let me know.whats cvcp -R ? |
|
| Back to top |
|
|
mactinosx
RAID 5
Joined: 07 Mar 2009
Posts: 18
|
| Posted: Fri Aug 28, 2009 2:04 am Post subject: |
|
|
Hi, thanks for the respons!
Tonight i again copied the data to the xsan volume with a cvcp -vxzy,
this time i did the run on the mdc1 server. Before the run i unmounted all the volumes (so i only mounted the volume on the mdc1 server),
so Spotlight could quietly do indexing first on the background. The result was no error's..  The only difference this time was that this copy run taked several hours..
I'm glad that this worked! I was afraid that i had to do the second option as cedge318 tipped; to create a file such as .metadata_never_index..
But our data has thousands of .zip files.. 
| abstractrude wrote: | | so you never let me know.whats cvcp -R ? |
Sorry i didn't answered your question yet abstractrude, but i always use the -R because this copies the directory and the entire subtree.
Also the -R mode will continue copying even if errors are detected. This is a mode under cp (man cp)
I thought that this was also a mode under cvcp but i saw that the cvcp command doesn't 'support' that mode..
Thanks again guys! |
|
| Back to top |
|
|
lotte
Xsan Master
Joined: 11 Dec 2008
Posts: 190
|
| Posted: Tue Jan 11, 2011 10:26 am Post subject: |
|
|
Update... be aware of cvcp -R cause: The cvcp –R creates an output file filled with “0”, it is a performance test option. All the files created by cvcp –R are not usable.
lotte |
|
| Back to top |
|
|
|
Xsanity Forum
Forum Search
Forum Help
Log in to check messages
Xsanity Articles
