This is the mail archive of the cygwin mailing list for the Cygwin project.


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]
Other format: [Raw text]

Re: Rsync and the two latest snapshots


On Mon, Aug 13, 2007 at 06:20:05PM +0100, Thorsten Kampe wrote:
>* Corinna Vinschen (Mon, 13 Aug 2007 17:12:39 +0200)
>> On Aug 10 15:33, Corinna Vinschen wrote:
>> > On Aug 10 14:14, Thorsten Kampe wrote:
>> > > * Corinna Vinschen (Fri, 10 Aug 2007 13:30:45 +0200)
>> > > > On Aug  9 19:23, Thorsten Kampe wrote:
>> > > > > rsync: recv_generator: failed to stat "/cygdrive/j/thorsten/backup/usb/data/in
>> > > > > stall/thebat/imap/IMAP-Einstellungen und Erkl\#344rung der verschiedenen Punkt
>> > > > > e/atb_team.gif": Bad address (14)                                             
>> > > > 
>> > > > Erm... you didn't tell about this "Bad address" error.
>> > > 
>> > > These are just German Umlauts and in my opinion not connected to the "too many open files" errors.
>> > 
>> > "Bad address" is a serious error message (accessing an invalid memory
>> > address) and, even *if* they are due to the german umlauts, it's probably
>> > worth to find out what's causing it.
>> > 
>> > > > > rsync: recv_generator: mkdir "/cygdrive/j/thorsten/backup/usb/data/install/usb
>> > > > > 2" failed: Too many open files (24)                                           
>> Ok, I'm almost sure I found the cause of the problem.  Due to an unlucky
>> combination of function calls, my new code filled up the internal heap
>> of the DLL without ever freeing the mmeory again, for each file access.
>> Since the internal heap is rather big by default, you only encounter this
>> problem for long running processes accessing lots of files.
>> 
>> I've checked in a patch.  Please give the next developer snapshot
>> another try.
>
>Yes, it's fixed now, thanks. You've also done some magic because the 
>whole rsync file transfer runs about 2 - 6 times faster than it used 
>to. It's amazing.

Does rsync use pipes by any chance?  If so, that may be at least part of the reason
since that code has been revamped.

cgf

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]