cheap san was (E: [NTLUG:Discuss] File Size Limit)

[Alfred Dayton]

Speaking of "cheap mans san", I am trying to find method for xfer large (25
gig) video files off a

Windows rendering workstation across network (10/100/1000) to a pc/san/nas
device.  Perhaps

Linux would provide a speedy solution???  The problem is it takes a
Loooooong time presently

Xfer from windows 2000 to windows 2000 boxes across a 10/100 mbs lan.  What
are the limiting

Factors in this scenario? I.e., would changing to 1 gig lan improve xfers or
is the bottleneck in

The hard drive/pci bus area?  I googled and checked drive mfgs for some kind
of chart or

White paper/faq on the subject matter but found none.  Compaq Server Div
several years ago had an excellent

White paper on this subject but I can not find it again.

   I am guessing that a small hardware raid stripe (3-6 drives) on each box,
whether windows or linux is going

To be the only answer to achieving realstic thruput to move the files in an
acceptably short time.  If so

Since xfers are only intermittent perhaps software raid strip would work to
keep cost down.

Thanks for any help point me in right direction.

Alfred

-----Original Message-----
From: discuss-bounces at ntlug.org [mailto:discuss-bounces at ntlug.org]On Behalf
Of gan hawk
Sent: Thursday, November 20, 2003 1:58 AM
To: discuss at ntlug.org
Subject: Re: [NTLUG:Discuss] File Size Limits


The issue is not with file system alone. Applications need to support 64 bit
addressing. Like if the application uses open() for reading files, it will
not work and you have to use open64() or set O_LARGEFILE. I learnt this the
hard way when working on a progam to image computers.
But you can file a bug with apache and they should fix it.

Ganesh

>some apps like apache will only work with less-than-2gb files. If your
>apache log
>files go over 2Gig the apache server will crash or stop logging... can't
>remember
>which.... so ever if the OS does large files... the apps might not.
>
>jack
>
>
>
> > On Wed, 2003-11-19 at 16:26, Chris Cox wrote:
> > > Kenneth Loafman wrote:
> > > > Has the 2GB file size limit been broken under Linux yet?
> > > >
> > > > If so, does it need a special kernel gen to get there?
> > > >
> > > > I'm thinking that it hasn't because size_t is still typedef'ed to an
>int
> > > > in many places, and that's 32-bit until we go to 64-bit processors.
> > > >
> > >
> > > Uhhh... yep.. broke through this quite some time ago....
> > > # ls -lh
> > > total 24G
> > > drwxr-xr-x    4 root     root          256 Nov 14 13:50 .
> > > drwxr-xr-x   25 root     root          600 Nov  3 16:32 ..
> > > -rw-r--r--    1 root     root          84M Jul 16 10:05
>9_Recommended.zip
> > > -rw-r--r--    1 root     root         9.8G Sep  2 13:21
>celap5-suse82-30G-cjc.img
> > > -rw-r--r--    1 root     root         8.1G Sep 24 16:53
>celap7-suse82-30G-cjc.img
> > > -rw-r--r--    1 root     users        5.3G Jul 24 12:46
>rh90-n610c.img.gz
> > >
> > > I know I've created larger files... just an example.
> > >
> > > This is from a SuSE 8.2 box with a 1.7TB RAID 5 using
> > > reiserfs out of the box.... no mods necessary with SuSE anyway.
> > >
> > > Samba has a "come and go" issue with 32bit limits... you'll need
> > > to have both the latest samba 2.2.8a+ and the latest kernel smbfs
>patches
> > > for it to understand more than 2G (there are other versions of
> > > Samba where it worked... it's just one of those things that
> > > comes and goes).
> > >
> > > I'm working on getting our 1st 4TB RAID setup and working.  It's
> > > split across two SuSE boxen (they can see each others stuff
> > > when needed... sort of a cheap man's SAN).
> > >
> > >
> > >
> > >
> > >
> > > _______________________________________________
> > > https://ntlug.org/mailman/listinfo/discuss
>
>
>_______________________________________________
>https://ntlug.org/mailman/listinfo/discuss

_________________________________________________________________
Need a shot of Hank Williams or Patsy Cline?  The classic country stars are
always singing on MSN Radio Plus.  Try one month free!
http://join.msn.com/?page=offers/premiumradio


_______________________________________________
https://ntlug.org/mailman/listinfo/discuss