A weblog for using digital video in an educational setting by Johnny Blakeborough ETC Multimedia Technicain, Vancouver Island University.

Thursday, October 14, 2004

Video Editing over Gigabit Ethernet
Centralized Digital Video Storage

Currently at Malaspina video projects are stored on the hard drives locally, if students or employees want to work at a different editing station they can't access their projects unless we move them manually using an external Firewire drive. Often the suite a project was started on will not be available when the group is. I hope to create a system of storing projects in a central location where it can be accessed from any of our suites.

To accomplish this we are planning on using an Apple Xserve running Mac OS X Server connected to the workstations running Mac OS X with 1 Gbps Gigabit Ethernet using a dedicated Gigabit switch. We could use 2 Gbps Fiber Channel for increased network speed but the cost of host bus adapters, cables, switches and specialized SAN software (such as Xsan and ImageSAN) is prohibitive compared to cost of Gigabit Ethernet (which comes standard in Apple Xserves, PowerMac G4s and G5s.) Accounts could be located on the Xserve and projects stored in the user's Movies directory.

This sort of setup should accommodate up to four SD video editing suites simultaneously or perhaps two HD video editing suites (which we have no current plans for but I will provide data for interest sake.) Gigabit Ethernet is rated at a maximum of 125 MBps, although in reality users may achieve only 60 MBps to 70 MBps due to network overhead. Standard Definition video compressed for DV is roughly 3.5 MBps. DV compressed HD video (DVCPRO HD) requires roughly 12.5 MBps of bandwidth for realtime playback. To provide enough bandwidth for editing you should multiply its bandwidth requirement by a minimum of 2 (7 MBps is the highest amount of bandwidth that one iMovie station could generate in my single workstation tests). Using that math SD video editors will require 28 MBps (3.5 * 2 * 4 workstations) and one HD video editor will require 25 MBps (12.5*2) which fits into our 60 MBps to 70 MBps achievable bandwidth with Gigabit Ethernet.

I believe the real issue will be internal bandwidth (sustained disk read/write) on the server. The G5 Xserve with a single SATA hard drive for video will only give us about 25 MBps sustainable read/write, way too slow for four simultaneous editing suites but should be able to handle two effectively. If we add a PCI Hardware RAID card and 2 more SATA hard drives it should increase performance to roughly 50 MBps sustainable read/write allowing up to five clients to edit video simultaneously.

Another issue is the Xserves currently have a maximum storage capacity of 750 GB, this sounds like tons of storrage but you never know how your needs will grow. Especially since there would be no redundancy to the data. That means if one of the 3 drives used in the 750 GB RAID were to have a problem all students in all the suites would loose all there projects. This is unexceptable. Capacity, performance and redundancy could be increased with the addition of one or more Apple Xserve Raids (up to 200 MBps read/write with a maximum storage capacity of 3500 GB per unit.) Steve Mullen has a great article on the Xserve Raid and it's real world performance at Video Systems Magazine.

I have connected the 4 workstations to the Gigabit switch which is connected to the Xserve's second Ethernet adapter. The Primary ethernet adapter is connected to the College's 10/100 mb LAN. I then set up Mac OS X Server to share it's network from the primary Ethernet to the secondary port. Later I will tackle the daunting task of setting up workstation authentication through the Xserve

I've had some experience setting up Mac OS X servers before but if I run into problems I know were I can find Help. Now if I can incorporate this system of server storage of projects with template accounts and Windows account login I will be a very happy video tech.

5 Comments:

Blogger Johnny said...

Added Clinet/Server illustration October 16, 2004.

3:53 p.m.

 
Blogger Gr said...

Johnny,

what about off campus up load to the video server it might save suite time. so a student the night before their booked time could up load the files then have all his/her video files ready to go when they walk in the door or even a ruff edit they did at home.

Greg

9:42 a.m.

 
Blogger Johnny said...

Great to here from you Greg.
The idea of uploading and downloading your video projects from home is intriguing. Unfortunately the bandwidth just isn't fast enough for this type of operation yet. The fastest broadband connection you can get at home in Canada for under $100 per month is Shaw Extreme (currently only in 6 major cities) at 1 Mbps upload. Now this is the absolute maximum, your average speed is probably going to be closer to .25 Mbps. To upload a video (not edit) in realtime you would need a connection speed of 28 Mbps (3.5 MBps * 8 to get from Bytes to bits.) That means a 1 hour video on your computer in DV would take 112 hours to upload (28 Mbps / .25 Mbps * 1 hour) on the fastest home connection. Hopefully one day home connections will be fast enough to accommodate this sort of thing but I think were still quite a few years away. The best solution for those that want to transfer video projects from home and school is to use a digital video camera to temporarily store the project, it transfers in realtime.
Thanks for your comments, I hope to hear more from you.

4:03 p.m.

 
Blogger Johnny said...

Added more detailed information from real world tests. I captured and edited SD video over a Gigagabit Ethernet network (using a PowerMac G4 800 as a file server and a PowerBook 867 as a workstation) February 18, 2005.

11:49 a.m.

 
Blogger Johnny said...

Tested Xserve RAID (1.3 TB in RAID 5) connected (with 2 GB Fiber) to a Xserve networked (with 1 GB Ethernet) to 4 G5 dual processor workstations and a MacBook Pro. All 5 stations were able to capture SD digital video to the RAID without any dropped frames. I was also able to play back video without issue from one workstation while the other 4 still captured. July 28, 2006.

11:51 a.m.

 

Post a Comment

<< Home