some_file_transfer_accelertion_stuff.md

Discussions

• http://www.quora.com/What-kind-of-technology-does-Filecatalyst-and-Aspera-uses-to-fast-file-transfers
• http://serverfault.com/questions/300086/file-transfer-alternatives
• http://serverfault.com/questions/111813/what-is-the-best-way-to-transfer-a-single-large-file-over-a-high-speed-high-lat
• http://forums.smallnetbuilder.com/showthread.php?t=10950

File Catalyst:

• http://www.filecatalyst.com/what-problems-are-we-solving
• http://www.filecatalyst.com/collateral/Accelerating_File_Transfers.pdf
• Customers:
  • http://www.filecatalyst.com/quicklink-and-filecatalyst-together-on-ios-and-iphone
  • http://www.filecatalyst.com/sending-large-media-files-how-free-services-stack-up (February 14, 2013)
  • http://svgeurope.org/blog/headlines/shapeshifter-taps-filecatalyst-for-large-media-file-transfer/
• Critic:
  • http://etherealmind.com/file-catalyst-unlimitech-software-dishonest-comments/
• Pricing:
  • http://www.filecatalyst.com/products/filecatalyst-workflow/workflow-pricing
• Videos

DataExp:

• http://www.dataexpedition.com/expedat/?gclid=CLqAnZKatbkCFYKS3godiEkAXw

Aspera + Amazon

• http://readwrite.com/2011/09/27/aspera-sends-your-data-directl

Comparison:

• http://www.thinkmind.org/index.php?view=article&articleid=icns_2013_2_40_10167
• http://www.thinkmind.org/download.php?articleid=icns_2013_2_40_10167
• http://www.filecatalyst.com/pride-in-our-work
  • TIXStream
  • FC Direct
  • ExpeDat

S3 Fuse

• https://code.google.com/p/s3fs/wiki/FuseOverAmazon
• https://code.google.com/p/s3fs/issues/detail?id=24
• http://www.idevelopment.info/data/AWS/AWS_Tips/AWS_Management/AWS_20.shtml#s3fs Limitations
• http://juliensimon.blogspot.de/2013/08/howto-aws-mount-s3-buckets-from-linux.html

Problems/Solutions with AWS + S3

• http://aws.typepad.com/aws/2010/12/amazon-s3-object-size-limit.html
• http://www.filecatalyst.com/what-to-know-before-moving-your-data-to-the-cloud
• http://www.turnkeylinux.org/blog/exploring-s3-based-filesystems-s3fs-and-s3backer

Airship:

• http://help.useairship.com/wiki/Home
• http://help.useairship.com/wiki/Installation
• http://help.useairship.com/wiki/License
• http://help.useairship.com/wiki/FAQ
• http://www.useairware.com/#!about/c1nmv
• http://www.useairware.com/#!client-stories/cmv5
• http://www.useairware.com/#!clients/c1szy
• http://help.useairship.com/images/4/44/AIRShip_technical_guide_v_1_2_2-2.pdf
• http://forums.smallnetbuilder.com/showpost.php?s=a429954b3fac433340e1f57b6ef3c8d2&p=74111&postcount=4

Open Source:

• How to transfer large amounts of data via network.
• http://www.filecatalyst.com/open-source-fast-file-transfers

mrsync (multicast remote sync)

• http://mrsync.sourceforge.net/
• http://sourceforge.net/projects/mrsync/files/mrsync/

GridFTP

• http://en.wikipedia.org/wiki/GridFTP
• http://www.globus.org/toolkit/docs/latest-stable/gridftp/
• http://www.globus.org/toolkit/docs/latest-stable/gridftp/gridftp.pdf

bbcp

• http://moo.nac.uci.edu/~hjm/HOWTO_move_data.html#bbcp

UDT: Breaking the Data Transfer Bottleneck

• http://udt.sourceforge.net/
• http://udt.sourceforge.net/doc.html
• http://sourceforge.net/p/udt/git/ci/master/tree/
• http://blog.verycloud.com/blog/
• http://www.hpcwire.com/hpcwire/2009-12-08/open_cloud_testbed_wins_bandwidth_challenge_at_sc09.html

Sector/Sphere

• http://sector.sourceforge.net/
• http://sector.sourceforge.net/pub/Sector-cloudcom-tutorial.pdf

Tsunami-UDP

• https://github.com/rriley/tsunami-udp
• Using Tsunami UDP in AWS- How it helps, Configuration and Comparison