FAST TCP Steven LowCS/EEnetlab.CALTECH.eduFAST Protocols for Ultrascale Networksnetlab.caltech.edu/FASTInternet: distributed feedback control system TCP: adapts sending rate to congestion AQM: feeds back congestion informationRf(s)Rb’(s)x))((1llllctycp −=&())()(1)( tan)( )()(1-2tqtttTwxiidtqtxiiiiiii&&κηα−−=ypqTCP AQMTheoryCalren2/AbileneChicagoAmsterdamCERNGenevaSURFNetStarLightWAN in LabCaltechresearch & production networksMulti-Gbps50-200ms delayExperimentStudentsChoe (Postech/CIT)Hu (Williams)J. Wang (CDS)Z.Wang (UCLA)Wei (CS)IndustryDoraiswami (Cisco)Yip (Cisco)FacultyDoyle (CDS,EE,BE)Low (CS,EE)Newman (Physics)Paganini (UCLA)Staff/PostdocBunn (CACR)Jin (CS)Ravot (Physics)Singh (CACR)PartnersCERN, Internet2, CENIC, StarLight/UI, SLAC, AMPATH, Cisco People155Mb/sslowstartequilibriumFASTrecoveryFASTretransmittimeout10Gb/sImplementationnetlab.caltech.eduFAST project Protocols for ultrascale networks >100 Gbps throughput, 50-200ms delay Theory, algorithms, design, implement, demo, deployment Faculty Doyle (CDS, EE, BE): complex systems theory Low (CS, EE): PI, networking Newman (Physics): application, deployment Paganini (EE, UCLA): control theory Research staff 4 postdocs, 5 engineers, 8 students Collaboration Cisco, Internet2/Abilene, CERN, DataTAG (EU), … Funding NSF, DoE, Lee Center (ARO, Cisco)netlab.caltech.eduOutline Motivation Experiment Implementation WAN in Labnetlab.caltech.eduHigh Energy Physics Large global collaborations2000 physicists from 150 institutions in >30 countries300-400 physicists in US from >30 universities & labs SLAC has 500TB data by 4/2002, world’s largest database Typical file transfer ~1 TBAt 622Mbps: ~ 4 hrsAt 2.5Gbps: ~ 1 hrAt 10Gbps: ~15minGigantic elephants! LHC (Large Hadron Collider) at CERN, to open 2007Generate data at PB (1015B)/secFiltered in realtime by a factor of 106to 107Data stored at CERN at 100MB/secMany PB of data per yearTo rise to Exabytes (1018B) in a decadenetlab.caltech.eduHEP high speed network…that must changenetlab.caltech.eduHEP Network (DataTAG)NLNLSURFnetGENEVAUKUKSuperJANET4ABILENEABILENEESNETESNETCALRENCALRENItItGARR-BGEANTNewYorkFrFrRenaterSTAR-TAPSTARLIGHTWave Triangle 2.5 Gbps Wavelength Triangle 2002 10 Gbps Triangle in 2003Newman (Caltech)netlab.caltech.eduNetwork upgrade 2001-06’01155’02622’032.5’045’0510netlab.caltech.eduProjected performanceNs-2: capacity = 155Mbps, 622Mbps, 2.5Gbps, 5Gbps, 10Gbps100 sources, 100 ms round trip propagation delay’01155’02622’032.5’045’0510J. Wang (Caltech)netlab.caltech.eduProjected performanceNs-2: capacity = 10Gbps100 sources, 100 ms round trip propagation delayFASTTCP/REDJ. Wang (Caltech)netlab.caltech.eduOutline Motivation Experiment Implementation WAN in Labnetlab.caltech.eduNetwork(Sylvain Ravot, caltech/CERN)netlab.caltech.eduNetwork(Sylvain Ravot, caltech/CERN)netlab.caltech.eduFAST BMPSInternet2Land SpeedRecordFAST12127910Geneva-SunnyvaleBaltimore-Sunnyvale#flowsFAST Standard MTU Throughput averaged over > 1hrnetlab.caltech.eduFAST BMPSFairbanks, AL –Amsterdam, NL0.625 13--12,2724014.92 1Alaska-Amsterdam9.4.20021,5001,5001,5001,5001,5004,470MTUB858585180180 -Delayms21,6473,72515,3967533878.4 TransferGBBaltimore -Sunnyvale21,6003,9488,60933.9910Caltech-SLAC20.11.2002Baltimore -Sunnyvale4,0303,9487,94031.359Caltech-SLAC19.11.2002Baltimore -Sunnyvale21,6003,9486,12324.177Caltech-SLAC18.11.2002CERN -Sunnyvale3,60010,0371,79718.032Caltech-SLAC19.11.2002CERN -Sunnyvale3,60010,0379259.281Caltech-SLAC19.11.2002MS, WA –ISI, Va82 5,626 9575.382MS-ISI29.3.2000PathDurationsDistancekmThruputMbpsBmpsPetaflowsMbps = 106b/s; GB = 230bytesnetlab.caltech.eduAggregate throughput1 flow 2 flows 7 flows 9 flows 10 flowsAverage utilization95%92%90%90%88%FAST Standard MTU Utilization averaged over > 1hr1hr 1hr6hr1.1hr 6hrSCinetCaltech-SLAC experimentsnetlab.caltech.edu/FASTSC2002Baltimore, Nov 2002ExperimentSunnyvale BaltimoreChicagoGeneva3000km1000km7000kmC. Jin, D. Wei, S. LowFAST Team and PartnersInternet: distributed feedbacksystemRf(s)Rb’(s)xpTCP AQMTheoryFAST TCP Standard MTU Peak window = 14,255 pkts Throughput averaged over > 1hr 925 Mbps single flow/GE card9.28 petabit-meter/sec1.89 times LSR 8.6 Gbps with 10 flows34.0 petabit-meter/sec6.32 times LSR 21TB in 6 hours with 10 flowsImplementation Sender-side modification Delay basedHighlights12127910Geneva-SunnyvaleBaltimore-SunnyvaleFASTI2 LSR#flowsnetlab.caltech.eduFAST vs Linux TCPCERN -Sunnyvale13336001,50018010,0373173.182Linux TCPtxqueulen=100CERN -Sunnyvale3903600 1,50018010,037 9319.352Linux TCPtxqueulen=10000CERN -Sunnyvale78 36001,50018010,0371851.86 1Linux TCPtxqueulen=1001,5001,5001,500MTUB180180 180Delayms753387111 TransferGBCERN -Sunnyvale360010,0371,79718.032FAST19.11.2002CERN -Sunnyvale360010,0379259.281FAST19.11.2002CERN -Sunnyvale3600 10,037 2662.671Linux TCPtxqueulen=10000PathDurationsDistancekmThruputMbpsBmpsPetaflowsMbps = 106b/s; GB = 230bytes; Delay = propagation delayLinux TCP expts: Jan 28-29, 2003netlab.caltech.eduAggregate throughputLinux TCP Linux TCP FASTAverage utilization19%27%92%FAST Standard MTU Utilization averaged over 1hrtxq=100 txq=1000095%16%48%Linux TCP Linux TCP FAST2G1Gnetlab.caltech.eduCaltech-SLAC entryRapid recoveryafter possiblehardware glitchPower glitchReboot100-200Mbps ACK trafficSCinetCaltech-SLAC experimentsnetlab.caltech.edu/FASTSC2002Baltimore, Nov 2002Acknowledgments PrototypeC. Jin, D. Wei TheoryD. Choe (Postech/Caltech), J. Doyle, S. Low, F. Paganini (UCLA), J. Wang, Z. Wang (UCLA) Experiment/facilities Caltech: J. Bunn, C. Chapman, C. Hu (Williams/Caltech), H. Newman, J. Pool, S. Ravot (Caltech/CERN), S. Singh CERN: O. Martin, P. Moroni Cisco: B. Aiken, V. Doraiswami, R. Sepulveda, M. Turzanski, D. Walsten, S. Yip DataTAG: E. Martelli, J. P. Martin-Flatin Internet2: G. Almes, S. Corbato Level(3): P. Fernes, R. Struble SCinet: G. Goddard, J. Patton SLAC: G. Buhrmaster, R. Les Cottrell, C. Logg, I. Mei, W. Matthews, R. Mount, J. Navratil, J. Williams StarLight: T. deFanti, L. Winkler Major sponsorsARO, CACR, Cisco, DataTAG, DoE, Lee Center, NSFnetlab.caltech.eduConnections that leaves broadband in the dustApril 7, 2003Pushing the speed limit: for
View Full Document
Unlocking...