LambdaBridge: A Scalable Architecture for Future Generation Terabit Applications

Abstract

Abstract-LambdaGrid applications as typified by data-intensive collaborative visualization are likely to be the first users of terabit-level networking. This paper features a main enabler of collaborative visualization over LambdaGrid, the Scalable Adaptive Graphics Environment (SAGE) in particular, and anticipates the future needs of LambdaGrid applications in general. We present a scalable architecture called LambdaBridge to 'bridge' LambdaGrid applications with the terabit optical core networks. LambdaBridge will provision and control predictableperformance networks for end-systems (i.e. Grid clusters) using on-demand lambda/VLAN provisioning and end-system traffic shaping. The chief contribution of LambdaBridge is a deep understanding of how to synergistically bridge provisionable networks, end-systems, and future generation distributed terabit applications. This paper also introduces Scalable Visualcastinga multicasting service for LambdaGrid that incorporates IP multicasting and optical multicasting.

KOLAM: a cross-platform architecture for scalable visualization and tracking in wide-area imagery

“…Such ultra large-scale visualization initiatives are currently being used with infrastructures such as the OptiPlanet Collaboratory. 31,35 This persistent, distributed visualization cyberinfrastructure connects a series of OptIPortals, 34,35 which are tiled displays that comprise the visual interfaces to OptIPuters. 27,34 These large scale visualization and analysis systems seek to create a synergistic combination between dense displays, high-speed networking, remote storage containing extremely large scientific datasets, distributed processing, data mining and visualization.…”

“…26 Based on the ability of the human visual system to rapidly identify patterns and discern differences, especially when the targeted data is extremely large, extensive research has been performed regarding the visualization of high-resolution imagery on tiled displays. [27][28][29][30][31][32][33][34][35][36][37][38] Architectures such as SAGE 29,33,38 and DIGI-Vis; 37 and applications such as JuxtaView 30 and Giga-Stack 36 seamlessly display a number of visualization applications over the entire tiled display. The primary goal of such systems is to support application heterogeneity and scalability by decoupling the graphics rendering and display processes from each other, and by utilizing high-bandwidth lambda networks to bridge them.…”

Terabit/s-scalable end-to-end parallel networking architecture (TLAN) based on virtual optical resource control

“…Multi-channel streaming of such large streams requires a bandwidth of 100Gbps to 1Tbps. TLAN aims to support high-end scientific application users [2] who, for example, may want to transfer over ten sets of 4K camera streams for sharing and discussion by collaborators in different remote sites; such images may be displayed using SAGE [4]. TLAN is considered as "Terabit/s-scalable end-to-end parallel networking architecture for high-end scientific applications."…”

“…Optical interfaces for over 10Gbps are another part of the trend to parallel processing, and 40Gbps Ethernet and 100Gbps Ethernet standards are adopting some form of parallel physical layer connections. Our research target is to realize the terabit-scalable end-to-end parallel networking architecture called TLAN [1][2][3]. TLAN uses the concepts of multi-rail and multi-lane.…”

KOLAM : human computer interfaces fro visual analytics in big data imagery

“…Additionally, work has been done towards rapid post-processing of gigapixel imagery utilizing an efficient parallel programming methodology [13]. Based on the ability of the human visual system to rapidly identify patterns and discern differences, especially when the targeted data is extremely large, extensive research has been performed regarding the visualization of high-resolution image planes on tiled displays [14][15][16][17][18][19][20][21][22][23][24]. Architectures such as SAGE [16,20,25] (See Figure 1.4) and DIGI-Vis [24]; and applications such as JuxtaView [17] (See Figure 1.4) and Giga-Stack [23] seamlessly display a number of visualization applications over the entire tiled display.…”