Framework for supporting multi-service edge packet processing on network processors

Raghunath, Arun; Kunze, Aaron; Johnson, Erik J.; Balakrishnan, Vinod

doi:10.1145/1095890.1095913

Cited by 10 publications

(9 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Our work is complementary to the research efforts in building programming languages [9], [14] and operating systems [22], [28], [40] for network processors. For instance, Wolf et.…”

Section: Related Workmentioning

confidence: 98%

See 1 more Smart Citation

Run-Time System for Scalable Network Services

Shevade

Kokku

Vin

2008

IEEE INFOCOM 2008 - The 27th Conference on Computer Communications

View full text Add to dashboard Cite

Sophisticated middlebox services-such as network monitoring and intrusion detection, DDoS mitigation, worm scanning, XML parsing and protocol transformation-are becoming increasingly popular in today's Internet. To support highthroughput, these services are often deployed on Distributed Memory, Multi-processor (DM-MP) hardware platforms such as a cluster of network processors. Scaling the throughput of such platforms, however, is challenging because of the difficulties and overheads of accessing persistent, shared state maintained by the services.In this paper, we describe the design and implementation of Oboe, a run-time system for DM-MP platforms that addresses the above challenge through two foundations: (1) categoryspecific management of shared state, and (2) adaptive flowlevel load distribution for addressing persistent processor overload. Our simulations demonstrate that Oboe can achieve performance within 0-5% of an ideal adaptive system. Our prototype implementation of Oboe on a cluster of IXP2400 network processors, demonstrates the scalability achieved with increasing number of processors, number of flows and state size. I. INTRODUCTIONThe designs of most modern network services follow a canonical computational model: a sequence of packets arrive at the service, get classified as belonging to a flow, undergo service-specific computation, and get forwarded to a subsequent service, a client or a server (see Figure 1). Examples of such middlebox services include network monitoring and intrusion detection [4], DDoS mitigation [24] and worm scanning [34], XML parsing [1], Enterprise Service Bus (ESB) protocol transformation, and ESB policy enforcement [1].To support high throughput (thousands to millions of packets per second), these services are often deployed on a distributed memory multi-processor (DM-MP) platform (e.g., a cluster of network processors, general-purpose processors, and co-processors [17]). The design of such platforms is guided by the following requirements: (1) scale the service throughput linearly with number of parallel processors; (2) minimize the increase in the per-packet processing time resulting from DM-MP architecture; (3) maintain intra-flow packet order even though multiple packets are processed in parallel; and (4) minimize the programming effort required to exploit parallelism on such platforms.Meeting these requirements has proved to be challenging because of three reasons. First, most of the modern network

show abstract

“…Our work is complementary to the research efforts in building programming languages [9], [14] and operating systems [22], [28], [40] for network processors. For instance, Wolf et.…”

Section: Related Workmentioning

confidence: 98%

“…al. [28] discuss mechanisms and policies for light-weight run-time adaptation on a sharedmemory multi-core system, as opposed to a distributed memory model in this paper. Related work on parallel protocol processing and cache affinity scheduling has focused on the problem of TCP processing over shared-memory hardware [7], [29], [41].…”

Section: Related Workmentioning

confidence: 99%

Run-Time System for Scalable Network Services

Shevade

Kokku

Vin

2008

IEEE INFOCOM 2008 - The 27th Conference on Computer Communications

View full text Add to dashboard Cite

show abstract

“…On the other hand, Vinod Balakrishnan, et al [ 15 ] concentrate on balancing two requirements in packet-processing applications on multi-core processors. Arun Raghunath, et al [ 2 ] present yet another approach to support network processor platforms, which are increasingly required to support a rich set of services. These multi-service systems are also subjected to widely varying and unpredictable traffic.…”

Section: Related Workmentioning

confidence: 99%

Dynamic Adaptive Self-Configurable Network Processor

Satheesh

Kumar

Krishnaveni

2010

2010 7th International Conference on Ubiquitous Intelligence &Amp; Computing and 7th International Conference on Autonomic &Amp

View full text Add to dashboard Cite

An ideal Network Processor, that is, a programmable multi-processor device must be capable of offering both the flexibility and speed required for packet processing. But current Network Processor systems generally fall short of the above benchmarks due to traffic fluctuations inherent in packet networks, and the resulting workload variation on individual pipeline stage over a period of time ultimately affects the overall performance of even an otherwise sound system. One potential solution would be to change the code running at these stages so as to adapt to the fluctuations; a near robust system with standing traffic fluctuations is the dynamic adaptive processor, reconfiguring the entire system, which we introduce and study to some extent in this paper. We achieve this by using a crucial decision making model, transferring the binary code to the processor through the SOAP protocol.

show abstract

“…The latter would be better at adapting to changing workloads. As demonstrated in [9] the ability to adapt to different workloads can significantly improve performance in the face of changing workloads.…”

Section: Backwards Compatibilitymentioning

confidence: 99%

Design of a scalable network programming framework

Wun

Crowley

Raghunath

2008

Proceedings of the 4th ACM/IEEE Symposium on Architectures for Networking and Communications Systems

Self Cite

View full text Add to dashboard Cite

Nearly all programmable commercial hardware solutions offered for high-speed networking systems are capable of meeting the performance and flexibility requirements of equipment vendors. However, the primary obstacle to adoption lies with the software architectures and programming environments supported by these systems. Shortcomings include use of unfamiliar languages and libraries, portability and backwards compatibility, vendor lock-in, design and development learning curve, availability of competent developers, and a small existing base of software. Another key shortcoming of previous architectures is that either they are not multi-core oriented or they expose all the hardware details, making it very hard for programmers to deal with. In this paper, we present a practical software architecture for high-speed embedded systems that is portable, easy to learn and use, multicore oriented, and efficient.

show abstract

Framework for supporting multi-service edge packet processing on network processors

Cited by 10 publications

References 24 publications

Run-Time System for Scalable Network Services

Run-Time System for Scalable Network Services

Dynamic Adaptive Self-Configurable Network Processor

Design of a scalable network programming framework

Contact Info

Product

Resources

About