Leveraging InfiniBand for Highly Concurrent Messaging in Java Applications

Nothaas, Stefan; Beineke, Kevin; Schoettner, Michael

doi:10.1109/ispdc.2019.00013

Cited by 3 publications

(2 citation statements)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…C-verbs are the native verbs implementation included in the OFED package [13]. Using the Java Native Interface (JNI) [30], this library can be utilized in Java applications as well in order to create a custom network subsystem [22] [34]. Using the Unsafe class [32] or Java DirectByteBuffers, memory can be allocated off-heap to use it for sending and receiving data with InfiniBand hardware (buffers must be registered with a protection domain which pins the physical memory).…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

A Benchmark to Evaluate InfiniBand Solutions for Java Applications

Nothaas¹,

Ruhland²,

Schöttner³

2019

Preprint

Self Cite

View full text Add to dashboard Cite

Low-latency network interconnects, such as Infini-Band, are commonly used in HPC centers and are even accessible with todays cloud providers offering equipped instances for rent. Most big data applications and frameworks are written in Java. But, the JVM environment alone does not provide interfaces to directly utilize InfiniBand networks.In this paper, we present the "Java InfiniBand Benchmark" to evaluate the currently available (and supported) "low-level" solutions to utilize InfiniBand in Java. It evaluates socket-and verbs-based libraries using typical network microbenchmarks regarding throughput and latency. Furthermore, we present evaluation results of the solutions on two hardware configurations with 56 Gbit/s and 100 Gbit/s InfiniBand NICs. With transparency often traded for performance and vice versa, the benchmark helps developers with studying the pros and cons of each solution and support them in their decision which solution is more suitable for their existing or new use-case.

show abstract

Section: Related Workmentioning

confidence: 99%

“…MPI. We discuss and evaluate these in a separate publication [34]. We used our benchmark to evaluate the listed solutions on two hardware configurations with 56 Gbit/s and 100 Gbit/s InfiniBand NICs.…”

Section: Introductionmentioning

confidence: 99%