Abstract

In virtualized datacenters, the last hop switching hap-pens inside a server. As the number of virtual machines hosted on the server goes up, the last hop switch can be a performance bottleneck. This paper presents the Hyper-Switch, a highly efficient and scalable software-based network switch for virtualization platforms that support driver domains. It combines the best of the ex-isting I/O virtualization architectures by hosting device drivers in a driver domain to isolate faults and placing the packet switch in the hypervisor for efficiency. In ad-dition, this paper presents several optimizations that en-hance performance. They include virtual machine (VM) state-aware batching of packets to mitigate the costs of hypervisor entries and guest notifications, preemptive copying and immediate notification of blocked VMs to reduce packet arrival latency, and, whenever possible, packet processing is dynamically offloaded to idle pro-cessor cores. These optimizations enable efficient packet processing, better utilization of the available CPU re-sources, and higher concurrency. We implemented a Hyper-Switch prototype in the Xen virtualization platform. This prototype’s performance was then compared to Xen’s default network I/O archi-tecture and KVM’s vhost-net architecture. The Hyper-Switch prototype performed better than both, especially for inter-VM network communication. For instance, in one scalability experiment measuring aggregate inter-VM network throughput, the Hyper-Switch achieved a peak of ∼81 Gbps as compared to only ∼31 Gbps under Xen and ∼47 Gbps under KVM. 1