Hui Lu

Selected Publications

• SPIRIT: Speed-Driven Online Adaptation for Self-Speculative Decoding

  Chenghao Liu, Hui Lu, Chengbo Zhan, Jia Rao

  To appear at Conference on Neural Information Processing Systems (NeurIPS 2026)

• Courier: Host-Transparent Direct Network I/O for Secure Containers in Cloud VMs

  Hang Huang, Zhucan Ye, Zhiheng Tao, Hui Lu, Wenlong Hou, Wei Guo, Quan Xu, Jiang Liu, Jiangshan Lai, Jia Rao, Zhuo Huang, Song Wu, Chen Yu, Hai Jin

  To appear at ACM SIGOPS Annual Technical Conference (SIGOPS ATC 2026)

• Quantifying the Cost of Software-Managed Synchronization on Multi-Host CXL Memory

  Peiran Du, Weishu Deng, Yang Song, Chenfei Liao, Yujie Yang, Ren Wang, Hui Lu, Jia Rao

  To appear at The International Conference for High Performance Computing, Networking, Storage, and Analysis (SC 2026)

• vBOIDs: Taming Chaos via Coarse-Grained Scheduling Abstraction for Containers

  Kaesi Manakkal, Nathan Daughety, Yu Sun, Marcus Pendleton, and Hui Lu

  20th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2026)

• JANUS: Cross-World, Cooperative Nested Virtualization for Secure Containers

  Jiangshan Lai, Hang Huang, Quan Xu, Zhen Ren, Wenlong Hou, Wei Guo, Jia Rao, Hui Lu, Weidong Han, Jiesheng Wu, Jiang Liu, Naixuan Guan, Yibin Shen, Feng Yu, Xu Wang, Shiqiang Zhang, Zhiheng Tao, Yisheng Xie, Song Wu, Hai Jin

  20th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2026)

• Scaling Attention Beyond GPUs for LLM Inference

  Weishu Deng, Yujie Yang, Peiran Du, Lingfeng Xiang, Zhen Lin, Chen Zhong, Faraz Ahmed, Lianjie Cao, Puneet Sharma, Song Jiang, Hui Lu, and Jia Rao

  35th International Symposium on High-Performance Parallel and Distributed Computing (HPDC 2026)

• AEP: Achieving Hierarchical Fault Tolerance in DSM Through Atomic Execution Protection

  Zixuan Wang, Qi Wu, Hang Huang, Jia Rao, Hui Lu, Hao Fan, Zhuo Huang, Song Wu, Hai Jin

  21st European Conference on Computer Systems (EuroSys 2026)

• DLRover-LM: LLM Pre-Training Framework with Thousands of Accelerators in AntGroup

  Ziling Huang, Zhengmao Ye, Qingsong Cai, Zelong Huang, Bo Sang, Haitao Zhang, Jian Sha, Tingfeng Lan, Hui Lu, Yuanchun Zhou, Mingjie Tang

  42nd IEEE International Conference on Data Engineering (ICDE 2026)

• LiteShield: Secure Containers via Lightweight, Composable Userspace μKernel Services

  Kaesi Manakkal, Nathan Daughety, Marcus Pendleton, Hui Lu

  USENIX Annual Technical Conference (USENIX ATC 2025)

• DSA-2LM: A CPU-Free Tiered Memory Architecture with Intel DSA

  Ruili Liu, Teng Ma, Mingxing Zhang, Jialiang Huang, Yingdi Shan, Zheng Liu, Lingfeng Xiang, Zhen Lin, Hui Lu, Jia Rao, Kang Chen, Yongwei Wu

  USENIX Annual Technical Conference (USENIX ATC 2025)

• mLoRA: Fine-Tuning LoRA Adapters via Highly-Efficient Pipeline Parallelism in Multiple GPUs

  Zhengmao Ye, Dengchun Li, Zetao Hu, Tingfen Lan, Sha Jian, Sicong Zheng, Lei Duan, Jie Zuo, Hui Lu, Yuanchun Zhou, Mingjie Tang

  Proceedings of the VLDB Endowment (VLDB 2025)

• DLRover-RM: Resource Optimization for Deep Recommendation Models Training in Cloud

  Qinlong Wang, Tingfeng Lan, Yinghao Tang, Bo Sang, Ziling Huang, Yihen Du, Haitao Zhang, Shajian, Ke Zhang, Hui Lu, Yuanchun Zhou, Mingjie Tang

  Proceedings of the VLDB Endowment (VLDB 2024)

• Nomad: Non-Exclusive Memory Tiering via Transactional Page Migration

  Lingfeng Xiang, Zhen Lin, Weishu Deng, Hui Lu, Jia Rao, Yifan Yuan, Ren Wang

  USENIX Symposium on Operating Systems Design and Implementation (OSDI 2024)

• PVM: Efficient Shadow Paging for Deploying Secure Containers in Cloud-native Environments

  Hang Huang, Jiangshan Lai, Jia Rao, Hui Lu, Wenlong Hou, Hang Su, Quan Xu, Jiang Zhong, Jiahao Zeng, Xu Wang, Zhengyu He, Weidong Han, Jiang Liu, Tao Ma, Song Wu

  ACM Symposium on Operating Systems Principles (SOSP 2023)

• P2Cache: Exploring Tiered Memory for In-Kernel File Systems Caching

  Zhen Lin, Lingfeng Xiang, Jia Rao, Hui Lu

  USENIX Annual Technical Conference (USENIX ATC 2023)

• Parallelizing Packet Processing in Container Overlay Networks

  Jiaxin Lei*, Manish Munikar*, Kun Suo*, Hui Lu, Jia Rao

  European Conference on Computer Systems (EuroSys 2021)

• PLASMA: Programmable Elasticity for Stateful Cloud Computing Applications

  Bo Sang, Pierre-Louis Roman, Patrick Eugster, Hui Lu, Srivatsan Ravi, Gustavo Petri

  European Conference on Computer Systems (EuroSys 2020)

• BAOverlay: A Block-Accessible Overlay File System for Fast and Efficient Container Storage

  Yu Sun, Jiaxin Lei, Seunghee Shin, Hui Lu

  ACM Symposium on Cloud Computing (SoCC 2020)

Full publication list

Sponsored Projects

National Science Foundation (NSF)

• User-transparent Data Management for Persistence and Crash-consistency in Non-volatile Memories (2023–2027)
• Rethinking Virtualization in Cloud-Native Systems (2023–2028)
• Salvaging Commodity Operating Systems to Support Emerging Networking Technologies (2019–2023)

Air Force Research Laboratory (AFRL)

• Enabling Lightweight, Assured Secure Containers for Container-based Orchestration Platforms (2024–2028)

Teaching

• CSE 5359/6359: Advanced Topics in Systems & Architecture
  Fall 2026, Fall 2025, Fall 2024
• CSE 3320: Operating Systems
  Fall 2025, Fall 2024, Fall 2023
• CSE 4372/5372: RISC Processor Design
  Spring 2027, Spring 2024

Students

Current Ph.D. Students

• Yan Wang (since Fall 2025)
• Yang Song (since Fall 2025)
• Chenfei Liao (since Fall 2024)
• Chengbo Zhan (since Fall 2024)
• Kaesi Manakkal (since Fall 2023)

Alumni

• Yu Sun, Ph.D. 2025; Broadcom Inc
• Zhen Lin, Ph.D. 2025; Software Engineer, ByteDance
• Jiaxin Lei, Ph.D. 2024; Assistant Professor, Kean University