I am currently a Postdoctoral Research Fellow in cooperation with Prof. Shaohua Wan at the Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China (UESTC), Shenzhen, China. I received the Ph.D. degree in Computer Science from the College of Computer Science at the Chongqing University (CQU), Chongqing, China, in 2023 and the B.S. degree in Network Engineering from the School of Computer and Control Engineering at the North University of China (NUC), Taiyuan, China, in 2017. I have authored and co-authored more than 10 papers with total google scholar 
My research interests include:
- Vehicular Networks
- Vehicular Cyber-Physical Systems
- Edge Computing
- Deep Reinforcement Learning
- Game Theory
- 2023.04: My GitHub stars have reached 100!
- 2022.10: 🎉🎉 One paper is accepted by JSA!
- 2022.10: 🎉🎉 My google scholar citations have reached 100!
- 2022.09: One invention patent is granted!
- 2022.06: One paper is accepted by IEEE ITSC 2022!
Enabling Digital Twin in Vehicular Edge Computing: A Multi-Agent Multi-Objective Deep Reinforcement Learning Solution
Xincao Xu, Kai Liu, Penglin Dai, and Biwen Chen
- We present a DT-VEC architecture, where the heterogeneous information can be sensed by vehicles and uploaded to the edge node via V2I communications. The DT-VEC are modeled at the edge node, forming a logical view to reflect the physical vehicular environment.
- We model the DT-VEC by deriving an ISAC-assisted sensing model and a reliability-guaranteed uploading model.
- We formulate the bi-objective problem to maximize the system quality and minimize the system cost, simultaneously. In particular, we define the quality of DT-VEC by considering the timeliness and consistency, and define the cost of DT-VEC by considering the redundancy, sensing cost, and transmission cost.
- We propose a multi-agent multi-objective (MAMO) deep reinforcement learning solution implemented distributedly in the vehicles and the edge nodes. Specifically, a dueling critic network is proposed to evaluate the advantage of action over the average of random actions.
- Submitted to IEEE Transactions on Consumer Electronics (under review)
Cooperative Sensing and Heterogeneous Information Fusion in VCPS: A Multi-agent Deep Reinforcement Learning Approach
Xincao Xu, Kai Liu, Penglin Dai, Ruitao Xie, and Jiangtao Luo
- We present a VEC architecture, in which heterogeneous information can be cooperatively sensed and uploaded via V2I communications. Logical views can be constructed by fusing the heterogeneous information at edge nodes.
- We derive a cooperative sensing model based on the multi-class M/G/1 priority queue. On this basis, we define a noval metric AoV by modeling the timeliness, completeness, and consistency of the logical views.
- We formulate the problem, which aims at maximizing the quality of VCPS.
- We propose a multiagent DRL solution, where a difference-reward-based credit assignment is designed to divide the system reward into the difference reward for vehicles, reflecting their individual contributions.
- Submitted to IEEE Transactions on Intelligent Transportation Systems (under review)
Joint Task Offloading and Resource Optimization in NOMA-based Vehicular Edge Computing: A Game-Theoretic DRL Approach
Xincao Xu, Kai Liu, Penglin Dai, Feiyu Jin, Hualing Ren, Choujun Zhan, and Songtao Guo
- We present a NOMA-based VEC architecture, where heterogeneous resources of edge nodes are cooperated for real-time task processing.
- We derive a V2I transmission model by considering both intra-edge and inter-edge interference and formulate a cooperative resource optimization (CRO) problem by jointly optimizing real-time task offloading and heterogeneous resource allocation, aiming at maximizing the service ratio.
- We decompose the CRO into two subproblems, namely, task offloading and resource alloction. The first subproblem is modeled as an EPG with Nash equilibrium (NE) existence and converagence, and a multi-agent D4PG algorithm is proposed to achieve the NE by adopting the potential function as reward function. The second subproblem is divided into two independent convex optimization problems, and an optimal solution is proposed based on a gradient-based iterative method and KKT condition.
- Accepted by Journal of Systems Architecture (JCR Q1)
JCR: Journal Citation Reports by Clarivate Com.
SCI: Journal Partition List by National Science Library, Chinese Academy of Sciences
CCF: Recommended Publications by China Computer Federation
*: Corresponding Author
- Xincao Xu, Kai Liu*, Penglin Dai, Feiyu Jin, Hualing Ren, Choujun Zhan, and Songtao Guo, Joint Task Offloading and Resource Optimization in NOMA-Based Vehicular Edge Computing: A Game-Theoretic DRL Approach, Journal of Systems Architecture, volume 134, pp. 102780, January 2023. IF: 5.836 (2021), 4.497 (5-year) [JCR Q1|SCI Q2|CCF B]
- Chunhui Liu, Kai Liu*, Hualing Ren, Xincao Xu, Ruitao Xie and Jingjing Cao, RtDS: Real-time Distributed Strategy for Multi-period Task Offloading in Vehicular Edge Computing Environment, Neural Computing and Applications, to appear. IF: 5.606 (2020), 5.573 (5-year) [JCR Q1|SCI Q2]
- Ke Xiao, Kai Liu*, Xincao Xu, Liang Feng, Zhou Wu and Qiangwei Zhao, Cooperative Coding and Caching Scheduling via Binary Particle Swarm Optimization in Software Defined Vehicular Networks, Neural Computing and Applications, volume 33, issue 5, pp. 1467-1478, May 2021. IF: 5.606 (2020), 5.573 (5-year) [JCR Q1|SCI Q2]
- Ke Xiao, Kai Liu*, Xincao Xu, Yi Zhou and Liang Feng, Efficient Fog-assisted Heterogeneous Data Services in Software Defined VANETs, Journal of Ambient Intelligence and Humanized Computing, volume 12, issue 1, pp.261-273, January 2021. IF: 7.104 (2020), 6.163 (5-year) [JCR Q2|SCI Q3]
- Xincao Xu, Kai Liu*, Ke Xiao, Liang Feng, Zhou Wu and Songtao Guo, Vehicular Fog Computing Enabled Real-time Collision Warning via Trajectory Calibration, Mobile Networks and Applications, volume 25, issue 6, pp. 2482-2494, December 2020. IF: 2.602 (2019), 2.76 (5-year) [JCR Q2|CCF C]
- Kai Liu*, Xincao Xu, Mengliang Chen, Bingyi Liu*, Libing Wu and Victor Lee, A Hierarchical Architecture for the Future Internet of Vehicles, IEEE Communications Magazine, volume 57, issue 7, pp. 41-47, July 2019. IF: 10.356 (2018), 12.091 (5-year) [JCR Q1|SCI Q1]
- Xincao Xu, Kai Liu, Qisen Zhang, Hao Jiang, Ke Xiao and Jiangtao Luo, Age of View: A New Metric for Evaluating Heterogeneous Information Fusion in Vehicular Cyber-Physical Systems, IEEE 25th International Conference on Intelligent Transportation Systems (IEEE ITSC’22), Macau, China, October 8-12, 2022.
- Chunhui Liu, Kai Liu, Xincao Xu, Hualing Ren, Feiyu Jin and Songtao Guo, Real-time Task Offloading for Data and Computation Intensive Services in Vehicular Fog Computing Environments, IEEE International Conference on Mobility, Sensing and Networking (IEEE MSN’20), Tokyo, Japan, December 17-19, 2020.
- Yi Zhou, Kai Liu, Xincao Xu, Chunhui Liu, Liang Feng and Chao Chen, Multi-period Distributed Delay-sensitive Tasks Offloading in a Two-layer Vehicular Fog Computing Architecture, International Conference on Neural Computing and Applications (NCAA’20), Shenzhen, China, July 3-6, 2020.
- Yi Zhou, Kai Liu, Xincao Xu, Songtao Guo, Zhou Wu, Victor Lee and Sang Son, Distributed Scheduling for Time-Critical Tasks in a Two-layer Vehicular Fog Computing Architecture, IEEE Consumer Communications and Networking Conference (IEEE CCNC’20), Las Vegas, USA, January 11-14, 2020.
- Xincao Xu, Kai Liu, Ke Xiao, Hualing Ren, Liang Feng and Chao Chen, Design and Implementation of a Fog Computing Based Collision Warning System in VANETs, IEEE International Symposium on Product Compliance Engineering-Asia (IEEE ISPCE-CN’18), Hong Kong/Shengzhen, December 5-7, 2018. (Best Paper Award)
- Xincao Xu, Kai Liu*, Chunhui Liu, Hao Jiang, Songtao Guo and Weiwei Wu, Potential Game Based Channel Allocation for Vehicular Edge Computing, Tien Tzu Hsueh Pao/Acta Electronica Sinica, volume 49, issue 5, pp.851-860, July 2021. [CCF T1]
- Xincao Xu, Yi Zhou, Kai Liu, Chaocen Xiang, Yantao Li and Songtao Guo, Potenial Game based Distributed Channel Allocation in Vehicular Fog Computing Environments, 14th China Conference on Internet of Things (CWSN’20), Dunhuang, China, September 18-21, 2020. (Best Paper Candidate)
📊 Weekly development breakdown
Still Gathering Statistics...
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent