Publications (Google Scholar Profile)

2024

• Efficient One-Shot Pruning of Large Language Models with Low-Rank Approximation. [pdf] [code]
  IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2024. CCF-C Conference.

• Data-Efficient Knowledge Distillation with Teacher Assistant-Based Dynamic Objective Alignment. [pdf] [code]
  International Conference on Computational Science (ICCS), 2024. IIE-B Conference.

2023

• A Contrastive Self-distillation BERT with Kernel Alignment-Based Inference. [pdf] [code]
  International Conference on Computational Science (ICCS), 2023. IIE-B Conference.

• MetaBERT: Collaborative Meta-Learning for Accelerating BERT Inference. [pdf] [code]
  International Conference on Computer Supported Cooperative Work in Design (CSCWD), 2023. CCF-C Conference.