Pennsylvania State University
Jun. 2022 - Oct. 2022 Research collaborator · Mentor: Wenpeng Yin
- Studied robustness of learning from task instructions.
- Experimented with and analyzed instruction-tuned models under perturbed instructions.
North Carolina State University
Aug. 2022 - 2023 Research collaborator · Mentor: Dongkuan Xu and Xipeng Shen
- Worked on zero-shot code generation via rule-AI co-learning from documents.
- Proposed a framework combining rule-based and AI-based methods to generate DSL code.
Shanghai Jiao Tong University
Apr. 2023 - Jun. 2023 Research collaborator · Mentor: Pengfei Liu
- Trained LLaMA-13B through continued pretraining and finetuning on curated math datasets.
- Improved model performance on mathematical reasoning tasks.
University of Southern California
Aug. 2022 - Dec. 2022 Research collaborator · Mentor: Peter A. Beerel
- Designed visual networks with very low FLOPs.
- Proposed and evaluated dilated depthwise convolution for capturing global information.
Dartmouth College
May 2022 - Sep. 2022 Research collaborator · Mentor: Soroush Vosoughi
- Analyzed the evolution of artificial intelligence techniques in biomedical publications.
- Developed an analysis method for biomedical AI publication trends.
ETH Zurich
Jun. 2020 - Oct. 2020 Research collaborator · Mentor: Yuyi Wang
- Designed pre-training tasks for text summarization.
- Used learned metrics to identify high-importance sentences as summaries for more effective pre-training.