Siyuan (Wilson) Sun孙思源
Undergraduate Student @ University of Arizona 人工智能/计算机科学本科生 @ 亚利桑那大学
About Me关于我
I am an undergraduate student at University of Arizona, majoring in AI/CS. I am currently working on natural language processing (NLP) research at CLULab and advised by Prof. Mihai Surdeanu. I am also a research intern at SJTULUMIA Lab, advised by Prof. Zhouhan Lin. 我是就读于亚利桑那大学的本科生,主修人工智能/计算机科学。目前,我主要在CLULab进行自然语言处理(NLP)研究,有幸接受Mihai Surdeanu 教授的指导。同时我正在上海交通大学林洲汉教授的LUMIA Lab实习。
My general research interests lie at the intersection of Large Language Models (LLMs) and Information Retrieval (IR), with a specific focus on memory mechanisms in LLMs. I am especially interested in how retrieval can provide LLMs with effective external memory, and how LLMs can in turn improve retrieval and other components of modern IR systems. 我的研究兴趣集中在大语言模型 (LLMs) 与信息检索 (IR) 的交叉领域,重点关注LLM的记忆机制。我特别感兴趣的是,IR如何为LLM提供有效的外部记忆,以及LLM反过来又如何改进现代IR系统。
I am preparing for Fall 2027 Ph.D./Master applications in IR and NLP. I am also actively seeking internship opportunities in both academia and industry. 我正在寻找2027年秋季入学的博士或硕士项目机会(信息检索、NLP相关方向)。我也正积极寻求实习机会。
Education教育经历
B.S. in Artificial Intelligence 人工智能 理学学士
- GPA: 3.85/4.0 GPA: 3.85/4.0
- Relevant Coursework: Deep Learning for NLP, Neural Networks, Reinforcement Learning, Principles of ML, Text Retrieval and Web Search. 相关课程:自然语言处理深度学习、神经网络、强化学习、机器学习原理、文本检索与网络搜索等。
B.S. in Artificial Intelligence 人工智能 理学学士
- Transferred to University of Arizona 转学至亚利桑那大学
Experience专业经历
Research Intern 研究实习生
- Parametric Memory for LLMs 大语言模型参数话记忆
- LLMs pretraining 大语言模型预训练
- Test-Time Training (TTT) for LLMs 大语言模型TTT
Undergraduate Research Assistant 本科生研究助理
- Optimization of Transformer-based Neural Retrieval Systems Transformer架构的神经检索模型调优
Technical Skills 技术技能
Frameworks: PyTorch; Hugging Face Transformers, Accelerate, PEFT, and TRL.
Retrieval Tools: FAISS, Elasticsearch, Milvus.
Model Training: Multi-GPU training; mixed-precision training (FP16/BF16).
Development Tools: Linux, Git. 编程语言: Python、C/C++、Java、Shell。
框架: PyTorch;Hugging Face Transformers、Accelerate、PEFT 和 TRL。
检索工具: FAISS、Elasticsearch、Milvus。
模型训练: 多 GPU 训练、混合精度训练(FP16/BF16)。
开发工具: Linux、Git。