Yiping Ji
Hi there, I am a second-year PhD student supervised by Prof. Simon Lucey at Australian Institute for Machine Learning(AIML), University of Adelaide. Prior to this, I completed my Master’s degree by research in Applied Mathematics, supervised by Prof. Nir Sochen at Tel Aviv University, Israel. Before that, I earned my Bachelor’s degree in Electrical and Electronic Engineering at Tel Aviv University, Israel.
My research interests lie in uncovering the mathematical processes behind deep neural networks, with the goal of developing more efficient and effective deep learning models.
Some topics that I currently focus on:
- Parameter Efficient Learning
- Transformers Architecture
- Neural Tangent Kernel and Feature Learning
News
- June 2025 “Always Skip Attention” was accepted by ICCV 2025!
- Feb 2025 Happy to attend Australia Google Research Day at Sydney
- Jan 2025 “Efficient Learning with Sine-Activated Low-Rank Matrices” was accpeted by ICLR 2025! This work is very interesting and I really like it!
Research
Rethinking Softmax: Self-Attention with Polynomial Activations
Education
- Oct. 2023 - Today, Ph.D. student in Computer Science and Mathematics, University of Adelaide, Australia
- Oct. 2019 - Jul. 2023, M.Sc in Applied Mathematics, Tel Aviv University, Israel
- Oct. 2015 - Jul. 2019, B.Sc in Electrical and Electronic Engineering, Tel Aviv University, Israel
Teaching
- Teaching Assistant: COMPSCI 7327 – Concepts in Artificial Intelligence and Machine Learning, University of Adelaide, Trimester 1, 2025
Services
- Conference Reviewer: ICLR’ 25