About

Hi there, I am a third-year PhD student supervised by Prof. Simon Lucey at Australian Institute for Machine Learning (AIML), University of Adelaide. Prior to this, I completed my Master's degree by research in Applied Mathematics, supervised by Prof. Nir Sochen at Tel Aviv University, Israel. Before that, I earned my Bachelor's degree in Electrical and Electronic Engineering at Tel Aviv University, Israel.

My research focus on representation learning and training deep networks efficiently and effectively. I am current exploring training residual-free transformers.

"Ultimately, it comes down to taste." — Steve Jobs

Publications

* indicates equal contribution

• Cutting the skip: Training Residual-Free Transformers

  Yiping Ji, James Martens, Jianqiao Zheng, Ziqin Zhou, Peyman Moghadam, Xinyu Zhang, Hemanth Saratchandran, Simon Lucey

  Preprint 2025 Abs · Paper ·
• Always Skip Attention

  Yiping Ji, Hemanth Saratchandran, Peyman Moghadam, Simon Lucey

  ICCV 2025 Abs · Paper ·
• Efficient Learning with Sine-Activated Low-Rank Matrices

  Yiping Ji*, Hemanth Saratchandran*, Cameron Gordon, Zeyu Zhang, Simon Lucey

  ICLR 2025 Abs · Paper · Project page · Code
• Compressing Sine-Activated Low-Rank Adapters through Post-Training Quantization

  Cameron Gordon*, Hemanth Saratchandran*, Yiping Ji*, Paul Albert, Simon Lucey

  AAAI 2026 Abs · Paper ·
• Rethinking Softmax: Self-Attention with Polynomial Activations

  Hemanth Saratchandran, Jianqiao Zheng, Yiping Ji, Wenbo Zhang, Simon Lucey

  Preprint 2024 Abs · Paper ·

Education

• Ph.D. in Computer Science,University of Adelaide, 2023 -- Present
• M.Sc. in Applied Mathematics,Tel Aviv University, 2019 -- 2023
• B.Sc. in Electrical and Electronic Engineering,Tel Aviv University, 2015 -- 2019

Services

• Conference Reviewer:ICLR(2025,2026) AAAI(2026)

Teaching

• Semester 2, 2025Supervisor, Student Research Project @ University of Adelaide
• Semester 2, 2025Tutor, Statistical Machine Learning @ University of Adelaide
• Trimester 2, 2025Tutor, Using Machine Learning Tools @ University of Adelaide
• Trimester 1, 2025Tutor, Concepts in Machine Learning and Artificial Intelligence @ University of Adelaide

Miscellaneous

• I like travelling (30+ countries), cooking, photographing.