Some Reflection on the Iterating Method of Large Model: Parameter Count or Multimodality
Intro Nowadays, people are familiarized with large model, such as LLMs, in their daily lives. Discussions about which model should own the title of “strongest” are prevalent. AI startup enterprises are striving to optimize their models by any means necessary, including scaling model’s parameter count. As diving into this field of deep learning for more than one year, I have grown weary of this competition focused on model’s parameter count (Hereinafter referred to as NoP, Numbers of Parameter)....