AI like a nuclear bomb

Is the super fast development of large language models becoming like the nuclear bomb race? And whoever gets the “ultimate” level gets a new deterrence weapon?