Scientists Used AI to Create Viruses: Are We Guarding Against Dangers?

Media outlets are reporting that Stanford scientists used AI to create an artificial virus. From the Wall Street Journal story:

Artificial-intelligence systems have been displaying some eye-opening new abilities in recent weeks: breaking out of their enclosures, hacking other companies, lying to people.

And now, for the first time, an AI model has created a new virus. A whole family of them, in fact.

In a study published in the journal Science, researchers at Stanford University and elsewhere said they successfully directed an AI model to create a collection of simple viruses that only infect bacteria and pose no threat to humans.

These particular viruses may not be dangerous, but what about the next ones scientists manufacture? What about potential attempts to test their virulence in humans? The approach in the Stanford lab sure sounds like a new form of gain-of-function research to me.