• Google-owned DeepMind, an AI startup based in London, is facing some backlash from the scientific community after announcing its AlphaFold program was a "solution" to the protein folding problem. 
  • DeepMind researchers announced on Monday it had successfully modeled complex protein structures – and suggested its findings could revolutionize drug discovery and medicine forever.
  • While a number of independent academics hailed the breakthrough, several said it wasn't clear how well AlphaFold would work in the real world.
  • John Moult, chair of the academic competition which heralded DeepMind's breakthrough, defended the findings, telling Business Insider he had looked at the results 'very carefully'. 
  • Visit Business Insider's homepage for more stories.

Academics and researchers are debating claims by Google-owned AI firm DeepMind that it's solved one of the toughest problems in biology, warning against overhyping the breakthrough.

On Monday, DeepMind said it had broken new ground in understanding the behavior of microscopic proteins, saying its AlphaFold artificial intelligence program could reliably predict their shape, effectively solving a problem that's plagued scientists for decades.

Professor Venki Ramakrishnan, a previous winner of the Nobel Prize for chemistry, hailed the results as a "stunning" achievement.

And DeepMind's team wrote in a blog on Monday: "This breakthrough demonstrates the impact AI can have on scientific discovery and its potential to dramatically accelerate progress in some of the most fundamental fields that explain and shape our world."

But some academics are skeptical of how much DeepMind's claims should be hyped as a "solution" to the protein-folding problem. They called on DeepMind to put AlphaFold's code into the public domain, and said it wasn't clear how the program would perform outside a narrow setting.

DeepMind's breakthrough was part of CASP (Critical Assessment of Structure Prediction), a global competition specifically set up to test research teams on their ability to predict a protein's shape from its sequence of amino acids.

Speaking to Business Insider, Max Little, an associate professor and senior lecturer in computer science at the University of Birmingham, said DeepMind's AI had only shown potential "within the context of the CASP database challenge".

He said: "We can't really be sure how well AlphaFold will work when faced with the far more rich and varied array of proteins found in the real world of living organisms."

Here's what DeepMind did

DeepMind AlphaFold GIF
DeepMind demonstrating its AlphaFold program is able to predict protein structures with a high degree of accuracy.
DeepMind

Proteins are a key building block for life on Earth, found in humans, animals, plants, and microscopic organisms. They are invisible to the human eye, and constantly rearranging themselves, which makes studying and predicting their behavior hard. 

The way proteins move around (or "fold") inside your body — transforming from a string of amino acids into more complicated 3D structures — has big implications for your health, and is linked to everything from Alzheimer's to the flu. That's why scientists have spent the better part of 50 years trying to predict their movement. 

If you already know how a protein will behave, they say, you could theoretically alter its behavior. For example, by stopping a misfolding protein in its tracks, you might save its host from contracting a neurodegenerative disease like Parkinson's. Equally, you could better target medical treatment because you have a better idea of how an individual's body would react, staving off any nasty side effects in advance.  

In 2018, DeepMind first entered AlphaFold into CASP, but the results weren't deemed concrete enough to be medically useful.

This year, the latest version of AlphaFold had been trained on a "Protein Data Bank", made up of around 170,000 different structures, and matched up with predictions made by scientists in labs — a much longer and more expensive process — with high accuracy in two-thirds of cases. 

Experts warned DeepMind's research might not apply outside of a narrow setting

Professor Mike Thompson, an expert in structural biology at the University of California, branded the idea that protein folding had been solved "laughable". 

"Frankly, the hype serves no one," he wrote on Twitter, adding that the company could "never live up to the promise that's been made". He continued: "Until DeepMind shares their code, nobody in the field cares and it's just them patting themselves on the back." 

Thompson did add that "the advance in prediction is impressive." He continued: "However, making a big step forward is not the same as 'solving' a decades old problem in biology and chemical physics."

"Despite this being the biggest thing that has happened in protein folding, the problem is not yet solved," added Vishal Gulati, a seasoned venture capitalist specializing in deep tech and health startups, in a blog post published on Tuesday. 

Noting DeepMind's research was "not a minor achievement", Gulati added: "Compared to the problem of protein folding, CASP is a game. It is a very hard game but it is a reduced problem set which helps us train tools and standardize performance ... It is a necessary step but it is not sufficient."

Lior Pachter, a professor of computational biology at the California Institute of Technology, agreed, writing on Twitter that the protein folding problem was not "well defined". 

"I don't mind that Google hyped this," he wrote. "I do mind that many (computational) biologists who ought to know better are going around screaming: 'Protein folding is solved!'

"Have some self-respect." 

But CASP's chair said he had looked at the results and that code-sharing wasn't the norm

That the findings would trigger some robust public debate is, perhaps, to be expected.

In an email exchange with Business Insider, CASP chair John Moult rejected the criticisms, writing: "CASP is not a game, it's a scientific experiment designed to test folding methods in close-to-real-life situations ... What is missing?"

He added: "Perhaps the people hyping the results have actually looked at them? [It] seems like this person hasn't." 

In response to criticism of DeepMind's refusal to share AlphaFold's code, Moult wrote: "This is an old chestnut in the field. Although code-sharing is obviously desirable, and some groups do it, it has never been the norm. [It is] not clear why DeepMind should be held to a higher standard than others."

Finally, he said: "Fifty years of listening to false claims about this problem has made me the world's biggest skeptic. But I have looked at these results very carefully ... Clearly, this is just the beginning of what DeepMind and others will achieve with these sorts of approaches."

A spokesperson for DeepMind declined to comment when approached by Business Insider. 

Get the latest Google stock price here.