Generative Tensorial Reinforcement Learning (GENTRL)

YouTube search... ...Google search

• Deep learning enables rapid identification of potent DDR1 kinase inhibitors | A. Zhavoronkov, Y. Ivanenkov, A. Aliper, M. Veselov, V. Aladinskiy, A. Aladinskaya, V. Terentiev, D. Polykovskiy, M. Kuznetsov, A. Asadulaev, Y. Volkov, A. Zholus, R. Shayakhmetov, A. Zhebrak, L. Minaeva, B. Zagribelnyy, L. Lee, R. Soll, D. Madge, L. Xing, T. Guo & A. Aspuru-Guzik - Nature Biotechnology
  • GENTRL | GitHub
  • Supplementary Code
  • AI in Medicine: Life Sciences and Drug Discovery - Transcript | Alex Zhavoronkov & Michael Krigsman
  • How an AI Startup Designed a Drug Candidate in Just 46 Days | Edd Gent - SingularityHub
• Variational Autoencoder (VAE)
• Generative Adversarial Network (GAN)
• Pharmaceuticals
• Artificial Intelligence (AI) ... Generative AI ... Machine Learning (ML) ... Deep Learning ... Neural Network ... Reinforcement ... Learning Techniques
• Conversational AI ... ChatGPT | OpenAI ... Bing/Copilot | Microsoft ... Gemini | Google ... Claude | Anthropic ... Perplexity ... You ... phind ... Grok | xAI ... Groq ... Ernie | Baidu

A deep generative model, generative tensorial reinforcement learning (GENTRL). The GENTRL model is a Variational Autoencoder (VAE) with a rich prior distribution of the latent space. We used tensor decompositions to encode the relations between molecular structures and their properties and to learn on data with missing values. We train the model in two steps. First, we learn a mapping of a chemical space on the latent manifold by maximizing the evidence lower bound. We then freeze all the parameters except for the learnable prior and explore the chemical space to find molecules with a high reward. GENTRL is a deep generative model that can be used for de novo drug discovery and other tasks that require the generation of new molecules with desired properties. GENTRL is a variational autoencoder (VAE) with a rich prior distribution of the latent space. This allows GENTRL to generate a diverse range of molecules with varying properties.

GENTRL is trained to optimize three objectives: synthetic feasibility, novelty, and biological activity. Synthetic feasibility is the likelihood that a molecule can be synthesized in a laboratory. Novelty is the likelihood that a molecule is new and has not been previously synthesized. Biological activity is the likelihood that a molecule has the desired biological effect.

GENTRL is trained in two steps. First, a VAE is trained to learn the distribution of known molecules. This is done by maximizing the evidence lower bound (ELBO). Second, a reinforcement learning (RL) agent is trained to generate molecules that optimize the three objectives. The RL agent is rewarded for generating molecules that are synthetically feasible, novel, and have the desired biological activity.

GENTRL has been shown to be effective in discovering new drug candidates. For example, GENTRL was used to discover potent inhibitors of discoidin domain receptor 1 (DDR1), a kinase target implicated in fibrosis and other diseases. In 21 days, GENTRL was able to discover four compounds that were active in biochemical assays and two compounds that were validated in cell-based assays. One lead candidate was tested and demonstrated favorable pharmacokinetics in mice.

GENTRL is a promising new approach to de novo drug discovery and other tasks that require the generation of new molecules with desired properties. GENTRL is able to generate a diverse range of molecules with high synthetic feasibility, novelty, and biological activity.

Here is an example of how GENTRL can be used to discover new drug candidates:

1. A GENTRL model is trained on a dataset of known molecules, including their biological activity.
2. The GENTRL model is used to generate a new molecule with the desired biological activity.
3. The new molecule is synthesized in a laboratory and tested for its biological activity.
4. If the new molecule has the desired biological activity, it is further tested and evaluated for its safety and efficacy.

This process can be repeated to generate and test new drug candidates until a promising lead compound is identified.

GENTRL is a powerful tool for drug discovery and other tasks that require the generation of new molecules with desired properties. GENTRL is still under development, but it has the potential to revolutionize the way that new drugs are discovered.