
==== Front
Top Curr Chem (Cham)
Top Curr Chem (Cham)
Topics in Current Chemistry (Cham)
2365-0869
2364-8961
Springer International Publishing Cham

38965117
469
10.1007/s41061-024-00469-6
Review
The State-of-the-Art Overview to Application of Deep Learning in Accurate Protein Design and Structure Prediction
Saharkhiz Saber 1
Mostafavi Mehrnaz 2
Birashk Amin 3
Karimian Shiva 4
Khalilollah Shayan 5
Jaferian Sohrab 6
Yazdani Yalda yaldayznn@gmail.com

7
Alipourfard Iraj ialipourfard@ichf.edu.pl

8
Huh Yun Suk 9
Farani Marzieh Ramezani 9
Akhavan-Sigari Reza 10
1 https://ror.org/03c4mmv16 grid.28046.38 0000 0001 2182 2255 Division of Neuroscience, Department of Cellular and Molecular Medicine, Faculty of Medicine, University of Ottawa, Ottawa, ON Canada
2 https://ror.org/034m2b326 grid.411600.2 Faculty of Allied Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
3 https://ror.org/049emcs32 grid.267323.1 0000 0001 2151 7939 Department of Computer Science, The University of Texas at Dallas, Richardson, TX USA
4 https://ror.org/048vche49 grid.472332.3 0000 0004 0494 2337 Electrical and Computer Research Center, Sanandaj Azad University, Sanandaj, Iran
5 grid.411463.5 0000 0001 0706 2472 Department of Neurosurgery, Faculty of Medicine, Tehran Medical Sciences, Islamic Azad University, Tehran, Iran
6 https://ror.org/022kthw22 grid.16416.34 0000 0004 1936 9174 Goergen Institute for Data Science, University of Rochester, Rochester, NY USA
7 https://ror.org/04krpx645 grid.412888.f 0000 0001 2174 8913 Immunology Research Center, Tabriz University of Medical Sciences, Tabriz, Iran
8 grid.413454.3 0000 0001 1958 0162 Institute of Physical Chemistry, Polish Academy of Sciences, Marcina Kasprzaka 44/52, 01-224 Warsaw, Poland
9 https://ror.org/01easw929 grid.202119.9 0000 0001 2364 8385 Department of Biological Engineering, Inha University, Incheon, Republic of Korea
10 https://ror.org/021ft0n22 grid.411984.1 0000 0001 0482 5331 Department of Neurosurgery, University Medical Center, Tuebingen, Germany
4 7 2024
4 7 2024
2024
382 3 234 2 2024
9 6 2024
© The Author(s) 2024
2024
https://creativecommons.org/licenses/by/4.0/ Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
In recent years, there has been a notable increase in the scientific community's interest in rational protein design. The prospect of designing an amino acid sequence that can reliably fold into a desired three-dimensional structure and exhibit the intended function is captivating. However, a major challenge in this endeavor lies in accurately predicting the resulting protein structure. The exponential growth of protein databases has fueled the advancement of the field, while newly developed algorithms have pushed the boundaries of what was previously achievable in structure prediction. In particular, using deep learning methods instead of brute force approaches has emerged as a faster and more accurate strategy. These deep-learning techniques leverage the vast amount of data available in protein databases to extract meaningful patterns and predict protein structures with improved precision. In this article, we explore the recent developments in the field of protein structure prediction. We delve into the newly developed methods that leverage deep learning approaches, highlighting their significance and potential for advancing our understanding of protein design.

Keywords

Deep learning
Protein structure prediction
Rational design
Protein engineering
issue-copyright-statement© Springer Nature Switzerland AG 2024
==== Body
pmcIntroduction

Proteins are prerequisite components of living organisms whose functions are dictated by their three-dimensional structures, which in turn are predominantly bound to their amino acids sequences [2]. At the time of writing this article, structures of more than 177,000 proteins have been submitted to publically accessible online databases, resulting from meticulous experimental research directed at determining three-dimensional structures using, for example, crystallography and neutron magnetic resonance (NMR) (Table 1). Such experiments are time-consuming, and more feasible options than those determining the structures of hypothesized proteins and synthesized peptides according only to their amino acid sequences have been developed that are more rapid and less time-consuming. More complications will arise when atomic accuracy without homologous counterparts is needed [3]. Only a few methods have attempted to tackle this specific issue; these have used different approaches but aspired to achieve the same goal: the atomic accuracy of an angstrom [4].Table 1 Experimentally validated methods for solving protein structure in the Protein Data Bank database according to the method applied

PDB data distribution by experimental method (proteins only)	Count	
X-Ray	155,029	
NMR	12,190	
EM	10,262	
Multiple methods	191	
Neutron	72	
Other	32	
Total	177,776	
At the time of writing this article, X-ray crystallography remains the predominant approach for protein modeling

EM Electron microscopy, NMR neutron magnetic resonance, PDB Protein Data Bank database

To bridge the gap between amino acid sequence and a protein structure that governs functionality, the scientific community of computational biology should face the problem of developing a method for accurate prediction of protein structure [5]. There are predominantly two logical schemes, one focusing on evolutionary homology and the other focusing on the physical interactions of thermodynamics and kinetics. Focusing solely on the latter has proven increasingly challenging due to the complexity and intractability of many variables responsible for protein stability. The former method employs homology to solve and predict protein structure according to evolutionary history [6]. In recent years, deep learning techniques (See Glossary at end of article) have been employed to interpret the correlation between experimentally solved protein structures and their corresponding amino acid sequences. Due to the large quantity of data available in both types of databases, there remains much to be desired when dealing with predictions involving structures with no experimentally solved homolog counterparts [7]. The additional information needed to overcome this obstacle can be obtained through the process of mining co-evolutionary indicators in the alignment of multiple sequences. However, even with the aid of a deep learning neural network, it has not yet been possible to predict the interaction between residues that ultimately assemble into a protein structure. Additionally, in recent years, an inverse dilemma has attracted the attention of the biotechnology community, namely the construction of an amino acid sequence that folds into a specific three-dimensional structure. This would serve as a logical and rational design for a specific interaction [8]. Protein modeling algorithms are fundamentally demanding tasks. Recent advancements in computational hardware, including both central processing units (CPUs) and graphics processing units (GPUs), along with the rapid progress in algorithm development, are facilitating significant strides toward attaining meaningful solutions in protein structure prediction.

In this review, our aim is to describe the highlights of these breakthroughs in protein modeling with a focus on deep-learning methods. It is an exciting new vantage point worth exploring that is pioneering the rational design approach.

Multi-Stages Modeling

The prediction of protein structures is rooted in Anfinsen’s hypothesis, formulated in 1961, which posits that the primary sequence of amino acids alone encodes the necessary information for precise folding. This hypothesis suggests that the native state of a polypeptide possesses the lowest free energy and can be envisioned as an energy landscape. Subsequent refolding experiments have provided empirical evidence supporting this hypothesis, now widely recognized as Anfinsen’s dogma [9]. The main challenge to this approach was first identified by Levinthal, who described it as a conceptual roadblock, taking into account that each amino acid has a small finite number of possible backbone states and, as the chain grows, the total size of the searchable alternative conformations become unattainable [see 10]. To circumvent this roadblock, it is crucial to recognize that the landscape of the energy is not, in fact, a flat plane with a single sink-hole but rather an overall funnel shape that directs sampling toward the native conformation; accepting this perception eliminates the necessity of exploring the entire conformational space. In short stretches, local interaction between amino acids can direct the sampling toward the near-native conformation [11]. In globular proteins, hydrophobic residues are predominantly buried in the core of the protein, increasing the van der Waals interactions while restricting the formation of entropically unfavorable grooves in the water solution. Also, the bias toward a strong backbone limits the number of flexible positions each side chain can assume in the proximity of a specific set of rotamers [12]. As a protein folds to its natural state, inevitably, some polar groups are buried in the core and cannot contribute to the total stability of the native state; consequently, this potential decrease in stability is compensated for through the formation of hydrogen bonds and disulfide bridges. This concept can be utilized to distinguish between native states and other compact ones. As hydrogen bonding in the backbone and hydrophobic burial of residues in the core are detectable in low-resolution modeling systems, specific modeling of side-chain flexibility requires a more computationally intensive analysis [13].

Modeling approaches for protein structure prediction are typically categorized into multiple levels with varying resolutions. The sampling of hydrophobic interactions, formation of secondary structure, elimination of overlaps and overall backbone conformation are addressed using a coarse-grained energy function [3]. This allows for faster exploration of the conformational space. Subsequently, at the higher resolution of the atomistic level, the focus shifts toward modeling flexible side chains and refining the structure. This stage takes into account multiple local minima in the energy landscape. Due to the increased level of detail, this refinement step is more computationally intensive [14]. (Fig. 1).Fig. 1 Following the coarse-grained modeling stage, the focus shifts to the higher resolution atomistic level. Here, the modeling process becomes more intricate, incorporating the modeling of flexible side chains and protein structure refinement. 3D Three-dimensional, Res resolution

In previous research, the prediction of protein models with the aid of known related proteins, known as template-based modeling, was fundamentally distinct from the prediction of proteins without any known counterparts. The choice depended on the availability of known structures in the databases; as such, the former method employed alignment of a known protein with the homology in mind, while the latter method focused on the energy function and sampling from alternative forms. Although template-based modeling can often generate accurate predictions, it must provide a measurable understanding of the physical principle of the folded structure [4]. Recently, however, the distinction between the two methods has become clearer as the template-based methods integrate energy refinement. At the same time, the novel fold modeling system incorporates deep learning to sample the information currently available in protein databases. This method can recognize the similarity between small fragments of polypeptides and identify the least common denominator when assimilating the backbone and side chains during multiple levels of refinement.

Template-based modeling

In a typical template-based modeling scenario, a preferable structure closely related to the query must be selected initially. This selection can consist of a simple BLAST (Basic Local Alignment Search Tool) search for a single sequence or multiple-sequence alignment from different proteins of known structures. Following the selection of a suitable backbone, modifications, such as deletion, insertion and mutation in the query, will be accounted for during the optimization of side chains. The initial backbone will be rotated and reconstructed solely around those specific modifications, and then the final model will be constructed. For the less closely related targets, more sophisticated methods, such as fragment-based modeling, will be utilized; however, when homology in the targets with the aligned results of < 20% is achieved, the accuracy of template-based modeling will plummet and render it unsuitable for gaining reliable results[15]. Approximately 60% of known protein families can accommodate template-based modeling to provide meaningful data regarding three-dimensional structures.

Template-free Modeling

In contrast to template-based modeling, the global similarity is absent in the scenario of template-free modeling. Thus, a sampling scheme for generating candidate structures followed by a ranking criterion would be employed. First, multiple alignments are used to predict local features, such as torsion angles of the main backbone and different secondary structures. Non-local features, such as the distances between residues and clashes, are also calculated, following which, after refinement, ranking between candidates will be utilized for the final prediction. During the initial sampling, usually short fragments of 3–12 residues in length are taken from experimentally modeled structures [16]. Fragment sampling relies not only on sequence similarity but also on the secondary structures and torsion angles. At this stage, the prediction of a protein is usually guided by the random brute forcing of employing the Monte Carlo simulation. This simulation randomly substitutes fragments of 25 residues in length in a small backbone, calculates the energy and compares this energy with another randomly selected fragment. If the energy is lowered after the insertion, the move is favored; in the case of an increase in the energy, the probability of a suitable insertion is dramatically lowered by the criterion of Metropolis [4]. Thousands of simulations are usually needed to find the lowest state of energy. However, to some extent, the coarse-grained function can mitigate the complexity of such simulations for a faster result. In the absence of global similarity, fragment-based modeling offers some advantages, such as using experimentally curated fragments to ensure that the final model has the local protein features without solely relying on meticulous energy calculation. Monte Carlo simulation is efficient for small domains with predominant alpha-helical structures. In contrast, long-distance residue contacts in beta-strands and topologically complex domains pose the biggest challenge for this simulation. Real-world applications, such as drug design and inverse approaches for protein design, rely on finer features in the near-native state of a protein, such as side-chain packing. Therefore, the coarse-grained energy function in fragment assembly is unable to fill the gaps in required details; hence, many refinement strategies are proposed to achieve a detailed model. Refinement strategies, such as molecular dynamics, incorporate precise energy functions in conjunction with exploring the surrounding space. In molecular dynamic simulation, the surrounding space in a hypothetical box is filled with water molecules, and the simulation of the trajectory of the target molecule is calculated in minuscule time-frames according to Newton’s Law of motion and energy [17]. Recently, this refinement strategy has been further enhanced by incorporating energy minimization and the sampling of side-chain rotamers, demonstrated by the Rosetta tool [18].

Machine Learning-based Methods

More sophisticated methods have emerged with the growing demand for more precision in modeling and in defining the more disguised features like residue-residue contacts. In earlier studies, machine learning models were employed to predict features like torsion angle and accessible residues. More recently, predictions like the inter-residue distances have paved the way for deep-learning techniques to be able to familiarize themselves with patterns in available sequences in databases and their correlated structures. Advances in image analysis have facilitated the prediction of contact maps [19]. Methods like DeepContact use deep learning to accommodate themselves with large amounts of data of known proteins and their contact maps and alignment to recognize spatial contacts [20]. Deep learning is also contributing to a recently emerging field of protein design that, by nature, is an inverse dilemma to an already existing protein prediction challenge. In the field of protein design, finding the conformation with the lowest energy is not the priority; rather, the aim is to determine a specific sequence that folds into a stable desirable conformation or incorporates itself into a binding interaction. Yet the toolsets needed for such approaches are very similar to previous prediction attempts [21] and, similar to protein modeling, template-based designs and de novo designs are employed. In template-based protein design, existing proteins are modified to gain new functions, while in the de novo designs approach, desirable interactions and physiochemical restrictions dictate the desirable backbone and side chains. In contrast to repurposing naturally occurring proteins, the de novo designs method allows for the creation of new structures without the reliance on evolutionary restrictions. It is worth mentioning that the energy function is also used to rank the possible conformations with favorable side chains and interactions in both de novo and template-based protein design [22].

The first step in the de novo approach in protein design is the assignment of a particular fold or a topology. The fold is then used to induce a particular function. The number of conformations for a hypothetical fold can be extensive, but only a few of them are thermodynamically stable and properly packed. Similar to structure prediction, small fragments of naturally occurring folds are often used in conjunction with specific restrictions in residue distance. This strategy has been used to design many protein folds that are not limited to helical conformations, such as the folds that solely consist of beta-sheets and turns. This approach has also successfully been used to make alternate folds from naturally occurring helix-turn-helix motifs to form pockets with active site functionality [23]. In the case of coiled proteins with a limited number of alpha helix fragments, it is also possible to use the purely parametric design, initially with a limited number of parameters, for obtaining the desirable backbone in a systemic manner [24]. Certain spatial parameters allow for the tight packing of coiled folds with stronger interactions. In de novo protein design, the usual goal is either the correct protein–protein interaction or the protein–ligand interaction; in both cases, a sufficient hydrophobic packing between two molecules is desirable. Hence, the natural next step is docking [25]. Protein–ligand docking is feasible with many toolsets, chief among them are the Molegro virtual docker [26] and the accelerated Vina–GPU docker, both of which yield suitable results for small ligands [27]. On the other hand, protein–protein docking is more computationally intensive. Previously, the ZDOCK tool was used as the benchmark for protein–protein docking; the recently developed Graph Neural network (GNN-Dove) [28] utilizes a deep learning approach to extract the interface area and has proven to be a more robust tool compared to previous methods.

In protein design, regardless of the initial method, which can be template-based or de novo, some optimizations are employed since a particular amino acid sequence is involved in the binding or stabilization of the final protein [29]. Sequence optimization software incorporates energy functions to account for the favorability of binding or stabilizing sequences while searching for the most suited alternative sequences. Similar to structure prediction approaches, the same energy function is used during the design and refinement steps. In this context, deep learning is also utilized to train the energy function to predict the experimentally proven changes in energy corresponding with shifting different chemical groups. Multiple methods, such as genetic algorithms and simulated annealing, have also been developed to identify better substitute sequences. Rosetta software uses simulated annealing to identify rotamers with lower energy. Despite the rapidity of this method, it does not guarantee that the lowest possible energy will be found. A vulnerable area in protein design is the sensitiveness of the calculations needed to determine even small changes in the conformation of the backbone, and since the energy calculation is based on all the atoms in the protein model and cannot account for all the variables that contribute to the energy in a protein, this can pose a challenge. To address this issue, TERtiary Motifs (TERMs) or tertiary structural motifs that are derived fragments of residues from known proteins are first introduced in the Protein Data Bank (PDB) database. TERMs are then used for optimizations that share similar energy functions [30].

Application of Rational Protein Design

During the last decade, applications of protein design in research, medicine and industry have grown exponentially. The premise of the rapid creation of new proteins in conjunction with the development of new computational algorithms have led to researchers suggesting multiple solutions to their problems in quick succession. Creating specific mutations for more thermally stable proteins with higher expression is manageable using the multiple alignments in conjunction with the Rosetta simulation. For example, this approach can increase the thermal tolerance of proteins, such as the RH5 protein involved in malaria invasion [31]. In medicine, the ability to change the properties of binding specificity is a powerful tool to manipulate cell signaling pathways. Another example of novel assemblies using simulations was demonstrated in designing dual-specific antibodies by self-assembling two unique light chains. This resulted in each arm recognizing different targets and has been proven to be useful in recruiting immune T cells to a specific target [32]. Another example of de novo protein design is the creation of interleukin (IL) mimics that confer anti-cancer properties by binding to their receptors without inducing toxicity [33]. One of the main strengths of protein design can be seen in self-assembling nanocages. These symmetrical oligomers are constructed using homodimers and homotrimers as building blocks and designed with complementary interfaces for stable assembly. Similar to viral capsids, nanocages can pack RNA molecules and have many applications in nanoparticle vaccines [34]. Regulating signaling pathways is an intriguing concept for de novo protein design and, in particular, can be utilized in inflammatory pathways [35]. This concept incorporates a one-sided interface design in which one of the proteins in an interaction is mutated. Since excessive increases in polar residues in the mutated protein can be detrimental to stability and proper folding, more hydrophobic patches on the target surface are taken advantage of during the design process. Protein–protein interaction can further be improved by means of scaffolding [36], which encompasses the binding motif in a properly folded scaffold. Previous attempts consisted of sampling the fragments of receptor-binding helices of IL-2 that were integrated into a de novo-designed protein. The resulting molecule conferred the anti-cancer properties in colon cancer mouse models while inducing less toxicity. Deep-learning mediated protein design is also useful when immune regulatory and anti-inflammatory properties are desired; this goal is achievable by sampling and adding the mutations in motifs that are deemed favorable substrates for major histocompatibility complexes in target molecules [37]. A new perspective in de novo protein design is to create multiple protein structures that are computationally sampled for suitable binding pockets. In a previous study, multiple beta barrels were computationally designed in a manner to enhance the fluorescent emission for localization imaging inside the cell. Accuracy is one of the main challenges when computational methods in de novo protein design are employed in catalytic scenarios. The typical 1-angstrom accuracy of computational methods cannot fully account for the sub-angstrom nature of transitional states of binding to substrates and the subsequent release of the products in enzymes. Although additional side chain design in surrounding residues is usually performed for the stability of the protein, the naturally evolved enzymes incorporate many different mechanisms, such as entering the substrate and releasing the product in quick succession, which is currently challenging for available methods to evaluate. Many important proteins, like those involved in signal transduction pathways, have more than one conformation. Multiple conformations enable the protein to switch between alternate forms. A multi-state protein design has been used to incorporate different time scales in the conformational transition of a protein that is functionally relevant and is at low energy states for different conformations that a backbone can accommodate [38]. These flexible cases are often calculated by the combination of molecular trajectory simulation and the analysis of the energy landscape.

Limitations of Rational Protein Design in Functional Dynamics

The rational methods used in protein design offer valuable insights into protein structure and function; however, they are not without limitations, including those mentioned below.

Inability to Capture Complex Functional Dynamics

One of the major limitations in rational designing is the inability of current methods to accurately capture the intricate dynamics of protein function. Proteins often exhibit complex conformational changes and dynamic motions that are essential for their biological activity. Rational design methods struggle to account for these dynamic behaviors adequately.

Dependence on Simplified Models

Rational protein design often relies on simplified models of protein structure and function. These models may overlook important factors, such as solvent effects, ligand interactions, and allosteric regulation, leading to inaccuracies in predictions.

Challenges in Predicting Protein Flexibility

Predicting the flexibility of proteins, especially in response to environmental changes or binding events, remains a significant challenge for rational design methods. Flexibility is crucial for protein function, yet accurately predicting and manipulating flexibility a computationally daunting task.

These limitations significantly impact protein engineering efforts, which can lead to engineered proteins with altered dynamic behaviors.

Task-specific tools

As the trend of protein design moves toward the semi-rational approach, employing direct evolution, which relies on high-throughput systems and precise simulation of rational designs in unison, is inevitable. To fulfill this task, a myriad of tools have been developed during the last decade, which are becoming continuously more sophisticated. On the bright side, many of those tools focus on distinct tasks and can be utilized for many particular cases by offering many solutions to a single problem. The negative implication is the overwhelming number of these toolsets that, in many cases, could be more user-friendly for practitioners [1]. The majority of these tools rely on multiple-sequence alignment to gather information about allosteric networks, transport pathways, and binding sites. We have gathered a list of these tools that may be less known but offer applicable approaches to tackle these challenges (Table 2).Table 2 A list of more task-specific tools

Program/toolset	Application	Link	
PPI3D

ISEE

MutaBind

DisruPPI

	Protein–protein interaction	http://bioinformatics.ibt.lt/ppi3d

https://github.com/haddocking/iSee

http://www.ncbi.nlm.nih.gov/projects/mutabind

	
CaverDoCK	Ligand transport	https://loschmidt.chemi.muni.cz/caverweb	
PDB2Graph

AlloSigma

STRESS

	Allostery	http://bioinf.modares.ac.ir/software/pdb2graph

http://allosigma.bii.a-star.edu.sg

https://github.com/gersteinlab/STRESS

	
BioStructMap	Data integration	https://biostructmap.burnet.edu.au	
DynaMut	Dynamic simulation	http://biosig.unimelb.edu.au/dynamut/	

RoseTTAFold and AlphaFold2

As discussed in the above text, many attempts have been made during the past decade to solve the problem of protein modeling, whether used for prediction or for design purposes. Until recently, most developments revolved around energy function and force fields to account for interactions in atomic levels [39]. Realistically, the myriad of parameters cannot be collectively realized in such simulations, and the accuracy of predictions based on the dynamics simulation is bottlenecked by the embedded physics of the force field. Also, molecular dynamic simulations are usually performed on a time scale of < 1 ms; while it can accurately account for smaller molecules, this time scale renders this method unsuitable for larger complexes. Popular Monte Carlo-based methods [21], such as Rosetta, were developed to identify the lowest energy state; hence, their usefulness declines when used for larger molecules. Millions of parameters must be considered to comprehend and utilize the relation between amino acid sequence and structure.

Very recently, deep learning-derived methods, such as AlphaFold and RoseTTAFold, have reached desirable accuracy when dealing with larger complexes [40]. Unlike previous methods, these new methods make no assumptions about the form or function of atomic interaction; rather, the training of the network is done directly on thousands of already experimentally determined structures. Unlike molecular dynamic simulations, the trajectory is directly optimized by deep learning training in a series of updates; hence, the challenge of global optimization in large spaces is overcome. Although these methods are developed by training the network with extracted structural information from already determined proteins, they can predict the structure from the amino acid sequence without relying on evolutionary information. This indicates a rich understanding of these methods about sequence-structure relationships [41]. Very recently, RoseTTAFold was trained to recover sequences from the structure. The application for this accomplishment is to enhance the quality of limited experimental data by completing the missing gaps in the structure. Since RoseTTAFold and AlphaFold use different network training and parameters, combining both in predicting structures and even more ambitious goals, such as full proteome interactions, has proven to be more accurate than using either individually [42].

The gold standard for the accuracy and performance in the structure prediction of newly developed approaches is the CASP (Critical Assessment of protein Structure Prediction), which occurs once every 2 years with a simple yet robust method by using the recently solved structures that have not been publicly disclosed and thus considered to be blind prediction tests for competing methods [43]. During the CASP14 assessment in July 2020, AlphaFold2 achieved tremendously more accurate results for structure prediction with a median backbone accuracy of root mean square deviation (RMSD) of 0.9 Angstrom (Å) at 95% residue coverage; a RMSD of 2.8 Å was previously considered the record of other competing methods [44]. By training a neural network with data based upon physical, evolutionary homologous structures and geometric constraints of thousands of determined PDB structures, AlphaFold2 was able to predict the structure of > 350,000 unique sequences from UniClust30 (Fig. 2) [45]. AlphaFold2 uses geometric inductive bias to render structures that are trained from PDB; by doing so, it eliminates the requirement for handcrafted features, such as the score function for hydrogen bonding. This allows AlphaFold2 to fill in the missing experimental data and to produce accurate results in challenging cases, such as structures with intertwined homomers [46, 47]. Instead of the CPU, AlphaFold2 leverages the graphic processor unit. Currently, it uses roughly 1 GPU–minute per 384 residues. A parallel development in high-end processors, particularly in GPUs, drove applications to be more lenient toward GPU CUDA-Cores instead of CPU for such tasks. Although AlphaFold2 can run locally on a CPU, it benefits greatly from stronger GPUs with a high amount of vRAM. This application is publicly available in GitHub and can be run locally with a database of around 2TBs. However, in collaboration with Google, it can also be utilized as a user-friendly online tool with a decent performance in collab.research.google.com [48].Fig. 2 AlphaFold2 workflow works on the basis of pair representation. It refines the representations for both the multiple sequence alignment and the pair interactions but also iteratively exchanges information between them

Concluding remarks

During the last 2 years, PDB has integrated computed structure models (CSM) in its database and search algorithm. At the time of writing this review, more than 1 million CSM entries had been registered in PDB and were publicly available. This shows that alongside 200,000 experimentally determined structures[49], CSM models have been accepted by the research community and are leveraged as an invaluable tool that facilitates a multitude of previously challenging aspects of de novo protein design and subsequent modeling. The extent of transformative progress in the field of computational biology during the past year has been astonishing. To train a network with a myriad of data and account for astronomically more parameters than any conventional method promises an exciting future where the accuracy of the prediction of the progress in this field is far behind the accuracy of predicting protein structures.

Author Contributions

Sh.K: Data curation. Sh.K: Investigation and validation. Y.S.H and M.R.F: formal analysis. R.A.S: methodology. S.J, S.S, M.M and A.B: writing manuscript. Y.Y and I.A: conceptualization, project administration, supervision, working out of technical details, editing and submitting the manuscript as corresponding authors. All authors have reviewed and approved the final manuscript.

Funding

Not applicable.

Availability of data and materials

Not applicable.

Declarations

Conflict of interest

The authors declared they have no conflict of interest.

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Glossary

Deep Learning Deep learning is a subfield of machine learning that focuses on training artificial neural networks to perform complex tasks. It involves the use of multiple layers of interconnected nodes or neurons.

Molecular Dynamics Simulation A computational technique that simulates the movement and interactions of atoms within a protein structure over time. Molecular dynamics simulations can refine protein models by exploring dynamic behaviors, flexibility, and interactions with surrounding molecules.

Nuclear Magnetic Resonance This is a powerful analytical technique used to study the properties of atomic nuclei within a magnetic field.

Refinement The process of iteratively improving the accuracy and reliability of predictions related to protein structure, function, interactions, and other properties.

Rotamer A rotamer refers to one of the possible conformations or spatial arrangements that a molecule can adopt due to the rotation of specific bonds.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
==== Refs
References

1. Koepnick B De novo protein design by citizen scientists Nature 2019 570 7761 390 394 10.1038/s41586-019-1274-4 31168091
Koepnick B et al (2019) De novo protein design by citizen scientists. Nature 570(7761):390–394. 10.1038/s41586-019-1274-431168091 10.1038/s41586-019-1274-4
2. Greener JG Kandathil SM Jones DT Deep learning extends de novo protein modeling coverage of genomes using iteratively predicted structural constraints Nat Commun 2019 10 1 3977 10.1038/s41467-019-11994-0 31484923
Greener JG, Kandathil SM, Jones DT (2019) Deep learning extends de novo protein modeling coverage of genomes using iteratively predicted structural constraints. Nat Commun 10(1):3977. 10.1038/s41467-019-11994-031484923 10.1038/s41467-019-11994-0
3. Kuhlman B Bradley P Advances in protein structure prediction and design Nat Rev Mol Cell Biol 2019 20 11 681 697 10.1038/s41580-019-0163-x 31417196
Kuhlman B, Bradley P (2019) Advances in protein structure prediction and design. Nat Rev Mol Cell Biol 20(11):681–697. 10.1038/s41580-019-0163-x31417196 10.1038/s41580-019-0163-x
4. Hou J Protein tertiary structure modeling driven by deep learning and contact distance prediction in CASP13 Proteins 2019 87 12 1165 1178 10.1002/prot.25697 30985027
Hou J et al (2019) Protein tertiary structure modeling driven by deep learning and contact distance prediction in CASP13. Proteins 87(12):1165–1178. 10.1002/prot.2569730985027 10.1002/prot.25697
5. Nielsen H A brief history of protein sorting prediction Protein J 2019 38 200 216 10.1007/s10930-019-09838-3 31119599
Nielsen H et al (2019) A brief history of protein sorting prediction. Protein J 38:200–216. 10.1007/s10930-019-09838-331119599 10.1007/s10930-019-09838-3
6. Ramazi S Zahiri JJD Post-translational modifications in proteins: resources, tools and prediction methods Database (Oxford) 2021 10.1093/database/baab012 33826699
Ramazi S, Zahiri JJD (2021) Post-translational modifications in proteins: resources, tools and prediction methods. Database (Oxford). 10.1093/database/baab01233826699 10.1093/database/baab012
7. Torrisi M Deep learning methods in protein structure prediction Comput Struct Biotechnol J 2020 18 1301 1310 10.1016/j.csbj.2019.12.011 32612753
Torrisi M et al (2020) Deep learning methods in protein structure prediction. Comput Struct Biotechnol J 18:1301–1310. 10.1016/j.csbj.2019.12.01132612753 10.1016/j.csbj.2019.12.011
8. Pan X Kortemme T Recent advances in de novo protein design: principles, methods, and applications J Biol Chem 2021 296 100558 10.1016/j.jbc.2021.100558 33744284
Pan X, Kortemme T (2021) Recent advances in de novo protein design: principles, methods, and applications. J Biol Chem 296:100558. 10.1016/j.jbc.2021.10055833744284 10.1016/j.jbc.2021.100558
9. Noji M Breakdown of supersaturation barrier links protein folding to amyloid formation Commun Biol 2021 4 1 120 10.1038/s42003-020-01641-6 33500517
Noji M et al (2021) Breakdown of supersaturation barrier links protein folding to amyloid formation. Commun Biol 4(1):120. 10.1038/s42003-020-01641-633500517 10.1038/s42003-020-01641-6
10. Zeng J Huang Z From Levinthal’s paradox to the effects of cell environmental perturbation on protein folding Curr Med Chem 2019 26 42 7537 7554 10.2174/0929867325666181017160857 30332937
Zeng J, Huang Z (2019) From Levinthal’s paradox to the effects of cell environmental perturbation on protein folding. Curr Med Chem 26(42):7537–7554. 10.2174/092986732566618101716085730332937 10.2174/0929867325666181017160857
11. Gianni S Fuzziness and frustration in the energy landscape of protein folding, function, and assembly Acc Chem Res 2021 54 5 1251 1259 10.1021/acs.accounts.0c00813 33550810
Gianni S et al (2021) Fuzziness and frustration in the energy landscape of protein folding, function, and assembly. Acc Chem Res 54(5):1251–1259. 10.1021/acs.accounts.0c0081333550810 10.1021/acs.accounts.0c00813
12. Toto A Templated folding of intrinsically disordered proteins J Biol Chem 2020 295 19 6586 6593 10.1074/jbc.REV120.012413 32253236
Toto A et al (2020) Templated folding of intrinsically disordered proteins. J Biol Chem 295(19):6586–6593. 10.1074/jbc.REV120.01241332253236 10.1074/jbc.REV120.012413
13. Haddad Y Adam V Heger Z Rotamer dynamics: analysis of rotamers in molecular dynamics simulations of proteins Biophys J 2019 116 11 2062 2072 10.1016/j.bpj.2019.04.017 31084902
Haddad Y, Adam V, Heger Z (2019) Rotamer dynamics: analysis of rotamers in molecular dynamics simulations of proteins. Biophys J 116(11):2062–2072. 10.1016/j.bpj.2019.04.01731084902 10.1016/j.bpj.2019.04.017
14. Jewett AI Moltemplate: tool for coarse-grained modeling of complex biological matter and soft condensed matter physics J Mol Biol 2021 433 11 166841 10.1016/j.jmb.2021.166841 33539886
Jewett AI et al. (2021) Moltemplate: tool for coarse-grained modeling of complex biological matter and soft condensed matter physics. J Mol Biol 433(11):166841. 10.1016/j.jmb.2021.16684133539886 10.1016/j.jmb.2021.166841
15. Lensink MF Modeling protein–protein, protein–peptide, and protein–oligosaccharide complexes: CAPRI 7th edition Proteins 2020 88 8 916 938 10.1002/prot.25870 31886916
Lensink MF et al (2020) Modeling protein–protein, protein–peptide, and protein–oligosaccharide complexes: CAPRI 7th edition. Proteins 88(8):916–938. 10.1002/prot.2587031886916 10.1002/prot.25870
16. Xu J Wang S Function, and bioinformatics, analysis of distance-based protein structure prediction by deep learning in CASP13 Proteins 2019 87 12 1069 1081 10.1002/prot.25810 31471916
Xu J, Wang S (2019) Function, and bioinformatics, analysis of distance-based protein structure prediction by deep learning in CASP13. Proteins 87(12):1069–1081. 10.1002/prot.2581031471916 10.1002/prot.25810
17. Salo-Ahen OM Molecular dynamics simulations in drug discovery and pharmaceutical development Processes 2020 9 1 71 10.3390/pr9010071
Salo-Ahen OM et al (2020) Molecular dynamics simulations in drug discovery and pharmaceutical development. Processes 9(1):71. 10.3390/pr901007110.3390/pr9010071
18. Leelananda SP Joci SJ Lindert, and modeling, Using NMR chemical shifts and Cryo-EM density restraints in iterative Rosetta-MD protein structure refinement J Chem Inf Model 2019 60 5 2522 2532 10.1021/acs.jcim.9b00932 31872764
Leelananda SP, Joci SJ (2019) Lindert, and modeling, Using NMR chemical shifts and Cryo-EM density restraints in iterative Rosetta-MD protein structure refinement. J Chem Inf Model 60(5):2522–2532. 10.1021/acs.jcim.9b0093231872764 10.1021/acs.jcim.9b00932
19. Wei G Protein structure prediction beyond AlphaFold Nat Mach Intell 2019 1 8 336 337 10.1038/s42256-019-0086-4 38515561
Wei G (2019) Protein structure prediction beyond AlphaFold. Nat Mach Intell 1(8):336–337. 10.1038/s42256-019-0086-438515561 10.1038/s42256-019-0086-4
20. Li Y ResPRE: high-accuracy protein contact prediction by coupling precision matrix with deep residual neural networks Bioinformatics 2019 35 22 4647 4655 10.1093/bioinformatics/btz291 31070716
Li Y et al (2019) ResPRE: high-accuracy protein contact prediction by coupling precision matrix with deep residual neural networks. Bioinformatics 35(22):4647–4655. 10.1093/bioinformatics/btz29131070716 10.1093/bioinformatics/btz291
21. Pearce R Zhang YJ Deep learning techniques have significantly impacted protein structure prediction and protein design Curr Opin Struct Biol 2021 68 194 207 10.1016/j.sbi.2021.01.007 33639355
Pearce R, Zhang YJ (2021) Deep learning techniques have significantly impacted protein structure prediction and protein design. Curr Opin Struct Biol 68:194–207. 10.1016/j.sbi.2021.01.00733639355 10.1016/j.sbi.2021.01.007
22. Ovchinnikov S Huang P-SJ Structure-based protein design with deep learning Curr Opin Chem Biol 2021 65 136 144 10.1016/j.cbpa.2021.08.004 34547592
Ovchinnikov S, Huang P-SJ (2021) Structure-based protein design with deep learning. Curr Opin Chem Biol 65:136–144. 10.1016/j.cbpa.2021.08.00434547592 10.1016/j.cbpa.2021.08.004
23. Anishchenko I De novo protein design by deep network hallucination Nature 2021 600 7889 547 552 10.1038/s41586-021-04184-w 34853475
Anishchenko I et al (2021) De novo protein design by deep network hallucination. Nature 600(7889):547–552. 10.1038/s41586-021-04184-w34853475 10.1038/s41586-021-04184-w
24. Woolfson DW A brief history of de novo protein design: minimal, rational, and computational J Mol Biol 2021 433 20 167160 10.1016/j.jmb.2021.167160 34298061
Woolfson DW (2021) A brief history of de novo protein design: minimal, rational, and computational. J Mol Biol 433(20):167160. 10.1016/j.jmb.2021.16716034298061 10.1016/j.jmb.2021.167160
25. Porter KA What method to use for protein–protein docking? Curr Opin Struct Biol 2019 55 1 7 10.1016/j.sbi.2018.12.010 30711743
Porter KA et al (2019) What method to use for protein–protein docking? Curr Opin Struct Biol 55:1–7. 10.1016/j.sbi.2018.12.01030711743 10.1016/j.sbi.2018.12.010
26. Bitencourt-Ferreira G, de Azevedo WFJDsfdd (2019) Molegro virtual docker for docking. Methods Mol Biol 149–167. 10.1007/978-1-4939-9752-7_10
27. Eberhardt J AutoDock Vina 1.2. 0: New docking methods, expanded force field, and Python bindings J Chem Inf Model 2021 61 8 3891 3898 10.1021/acs.jcim.1c00203 34278794
Eberhardt J et al (2021) AutoDock Vina 1.2. 0: New docking methods, expanded force field, and Python bindings. J Chem Inf Model 61(8):3891–3898. 10.1021/acs.jcim.1c0020334278794 10.1021/acs.jcim.1c00203
28. Wang X Flannery ST Kihara DJF Protein docking model evaluation by graph neural networks Front Mol Biosci 2021 8 647915 10.3389/fmolb.2021.647915 34113650
Wang X, Flannery ST, Kihara DJF (2021) Protein docking model evaluation by graph neural networks. Front Mol Biosci 8:647915. 10.3389/fmolb.2021.64791534113650 10.3389/fmolb.2021.647915
29. Shen C From machine learning to deep learning: advances in scoring functions for protein–ligand docking WIREs Comput Mol Sci 2020 10 1 e1429 10.1002/wcms.1429
Shen C et al (2020) From machine learning to deep learning: advances in scoring functions for protein–ligand docking. WIREs Comput Mol Sci 10(1):e1429. 10.1002/wcms.142910.1002/wcms.1429
30. Frappier V Tertiary structural motif sequence statistics enable facile prediction and design of peptides that bind anti-apoptotic Bfl-1 and Mcl-1 Structure 2019 27 4 606 617.e5 10.1016/j.str.2019.01.008 30773399
Frappier V et al (2019) Tertiary structural motif sequence statistics enable facile prediction and design of peptides that bind anti-apoptotic Bfl-1 and Mcl-1. Structure 27(4):606–617.e5. 10.1016/j.str.2019.01.00830773399 10.1016/j.str.2019.01.008
31. Warszawski S Design of a basigin–mimicking inhibitor targeting the malaria invasion protein RH5 Proteins 2020 88 1 187 195 10.1002/prot.25786 31325330
Warszawski S et al (2020) Design of a basigin–mimicking inhibitor targeting the malaria invasion protein RH5. Proteins 88(1):187–195. 10.1002/prot.2578631325330 10.1002/prot.25786
32. Sesterhenn F De novo protein design enables the precise induction of RSV-neutralizing antibodies Science 2020 368 6492 eaay5051 10.1126/science.aay5051 32409444
Sesterhenn F et al (2020) De novo protein design enables the precise induction of RSV-neutralizing antibodies. Science 368(6492):eaay5051. 10.1126/science.aay505132409444 10.1126/science.aay5051
33. Holder PG Engineering interferons and interleukins for cancer immunotherapy Adv Drug Deliv Rev 2022 182 114112 10.1016/j.addr.2022.114112 35085624
Holder PG et al (2022) Engineering interferons and interleukins for cancer immunotherapy. Adv Drug Deliv Rev 182:114112. 10.1016/j.addr.2022.11411235085624 10.1016/j.addr.2022.114112
34. Li Y Champion JAJ Self-assembling nanocarriers from engineered proteins: design, functionalization, and application for drug delivery Adv Drug Deliv Rev 2022 189 14462 10.1016/j.addr.2022.114462
Li Y, Champion JAJ (2022) Self-assembling nanocarriers from engineered proteins: design, functionalization, and application for drug delivery. Adv Drug Deliv Rev 189:14462. 10.1016/j.addr.2022.11446210.1016/j.addr.2022.114462
35. Zhou G Groth T Host responses to biomaterials and anti-inflammatory design—a brief review Macromol Biosci 2018 18 8 1800112 10.1002/mabi.201800112
Zhou G, Groth T (2018) Host responses to biomaterials and anti-inflammatory design—a brief review. Macromol Biosci 18(8):1800112. 10.1002/mabi.20180011210.1002/mabi.201800112
36. Basler S Efficient Lewis acid catalysis of an abiological reaction in a de novo protein scaffold Nat Chem 2021 13 3 231 235 10.1038/s41557-020-00628-4 33526894
Basler S et al (2021) Efficient Lewis acid catalysis of an abiological reaction in a de novo protein scaffold. Nat Chem 13(3):231–235. 10.1038/s41557-020-00628-433526894 10.1038/s41557-020-00628-4
37. Wang J Scaffolding protein functional sites using deep learning Science 2022 377 6604 387 394 10.1126/science.abn2100 35862514
Wang J et al (2022) Scaffolding protein functional sites using deep learning. Science 377(6604):387–394. 10.1126/science.abn210035862514 10.1126/science.abn2100
38. Dawson WM Rhys GG Woolfson DNJ Towards functional de novo designed proteins Curr Opin Chem Biol 2019 52 102 111 10.1016/j.cbpa.2019.06.011 31336332
Dawson WM, Rhys GG, Woolfson DNJ (2019) Towards functional de novo designed proteins. Curr Opin Chem Biol 52:102–111. 10.1016/j.cbpa.2019.06.01131336332 10.1016/j.cbpa.2019.06.011
39. Noé F De Fabritiis G Clementi CJ Machine learning for protein folding and dynamics Curr Opin Struct Biol 2020 60 77 84 10.1016/j.sbi.2019.12.005 31881449
Noé F, De Fabritiis G, Clementi CJ (2020) Machine learning for protein folding and dynamics. Curr Opin Struct Biol 60:77–84. 10.1016/j.sbi.2019.12.00531881449 10.1016/j.sbi.2019.12.005
40. Lee C Su B-H Tseng YJ Comparative studies of AlphaFold, RoseTTAFold, and Modeller: a case study involving the use of G-protein-coupled receptors Brief Bioinform 2022 23 5 bbac308 10.1093/bib/bbac308 35945035
Lee C, Su B-H, Tseng YJ (2022) Comparative studies of AlphaFold, RoseTTAFold, and Modeller: a case study involving the use of G-protein-coupled receptors. Brief Bioinform 23(5):bbac308. 10.1093/bib/bbac30835945035 10.1093/bib/bbac308
41. Norn C Protein sequence design by conformational landscape optimization Proc Natl Acad Sci U S A 2021 118 11 e2017228118 10.1073/pnas.2017228118 33712545
Norn C et al (2021) Protein sequence design by conformational landscape optimization. Proc Natl Acad Sci U S A 118(11):e2017228118. 10.1073/pnas.201722811833712545 10.1073/pnas.2017228118
42. Golinelli-Pimpaneau B Prediction of the iron–sulfur binding sites in proteins using the highly accurate three-dimensional models calculated by AlphaFold and RoseTTAFold Inorganics 2022 10 1 2 10.3390/inorganics10010002
Golinelli-Pimpaneau B (2022) Prediction of the iron–sulfur binding sites in proteins using the highly accurate three-dimensional models calculated by AlphaFold and RoseTTAFold. Inorganics 10(1):2. 10.3390/inorganics1001000210.3390/inorganics10010002
43. Jumper J Applying and improving AlphaFold at CASP14 Proteins 2021 89 12 1711 1721 10.1002/prot.26257 34599769
Jumper J et al (2021) Applying and improving AlphaFold at CASP14. Proteins 89(12):1711–1721. 10.1002/prot.2625734599769 10.1002/prot.26257
44. Pereira J High-accuracy protein structure prediction in CASP14 Proteins 2021 89 12 1687 1699 10.1002/prot.26171 34218458
Pereira J et al (2021) High-accuracy protein structure prediction in CASP14. Proteins 89(12):1687–1699. 10.1002/prot.2617134218458 10.1002/prot.26171
45. Al-Janabi A Has DeepMind's AlphaFold solved the protein folding problem? Biotechniques 2022 72 3 73 76 10.2144/btn-2022-0007 35118884
Al-Janabi A (2022) Has DeepMind's AlphaFold solved the protein folding problem?. Biotechniques 72(3):73–76. 10.2144/btn-2022-000735118884 10.2144/btn-2022-0007
46. Jumper J Highly accurate protein structure prediction with AlphaFold Nature 2021 596 7873 583 589 10.1038/s41586-021-03819-2 34265844
Jumper J et al (2021) Highly accurate protein structure prediction with AlphaFold. Nature 596(7873):583–589. 10.1038/s41586-021-03819-234265844 10.1038/s41586-021-03819-2
47. Roohparvar Basmenj E A novel approach to design a multiepitope peptide as a vaccine candidate for Bordetella pertussis J Biomol Struct Dyn 2023 8 1 13 10.1080/07391102.2023.2278081
Roohparvar Basmenj E et al (2023) A novel approach to design a multiepitope peptide as a vaccine candidate for Bordetella pertussis. J Biomol Struct Dyn 8:1–13. 10.1080/07391102.2023.227808110.1080/07391102.2023.2278081
48. Wang G et al (2022) Helixfold: An efficient implementation of alphafold2 using a paddle. 10.48550/arXiv.2207.05477
49. Burley SK RCSB Protein Data Bank (RCSB.org): delivery of experimentally-determined PDB structures alongside one million computed structure models of proteins from artificial intelligence/machine learning Nucleic Acids Res 2023 51 D1 D488 D508 10.1093/nar/gkac1077 36420884
Burley SK et al (2023) RCSB Protein Data Bank (RCSB.org): delivery of experimentally-determined PDB structures alongside one million computed structure models of proteins from artificial intelligence/machine learning. Nucleic Acids Res 51(D1):D488–D508. 10.1093/nar/gkac107736420884 10.1093/nar/gkac1077
