Theoretical studies on the interactions of XIAP-BIR3 domain with bicyclic and tricyclic core monovalent Smac mimetics.

X-linked IAP can bind caspase-9 and inhibit its activity. Mitochondrial protein Smac/DIABLO can also interact with XIAP and relieve the inhibition on caspase-9 to induce apoptosis. A series of artificial Smac mimetics have been used to mimic the Smac N-terminal tetrapeptide AVPI to bind to XIAP-BIR3, but these structural diverse mimetics exhibited distinct binding affinities. To get an insight into the binding nature and optimize the structures, molecular docking and dynamics simulations were used to study the binding of XIAP-BIR3 with three groups of Smac mimetics. The docking results reveal that these Smac mimetics anchored on the surface groove of XIAP-BIR3 and superimposed well with AVPI. The modifications on the seven-membered ring of bicyclic core segment do not strengthen the binding affinity, while a benzyl introduced to the five-membered ring is favorable to the binding. Molecular dynamics simulations on three typical systems show that these complexes are very stable. Hydrogen bonds between the bicyclic core segment and Thr308 play critical roles in maintaining the stability of complex. The binding free energies calculated by MM_PBSA method are consistent with the experimental results.