Smish

• https://www.mdpi.com/2079-9292/11/4/540 $f(x)=x\cdot \tanh [\ln (1+sigmoid(x))]$
• It’s similar to Mish: $f(x)=x\cdot \tanh [\ln (1+e^x)]$
• green is mish
• purple is Sigmoid Linear Unit (Swish)
  • Note: it converges with Mish as $x\to \infty$
• red is smish
  • Note: Smish doesn’t converge with Swish as $x\to \infty$