`kiwi.modules.common.activations`¶

Module Contents¶

`gelu`(x)	gelu activation function copied from pytorch-pretrained-BERT.
`swish`(x)	swusg activation function copied from pytorch-pretrained-BERT.

kiwi.modules.common.activations.gelu(x)¶: gelu activation function copied from pytorch-pretrained-BERT.

kiwi.modules.common.activations.swish(x)¶: swusg activation function copied from pytorch-pretrained-BERT.