A linear function would fit the data only to a straight line, whereas nonlinear functions can capture more interesting behaviors. “The curve of your activation function is introducing that ...