Is sexual consent more complicated than a ‘yes’ or ‘no’?

Why all this talk about sexual consent if it’s just about about saying ‘yes’ or ‘no’?