I agree that the series is clear that there was violence and a violation of consent. What's more, Hagiwara explicitly calls Nakarai out for it after seeing his bruises. It's subtle (and well acted) but clear: a moment before, Hagiwara might have let Nakarai walk away and believe his story, let him be with Fujisawa; a moment after, he refuses to, and Nakarai can't pretend any more. Also, remember Hagiwara deletes Nakarai's contact only after Hiraiwa reassures him that Nakarai is fine now.