They're about the same age right? They would have gone to school together. Maybe Grindelwald is Graves's senior and he likes to tease the smart little junior, play harmless pranks on him.

They can be whatever house you want. I'm thinking Slytherin Grindelwald and Ravenclaw Graves.

Can have smut or not, doesn't matter to me!