I haven't considered Graves not feeling anything before. I assumed a person like him would feel bad for Newt, maybe a little frustrated at himself for not being able to defend himself against Grindelwald, but what if Graves just felt sorry for Newt... but that's all? He doesn't want to meet Newt, he doesn't want to talk with him - why should he? He does not really care that Newt seems to be slightly afraid of him; it's Newt's problem not his, Graves'.

What I am trying to say is that I'm dying to read about Graves getting to know what Grindelwald did to Newt with Graves' face.