If we're shown not to have done anything wrong then it absolutely is defamatory. He didn’t say we had been charged, he said we had cheated and implied we had done it lots of times.
Definitely actionable if not shown to be true.
No point suing him, other than for fun, though.