Kaoru's Grandfather. Kaoru's scars on the back was due to Gen'ichiro hitting him violently with bamboo cane when Kaoru has been trying to protect the mementos of his dead mother.

Manga only:

Manga only part2: