Libreddit does this, and it shows a pointer when you hover over the bar/header where the username and upvote count are, to indicate that you can collapse the comment by clicking.