To remove focus on a Task, first select the Task title to open more details. Then, on the right hand side, click Remove Focus.

task-remove-focus