The Reds went ahead through debutant Jordan Rossiter, but Boro equalised and took the game into extra time.
Substitute Suso scored what Liverpool fans thought would be the winner, but once again the visitors equalised.
A thrilling penalty shoot-out then followed, and the Reds finally won 14-13.