Sunday's 4-0 win at West Ham bolsters Liverpool's chance of a top four finish, but it is still possible for Arsenal to pip them to that all-important Champions League qualification place.
"I've been in the business long enough to know the biggest mistake is counting points before you have them," he said after the game.
"We won't do this. The first sentence the boys said in the dressing room - and I didn't have to say it - was 'one more game'. We want this Champions League position.
"Middlesbrough have nothing to lose but we have everything to lose," added former Borussia Dortmund manager Klopp.
"We have always known we will have to go until the end of the season, that is no problem for us.
"If we win we deserve to be in the Champions League. If not, we don't deserve it.
"We found a good mood against West Ham and if we find it in the next game then we have a good chance. But counting points in the next game is really silly, we won't do this."