With 29 points separating the two clubs and no points from their two encounters this season, the Liverpool boss knows things need to change.
"As much as it hurts to say it, the gulf between the two teams has become embarrassing," said Houllier.
"We're going to have to take maximum points from the games we have left to play at Anfield," added Houllier. "We're also going to need a result from at least one of our two away matches."
"We're still in there fighting and I am sure we won't play as badly as we did against Charlton in any of the games coming up," said Houllier.
"Fourth place is still open and there are four or five teams competing for it. We are still in there."