The French striker earned a penalty and scored from the spot to give the Reds the lead on 20 minutes.
Seven minutes later he added a second to make it 2-0.
Gareth Barry equalised for the visitors in the se3cond half but Rafael Benitez's side held on for the three points.