Dirk Kuyt squandered the Reds' sixth spot-kick this season just before Laurent Koscielny put through his own net, but Van Persie equalised with a close-range header from a rare Gunners' chance.
The home side dominated the second half but failed to capitalise and were punished by the Holland international's second in added time.
