Fabius, whose departure has long been rumored, replied "yes" when journalists asked if he was taking part in his final cabinet meeting on Wednesday.