Rifai was sent down to AHL Toronto on Sunday.
Rifai didn't get into Saturday's lineup against Buffalo and will now head back to the minors. He has 17 points in 49 AHL appearances this season. With several injuries on the Maple Leafs' blue line, Rifai could be promoted again before Monday's tilt with Florida.