The Rays optioned Milner to Triple-A Durham on Wednesday, Juan Toribio of MLB.com reports.
Milner's stay with the big club lasted just two days, with the lefty reliever making one two-inning appearance for Tampa Bay. The Rays will replace Milner in the bullpen with right-hander Aaron Slegers, who was called up from Durham in a corresponding move.