The Pirates optioned Kelly to Triple-A Indianapolis on Sunday.
Kelly's stint in the big leagues lasted just five days, with the right-hander tossing a scoreless inning in relief during his lone appearance in Saturday's 4-3 loss to the Dodgers. The Pirates called up right-hander Khristian Curtis from Triple-A to replace Kelly in the bullpen.