Nevin was optioned to Triple-A Norfolk after Tuesday's win over the Twins, Rich Dubroff of BaltimoreBaseball.com reports.
The 24-year-old was promoted Friday and went 1-for-5 with a walk and two strikeouts in two games during his first stint in the majors. Nevin could rejoin the Orioles later in the season if the team needs corner-infield depth.