Brown will start at cornerback with Greg Toler (knee) inactive against Jacksonville, Bob Kravitz of WTHR TV reports.
Brown had been placed on injured reserve with the Colts in October and later released. He was signed last week. Brown started three games earlier in the season, so he should know the defense. He'll start opposite Vontae Davis.