During the summer of 2008, he also signed a contract with VfB Stuttgart's first team, for which he made his competitive debut in the first round of the DFB-Pokal on 10 August 2008 in their 5–0 away victory over Hansa Lüneburg.

On 15 January 2017, Rudy was transferred to Bayern Munich on 1 July 2017 after his Hoffenheim contract expired.[5] On 6 August 2017, Rudy made his debut in a 5–4 penalty-shootout victory over Borussia Dortmund in the 2017 DFL-Supercup.[6][7] In his first Bundesliga match with the club, he provided an assist from the free-kick to his fellow Bayern newcomer and his former Hoffenheim teammate Niklas Süle in a 3–1 win over Bayer Leverkusen.[8] Rudy scored his first goal for Bayern Munich in a 3–0 victory over Hannover in the Bundesliga.[9]