The Northern Powerhouse minister has quit the Government to “pursue other challenges” as Theresa May continued to put her frontbench team together.
Andrew Percy said he had been asked to continue in his role at the Department for Communities and Local Government but had “reluctantly” decided to step down.
The Brigg and Goole MP said the Prime Minister “continues to enjoy my full support” from the backbenches.
In a post on his Facebook page, he said: “Was a privilege to be asked to continue serving in my role in Government as a minister, but I have reluctantly decided to step down and leave the Government.
“I thank the Prime Minister for offering me this role again but I have decided to pursue other challenges. She continues to enjoy my full support from the backbenches.
“I will not be making any further comment or doing any media on my decision. Thanks to all my civil servants to their incredible support in the role.
“My work as our local MP continues unchanged.”
In other changes in the ministerial ranks, former soldier and Westminster terror attack hero Tobias Ellwood has been given a new role at the Ministry of Defence.
The Conservative MP for Bournemouth East, who went to the aid of Pc Keith Palmer after he was fatally stabbed by Khalid Masood on March 22, had been at the Foreign Office.
Mr Ellwood tweeted: “Delighted and honoured to be appointed as minister in the Ministry of Defence. Thanks for all the support I received during my 3 yrs at FCO.”
Meanwhile it was confirmed that junior Brexit minister Lord Bridges of Headley has left his post.
Among those ministers continuing in their roles is Tory MP Tracey Crouch (Chatham and Aylesford) who was reappointed as sport minister while apparently watching the England v France friendly in Paris, which was attended by the Prime Minister and French President Emmanuel Macron.
Ms Crouch tweeted: “Missed @HKane goal. Ironically was on phone being reappointed @DCMS Sport, Tourism & Heritage minister. Obviously delighted (about goal too).”