All duties performed and all power and authority possessed or exercised by the head of any executive department in and over any bureau, office, officer, board, branch, or division of the public service transferred to the Department of Commerce, or any business arising therefrom or pertaining thereto, or in relation to the duties performed by and authority conferred by law upon such bureau, officer, office, board, branch, or division of the public service, whether of an appellate or revisory character or otherwise, shall be vested in and exercised by the Secretary of Commerce.