There shall be in said department a chief clerk and such other clerical assistants, inspectors, and special agents as may from time to time be provided for by Congress.