If there is probable cause to believe that a probationer or a person on supervised release has violated a condition of his probation or release, he may be arrested, and, upon arrest, shall be taken without unnecessary delay before the court having jurisdiction over him. A probation officer may make such an arrest wherever the probationer or releasee is found, and may make the arrest without a warrant. The court having supervision of the probationer or releasee, or, if there is no such court, the court last having supervision of the probationer or releasee, may issue a warrant for the arrest of a probationer or releasee for violation of a condition of release, and a probation officer or United States marshal may execute the warrant in the district in which the warrant was issued or in any district in which the probationer or releasee is found.