The Secretary is directed to refer to the armed services all scientific or technical information, coming to his attention, which he deems to have an immediate or potential practical military value or significance, and to refer to the heads of other Government agencies such scientific or technical information as relates to activities within the primary responsibility of such agencies.