S3162-118

1. Short title This Act may be cited as the Testing and Evaluation Systems for Trusted Artificial Intelligence Act of 2023 or the TEST AI Act of 2023.

2. Interagency coordination to facilitate testbeds Subsection (g) of section 22A of the National Institute of Standards and Technology Act (15 U.S.C. 278h–1) is amended to read as follows: In this subsection, the term artificial intelligence has the meaning given such term in section 5002 of the National Artificial Intelligence Act of 2020 (15 U.S.C. 9401). The Director shall, in coordination with the Secretary of Energy, the head of the interagency committee established under section 5103(a) of the National Artificial Intelligence Initiative Act of 2020 (15 U.S.C. 9413(a)), and such heads of such Federal agencies, private sector entities, and institutions of higher education as the head of such interagency committee considers appropriate, establish testbeds, including virtual and experimental environments, to support the development and testing of trustworthy artificial intelligence systems, including testbeds that support development of artificial intelligence guardrails, examine risks of misuse of such systems, and evaluate the vulnerabilities and conditions that may lead to failure in, malfunction of, or attacks on such systems. The Secretary of Commerce and the Secretary of Energy shall enter into a memorandum of understanding to implement the coordination between the Secretary of Energy and the Director required by paragraph (2). The memorandum shall be sufficient to ensure the Institute and other Federal agencies have access as may be necessary to the resources, personnel, and facilities at the Department of Energy, including the cross-cutting research and development programs— to advance artificial intelligence tools, systems, facilities, capabilities, and workforce needs; to improve the reliability and trustworthiness of artificial intelligence methods and solutions relevant to the mission of the Federal agencies conducting development or testing of artificial intelligence systems for use by the agency, or in conducting Federal oversight of commercial uses of artificial intelligence systems; and to establish testbeds, including a classified testbed as necessary, to support safeguards and systems to prevent the misuse of artificial intelligence systems, particularly in but not limited to weapons of mass destruction proliferation, undertake annual risk assessments of artificial intelligence misuse, formulate evaluation strategies, and employ testing and evaluation resources to support Federal oversight of artificial intelligence systems. (g)Testbeds(1)Definition of artificial intelligenceIn this subsection, the term artificial intelligence has the meaning given such term in section 5002 of the National Artificial Intelligence Act of 2020 (15 U.S.C. 9401).(2)In general The Director shall, in coordination with the Secretary of Energy, the head of the interagency committee established under section 5103(a) of the National Artificial Intelligence Initiative Act of 2020 (15 U.S.C. 9413(a)), and such heads of such Federal agencies, private sector entities, and institutions of higher education as the head of such interagency committee considers appropriate, establish testbeds, including virtual and experimental environments, to support the development and testing of trustworthy artificial intelligence systems, including testbeds that support development of artificial intelligence guardrails, examine risks of misuse of such systems, and evaluate the vulnerabilities and conditions that may lead to failure in, malfunction of, or attacks on such systems.(3)Memorandum of understanding(A)In generalThe Secretary of Commerce and the Secretary of Energy shall enter into a memorandum of understanding to implement the coordination between the Secretary of Energy and the Director required by paragraph (2).(B)RequirementsThe memorandum shall be sufficient to ensure the Institute and other Federal agencies have access as may be necessary to the resources, personnel, and facilities at the Department of Energy, including the cross-cutting research and development programs—(i)to advance artificial intelligence tools, systems, facilities, capabilities, and workforce needs;(ii)to improve the reliability and trustworthiness of artificial intelligence methods and solutions relevant to the mission of the Federal agencies conducting development or testing of artificial intelligence systems for use by the agency, or in conducting Federal oversight of commercial uses of artificial intelligence systems; and(iii)to establish testbeds, including a classified testbed as necessary, to support safeguards and systems to prevent the misuse of artificial intelligence systems, particularly in but not limited to weapons of mass destruction proliferation, undertake annual risk assessments of artificial intelligence misuse, formulate evaluation strategies, and employ testing and evaluation resources to support Federal oversight of artificial intelligence systems..

1. Short title This Act may be cited as the Testing and Evaluation Systems for Trusted Artificial Intelligence Act of 2024 or the TEST AI Act of 2024.

2. Pilot program on establishing testbeds to support development, red-teaming, and blue-teaming of artificial intelligence systems In this section: The term artificial intelligence blue-teaming means an effort to conduct operational vulnerability evaluations and provide mitigation techniques to entities who have a need for an independent technical review of the security posture of an artificial intelligence system. The term artificial intelligence system has the meaning given the term artificial intelligence in section 5002 of the National Artificial Intelligence Act of 2020 (15 U.S.C. 9401). The term artificial intelligence red-teaming means structured adversarial testing efforts of an artificial intelligence system. The term critical infrastructure has the meaning given such term in subsection (e) of the Critical Infrastructures Protection Act of 2001 (42 U.S.C. 5195c(e)). The term national security means— the protection of the United States from foreign aggression; and does not otherwise include the protection of the general welfare of the United States. The term testbed means a facility or mechanism equipped for conducting rigorous and replicable testing of tools and technologies to help evaluate the functionality, performance, and security of those tools or technologies. Not later than 1 year after the date of the enactment of this Act, the Director of the National Institute of Standards and Technology and the Secretary of Energy shall, in coordination with the head of the interagency committee established under section 5103(a) of the National Artificial Intelligence Initiative Act of 2020 (15 U.S.C. 9413(a)), private sector entities, and institutions of higher education as the Director and Secretary of Energy consider appropriate, jointly carry out a pilot program to assess the feasibility and advisability of establishing testbeds, including virtual and experimental environments, to support the development, red-teaming and blue-teaming of artificial intelligence systems. In carrying out the pilot program required by subsection (b), the Director and the Secretary shall jointly establish one or more testbeds for the purposes described in subsection (b), including testbeds that support development of artificial intelligence standards for identifying, evaluating, and mitigating cyber, data, and network vulnerabilities that if exploited would create substantial risks to critical infrastructure or national security. The primary focus of the pilot program required by subsection (b) shall be artificial intelligence systems used by Federal agencies or that are under evaluation for future use by Federal agencies. The Secretary of Commerce and the Secretary of Energy shall enter into a memorandum of understanding to implement the coordination between the Secretary of Energy and the Director required by subsection (b). The memorandum of understanding entered into under paragraph (1) shall be sufficient to ensure the National Institute of Standards and Technology has such access as may be necessary to the resources, personnel, and facilities at the Department of Energy, including the cross-cutting research and development programs— to employ testing and evaluation resources to support Federal agency adoption and use of artificial intelligence systems by improving the reliability, functionality, performance, and security of artificial intelligence systems used by the Federal agencies; to establish testbeds, including a classified testbed as necessary, to support the testing, evaluation and development of artificial intelligence systems to identify, evaluate, and mitigate cybersecurity, data, and network vulnerabilities that if exploited would create substantial risks to critical infrastructure or national security, such as weapons of mass destruction proliferation; and to support the development of testing and evaluation standards, tools, and technologies inclusive of standards, tools, and technologies for artificial intelligence red-teaming and artificial intelligence blue-teaming, for such purposes. Not later than 1 year after the commencement of the pilot program required by subsection (b), the Director and the Secretary of Energy shall jointly develop metrics to assess the effectiveness of the pilot program in achieving the requirements set forth under subsection (e)(2). Not later than 3 years after the commencement of the pilot program required by subsection (b) and not less frequently than once each year thereafter for the duration of the pilot program, the Director and the Secretary shall jointly— evaluate the success of the pilot program, using the metrics developed pursuant to subsection (f); and submit to Congress the findings of the Director and the Secretary with respect to the evaluation carried out pursuant to paragraph (1). The pilot program required by subsection (b) and the memorandum of understanding entered into under subsection (e) shall both terminate on the date that is 7 years after the date of the enactment of this Act. In this subsection: The term appropriate congressional committees means— the congressional intelligence committees (as defined in section 3 of the National Security Act of 1947 (50 U.S.C. 3003)); the Committee on Armed Services, the Committee on Energy and Natural Resources, the Committee on Foreign Relations, the Committee on the Judiciary, the Committee on Homeland Security and Governmental Affairs, the Committee on Commerce, Science, and Transportation, and the Committee on Appropriations of the Senate; and the Committee on Armed Services, the Committee on Energy and Commerce, the Committee on Foreign Affairs, the Committee on the Judiciary, the Committee on Homeland Security, the Committee on Space, Science, and Technology, and the Committee on Appropriations of the House of Representatives. The term country of risk means a country identified in the report submitted to Congress by the Director of National Intelligence in 2024 pursuant to section 108B of the National Security Act of 1947 ( 50 U.S.C. 3043b) (commonly referred to as the Annual Threat Assessment). The terms covered assignee and covered visitor mean a foreign national from a country of risk that is engaging in competitive behavior that directly threatens U.S. national security, who is not an employee of either the Department of Energy or the management and operations contractor operating a National Laboratory on behalf of the Department of Energy, and has requested access to the premises, information, or technology of a National Laboratory. The term Director means the Director of the Office of Intelligence and Counterintelligence of the Department of Energy (or their designee). The term foreign national has the meaning given the term alien in section 101(a) of the Immigration and Nationality Act ( 8 U.S.C. 1101(a)). The term National Laboratory has the meaning given the term in section 2 of the Energy Policy Act of 2005 ( 42 U.S.C. 15801). The term nontraditional collection threat means a threat posed by an individual not employed by a foreign intelligence service, who is seeking access to information about a capability, research, or organizational dynamics of the United States to inform a foreign adversary or non-state actor. It is the sense of the Senate that— before being granted access to the premises, information, or technology of a National Laboratory, citizens of foreign countries identified in the 2024 Annual Threat Assessment of the intelligence community as engaging in competitive behavior that directly threatens U.S. national security should be appropriately screened by the National Laboratory to which they seek access, and by the Office of intelligence and Counterintelligence of the Department, to identify risks associated with granting the requested access to sensitive military, or dual-use technologies; and identified risks should be mitigated. The Director shall, in consultation with the applicable Under Secretary of the Department of Energy that oversees the National Laboratory, or their designee, promulgate a policy to assess the counterintelligence risk that covered visitors or covered assignees pose to the research or activities undertaken at a National Laboratory. The Director shall provide advice to a National Laboratory on covered visitors and covered assignees when 1 or more of the following conditions are present: The Director has reason to believe that a covered visitor or covered assignee is a nontraditional intelligence collection threat. The Director is in receipt of information indicating that a covered visitor or covered assignee constitutes a counterintelligence risk to a National Laboratory. Advice provided to a National Laboratory in accordance with paragraph (1) shall include a description of the assessed risk. When appropriate, the Director shall, in consultation with the applicable Under Secretary of the Department of Energy that oversees the National Laboratory, or their designee, provide recommendations to mitigate the risk as part of the advice provided in accordance with paragraph (1). Not later than 90 days after the date of the enactment of this Act, and quarterly thereafter, the Secretary of Energy shall submit to the appropriate congressional committees a report, which shall include— the number of covered visitors or covered assignees permitted to access the premises, information, or technology of each National Laboratory; the number of instances in which the Director provided advice to a National Laboratory in accordance with subsection (e); and the number of instances in which a National Laboratory took action inconsistent with advice provided by the Director in accordance with subsection (e). Section 22A of the National Institute of Standards and Technology Act (15 U.S.C. 278h–1) is amended— by striking subsection (g); and by redesignating subsection (h) as subsection (g).