NY State Senate Bill 2025-S934

Current Bill Status - In Senate Committee Internet And Technology Committee

Introduced
- In Committee Assembly
- In Committee Senate
- On Floor Calendar Assembly
- On Floor Calendar Senate
- Passed Assembly
- Passed Senate
Delivered to Governor
Signed By Governor

Please enter your contact information

First Name

Last Name

Email Address

A valid email address is required.

Home address is used to determine the senate district in which you reside. Your support or opposition to this bill is then shared immediately with the senator who represents you.

Optional services from the NY State Senate:

Create an account. An account allows you to officially support or oppose key legislation, sign petitions with a single click, and follow issues, committees, and bills that matter to you. When you create an account, you agree to this platform's terms of participation.

Include a custom message for your Senator? (Optional)

Enter a message to your senator. Many New Yorkers use this to share the reasoning behind their support or opposition to the bill. Others might share a personal anecdote about how the bill would affect them or people they care about.

Actions

View Actions

	Assembly Actions - Lowercase Senate Actions - UPPERCASE
Jan 08, 2025	referred to internet and technology

2025-S934 (ACTIVE) - Details

Current Committee:: Senate Internet And Technology
Law Section:: General Business Law
Laws Affected:: Add §399-zzzzzz, Gen Bus L
Versions Introduced in 2023-2024 Legislative Session:: S9450

2025-S934 (ACTIVE) - Summary

Requires the owner, licensee or operator of a generative artificial intelligence system to conspicuously display a warning on the system's user interface that is reasonably calculated to consistently apprise the user that the outputs of the generative artificial intelligence system may be inaccurate and/or inappropriate.

2025-S934 (ACTIVE) - Sponsor Memo

                                 
BILL NUMBER: S934

SPONSOR: GONZALEZ
 
TITLE OF BILL:

An act to amend the general business law, in relation to requiring warn-
ings on generative artificial intelligence systems

 
PURPOSE OR GENERAL IDEA OF BILL:

Requires warnings on generative artificial intelligence systems.

 
SUMMARY OF PROVISIONS:

399-zzzzzz(1): Defines important terms.  399-zzzzzz(2): Requires that
all generative AI systems have a conspicuous warning on their user
interface which reasonably apprises the user that the outputs of the
system may be inaccurate.  399-zzzzzz(3): Provides penalties.

 
JUSTIFICATION:

It was recently discovered that a generative artificial intelligence
chatbot was fabricating claims of sexual harassment about New York
lawmakers.

Generative artificial intelligence opens the door for numerous benefi-
cial use cases. However, as it is still in its infancy, generative Al
has the potential to hallucinate that is, confidently provide false or
misleading information.

The user interfaces of the platforms are easy- to-use by design, so they
are accessible to users who do not fully understand Al and how/ why it
hallucinates false information. Therefore, it is important that users be
apprise of the fact that these systems can be inaccurate, particularly
when such information can be falser regarding another, or even dangerous
to the user (for example, if the generative Al system provided improper
medical information).

An internal study has revealed that, of a sample of the 8 widely used
chatbots, only 4 make their warnings consistently visible to the user on
their web interface and only 3 make their warnings consistently visible
to the user on their mobile interface. Of the 8 chatbots, a warning is
visible at least for a short period of time on 6 chatbots on their web
interface and 5 chatbots on their mobile interface (though, this means
that the warning will disappear or effectively disappear after the first
message or few messages are sent).

After further testing of the 8 chatbots studied, at least one other
chatbot repeated the false claims of sexual harassment, with the chatbot
going so far as even providing the name of a fake accuser and a fabri-
cated background. A third chatbot provided other, less serious, false
accusations., One chatbot refused to answer any questions related to
public or priVate'persons, one chatbot refused to engage in òany conver-
sation related to sensitive topics, and three chatbots properly failed
to provide any false information. The chatbot that originally was fabri-
cating the claims of sexual harassment has since ceased doing so.

 
PRIOR LEGISLATIVE HISTORY:

2023-2024 S.9450A PASSED SENATE / A.10103B Third Reading

 
DIFFERENCE BETWEEN ORIGINAL AND AMENDED:

Adjusted the definitions of generative artificial intelligence systems
and artificial intelligence.

 
FISCAL IMPLICATIONS FOR STATE AND LOCAL GOVERNMENTS:

N/A

 
EFFECTIVE DATE:
This act shall take effect on the ninetieth day after it shall have
become law.

2025-S934 (ACTIVE) - Bill Text download pdf

                             
                     S T A T E   O F   N E W   Y O R K
 ________________________________________________________________________
 
                                    934
 
                        2025-2026 Regular Sessions
 
                             I N  S E N A T E
 
                                (PREFILED)
 
                              January 8, 2025
                                ___________
 
 Introduced  by Sen. GONZALEZ -- read twice and ordered printed, and when
   printed to be committed to the Committee on Internet and Technology
 
 AN ACT to amend the general business law, in relation to requiring warn-
   ings on generative artificial intelligence systems

   THE PEOPLE OF THE STATE OF NEW YORK, REPRESENTED IN SENATE AND  ASSEM-
 BLY, DO ENACT AS FOLLOWS:
 
   Section 1. The general business law is amended by adding a new section
 399-zzzzzz to read as follows:
   §  399-ZZZZZZ. WARNINGS ON GENERATIVE ARTIFICIAL INTELLIGENCE SYSTEMS.
 1. AS USED IN THIS SECTION THE FOLLOWING TERMS SHALL HAVE THE  FOLLOWING
 MEANINGS:
   (A) "GENERATIVE ARTIFICIAL INTELLIGENCE SYSTEM" SHALL MEAN ANY ARTIFI-
 CIAL  INTELLIGENCE SYSTEM WHOSE PRIMARY FUNCTION IS TO GENERATE CONTENT,
 WHICH CAN TAKE THE FORM OF CODE, TEXT, IMAGES, AND MORE.
   (B) "ARTIFICIAL INTELLIGENCE" SHALL MEAN A MACHINE-BASED  SYSTEM  THAT
 CAN,  FOR  A  GIVEN  SET  OF HUMAN-DEFINED OBJECTIVES, MAKE PREDICTIONS,
 RECOMMENDATIONS, OR DECISIONS INFLUENCING REAL OR VIRTUAL  ENVIRONMENTS.
 ARTIFICIAL  INTELLIGENCE  SYSTEMS USE MACHINE- AND HUMAN-BASED INPUTS TO
 PERCEIVE REAL AND VIRTUAL ENVIRONMENTS; ABSTRACT SUCH  PERCEPTIONS  INTO
 MODELS  THROUGH ANALYSIS IN AN AUTOMATED MANNER; AND USE MODEL INFERENCE
 TO FORMULATE OPTIONS FOR INFORMATION OR ACTION. THIS DEFINITION INCLUDES
 BUT IS NOT LIMITED TO SYSTEMS THAT USE MACHINE LEARNING, LARGE  LANGUAGE
 MODEL,  NATURAL  LANGUAGE  PROCESSING, AND COMPUTER VISION TECHNOLOGIES,
 INCLUDING GENERATIVE AI.
   2. THE OWNER, LICENSEE OR OPERATOR OF A GENERATIVE ARTIFICIAL INTELLI-
 GENCE SYSTEM SHALL CONSPICUOUSLY DISPLAY A WARNING ON THE SYSTEM'S  USER
 INTERFACE THAT IS REASONABLY CALCULATED TO CONSISTENTLY APPRISE THE USER
 THAT THE OUTPUTS OF THE GENERATIVE ARTIFICIAL INTELLIGENCE SYSTEM MAY BE
 INACCURATE AND/OR INAPPROPRIATE.
 
  EXPLANATION--Matter in ITALICS (underscored) is new; matter in brackets
                       [ ] is old law to be omitted.
                                                            LBD01087-01-5

 S. 934                              2
 
   3.  WHERE  SUCH OWNER, LICENSEE OR OPERATOR OF A GENERATIVE ARTIFICIAL
 INTELLIGENCE SYSTEM FAILS TO PROVIDE THE WARNING REQUIRED IN SUBDIVISION
 TWO OF THIS SECTION, SUCH OWNER, LICENSEE OR OPERATOR SHALL BE  ASSESSED
 A  CIVIL  PENALTY  OF THE LESSER OF TWENTY-FIVE DOLLARS PER USER OF SUCH
 SYSTEM  OR ONE HUNDRED THOUSAND DOLLARS. EACH CALENDAR YEAR DURING WHICH
 A VIOLATION CONTINUES SHALL CONSTITUTE A SEPARATE VIOLATION.
   § 2. This act shall take effect on the ninetieth day  after  it  shall
 have become a law.

Comments

Open Legislation is a forum for New York State legislation. All comments are subject to review and community moderation is encouraged.

Comments deemed off-topic, commercial, campaign-related, self-promotional; or that contain profanity, hate or toxic speech; or that link to sites outside of the nysenate.gov domain are not permitted, and will not be published. Attempts to intimidate and silence contributors or deliberately deceive the public, including excessive or extraneous posting/posts, or coordinated activity, are prohibited and may result in the temporary or permanent banning of the user. Comment moderation is generally performed Monday through Friday. By contributing or voting you agree to the Terms of Participation and verify you are over 13.

Create an account. An account allows you to sign petitions with a single click, officially support or oppose key legislation, and follow issues, committees, and bills that matter to you. When you create an account, you agree to this platform's terms of participation.

Senate Bill S934

Sponsored By

Current Bill Status - In Senate Committee Internet And Technology Committee

2025-S934 (ACTIVE) - Details

2025-S934 (ACTIVE) - Summary

2025-S934 (ACTIVE) - Sponsor Memo

2025-S934 (ACTIVE) - Bill Text download pdf

Comments

Senate Bill S934

Share this bill

Sponsored By

Kristen Gonzalez

Current Bill Status - In Senate Committee Internet And Technology Committee

2025-S934 (ACTIVE) - Details

2025-S934 (ACTIVE) - Summary

2025-S934 (ACTIVE) - Sponsor Memo

2025-S934 (ACTIVE) - Bill Text download pdf

Comments