Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set

An official website of the United States government Here's how you know

Official websites use .gov

A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS

A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

This content will become publicly available on May 2, 2026

Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set