Techniques for database connection management and governance in a multi-tenant provider network are described. One or more database proxy instances connect to client applications and can obtain database connections for these client applications. The database connections may be pinned to particular client applications and/or multiplexed and thus shared by multiple client connections.