Sqlcmd

SQL Server CLI client in Powershell

Not a part of SQL Server directly, but SQL Server includes an extension to Powershell called a powershell provider