# Spark SQL

<!-- BEGIN GENERATED:intro -->

The Spark SQL connector is a [Palantir-provided driver](../../data-integration/foundry-provided-drivers/index.md) for Spark SQL.

To create a new Spark SQL source, follow the [standard setup flow for Palantir-provided drivers](../../data-integration/foundry-provided-drivers/index.md#setup), then use the sections below for Spark SQL-specific configuration and networking. For the complete property reference, see the [official Spark SQL driver documentation ↗](https://cdn.cdata.com/help/ESM/jdbc/pg_connectionj.htm).

<!-- END GENERATED:intro -->

<!-- BEGIN GENERATED:capabilities -->

:::callout{theme="neutral" title="Beta"}
The Spark SQL connector is in the [beta](../../platform-overview/development-life-cycle/index.md) phase of development and may not be available on your enrollment. Functionality may change during active development.
:::

## Supported capabilities

| Capability | Status |
|---|---|
| Exploration | 🟡 Beta |
| Batch syncs | 🟡 Beta |
| Incremental | 🟡 Beta |
| [Table exports](#table-exports) | 🟡 Beta |

<!-- END GENERATED:capabilities -->

<!-- BEGIN GENERATED:configuration -->

## Configuration

The properties below are mandatory or recommended.

| Property | Required? | Description | Default |
|---|---|---|---|
| [`AuthScheme` ↗](https://cdn.cdata.com/help/ESM/jdbc/RSBSparksql_p_AuthScheme.htm) | Mandatory | The authentication scheme used. Accepted entries are Plain, LDAP, NOSASL, and Kerberos. | `Plain` |
| [`Server` ↗](https://cdn.cdata.com/help/ESM/jdbc/RSBSparksql_p_Server.htm) | Mandatory | The host name or IP address of the server hosting the SparkSQL database. | `{serverAddress}` |
| [`UseSSL` ↗](https://cdn.cdata.com/help/ESM/jdbc/RSBSparksql_p_UseSSL.htm) | Mandatory | Specifies whether to use SSL Encryption when connecting to Hive. | `TRUE` |
| [`Database` ↗](https://cdn.cdata.com/help/ESM/jdbc/RSBSparksql_p_Database.htm) | Recommended | The name of the SparkSQL database. | — |
| [`Password` ↗](https://cdn.cdata.com/help/ESM/jdbc/RSBSparksql_p_Password.htm) | Recommended | The password used to authenticate with SparkSQL. | — |
| [`Port` ↗](https://cdn.cdata.com/help/ESM/jdbc/RSBSparksql_p_Port.htm) | Recommended | The port for the SparkSQL database. | `10000` |
| [`TransportMode` ↗](https://cdn.cdata.com/help/ESM/jdbc/RSBSparksql_p_TransportMode.htm) | Recommended | The transport mode to use to communicate with the Hive server. Accepted entries are BINARY and HTTP. | `BINARY` |
| [`User` ↗](https://cdn.cdata.com/help/ESM/jdbc/RSBSparksql_p_User.htm) | Recommended | The username used to authenticate with SparkSQL. | — |

<!-- END GENERATED:configuration -->

<!-- BEGIN GENERATED:networking -->

## Networking

The table below lists the domains that the source must be able to access to run.

For each domain, add a corresponding [egress policy](../../administration/configure-egress/index.md). If the source is hosted on-premises and not directly reachable from Foundry, use an [agent proxy egress policy](../../administration/configure-egress/index.md#agent-proxy-egress-policies) instead. The agent host itself must also be able to reach the listed domains. See [using an agent as a proxy](../../data-connection/agent-proxy/index.md) for details.

| Domain  | Required |
|--- |--- |
| \<Server>:\<Port> | Always. Server and Port connection properties; default `Port=10000` |
| \<KerberosKDC>:88 | If `AuthScheme=Kerberos` |
| \<KerberosServiceKDC>:88 | If `AuthScheme=Kerberos` and Kerberos topology uses multiple realms |

<!-- END GENERATED:networking -->

<!-- BEGIN GENERATED:table-exports -->

## Table exports

This connector supports table exports. Learn how to [set up a table export](../../data-connection/export-overview/index.md#table-exports).

<!-- END GENERATED:table-exports -->