Skip to main content
Databricks logo

Overview

Add Databricks to any ModuleX agent or workflow. Manage Databricks jobs, runs, SQL warehouses, and vector search indexes via the Databricks REST API ({domain}.cloud.databricks.com).
Categories: Analytics & Data · Data Engineering · Analytics · Machine Learning · Auth: Databricks Personal Access Token · Actions: 41

Authentication

Databricks Personal Access Token

Authenticate using your Databricks workspace domain and a personal access token.

Required Credentials

Available Actions

Parameters

string
Identifier of a job. If omitted with all_queued_runs=true, cancels all queued runs in the workspace.
boolean
Cancel all queued runs. If no job_id is provided, all queued runs in the workspace are canceled.

Response

Parameters

string
required
Identifier of the run to cancel.

Response

Parameters

string
required
The name of the vector search endpoint to create.

Response

Parameters

string
required
JSON string of task specifications for this job.
string
An optional name for the job.
string
JSON string of tags associated with the job.
string
JSON string of job cluster specifications.
string
JSON string of email notification settings.
string
JSON string of webhook notification settings.
integer
Timeout in seconds applied to each run of this job.
string
JSON string of schedule definition with quartz_cron_expression and timezone_id.
integer
Maximum number of concurrent runs for the job.
string
JSON string specifying a remote Git repository for task source code.
string
JSON string of permissions to set on the job.

Response

Parameters

string
required
A human-readable name for the warehouse.
string
required
Size of the cluster: 2X-Small, X-Small, Small, Medium, Large, X-Large, 2X-Large, 3X-Large, 4X-Large.
integer
Minutes of inactivity before auto-stop. 0 disables. Must be 0 or >= 10. (Default: 10)
integer
Minimum number of clusters to maintain. (Default: 1)
integer
Maximum number of clusters for autoscaling. (Default: 1)
boolean
Whether to use Photon optimized clusters.
boolean
Whether to use serverless compute.
string
Warehouse type: TYPE_UNSPECIFIED, CLASSIC, or PRO.
string
Spot instance policy: POLICY_UNSPECIFIED, COST_OPTIMIZED, RELIABILITY_OPTIMIZED.
string
JSON string of channel details.
string
JSON string of custom key-value tags.

Response

Parameters

string
required
A unique name for the index (e.g., main_catalog.docs.en_wiki_index).
string
required
The name of the vector search endpoint.
string
required
Type of index: DELTA_SYNC or DIRECT_ACCESS.
string
required
The primary key column for the index.
string
The Delta table backing the index (required for DELTA_SYNC).
string
JSON array of column names to sync from the source Delta table.
string
JSON array of embedding source column configs.
string
The schema of the index in JSON format (required for DIRECT_ACCESS). Sent on the wire as schema_json.
string
Pipeline type: TRIGGERED or CONTINUOUS. (Default: TRIGGERED)

Response

Parameters

string
required
The name of the vector search endpoint to delete.

Response

Parameters

string
required
Identifier of the job to delete.

Response

Parameters

string
required
Identifier of the run to delete.

Response

Parameters

string
required
The ID of the SQL Warehouse to delete.

Response

Parameters

string
required
The name of the vector search index to delete.

Response

Parameters

string
required
The name of the vector search index.
string
required
JSON array of primary key values to delete.

Response

Parameters

string
required
The ID of the SQL Warehouse to edit.
string
New logical name for the warehouse.
string
Size of clusters: 2X-Small, X-Small, Small, Medium, Large, X-Large, 2X-Large, 3X-Large, 4X-Large.
integer
Minutes of inactivity before auto-stop. 0 disables. Must be 0 or >= 10.
integer
Minimum number of clusters.
integer
Maximum number of clusters for autoscaling.
boolean
Whether to use Photon optimized clusters.
boolean
Whether to use serverless compute.
string
Warehouse type: TYPE_UNSPECIFIED, CLASSIC, or PRO.
string
Spot instance policy: POLICY_UNSPECIFIED, COST_OPTIMIZED, RELIABILITY_OPTIMIZED.
string
JSON string of custom key-value tags.
string
JSON string of channel details.

Response

Parameters

string
required
Identifier of the run to export.
string
Which views to export: CODE, DASHBOARDS, or ALL. Defaults to CODE.

Response

Parameters

string
required
The name of the vector search endpoint.

Response

Parameters

string
required
Identifier of the job.

Response

Parameters

string
required
Identifier of the job.

Response

Parameters

string
required
Identifier of the run.
boolean
Whether to include the repair history in the response.
boolean
Whether to include resolved parameter values in the response.

Response

Parameters

string
required
Identifier of the run.

Response

Parameters

string
required
The ID of the SQL Warehouse.

Response

Response

Parameters

string
required
The ID of the SQL Warehouse.

Response

Parameters

string
required
The name of the vector search index.

Response

Parameters

integer
Maximum number of endpoints to return. (Default: 100)

Response

Parameters

boolean
Whether to include task and cluster details in the response.
string
Optional name to filter on.
integer
Maximum number of API page requests to make (1-10).

Response

Parameters

string
Identifier of a job to filter runs.
boolean
Set to true to return only active runs.
integer
Maximum number of runs to return. (Default: 100)

Response

Response

Parameters

string
required
The name of the vector search endpoint.

Response

Parameters

string
required
The name of the vector search index.
string
required
JSON array of column names to include in the response.
string
Free-text query for semantic search.
string
JSON array of floats representing the embedding vector.
string
JSON string representing query filters.
integer
Number of results to return. (Default: 10)
boolean
Whether to include embedding vectors in the results.

Response

Parameters

string
required
Identifier of the run to repair.
string
JSON array of task keys to repair.
boolean
If true, repair all failed tasks.
boolean
Controls whether the pipeline should perform a full refresh.

Response

Parameters

string
required
Identifier of the job.
string
required
JSON string of the new settings that fully replaces all existing job settings.

Response

Parameters

string
required
Identifier of the job to run.
string
JSON array of parameters for jobs with JAR tasks.
string
JSON object of key-value pairs for notebook tasks.
string
JSON array of parameters for Python tasks.
string
JSON array of parameters for spark submit tasks.

Response

Parameters

string
required
The name of the vector search index.
string
Primary key of the last entry returned in the previous scan. Leave empty to start from the beginning.
integer
Number of results to return. (Default: 10)

Response

Parameters

string
required
Identifier of the job.
string
required
JSON string of permission objects with user_name/group_name/service_principal_name and permission_level.

Response

Parameters

string
Instance profile ARN for IAM role (AWS).
string
Service account email for GCP workspaces.
string
Security policy: NONE or DATA_ACCESS_CONTROL.
string
JSON string of channel details.
string
JSON array of enabled warehouse type objects.
string
JSON array of general config key/value pairs.
string
JSON array of global parameter key/value pairs.

Response

Parameters

string
required
The ID of the SQL Warehouse.
string
required
JSON string of access control entries with user_name/group_name/service_principal_name and permission_level.

Response

Parameters

string
required
The ID of the SQL Warehouse to start.

Response

Parameters

string
required
The ID of the SQL Warehouse to stop.

Response

Parameters

string
required
The name of the vector search index to synchronize.

Response

Parameters

string
required
Identifier of the job to update.
string
required
JSON string of updated job settings (only fields to change).
string
JSON array of field paths to remove from the job settings.

Response

Parameters

string
required
The name of the vector search index.
string
required
JSON array of row objects to upsert.

Response

Limits & Quotas

  • Databricks API rate limits vary by endpoint and workspace tier. Consult your workspace admin for specific limits.
  • Jobs API: typically 30 requests/second per workspace.
  • Vector Search API: limits depend on endpoint configuration and provisioned capacity.
  • SQL Warehouses API: standard REST API limits apply.
  • Error model: non-2xx responses are caught and returned as success=False + error rather than raising.

Google Tag Manager

Microsoft Power BI

Mixpanel