Overview
Add Databricks to any ModuleX agent or workflow. Manage Databricks jobs, runs, SQL warehouses, and vector search indexes via the Databricks REST API ({domain}.cloud.databricks.com).
Authentication
Databricks Personal Access Token
Authenticate using your Databricks workspace domain and a personal access token.Required Credentials
Available Actions
cancel_all_runs — Cancel all active runs for a job.
cancel_all_runs — Cancel all active runs for a job.
cancel_run — Cancel a job run. The run is canceled asynchronously.
cancel_run — Cancel a job run. The run is canceled asynchronously.
create_endpoint — Create a new vector search endpoint.
create_endpoint — Create a new vector search endpoint.
create_job — Create a new Databricks job.
create_job — Create a new Databricks job.
Parameters
Response
create_sql_warehouse — Create a new SQL Warehouse in Databricks.
create_sql_warehouse — Create a new SQL Warehouse in Databricks.
Parameters
10)1)1)Response
create_vector_search_index — Create a new vector search index in Databricks.
create_vector_search_index — Create a new vector search index in Databricks.
Parameters
schema_json.TRIGGERED)Response
delete_endpoint — Delete a vector search endpoint.
delete_endpoint — Delete a vector search endpoint.
delete_job — Delete a job. Deleted jobs cannot be recovered.
delete_job — Delete a job. Deleted jobs cannot be recovered.
delete_run — Delete a non-active run. Returns an error if the run is active.
delete_run — Delete a non-active run. Returns an error if the run is active.
delete_sql_warehouse — Delete a SQL Warehouse by ID.
delete_sql_warehouse — Delete a SQL Warehouse by ID.
delete_vector_search_index — Delete a vector search index.
delete_vector_search_index — Delete a vector search index.
delete_vector_search_index_data — Delete rows from a Direct Access vector index by primary-key values.
delete_vector_search_index_data — Delete rows from a Direct Access vector index by primary-key values.
edit_sql_warehouse — Edit the configuration of an existing SQL Warehouse.
edit_sql_warehouse — Edit the configuration of an existing SQL Warehouse.
Parameters
Response
export_run — Export and retrieve the job run task.
export_run — Export and retrieve the job run task.
get_endpoint — Get details of a specific vector search endpoint.
get_endpoint — Get details of a specific vector search endpoint.
get_job — Retrieve the details for a single job.
get_job — Retrieve the details for a single job.
get_job_permissions — Get permissions of a job.
get_job_permissions — Get permissions of a job.
get_run — Retrieve the metadata of a run.
get_run — Retrieve the metadata of a run.
get_run_output — Retrieve the output and metadata of a single task run.
get_run_output — Retrieve the output and metadata of a single task run.
get_sql_warehouse — Retrieve details for a specific SQL Warehouse.
get_sql_warehouse — Retrieve details for a specific SQL Warehouse.
get_sql_warehouse_config — Retrieve the global configuration for SQL Warehouses.
get_sql_warehouse_config — Retrieve the global configuration for SQL Warehouses.
Response
get_sql_warehouse_permissions — Retrieve the permissions for a specific SQL Warehouse.
get_sql_warehouse_permissions — Retrieve the permissions for a specific SQL Warehouse.
get_vector_search_index — Retrieve details about a specific vector search index.
get_vector_search_index — Retrieve details about a specific vector search index.
list_endpoints — List all vector search endpoints.
list_endpoints — List all vector search endpoints.
list_jobs — List all jobs using automatic pagination.
list_jobs — List all jobs using automatic pagination.
list_runs — List all runs available to the user.
list_runs — List all runs available to the user.
list_sql_warehouses — List all SQL Warehouses available in the workspace.
list_sql_warehouses — List all SQL Warehouses available in the workspace.
Response
list_vector_search_indexes — List all vector search indexes for a given endpoint.
list_vector_search_indexes — List all vector search indexes for a given endpoint.
query_vector_search_index — Query a specific vector search index.
query_vector_search_index — Query a specific vector search index.
Parameters
10)Response
repair_run — Re-run one or more tasks.
repair_run — Re-run one or more tasks.
reset_job — Overwrite all settings for a job.
reset_job — Overwrite all settings for a job.
run_job_now — Run a job now and return the ID of the triggered run.
run_job_now — Run a job now and return the ID of the triggered run.
scan_vector_search_index — Scan a vector search index and return entries after a given primary key.
scan_vector_search_index — Scan a vector search index and return entries after a given primary key.
set_job_permissions — Set permissions on a job.
set_job_permissions — Set permissions on a job.
set_sql_warehouse_config — Update the global configuration for SQL Warehouses.
set_sql_warehouse_config — Update the global configuration for SQL Warehouses.
Parameters
Response
set_sql_warehouse_permissions — Update the permissions for a specific SQL Warehouse.
set_sql_warehouse_permissions — Update the permissions for a specific SQL Warehouse.
start_sql_warehouse — Start a SQL Warehouse by ID.
start_sql_warehouse — Start a SQL Warehouse by ID.
stop_sql_warehouse — Stop a SQL Warehouse by ID.
stop_sql_warehouse — Stop a SQL Warehouse by ID.
sync_vector_search_index — Synchronize a Delta Sync vector search index.
sync_vector_search_index — Synchronize a Delta Sync vector search index.
update_job — Update an existing job. Only the fields provided will be updated.
update_job — Update an existing job. Only the fields provided will be updated.
Limits & Quotas
- Databricks API rate limits vary by endpoint and workspace tier. Consult your workspace admin for specific limits.
- Jobs API: typically 30 requests/second per workspace.
- Vector Search API: limits depend on endpoint configuration and provisioned capacity.
- SQL Warehouses API: standard REST API limits apply.
- Error model: non-2xx responses are caught and returned as
success=False+errorrather than raising.