Skip to main content
Beta ProductSQL Proxy is currently in beta. API endpoints may change.
Jobs compute configuration controls how SQL Proxy routes queries to Databricks Jobs compute when using the @datafold:jobs_compute directive.

​
Get Configuration

GET /admin/config/jobs-compute 
curl -X GET \
  -H "Authorization: Bearer <admin-token>" \
  https://sqlproxy.your-company.datafold.com/admin/config/jobs-compute

​
Update Configuration (Full Replace)

PUT /admin/config/jobs-compute 
curl -X PUT \
  -H "Authorization: Bearer <admin-token>" \
  -H "Content-Type: application/json" \
  -d '{
    "enabled": true,
    "poll_interval_ms": 5000,
    "max_wait_ms": 3600000,
    "executor_script_path": "/dbfs/datafold/executor.py",
    "default_spark_version": "14.3.x-scala2.12",
    "default_node_type": "i3.xlarge",
    "default_num_workers": 4
  }' \
  https://sqlproxy.your-company.datafold.com/admin/config/jobs-compute

​
Request Body

FieldTypeRequiredDescription
enabledbooleanYesEnable/disable jobs compute routing
poll_interval_msintegerYesPolling interval for job status (milliseconds)
max_wait_msintegerYesMaximum wait time for job completion (milliseconds)
executor_script_pathstringYesDBFS path to the executor script
default_spark_versionstringYesDefault Databricks runtime version
default_node_typestringYesDefault EC2 instance type for workers
default_num_workersintegerYesDefault number of workers

​
Update Configuration (Partial)

PATCH /admin/config/jobs-compute All fields are optional. Only provided fields are updated. 
curl -X PATCH \
  -H "Authorization: Bearer <admin-token>" \
  -H "Content-Type: application/json" \
  -d '{"default_num_workers": 8}' \
  https://sqlproxy.your-company.datafold.com/admin/config/jobs-compute