Once you’re logged into Databricks, you’ll find the necessary configuration details:
Host URL:
The Host URL is the first part of the URL when you log into your Databricks. It will look something like https://<your-instance>.databricks.com.
API Token:
Click on your user icon in the upper right corner and select “Settings” from the dropdown menu.
In the Settings page, navigate to the “Developer” tab.
Here, you can create a new Access Token by clicking on Manage then “Generate New Token.” Give it a name and set the expiration duration.
Once the token is generated, copy it as it will be required for configuring the connector. Note: This token will only be shown once, so make sure to store it securely.
After configuring the connector in your application:
Save the configuration settings.
Test the connection to Databricks from the AI Squared platform to ensure a connection is made.
By following these steps, you’ve successfully set up a Databricks destination connector in AI Squared. You can now efficiently transfer data to your Databricks endpoint for storage or further distribution within AI Squared.