Comment
Author: Admin | 2025-04-27
Compute resource dedicated to a groupIn your Databricks workspace, go to Compute and click Create compute.Expand the Advanced section.Under Access mode, click Manual and then select Dedicated (formerly: Single-user) from the dropdown menu.In the Single user or group field, select the group you want assigned to this resource.Configure the other desired compute settings then click Create.Best practices for managing group clustersBecause user permissions are scoped down to the group when using group clusters, Databricks recommends creating a /Workspace/Groups/ folder for each group you plan to use with a group cluster. Then, assign CAN MANAGE permissions on the folder to the group. This allows groups to avoid permission errors. All of the group’s notebooks and workspace assets should be managed in the group folder.You must also modify the following workloads to run on group clusters:MLflow: Ensure you run the notebook from the group folder or run mlflow.set_tracking_uri("/Workspace/Groups/").AutoML: Set the optional experiment_dir parameter to “/Workspace/Groups/” for your AutoML runs.dbutils.notebook.run: Ensure the group has READ permission on the notebook being executed.Example group permissionsWhen you create a data object using the group cluster, the group is assigned as the object’s owner.For example, if you have a notebook attached to a group cluster and run the following command:SQLuse catalog main;create schema group_cluster_group_schema;Then run this query to check the owner of the schema:SQLdescribe schema group_cluster_group_schema;Auditing group dedicated compute activityThere are two key identities involved when a group cluster runs a workload:The user that is running the workload on the group clusterThe group whose permissions are used
Add Comment