Fixing the Synapse Error « Available workspace capacity exceeded error (Livy session) »

If you are working with Notebooks in Azure Synapse Analytics and multiple people are using the same Spark cluster at the same time then chances are high that you have seen any of these below errors:

« Livy Session has failed. Session state: error code: AVAILBLE_WORKSPACE_CAPACITY_EXCEEDED.You job requested 24 vcores . However, the workspace only has 2 vcores availble out of quota of 50 vcores for node size family [MemoryOptmized]. »

« Failed to create Livy session for executing notebook. Error: Your pool’s capacity (3200 vcores) exceeds your workspace’s total vcore quota (50 vcores). Try reducing the pool capacity or increasing your workspace’s