Jul 14, 2023
Have you considered using a custom Docker Image for your cluster? With this, you don't have to worry about entry scripts and just provide the image in which your custom Python libraries are already installed.
Have you considered using a custom Docker Image for your cluster? With this, you don't have to worry about entry scripts and just provide the image in which your custom Python libraries are already installed.
Software & Data Engineer at Datamesh GmbH. Sharing knowledge and code around software (cloud) development, data engineering & data science!