ads.jobs.builders package¶
Subpackages¶
- ads.jobs.builders.infrastructure package
- Submodules
- ads.jobs.builders.infrastructure.base module
- ads.jobs.builders.infrastructure.dataflow module
DataFlowDataFlow.CONST_BUCKET_URIDataFlow.CONST_COMPARTMENT_IDDataFlow.CONST_CONFIGDataFlow.CONST_DEFINED_TAGSDataFlow.CONST_DRIVER_SHAPEDataFlow.CONST_DRIVER_SHAPE_CONFIGDataFlow.CONST_EXECUTEDataFlow.CONST_EXECUTOR_SHAPEDataFlow.CONST_EXECUTOR_SHAPE_CONFIGDataFlow.CONST_FREEFORM_TAGSDataFlow.CONST_IDDataFlow.CONST_LANGUAGEDataFlow.CONST_MEMORY_IN_GBSDataFlow.CONST_METASTORE_IDDataFlow.CONST_NUM_EXECUTORSDataFlow.CONST_OCPUSDataFlow.CONST_POOL_IDDataFlow.CONST_PRIVATE_ENDPOINT_IDDataFlow.CONST_SPARK_VERSIONDataFlow.CONST_WAREHOUSE_BUCKET_URIDataFlow.attribute_mapDataFlow.create()DataFlow.delete()DataFlow.from_dict()DataFlow.from_id()DataFlow.init()DataFlow.job_idDataFlow.list_jobs()DataFlow.nameDataFlow.run()DataFlow.run_list()DataFlow.to_dict()DataFlow.to_yaml()DataFlow.with_compartment_id()DataFlow.with_configuration()DataFlow.with_defined_tag()DataFlow.with_driver_shape()DataFlow.with_driver_shape_config()DataFlow.with_execute()DataFlow.with_executor_shape()DataFlow.with_executor_shape_config()DataFlow.with_freeform_tag()DataFlow.with_id()DataFlow.with_language()DataFlow.with_logs_bucket_uri()DataFlow.with_metastore_id()DataFlow.with_num_executors()DataFlow.with_pool_id()DataFlow.with_private_endpoint_id()DataFlow.with_spark_version()DataFlow.with_warehouse_bucket_uri()
DataFlowAppDataFlowLogsDataFlowRunconda_pack_name_to_dataflow_config()
- ads.jobs.builders.infrastructure.dsc_job module
DSCJobDSCJobRunDataScienceJobDataScienceJob.CONST_BLOCK_STORAGEDataScienceJob.CONST_COMPARTMENT_IDDataScienceJob.CONST_DEFINED_TAGSDataScienceJob.CONST_DISPLAY_NAMEDataScienceJob.CONST_FREEFORM_TAGSDataScienceJob.CONST_JOB_INFRADataScienceJob.CONST_JOB_TYPEDataScienceJob.CONST_LOG_GROUP_IDDataScienceJob.CONST_LOG_IDDataScienceJob.CONST_MEMORY_IN_GBSDataScienceJob.CONST_OCPUSDataScienceJob.CONST_PROJECT_IDDataScienceJob.CONST_SHAPE_CONFIG_DETAILSDataScienceJob.CONST_SHAPE_NAMEDataScienceJob.CONST_STORAGE_MOUNTDataScienceJob.CONST_SUBNET_IDDataScienceJob.attribute_mapDataScienceJob.authDataScienceJob.block_storage_sizeDataScienceJob.build()DataScienceJob.compartment_idDataScienceJob.create()DataScienceJob.defined_tagsDataScienceJob.delete()DataScienceJob.fast_launch_shapes()DataScienceJob.freeform_tagsDataScienceJob.from_dict()DataScienceJob.from_dsc_job()DataScienceJob.from_id()DataScienceJob.init()DataScienceJob.instance_shapes()DataScienceJob.job_idDataScienceJob.job_infrastructure_typeDataScienceJob.job_typeDataScienceJob.list_jobs()DataScienceJob.log_group_idDataScienceJob.log_idDataScienceJob.nameDataScienceJob.payload_attribute_mapDataScienceJob.project_idDataScienceJob.run()DataScienceJob.run_list()DataScienceJob.shape_config_detailsDataScienceJob.shape_config_details_attribute_mapDataScienceJob.shape_nameDataScienceJob.snake_to_camel_mapDataScienceJob.standardize_spec()DataScienceJob.statusDataScienceJob.storage_mountDataScienceJob.storage_mount_type_dictDataScienceJob.subnet_idDataScienceJob.with_block_storage_size()DataScienceJob.with_compartment_id()DataScienceJob.with_defined_tag()DataScienceJob.with_freeform_tag()DataScienceJob.with_job_infrastructure_type()DataScienceJob.with_job_type()DataScienceJob.with_log_group_id()DataScienceJob.with_log_id()DataScienceJob.with_project_id()DataScienceJob.with_shape_config_details()DataScienceJob.with_shape_name()DataScienceJob.with_storage_mount()DataScienceJob.with_subnet_id()
DataScienceJobRunDataScienceJobRun.TERMINAL_STATESDataScienceJobRun.cancel()DataScienceJobRun.create()DataScienceJobRun.delete()DataScienceJobRun.download()DataScienceJobRun.exit_codeDataScienceJobRun.jobDataScienceJobRun.log_group_idDataScienceJobRun.log_idDataScienceJobRun.loggingDataScienceJobRun.logs()DataScienceJobRun.statusDataScienceJobRun.to_yaml()DataScienceJobRun.wait()DataScienceJobRun.watch()
- ads.jobs.builders.infrastructure.dsc_job_runtime module
CondaRuntimeHandlerContainerRuntimeHandlerDataScienceJobRuntimeManagerGitPythonRuntimeHandlerGitPythonRuntimeHandler.CONST_ENTRYPOINTGitPythonRuntimeHandler.CONST_ENTRY_FUNCTIONGitPythonRuntimeHandler.CONST_GIT_BRANCHGitPythonRuntimeHandler.CONST_GIT_CODE_DIRGitPythonRuntimeHandler.CONST_GIT_COMMITGitPythonRuntimeHandler.CONST_GIT_SSH_SECRET_IDGitPythonRuntimeHandler.CONST_GIT_URLGitPythonRuntimeHandler.CONST_JOB_ENTRYPOINTGitPythonRuntimeHandler.CONST_OUTPUT_DIRGitPythonRuntimeHandler.CONST_OUTPUT_URIGitPythonRuntimeHandler.CONST_PYTHON_PATHGitPythonRuntimeHandler.CONST_SKIP_METADATAGitPythonRuntimeHandler.CONST_WORKING_DIRGitPythonRuntimeHandler.PATH_DELIMITERGitPythonRuntimeHandler.RUNTIME_CLASSGitPythonRuntimeHandler.SPEC_MAPPINGS
IncompatibleRuntimeNotebookRuntimeHandlerPyTorchDistributedRuntimeHandlerPythonRuntimeHandlerPythonRuntimeHandler.CONST_CODE_ENTRYPOINTPythonRuntimeHandler.CONST_ENTRY_FUNCTIONPythonRuntimeHandler.CONST_JOB_ENTRYPOINTPythonRuntimeHandler.CONST_OUTPUT_DIRPythonRuntimeHandler.CONST_OUTPUT_URIPythonRuntimeHandler.CONST_PYTHON_PATHPythonRuntimeHandler.CONST_WORKING_DIRPythonRuntimeHandler.PATH_DELIMITERPythonRuntimeHandler.RUNTIME_CLASSPythonRuntimeHandler.SPEC_MAPPINGS
RuntimeHandlerScriptRuntimeHandler
- ads.jobs.builders.infrastructure.utils module
- Module contents
- ads.jobs.builders.runtimes package
- Submodules
- ads.jobs.builders.runtimes.artifact module
- ads.jobs.builders.runtimes.base module
MultiNodeRuntimeRuntimeRuntime.CONST_ARGSRuntime.CONST_DEFINED_TAGSRuntime.CONST_ENV_VARRuntime.CONST_FREEFORM_TAGSRuntime.CONST_MAXIMUM_RUNTIME_IN_MINUTESRuntime.argsRuntime.attribute_mapRuntime.defined_tagsRuntime.environment_variablesRuntime.envsRuntime.freeform_tagsRuntime.init()Runtime.kindRuntime.maximum_runtime_in_minutesRuntime.typeRuntime.with_argument()Runtime.with_defined_tag()Runtime.with_environment_variable()Runtime.with_freeform_tag()Runtime.with_maximum_runtime_in_minutes()
- ads.jobs.builders.runtimes.container_runtime module
ContainerRuntimeContainerRuntime.CONST_CMDContainerRuntime.CONST_ENTRYPOINTContainerRuntime.CONST_IMAGEContainerRuntime.CONST_IMAGE_DIGESTContainerRuntime.CONST_IMAGE_SIGNATURE_IDContainerRuntime.attribute_mapContainerRuntime.cmdContainerRuntime.entrypointContainerRuntime.imageContainerRuntime.image_digestContainerRuntime.image_signature_idContainerRuntime.init()ContainerRuntime.job_env_typeContainerRuntime.with_cmd()ContainerRuntime.with_entrypoint()ContainerRuntime.with_image()ContainerRuntime.with_image_digest()ContainerRuntime.with_image_signature_id()
- ads.jobs.builders.runtimes.python_runtime module
CondaRuntimeCondaRuntime.CONST_CONDACondaRuntime.CONST_CONDA_REGIONCondaRuntime.CONST_CONDA_SLUGCondaRuntime.CONST_CONDA_TYPECondaRuntime.CONST_CONDA_TYPE_CUSTOMCondaRuntime.CONST_CONDA_TYPE_SERVICECondaRuntime.CONST_CONDA_URICondaRuntime.attribute_mapCondaRuntime.condaCondaRuntime.init()CondaRuntime.with_custom_conda()CondaRuntime.with_service_conda()
DataFlowNotebookRuntimeDataFlowRuntimeDataFlowRuntime.CONST_ARCHIVE_BUCKETDataFlowRuntime.CONST_ARCHIVE_URIDataFlowRuntime.CONST_CONDA_AUTH_TYPEDataFlowRuntime.CONST_CONFIGURATIONDataFlowRuntime.CONST_OVERWRITEDataFlowRuntime.CONST_SCRIPT_BUCKETDataFlowRuntime.CONST_SCRIPT_PATHDataFlowRuntime.archive_bucketDataFlowRuntime.archive_uriDataFlowRuntime.attribute_mapDataFlowRuntime.configurationDataFlowRuntime.convert()DataFlowRuntime.init()DataFlowRuntime.overwriteDataFlowRuntime.script_bucketDataFlowRuntime.script_uriDataFlowRuntime.with_archive_bucket()DataFlowRuntime.with_archive_uri()DataFlowRuntime.with_conda()DataFlowRuntime.with_configuration()DataFlowRuntime.with_custom_conda()DataFlowRuntime.with_overwrite()DataFlowRuntime.with_script_bucket()DataFlowRuntime.with_script_uri()DataFlowRuntime.with_service_conda()
GitPythonRuntimeGitPythonRuntime.CONST_BRANCHGitPythonRuntime.CONST_COMMITGitPythonRuntime.CONST_GIT_SSH_SECRET_IDGitPythonRuntime.CONST_GIT_URLGitPythonRuntime.CONST_SKIP_METADATAGitPythonRuntime.attribute_mapGitPythonRuntime.branchGitPythonRuntime.commitGitPythonRuntime.init()GitPythonRuntime.skip_metadata_updateGitPythonRuntime.ssh_secret_ocidGitPythonRuntime.urlGitPythonRuntime.with_source()
NotebookRuntimeNotebookRuntime.CONST_ENTRYPOINTNotebookRuntime.CONST_EXCLUDE_TAGNotebookRuntime.CONST_NOTEBOOK_ENCODINGNotebookRuntime.CONST_NOTEBOOK_PATHNotebookRuntime.CONST_OUTPUT_URINotebookRuntime.CONST_OUTPUT_URI_ALTNotebookRuntime.CONST_SOURCENotebookRuntime.attribute_mapNotebookRuntime.exclude_tagNotebookRuntime.init()NotebookRuntime.notebookNotebookRuntime.notebook_encodingNotebookRuntime.notebook_uriNotebookRuntime.output_uriNotebookRuntime.sourceNotebookRuntime.with_exclude_tag()NotebookRuntime.with_notebook()NotebookRuntime.with_output()NotebookRuntime.with_source()
PythonRuntimeScriptRuntime
- Module contents
Submodules¶
ads.jobs.builders.base module¶
- class ads.jobs.builders.base.Builder(spec: Dict | None = None, **kwargs)[source]¶
Bases:
SerializableTo initialize the object, user can either pass in the specification as a dictionary or through keyword arguments.
- Parameters:
- attribute_map = {}¶
- build() Self[source]¶
Load default values from the environment for the job infrastructure. Should be implemented on the child level.
- get_spec(key: str, default: Any | None = None) Any[source]¶
Gets the value of a specification property
- Parameters:
key (str) – The name of the property.
default (Any, optional) – The default value to be used, if the property does not exist, by default None.
- Returns:
The value of the property.
- Return type:
Any
- property kind: str¶
The kind of the object as showing in YAML. Subclass should overwrite this value.