{"repo":"AgnostiqHQ/covalent-awsbatch-plugin","free":true,"listed":false,"github":"https://github.com/AgnostiqHQ/covalent-awsbatch-plugin","clone":"git clone https://github.com/AgnostiqHQ/covalent-awsbatch-plugin.git","description":"Executor plugin interfacing Covalent with AWS Batch","language":"Python","stars":11,"topics":["python","docker","workflow","etl","parallelization","pipelines","python3","cloud-computing","covalent","aws-batch"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"  Covalent AWS Batch Plugin Covalent is a Pythonic workflow tool used to execute tasks on advanced computing hardware. This executor plugin interfaces Covalent with AWS Batch which allows tasks in a covalent workflow to be executed as AWS batch jobs. 1. Installation To use this plugin with Covalent, simply install it using pip : 2. Usage Example This is an example of how a workflow can be adapted to utilize the AWS Batch Executor. Here we train a simple Support Vector Machine (SVM) model and use an existing AWS Batch Compute environment to run the train svm electron as a batch job. We also note we require DepsPip to install the dependencies when creating the batch job. During the execution of the workflow one can navigate to the UI to see the status of the workflow, once completed however the above script should also output a value with the score of our model. 3. Configuration There are many configuration options that can be passed in to the class ct.executor.AWSBatchExecutor or by modifying the covalent config file under the section [executors.awsbatch] For more information about all of the possible configuration values visit our read the docs (RTD) guide for this plugin. 4. Required AWS Resources In order to run your workflows with covalent there are a few notable AWS resources that need to be provisioned first. For more information regarding which cloud resources need to be provisioned visit our read the docs (RTD) guide for this plugin. The required AWS resources inc","default_branch":null,"files":null,"tree":[],"storefront":"/r/AgnostiqHQ","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/AgnostiqHQ/covalent-awsbatch-plugin/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}