Workdir File Upload

Example task yamls for cloud storage

Prerequisites

Config.yaml (~/.konduktor/config.yaml)

allowed_clouds:
  - {s3, gs}

Setup

1. Set up cloud storage credentials
2. Check cloud storage setup with:

$ konduktor check {gs, s3}

For more details, check out the setup of cloud storage here.

Current Working Directory

$ ls
task.yaml   myworkdir/
$ ls myworkdir/
workdir_file1.txt   workdir_file2.txt

Launching

$ konduktor launch task.yaml

Task.yaml

name: workdir-file-upload

workdir: myworkdir

resources:
  cpus: 1
  memory: 1
  image_id: ubuntu
  labels:
    kueue.x-k8s.io/queue-name: user-queue
    maxRunDurationSeconds: "600"

run: |
  if [ -f workdir_file1.txt ]; then
    echo "File exists"
  else
    echo "File does not exist"
    exit 1
  fi

  if [ -f workdir_file2.txt ]; then
    echo "File exists"
  else
    echo "File does not exist"
    exit 1
  fi