Single File Upload

Example task yamls for cloud storage

This example also demonstrates inline env variable use with ${TEST_FILE}.

Prerequisites

Config.yaml (~/.konduktor/config.yaml)

allowed_clouds:
  - {s3, gs}

Setup

1. Set up cloud storage credentials
2. Check cloud storage setup with:

$ konduktor check {gs, s3}

For more details, check out the setup of cloud storage here

.

Current Working Directory

$ ls
task.yaml   static.txt   test_file.txt

Launching

$ konduktor launch --env TEST_FILE=test_file.txt task.yaml

Task.yaml

name: single-file-upload

file_mounts:
  # <remote_path>: <local_path>
  ~/${TEST_FILE}: ./${TEST_FILE}
  ~/static.txt: ./static.txt

resources:
  cpus: 1
  memory: 1
  image_id: ubuntu
  labels:
    kueue.x-k8s.io/queue-name: user-queue
    maxRunDurationSeconds: "600"

run: |
  if [ -f ~/${TEST_FILE} ]; then
    echo "File exists"
  else
    echo "File does not exist"
    exit 1
  fi

  if [ -f ~/static.txt ]; then
    echo "File exists"
  else
    echo "File does not exist"
    exit 1
  fi