Prerequisites
Config.yaml (~/.konduktor/config.yaml
)
allowed_clouds:
- {s3, gs}
Setup
- Set up cloud storage credentials
- Check cloud storage setup with:
$ konduktor check {gs, s3}
For more details, check out the setup of cloud storage here.
Current Working Directory
$ ls
task.yaml myworkdir/
$ ls myworkdir/
workdir_file1.txt workdir_file2.txt
Launching
$ konduktor launch task.yaml
Task.yaml
name: workdir-file-upload
workdir: myworkdir
resources:
cpus: 1
memory: 1
image_id: ubuntu
labels:
kueue.x-k8s.io/queue-name: user-queue
maxRunDurationSeconds: "600"
run: |
if [ -f workdir_file1.txt ]; then
echo "File exists"
else
echo "File does not exist"
exit 1
fi
if [ -f workdir_file2.txt ]; then
echo "File exists"
else
echo "File does not exist"
exit 1
fi