Question
Ververica Platform's Artifact Management only allows you to upload files up to 50 MiB in size. How do upload larger files or how can I increase this limit?
Answer
Note: This section applies to Ververica Platform 2.4 or later.
Ververica Platform is not optimized to handle large artifact uploads. You are almost always better of uploading files to your storage provider directly, e.g. S3, Microsoft ABS, HDFS, through their native upload tools. Please follow our documentation for the right storage paths to upload to.
There are, however, situations in which cases that is not easily possible and you may wish to allow larger uploads through Ververica Platform. For these, add the following environment variables into your `values.yaml` file (append to the existing section if you are already using `env:`) and install/upgrade Ververica Platform via helm. Please adapt the allowed limits to your needs.
env:
- name: "spring.servlet.multipart.max-file-size"
value: "100MB"
- name: "spring.servlet.multipart.max-request-size"
value: "100MB"
Important: Ververica Platform will buffer the complete file in memory before uploading it to the configured Universal Blob Storage and will need to have enough memory left to do so. It may also become unstable if you increase the limit too much.