<p>I am working with kubernetes and I need to pass parquet files containing datasets between pods , but I don't know which option will work best.</p>
<p>As I know, persistent disk allows me to mount a shared volume on my pods, but with cloud storage I can share these files too.</p>
<p>All the process is hosted on google cloud.</p>

<p>If you want to persist the data you have to use the file store of Google. Which will support the read write many.</p>
<blockquote>
<p>Persistent Volumes in GKE are supported using the Persistent Disks.
The problem with these disks is that they only support
ReadWriteOnce(RWO) (the volume can be mounted as read-write by a
single node) and ReadOnlyMany (ROX)(the volume can be mounted
read-only by many nodes) access modes.</p>
</blockquote>
<p>Read more at : <a href="https://medium.com/@Sushil_Kumar/readwritemany-persistent-volumes-in-google-kubernetes-engine-a0b93e203180" rel="nofollow noreferrer">https://medium.com/@Sushil_Kumar/readwritemany-persistent-volumes-in-google-kubernetes-engine-a0b93e203180</a></p>
<p>With disk, it won't be possible to share the data between <strong>pods</strong> as it will only support the <strong>read-write</strong> once. The single disk will get attach to a <strong>single</strong> node.</p>
<p>If you looking forward to mounting the storage like a <code>cloud bucket</code> behind the POD using <code>CSI driver</code>, your file writing <strong>IO</strong> will be very slow. Storage can give better performance with API.</p>
<p>You can create the NFS server in Kubernetes and use also which will provide support again to read writ many.</p>
<p><a href="https://www.gluster.org/" rel="nofollow noreferrer">Gluster FS</a> &amp; <a href="https://min.io/" rel="nofollow noreferrer">MinIo</a> is one of the option to use, however if looking for <strong>managed</strong> <strong>NFS</strong> use the <strong><a href="https://cloud.google.com/filestore/docs/accessing-fileshares" rel="nofollow noreferrer">filestore</a></strong> of Google.</p>
