Does Velox support GS as well as S3?

[sumokiama]

I've asked the Gluten people about GS support and they say that it is not yet supported in Velox.
However, in the Velox howto pages, there is a section on settings for GS.

If GS is not yet supported, are there plans to do so?

[kgpai]

Apologies can you tell me what GS is ? Is it google cloud storage ?

[sumokiama]

Correct. Google cloud storage.

[kgpai]

@tigrux Has been adding support for read/write to GCS , with some PRs being merged recently. He can give you a better answer on state of the support.

[tigrux]

Hello. Yes, as @kgpai mentioned, we provided early support for GCS. It can read and write uris as gs://bucket:file.
It is not optimized at all, but in our testing it it able to read buckets containing terabytes of data, which has been enough.
We are in the process of adding support for Gluten, though it may take some months for it to be approved and merged.

[majetideepak]

The GCS implementation supports both reading and writing. See https://facebookincubator.github.io/velox/configs.html#google-cloud-storage-configuration for the available configuration.

[sumokiama]

Yes, we saw the configuration properties but nothing else about GCS. Thank you for verifying!

[majetideepak]

There is a small note about GCS here as well https://facebookincubator.github.io/velox/develop/connectors.html#storage-adapters