databend-query error start with Storageunavailable. Code: 39901, Text = can't clean temp dir:Permission denied (os error 13)

[wubx]

Summary

Databend Query start failure, caluse: Storageunavailable. Code: 39901, Text = can't clean temp dir:Permission denied (os error 13)

This hint is a little confusing what is it.

[TCeason]

databend/src/query/storages/common/cache/src/temp_dir.rs

Line 65 in 7548f99

"can't clean temp dir: {e}",

[wubx]

databend/src/query/config/src/config.rs

Lines 3023 to 3030 in 7548f99

	// Trick for cloud, perhaps we should introduce a new configuration for the local writeable root.
	if cache.disk_cache_config.path != inner::DiskCacheConfig::default().path
	&& spill.spill_local_disk_path == inner::SpillConfig::default().path
	{
	spill.spill_local_disk_path = PathBuf::from(&cache.disk_cache_config.path)
	.join("temp/_query_spill")
	.into();
	};

[forsaken628]

The current configuration of local spill is a bit complicated.

1. It is not enabled by default.
2. Configured spill_local_disk_path to enable it.
3. Configuring cache-disk-path will also enable it.

When enabled, it removes spill_local_disk_path as a backing mechanism for space cleanup.
This makes sense if spill_local_disk_path is an internally generated path.
But if it is not internally generated, but externally configured, deleting the path is unreasonable and should throw an error if the path does not exist.

Is there a best practice to make these logics a bit more standardized?

[wubx]

It might be a good idea to keep the separate.

[forsaken628]

update in #17103