"Nextflow v23.04.01: Issue with computeResourceType 'Job'"

[ajay15283]

Bug report

While utilizing Nextflow version 23.04.01, despite specifying the computeResourceType as 'Job', it appears that it is not generating job resources as expected; rather, it continues to create pods.

kubernetes {
      process {
	    executor = 'k8s'
		k8s {
         	pullPolicy = 'Always'
		queueSize = 10
		computeResourceType = 'Job'
        }  
      }
    }
}

xxxx@xxx:~$ kubectl get jobs -n xxxxx
No resources found in xxxxx namespace.

xxxx@xxxx:~$ kubectl get pod -n xxxxx|grep "14[0-9]m"
nf-012b6e0d3415a43a6c5afe016b0ef3f8   0/1     Pending     0          146m
nf-02033d43c8f4a2fb01edfe07d9949286   0/1     Pending     0          146m
nf-02ceb430c817f64db5e1dbe930a9e80e   1/1     Running     0          147m
nf-02d3a9a23657a9c3efdb297db94fe690   1/1     Running     0          147m
nf-06e3de64e0365d823ab7e1c612701638   0/1     Pending     0          145m
nf-08d04e644b8527142a0967a3607c59ac   1/1     Running     0          148m
nf-0abe54490644549b906a5ba4b024b47f   1/1     Running     0          149m
nf-0f4dbf0524b27c618779db3d0d403769   1/1     Running     0          149m
nf-12919c4110d21b1ed635d38cf401642c   0/1     Pending     0          146m
nf-193d97497c2f50f766d43f0e96689910   1/1     Running     0          149m
nf-195f7ed66d789b67d83a2705818a69c8   1/1     Running     0          148m
nf-1dd0f53192a3c2b5f0a8a3f475d5504a   1/1     Running     0          148m
nf-23e7519f94823bd0cddf2a986207831a   1/1     Running     0          147m
nf-27bb45352b44e6b2ea4385316e243fcb   0/1     Pending     0          146m
nf-29040a268121bdadcbc1a502bf8c406f   1/1     Running     0          147m
nf-2dd024519af8488e306030ba361f84f9   0/1     Pending     0          145m
nf-2e1f9911dd732100514970ad2d1e9096   1/1     Running     0          146m
nf-32404d31a06c2453e30a6d7ef7a800e6   1/1     Running     0          148m
nf-3364cde56474df34ef25fb133b7b4423   1/1     Running     0          147m
nf-3596fc4304399f8734d9f910bb819f8d   1/1     Running     0          148m
nf-371afc45bb9886c5ee6ed3e1ae352c10   1/1     Running     0          149m
nf-3a0d0a240067e4d21a2a6fd7cadc7a68   1/1     Running     0          148m
nf-3af2babdd6d85388cd0fb73cd7446651   1/1     Running     0          149m
nf-3cd7a4b67a53c98aaf0e1ca2fec90e55   1/1     Running     0          147m
nf-3dc7aeadf1997c91af44dc9294bf3136   1/1     Running     0          147m
nf-3f68ff94da3000ef63e372c864fd1a68   0/1     Pending     0          146m
nf-404a377851595e49c53494e1cfc8da0d   1/1     Running     0          147m
nf-412287502ab771971533c1a70d5d552f   1/1     Running     0          147m
nf-419ef087e326f9bed3dbc7269a7cf591   1/1     Running     0          148m
nf-43e8767e5ddd9259ebeaca6ea06bc779   1/1     Running     0          147m
nf-4499823ebd8a6aa242f1a4268d98d9f2   1/1     Running     0          149m
nf-4db409ce356ab52febf7dfd79c40e734   1/1     Running     0          147m
nf-4fa4b42b9c55816aca9f90445d9451b0   1/1     Running     0          146m
nf-547daa5fc555be78ebb73550d360f03f   0/1     Pending     0          145m
nf-59446a83f2952a55e6d9949933336252   1/1     Running     0          149m
nf-5c4ccb53d792381a4aa065263ea7c04d   0/1     Pending     0          145m
nf-5f7d04b7e2d92bb46c255cdcdaaea33b   1/1     Running     0          149m
nf-60ae76a6805722e90b46690dd229feb2   1/1     Running     0          147m
nf-61048bd600400e9baf0b650874bff663   0/1     Pending     0          146m
nf-61145d9234f7ec3b748d4e8c289c13da   1/1     Running     0          149m
nf-6448c019e1ae5b87bc896c4c674bcf97   0/1     Pending     0          145m
nf-69a945f67df180cb5869b9e2935bcc5d   0/1     Pending     0          146m
nf-6ac98c3ea27787ea1feb07d0c08439d5   1/1     Running     0          147m
nf-6bc007e0aeb88d07602e2e9b7b4a54fb   0/1     Pending     0          145m
nf-6d0c4999373fe5ca7ebdb8b29f2e8c3e   0/1     Pending     0          145m
nf-7782fff4de26d4400e15ef4aeeccd51b   1/1     Running     0          148m
nf-78dbbb96e3697a7cb488626fa5573943   1/1     Running     0          147m
nf-7ff3858607d68f80e3e0e5a4ad99624a   1/1     Running     0          147m
nf-8015c43c76486a6f1122238343944f12   1/1     Running     0          147m
nf-81541bfb26864f578c6fd07e4bfe0c4f   0/1     Pending     0          145m
nf-81d6a1dd12883e5f2915e85eb811e03f   1/1     Running     0          148m
nf-84465b6d81a90376431edaf392a07513   1/1     Running     0          149m
nf-899441735bcfd192f1b72a058d2ac401   1/1     Running     0          147m
nf-8f181d7fb99457f78aa608715747a5ef   1/1     Running     0          147m
nf-9af0a3f6e329497a92c3cfaed5f6e5dc   0/1     Pending     0          146m
nf-9b85652b678c17d115eac214d22cc45b   1/1     Running     0          149m
nf-9bcc36972ff4e85ff8918424d3b7678a   1/1     Running     0          148m
nf-9e0e902c3de00c47fcef327a6c26825e   1/1     Running     0          149m
nf-9f17d8777fc1424395405e387f93f210   1/1     Running     0          149m
nf-9f837444394d0c6e80b81ac0cd449751   1/1     Running     0          149m
nf-a8c7797f35da831b0a354cf27024c917   1/1     Running     0          148m
nf-a927ab4e59b52532c8c4f9100a31e186   1/1     Running     0          147m
nf-aac0f75e669df8506a6f15561b5af45d   0/1     Pending     0          146m
nf-ab3e843db4a6d745a712312c6b23f797   1/1     Running     0          149m
nf-b028d6c6421d5181cad5da576a3fbc2f   0/1     Pending     0          145m
nf-b0b823a482c5f0cda0505f9f6f70a63e   0/1     Pending     0          146m
nf-b1d8d2b11186dc519d34b9a7d5b6a27b   1/1     Running     0          147m
nf-b484d0c747a71eb10537c24b11e62554   1/1     Running     0          147m
nf-b56381390b92d879c9ee7911ce300401   1/1     Running     0          148m
nf-bb4da5a8fd0a811513f314a129d475a0   1/1     Running     0          148m
nf-bbb6e72bb28f6ada11356f685267647e   1/1     Running     0          148m
nf-bc40c1f5af74c2982db0dbba28cf6652   1/1     Running     0          148m
nf-bc5cbf1fbc51347ac611a936d6faec0a   0/1     Pending     0          145m
nf-bc8a8d871ec32398a1c2c4bf99c1cb9b   0/1     Pending     0          145m
nf-c0548719854891e3befa6e3fd376b868   1/1     Running     0          147m
nf-c137c0a5daa5119b268badc77cda5613   1/1     Running     0          147m
nf-c463193b2dd705f263c3f33911d0ae5d   1/1     Running     0          148m
nf-c56e2a033b50d5f8dea97a0c23bef7c5   1/1     Running     0          146m
nf-cdcf314429086bce7aa689b752e45034   1/1     Running     0          149m
nf-cdd0ead693299f2131e3ef1edd579920   1/1     Running     0          148m
nf-d042c031f364d1389d3a8fe95a08e7df   0/1     Pending     0          145m
nf-d23fd2ba6e921ee1f5caba750a83edea   0/1     Pending     0          146m
nf-d43bb9f6103be3f043e2a1c6020f4d9f   0/1     Pending     0          145m
nf-d68fa98efe8deac2cf6bce94bc787916   0/1     Pending     0          145m
nf-dca4f3a360295a1acd96c77f18128503   1/1     Running     0          147m
nf-dd3f17c56a3b6b8f5705f6d3abce7b6c   0/1     Pending     0          145m
nf-dd894f1afd14ffbbb5251e5d9964dfe5   1/1     Running     0          148m
nf-ddcefb82f27870aefadccd8e2fb9075a   1/1     Running     0          147m
nf-e702d0eeeefdf6a33fda248b914817dc   1/1     Running     0          148m
nf-e77b8c565564126f9df1ece437f6309e   1/1     Running     0          147m
nf-e8f2209555dadd21f044184ac5bf62bb   1/1     Running     0          149m
nf-e9cec1a7edec08327bac563ddf4dd05a   1/1     Running     0          147m
nf-ecc9959bf85e6c84d14fac6ea5cc682c   1/1     Running     0          149m
nf-efb41d5336f3be44256ae2588169945a   1/1     Running     0          149m
nf-effc4e094b958c16978a632a6b0c49f0   0/1     Pending     0          145m
nf-f34c25380ec67c35184afc25dff6a9d5   1/1     Running     0          147m
nf-f5a46ca2e9cc8c04e438c6626026cb5c   1/1     Running     0          149m
nf-fa89776258db680953b005606561c237   1/1     Running     0          147m
nf-fd13ecd693c0124ac2f28e06a02f2094   0/1     Pending     0          146m
peptiquest-ps-5                       1/1     Running     0          3h1m

Environment

• Nextflow version: 23.04.01
• Operating system: Linux[Ubuntu 22.02]
• Kubernetes Version: 1.28 (baremetal)

[ajay15283]

moved the "k8s" out of the "process" loop and job created so closing the discussion