Feedback : How to set the Compression type dynamically in a Delimited text dataset in ADF.

[GovindulaRakesh]

Document Correction Proposal: How to set the compression type dynamically in a delimited text dataset in ADF.

Documentation: https://learn.microsoft.com/en-us/azure/data-factory/format-delimited-text#dataset-properties

Overview

This request provides a step-by-step by explanation to set the compression type dynamically in a delimited text dataset in ADF which the above documentation doesn't have.

When we try to set the compression type in a delimited text dataset using Add dynamic content option, it is only showing the same option but not showing the dynamic editor to add the dynamic expression.

Correction Details:

This guide will allow users to:

Pass the Compression type value using dynamic expression or through dataset parameters.

Steps:

1. Prerequisites:

   Create a delimited text dataset in ADF for a zip file.

2. Steps to handle the above scenario:

   Create the required dataset parameters in the dataset and edit the dataset JSON to add the parameters or any required dynamic expression as shown below.

   "compressionCodec": {
               "value": "@dataset().comp",
               "type": "Expression"
           },
           "compressionLevel": {
               "value": "@dataset().comp_level",
               "type": "Expression"
           }
   

   

   Now, it will show the above edited dynamic expression for the compression type in the dataset.

Conclusion

By following this guide, users can give any value or use parameters to the Compression type in a delimited text dataset dynamically.

Reference:

azure - how to set Dynamic add content in Compression type in copy activity - Stack Overflow

This Correction request aims to improve user experience and security by providing clear documentation and example scripts to set the Compression type value dynamically in a Delimited text dataset.

title: Delimited text format in Azure Data Factory
author: jianleishen
ms.subservice: data-movement
ms.custom: synapse
ms.topic: conceptual
ms.author: jianleishen

---

author: @jianleishen
ms.subservice: data-movement
ms.custom: synapse
ms.topic: conceptual
ms.author: @jianleishen

[PesalaPavan]

@GovindulaRakesh
Thanks for your feedback! We will investigate and update as appropriate.

[TPavanBalaji]

@GovindulaRakesh
Thank you for bringing this to our attention.
I've delegated this to content author, who will review it and offer their insightful opinions.