Skip to content

Releases: demisto/demisto-sdk

v1.33.1

26 Dec 12:53
928176c
Compare
Choose a tag to compare

Breaking

  • Removed support for DS107 and RM106 validations. Ensures no "demisto" word in description and readme files for both new & old validate formats. #4712
  • Changed the code of RM116 - Validate that the readme file is not to short to RM117 due to error code duplication. #4712
  • Breaking Change: Removed the support for python 3.9, and upgraded the mitmproxy dependency version. #4718

Feature

  • Excluded silent items from release notes validation. #4720
  • Added PB131 validation. Ensures every silent trigger points to a silent playbook, and vice versa. #4670
  • Excluded silent-Playbooks/Triggers from the metadata. #4692
  • Added support for Silent-Playbooks in the old-validate. #4726
  • Added support for CaseLayouts and CaseFields content items paths to the validate-content-paths demisto-sdk pre-commit hook. #4706
  • Added PB132 validation. Ensures that silent playbooks do not have a README file. #4723
  • Updated validation rules to allow the deletion of silent Playbooks and silent Triggers. #4715
  • Added support for writing demisto-sdk pre-commit command results to files. #4697
  • Moved the CR101 validation to the new validation format. Checks if "Correlation Rule" files match standards to validate_content_path. #4569
  • Added PB130 validation. Checks whether the silent playbook name id and the isSilent key are set correctly. #4662

Fix

  • Fixed an issue where YmlSplitter attributes were being unintentionally updated. #4713
  • Fixed an issue where ST110 would incorrectly fail when adding the isSilent field. #4716
  • Fixed an issue where the error message wasn't clear when attempting to upload a content item to an unsupported marketplace. #4727
  • Changed the isSilent key to lower case. #4728
  • Fixed an issue in the demisto-sdk modeling-rules command where colored logs were not printed properly. #4733
  • Fixed an issue where RM114 falsely failed when it concatenated "Packs/" twice to the file path. #4717
  • Fixed an issue where RN106 and PA114 validations would fail on new packs. #4710
  • Fixed an issue where YmlSplitter attributes were being unintentionally updated. #4696
  • Fixed an issue where RN111 would fail when it should not when the docker entry message was missing. #4714
  • Fixed an issue where the "incident to alert" conversion was not applied to the metadata file during the execution of the prepare-content command. #4736
  • Fixed an issue where RN107 validation would fail on new content items and specific content types. #4711

v1.33.0

09 Dec 10:56
27378c9
Compare
Choose a tag to compare

Feature

  • Modified the demisto-sdk --release-notes command to print a markdown representation of the currently installed demisto-sdk changelog. #4687
  • Added support for a new pack version_config.json file. #4699
  • Updated the prepare-content command to replace all occurrences of an incorrect marketplace reference in the content. #4659
  • The Demisto-SDK CLI has been upgraded to use Typer for command-line interface (CLI) management. #4637
  • Added an isSilent key to the Playbook and Trigger schemas. #4689
  • Updated the GR107 validation to fail once on each item, and the message will contain all deprecated items in use instead of failing multiple times. #4667

Fix

  • Fixed an issue where YmlSplitter attributes were being unintentionally updated. #4695
  • Fixed an issue where -t flag was missing from update-release-notes command setup. #4691
  • Fixed an issue where RN108 validation raised an exception when executed on a new pack. #4700
  • Fixed an issue in the validate command where new files could not be parsed. #4700
  • Fixed an issue in the validate command where .pack-ignore files could not be parsed. #4700
  • Fixed an issue where using the -i flag with setup-env command would fail. #4690
  • Fixed an issue where the generate-docs command failed to ignore hidden parameters. #4589
  • Fixed an issue where logger was not initialized properly. #4695
  • Fixed an issue where validate GR107 was failing on unrelated content-item when running on deprecated content-items. #4667

Internal

  • Fixed the demisto-sdk nightly's run-end-to-end-tests-xsoar step, and updated the test-content missing flags. #4686
  • Added the deprecated merge-id-sets command to Typer app. #4680
  • Update demisto-sdk commands documentation. #4685
  • Fixed an issue where setup-env command would fail when FILE_PATHS argument was missing. #4694
  • NOTICE: Demisto-SDK will soon stop supporting Python 3.9 #4698

v1.32.5

25 Nov 07:13
87bc123
Compare
Choose a tag to compare

Breaking

  • Removed PA134 from the old validate. The validation ensures that the pack has exactly one category and that this category is valid. #4673

Feature

  • Modified PA103 validation (validate pack categories). The validation will now allow multiple categories for a single pack. #4673
  • Modified the configuration section generated by the generate-docs command by removing navigation steps and generalizing the code to accommodate different Cortex platforms. #4585
  • Added support for non-default registry ports when using custom docker images. i.e: 'registry:5000/repository/image:main' #4674
  • Added support for utilizing content_status.json within content pipelines. #4656

Fix

  • Fixed an issue where demisto-sdk pre-commit inadvertently skipped all files when executed with the --all-files flag. #4668
  • Fixed an issue where demisto-sdk commands would fail in some system setups. #4666
  • Fixed an issue where logging would fail when linking PR to Jira issue in the GitHub workflow step. #4649
  • Fixed an issue where logger crashed when imported as library. #4657
  • Fixed an issue where logging would fail when creating a Docker image. #4648

Internal

  • Moved RN106 and RN107 to the new validate format. These validations ensure there are no missing release notes. #4643
  • Fixed an issue where the git statuses of content objects related files were not calculated correctly. #4643

v1.32.4

10 Nov 14:56
1c49195
Compare
Choose a tag to compare

Breaking

  • The following commands will be deprecated and removed entirely in the next SDK release in two weeks: convert, create-content-artifacts, create-id-set, extract-code and lint.
  • Moved CJ102 to the new validate format. The validation's error number is now BA103 and it ensure that the tests section is either a non-empty list or "No tests".

Fix

  • Fixed an issue where getting a malformed file raised an non-indicative error.
  • Fixed an issue where the validate and create-id-set commands would fail to process correctly when encountering null values in the filters or transformers fields.

Internal

  • Moved RN113 to the new validate format. The validation ensures that all the first level headers in the release note are valid content types.
  • Moved RN115 to the new validate format. The validation ensure that the release notes first level headers are valid.

v1.32.3

30 Oct 09:42
Compare
Choose a tag to compare
  • Fixed an issue where integrations and scripts validations didn't run in builds. #4609
  • Added BA127 new validation. The validation checks that the level of depth of the context output path in the yml is lower or equal to 5 in XSOAR supported content items. #4490
  • Added RM116 validation to the new validate format. The validation ensure that every playbook has an image and that the image is located under doc_files folder. #4538
  • Added Python 3.12 support. #4598
  • Added the hidden:marketplacev2 field to the StrictScript pydantic object since it was recently added to the script schema. #4610
  • Removed IN161 - invalid siem marketplace from the old validate. #4609
  • Fixed an issue where docker logged debug level messages as info level. #4500
  • Improved docker registry logs. #4601
  • Fixed the StrictScript pydantic object to contain the new field hidden:marketplacev2 just as a field in Argument. #4615
  • Fixed an issue where docker validation didn't run in new validate. #4603
  • Fixed an issue where tasks calling playbooks were forced to have their names match the playbook ID. #4602
  • Modified the RM106 validation message to reflect the problem in the README file. #4604
  • Update SDK documentation. #4599
  • Moved RN111 validation to the new validate format. The validation ensures that the docker documented in the yml file matches the one in the Release Notes. #4619
  • Reverted support for GAR DockerHub proxy when running in a Gitlab CI environment. #4628

v1.32.2

06 Oct 16:35
0b22c86
Compare
Choose a tag to compare
  • GR107 validation has been removed from the legacy validate command to enhance performance. #4561
  • Added support in the schema for XSIAM custom hidden value. #4584
  • Moved GR107 validation to the new validate format. The validation ensures that deprecated content items are not used in other content items. #4561
  • Moved GR108 validation to the new validate format. The validation ensures that non-hidden packs do not depend on hidden packs. #4590
  • Enhanced the Graph interface to support multi-threaded environments. #4576
  • Moved GR101 validation to the new validate format. This validation checks whether the content item uses an item with a higher version (making it incompatible). #4570
  • Removed the validate warnings when the higher version is lower is not supported by Cortex anymore. #4570
  • Moved RM100 to the new validate format, The validation was split to 3 different validations RM100 - no empty sections, RM115 - no default sections, RM116 - readme not to short. #4371
  • Moved GR102 validation to the new validate format. This validation checks whether a content item has to_version higher than another one it uses. #4586
  • Removed the validate warnings when the source's to_version is higher than the general default version. #4586
  • Moved PA124 validation to the new validate format. The validation ensures that core packs do not depend on non-core packs. #4596
  • Fixed an issue where debug-logging in upload failed. #4591
  • Fixed an issue where debug-logging in test-modeling-rules failed. #4591
  • Fixed an issue where lint failed showing messages. #4582
  • Fixed an issue where generate-docs command used un-ordered dependency lists, which resulted in redundant git changes. #4533
  • Fixed an issue where debug-logging in setup-env failed. #4597
  • Fixed an issue where the update-release-notes command was not properly detecting existing items in the release notes. #4579
  • Upgrade the Neo4j version when working with the content graph in a local environment. #4571
  • Added support for GAR DockerHub proxy when running in a Gitlab CI environment. #4528
  • Added support for pre-commit hooks to save logs as Gitlab CI artifacts. #4581
  • Moved RN116 validation to the new validation format. The validation ensures that the RN contains a first level header. #4575
  • Upgrade pylint to 3.3.1 #4594
  • Improved implementation of the GR103 validation. #4568

v1.32.1

23 Sep 18:15
f8958f5
Compare
Choose a tag to compare
  • Modified the sdk-changelog script, to include the release date for each version in the title. #4553
  • Modified the xsoar-lint command to show GitHub Annotations for errors, when the GITHUB_ACTIONS environment key is set. Warnings are shown when the DEMISTO_SDK_XSOAR_LINTER_WARNING_ANNOTATIONS and GITHUB_ACTIONS are set. #4400
  • Fixed an issue where create artifacts failed logging in certain scenarios. #4574
  • Moved RN112 to the new validate format. The validation ensure that if RN contains 'breaking change' then the breaking change release note exist and filled correctly. #4559
  • Added the PA114 validation to the new validate command. The validation checks if the version in the pack_metadata.json file needs to be raised. #4342

v1.32.0

22 Sep 21:50
Compare
Choose a tag to compare
  • IN136 will be handled in the new validate format of RM102. #4535
  • Dropped support for Python 3.8. #4531
  • The validation GR103 has been removed from the old format to enhance performance. #4522
  • Move feed's expirationPolicy validation to a new validation - IN163. #4460
  • Modified the --release-notes flag which would previously support a specific changelog file format. Now it retrieves the release data from the GitHub tags info. #4554
  • Moved RM102 and IN136 validation to the new format. Ensures context outputs in README and YML files match. #4535
  • Moved RM110 validation to the new format. Ensuring all commands are documented in the README. #4542
  • Enhanced the format command logs by trimming whitespaces. #4529
  • Added 'StrictModelingRule' and 'StrictAssetsModelingRule' to the ST110 validation. #4560
  • Moved GR105 validation to the new format. Ensuring that each content item has a unique ID. #4545
  • Added 'ReleaseNotesConfig' and 'PackMetadata' to the ST110 validation. #4541
  • Modified the sdk-changelog script which would previously generate all release notes in one section. Now it generates the changelog with different sections separated by headers Fixed, Breaking Changes, and Internal. #4555
  • Modified the mypy pre-commit hook in the pre-commit command which would previously run locally. The hook now runs in Docker and is renamed to mypy-in-docker. #4468
  • Added 'AssetsModelingRuleSchema' to the ST110 validation. #4519
  • Discard 'canvas' tab from LO107 validation as it is now supported by XSIAM. #4544
  • Added support for a specific value in the hidden attribute of a script argument. #4550
  • Moved GR103 validation to the new validate format. The validation ensures that content items use other content items only if they exist in the repository. Additionally, removed this validation from the old format to improve performance. #4522
  • Fixed an issue in the init-validation script where it wasn't generating the correct execution mode for graph validations. #4543
  • Fix an issue with generate-docs command when an integration is missing a description. #4510
  • Fixed an issue where docker validations failed on API Modules in the new validate flow. #4539
  • Fixed an issue where running validate -a on specific validations failed ignored content items. #4539
  • Fixed an issue where RM106 failed on false positive cases of demisto word occurrence. #4539
  • Fixed an issue where the GR106 validation would fail on test playbooks that are marked as reputation tests. #4549
  • Fixed an issue where Threat Intel layouts created in the UI would fail when uploaded using the SDK upload command. #4548
  • Fixed an issue where logs would not show up correctly. #4514
  • Modified nltk version requirement to 3.9.1. #4540
  • Removed support for the Connection content item type. #4547
  • Deprecated. Removing the canvas-context-connections.yml schema's file. #4546
  • Fixed an issue where the run-test-playbook command (used internally) reported incorrect results. #4514

v1.31.11

09 Sep 08:03
2572ceb
Compare
Choose a tag to compare
  • Fixed an issue in RM114 where validate would not catch problematic images when their file type was not png or when their declaration within the README had additional characters present in it. #4512
  • Fixed an issue where the default validations would not run properly. #4532
  • Modified the ST110 validation to allow null values in XISAM-Report's default_template_id. #4525
  • Fixed an issue where the hidden files not uploaded to the artifact in github workflow. #4534

v1.31.10

28 Aug 09:37
bd0d8b4
Compare
Choose a tag to compare
  • The --ignore flag in the validate command no longer requires error codes to be listed under ignorable_errors in the config file. #4509
  • Fixed an issue where the DS107 validation (descriptions shouldn't contain the phrase demisto) failed when the Demisto Bot was mentioned. #4517