Releases: demisto/demisto-sdk
Releases · demisto/demisto-sdk
v1.23.0
- Added support for inputs sections and outputs sections in a playbook.
- Added a new service for file management, allowing to write files and read files from specific git branches, local file system, or from any remote api.
- Added a new flag
--docker/--no-docker
to demisto-sdk pre-commit, in order to enable the option to run the pre-commit command without docker hooks. - Added support for xsoar, xsoar-saas and xsiam wrapper clients to ease the integration via their apis.
- Added the command demisto-sdk coverage-analyze to the pre-commit hooks.
- Updated merge_coverage_report to be a hook in the pre-commit.
- Updated the mode option to be free text. for more details see https://github.com/demisto/demisto-sdk/blob/master/demisto_sdk/commands/pre_commit/README.md#modes
- Added a new command setup-env to setup the environment for integrations and scripts in vs code IDE, XSOAR and XSIAM.
- Fixed an issue where the SDK failed to retrieve docker hub token when there were temporary connection errors.
- Internal: Added a welcome comment to contributions PRs.
- Fixed metadata dependencies dumping in prepare-content command.
- Fixed an issue where the TagParser didn't work properly on all edge cases.
v1.22.0
- Added Docker Hook support to pre-commit; for details see https://github.com/demisto/demisto-sdk/blob/master/demisto_sdk/commands/pre_commit/README.md#docker-hooks
- Removed -use-local-import flag to graph update command.
- Perfomance improvements to graph commands.
- Adjust graph structure to accommodate anticipated changes in infrastructure for the validate command.
- Fixed an issue where the lint command with docker, would not give unique container names to different image runs.
- Added a new
display_name
field toPack
entity in graph.
v1.21.0
- Added the argument
--commited-only
to pre-commit to skip collecting on staged files. - Fixed an issue where the pre-commit command runs even in the case of deprecated or powershell integrations or scripts.
- Fixed an issue where validate falsely failed with error
PB101
andPB123
due to condition names discrepancy - Fixed an issue where the modeling-rules test command failed report and error when test data didn't exist.
- Changed the table print for modeling-rules test command.
- Updated the prepare-content to add contributor details to the
detaileddescription
field based on supportlevelheader key. - Added a new validation (
IN162
) to ensure that each event collector under partner supported packs have the xsoar value for the supportlevelheader key in its yml. - A rewrite for the download command, with many improvements and fixes, including:
- Large optimizations: reducing the runtime and CPU usage by a significant amount when there's a considerable amount of custom content items on the server.
- Improved error handling and messages, logs, and documentation (
demisto-sdk download --help
) for the command. - Fixed an issue where custom PowerShell-based integrations and automations would not download properly.
- Fixed an issue where names of the following custom content items would not have their IDs replaced from UUIDs:
- Classifiers
- Dashboards
- Indicator Types
- Reports
- Widgets
- Fixed an issue where the download would fail when using the '-r' / '--regex' flag when there were multiple custom content items on the server matching the pattern, having the same name.
- Fixed an issue where integrations / automations with a dot in their name would be saved with an incorrect file name (For example:
Test v1.1.py
would be namedTest v1.py
)
- Fixed the Link to Jira Github flow to match the Jira-dc.
v1.20.8
- Internal: Fixed an issue where the
tools.get_id
function would not find the ID for layout content items in some cases. - Internal: Fixed an issue where the
tools.get_display_name
function would return incorrect values for "Indicator Type" content items. - Changed the error code of the validate check for deprecated display names from
IN157
(duplicated a code used by anativeimage
check) toIN160
(new code). - Changed the error code of the validate check for invalid SIEM marketplace values from
IN151
(duplicated a code used by a check for empty command arguments) toIN161
(new code). - Added JUnit XML output support for test-content command.
- Updated the run-unit-tests command to not fail on JavaScript items, but skip them instead.
- Updated the
validate
pre-commit hook to run before therun-unit-tests
hook. This will preventvalidate
from falling on errors about temporary files that are sometimes created when running unit-tests. - Added the auto-replace-uuids flag to the download command. set this flag to False to avoid UUID replacements when downloading using download command.
- Added a new key supportlevelheader to the integration schema.
- format command will run without the content graph if graph creation fails.
- Updated the
GENERAL_DEFAULT_FROMVERSION
variable from 6.9.0 to 6.10.0. - Internal: Replaced the
tools._read_file
function with a more generictools.safe_read_unicode
function. - Internal: Added
pathlib.Path
support to thetools.get_yml_paths_in_dir
andtools.get_child_directories
functions. - Fixed an issue in the test-modeling-rule command, where possible exceptions were not caught.
- Added the --delete_existing_dataset/-dd flag to the modeling-rules test command to delete an existing dataset in the tenant.
- Added a new validation (
IN159
) which validates that reputation commands context outputs are spelled according to standards. - Internal: Added a
loaded_data
parameter toYmlSplitter
to allow passing preloaded YAML data.
v1.20.7
- Fixed an issue where unified integrations / scripts with a period in their name would not split properly.
- Fixed an issue where the documentation was out of date with the current structure of demisto-sdk which does not support command auto-completion.
- Improved logging for lint and prepare-content commands.
- Internal: Added the
CI_SERVER_HOST
,CI_PROJECT_ID
environment variables.
v1.20.6
- Added the --mode argument to the pre-commit command, to run pre-commit with special mode (to run with different settings), supported mode are: 'nightly'.
- Modified the
validate
andformat
pre-commit hooks to run with the--all
flag only when the--mode=nightly
argument and--all
flag were given. - Modified the
ruff
pre-commit hook to run with--config=nightly_ruff.toml
argument when running pre-commit command wite the--mode=nightly
argument. - Fixed an issue where deprecating parsing rules or modeling rules using format failed due to schema discrepancies.
- Fixed an issue where kebab-case arguments were not parsed correctly.
- Fixed an issue where validate falsely failed with error
RN115
on release notes with linefeed at the end of the file. - Fixed an issue where validate falsely failed with error
DS108
on descriptions ending with new lines followed by square/curly brackets. - Fixed an issue where graph commands would not clean their temporary files properly, causing successive commands to fail.
- Fixed an issue where an error log message changed the terminal color.
v1.20.5
- Fixed an issue where validate falsely failed with error
DS108
on descriptions ending with brackets that contains a dot at the end of them. - Fixed an issue where modeling-rule test command failed to properly render the comparison table when boolean value were printed.
- Fixed an issue were format added a dot at end of the description that already ends with question mark and exclamation mark.
- Fixed an issue where upload failed when trying to upload an indicator field.
- Updated the update-content-graph command to work with external repositories.
- Updated the validate command to work with external repositories when using the --graph flag.
v1.20.4
- Fixed an issue where using prepare-content, upload, zip-packs and download on machines with default encoding other than unicode caused errors.
- The modeling-rules-test will now ignore test data files containing the
test_data_config_ignore
key. - Fixed an issue where modeling-rules init-test-data command failed on modeling rules that contain the text
call
even not as a separate word. - Unlocked the dependency on
packaging
.
v1.20.3
- Added the
FileType.VULTURE_WHITELIST
to theFileType
enum for.vulture_whitelist.py
files. - Improved performance when reading
yml
files. - Fixed an issue where format would add unnecessary period at the end of descriptions ending with brackets.
- Fixed an issue where format would not add a period at the end of descriptions, when running on in script files.
- Fixed an issue where validate falsely failed with error
DS108
on descriptions ending with brackets that contains a dot at the end of them. - Fixed an issue where running validate -g failed reading a
.pack-ignore
file that contained only newlines and spaces. - Fixed an issue where upload failed when trying to upload a list content item.
- Fixed an issue where download would skip downloading list content items assigned to specific user roles with no roles.
- Demisto-SDK will now exit gracefully with an appropriate error message when git is not installed.
- Updated validation RN116 to support the structure of --force flag in update-release-notes command.
- Fixed an issue where the release notes file was not added automatically to git when using the update-release-notes command.
- Fixed the structure in update-release-notes command when used with the --force flag. Now the header will display the pack display name.
- Fixed the support in validate for
svg
images to have their theme suffix. - Modified validate to support only .svg files ending with _dark or _light suffixes.
- Fixed an issue where modeling-rule test command failed to properly compare types of fields.
- Updated the engineinfo type in the script schema.
- Updated the modeling-rules init & test commands to support RULE section fields.
- Stability improvements for graph create and graph update commands.
- Fixed the metadata type in the XSIAM dashboard schema to map, with possible values: lazy_load and cache_ttl
v1.20.2
- Updated the pre-commit command to run on all python versions in one run.
- Added the --dry-run flag to the pre-commit command, to create the config file without running the command.
- Fixed an issue where the coverage-analyze command was not parsing the logs correctly.
- Fixed an issue where validate falsly failed with error
DS108
on descriptions ending with a newline. - Added formatting for script yml files when period is missing in the end of comment field, in the format command.
- Fixed an issue where format add a newline with a period when the description field missing a period.
- The content graph will now include the python_version field that each script/integration uses.
- Updated the update-release-notes command message structure when is run with --force flag.
- Added the engineinfo in to the script schema. This field specifies on which engine the script will run.
- Fixed an issue where validate falsely failed with error
DS108
on empty descriptions. - Added support for lazy loading the of widgets in XSIAM dashboards.
- Added a validate check for correlation rules, making sure that
search_window
cannot be empty whenexecution_mode
is set toSCHEDULED
. - Added the metadata key to the XSIAM dashboard schema. This field adds support for dynamic parameters in the dashboards.