Media Insights Engine 5.0.1

Version 5.0.1 of MIE includes updates to Python packages.

Fixed:

• Updated python packages. See v5.0.1 commit for more details.

Media Insights Engine 5.0.0

Version 5.0.0 of MIE is a major update that changes the way encryption is handled throughout MIE generated resources and data. MIE now creates an AWS KMS CMK (customer managed key) for use in all services that are integrated with AWS KMS. This results in the encryption of data with that CMK rather than an AWS owned service provided encryption key.

You can find more information on this change in the MIE implementation guide: https://docs.aws.amazon.com/solutions/latest/aws-media-insights-engine/welcome.html

This release also includes the ability to subscribe to a MIE provided SNS topic and SQS Queue for workflow notification events. You can refer to the documentation here for more details.

Fixed:
SNS / SQS workflow event notification configured correctly (#694)

New:
MIE now provisions a custom KMS key (#689)
Custom KMS key identifiers added to stack output (#693)
Additional curl examples added to implementation guide (#698)
Instructions on how to receive workflow notification events added to implementation guide (#694)
Sonarcube properties file added

Security:
Applicable MIE services configured to use MIE created KMS key (#689)
KMS Key permissions scoped down to least privilege (#689, #701)

Media Insights Engine 4.0.1

Version 4.0.1 of MIE includes a small but high priority fix that is needed to avoid an error that was occurring in v4.0.0 when creating workflows.

Fixed:

• Avoid resource policy size restrictions in AWS Step Functions (#686)

Media Insights Engine 4.0.0

Version 4.0.0 of MIE includes new support for custom language models and source language auto-detection in Amazon Transcribe, new API resources for asset checkin/checkout, and more.

New:

• Add checkin/checkout functionality to facilitate mutex locking asset metadata (#660)
• Support custom language models in Amazon Transcribe (#599)
• Support source language auto-detection (#621)
• List the state machine ARN for workflows in the outputs for Cloud Formation stacks that create workflow resources (#641)
• Cache MediaConvert endpoint in order to avoid throttling in the Thumbnail operator (#638)
• Add support for Python 3.9 in the MIE Lambda layer (#647)

Fixed:

• Add an e2e test to validate the wait/resume operator (#657)
• Fix a bug with resuming a paused workflow (#657)
• Infrastructure as code: Return the correct MediaType in /workflow/execution requests (#635). This change altered the Dataplane API in a way that is not backwards compatible.
• Documentation: Add missing information to the dataplane API docs for /metadata (#637)
• Documentation: Add missing information to S3 advisory text (#633)

Security:

• Upgrade python runtimes for lambda functions from python 3.8 to 3.9. (#647)
• Support encryption options for the create_parallel_data function in Amazon Transcribe (#599). This change altered the Workflow API in a way that is not backwards compatible.
• Relocate MIE lambda layers (#676)

Media Insights Engine 3.0.4

Version 3.0.4 of MIE includes minor improvements to CloudFormation deployment templates and IAM security policies.

CI/CD Automation:

• Miscellaneous improvements to CloudFormation templates (#623, #624, #625, #629)

Security:

• Scope down IAM policy used for by DynamoDB Streams Lambda function for logging to Cloudwatch (#628)

Media Insights Engine 3.0.3

Version 3.0.3 of MIE includes improvements in control plane scalability, build automation, and documentation.

New:

• Statically define the MediaConvert endpoint to avoid throttling (#606)

CI/CD Automation:

• Add an option to specify an AWS profile to the build script so build assets can be uploaded to a user-specified AWS account (#601)
• Require users to acknowledge Amazon S3 security advice during the build script prior to uploading build assets to Amazon S3 (#603)

Fixed:

• Fix a pagination bug that prevented the control plane from handling more than 50 concurrent workflow executions (#609)

Documentation:

• Fix an error in the documentation for building MIE from scratch (#602)

Security:

• Update Python modules known to have possible security implications (#611)

Media Insights Engine 3.0.2

Version 3.0.2 of MIE features minor improvements in test automation, build automation, and bug fixes.

New:

• Add new e2e tests to validate CRUD functions in the workflow API for parallel data and terminologies in Amazon Translate. (#543)

CI/CD Automation:

• Allow parent stacks to specify both the solution version for the botoconfig string. This, combined with the existing functionality to specify the solution id, means that applications which use MIE can correctly describe themselves to the internal AWS mechanisms that count solution deployments. (#574)

Fixed:

• When processing long videos, workflows may fail if the video transcript exceeds the max length allowed by Amazon Polly. This behavior was changed so that workflows will skip the Polly operation and output a warning if the text is too long (#543)

• The API version reported by the /version resource under the data plane and control plane APIs was incorrectly defined as version 2.0.0. It is now correctly defined as version 3.0.0. (#576)

Media Insights Engine 3.0.1

Version 3.0.1 of MIE features minor security and documentation improvements.

Documentation:

• Sphinx generated API documentation copied to the Implementation Guide (#532)

Security:

• Validate SSL certificates when making calls to API Gateway (#525)
• Update Python modules known to have possible security implications (#526)
• Grant read permission to the dataplane bucket for Translate and Transcribe operators so they can access custom vocabularies, custom terminologies, etc. (#531)

CI/CD Automation:

• Add a one-click deploy option for the AWS region in eu-west-1 Ireland (#536)

Media Insights Engine 3.0.0

Version 3.0.0 of MIE features the ability for workflows to input media files that are stored in an S3 bucket which is managed outside the MIE stack. This enables users to trigger workflow executions from S3 events, so workflows can automatically process files when they are copied to an S3 bucket.

New:

• Workflows can now input media files that are stored in an S3 bucket which is managed outside the MIE stack. Prior to this release workflows required input media files to reside within the MIE data plane bucket. In order to use this capability the ARN for the external S3 bucket must be specified in the ExternalBucketArn parameter in the MIE base template for Cloud Formation (#489)

• Added a new parameter in the MIE Cloud Formation template that allows users and parent stacks to opt-out from anonymous data collection (#509)

• Added a new parameter in the MIE Cloud Formation template that allows parent stacks to associate their AWS solution id with MIE's boto3 calls. This helps the AWS Solution Builder team improve the quality of published solutions.

Changes:

• Media files are no longer copied to the data plane S3 bucket when recording new assets. This change will break backwards compatibility for applications that assume the S3Bucket property for assets is always the data plane bucket. This change is also the only change that caused MIE's major release number to bump from v2.5.0 to v3.0.0. (#489)

• If input media files cannot be found at the S3 location specified within workflow execution requests then return an error to the HTTP client indicating that the file could not be found. (#507)

Security:

• Upgrade urllib version (#490, #491)

CI/CD Automation:

• Validate S3 bucket ownership before uploading build artifacts (#499)

Documentation:

• The implementation guide now explains about how to start workflows programmatically and provides Python code samples for doing so. These examples can be used to set up an S3 trigger for workflow execution. (#489)

Media Insights Engine 2.0.5

Version 2.0.5 of MIE is the first release of MIE to be published as an official AWS solution. Yay! Most of the changes in this release were needed for compatibility with the AWS solution builder process.

New:

• Compatibility with build pipeline for the official AWS Media Insights Engine solution (#436, #442)
• Add user-agent string for botoconfig (#424)

Changes:

• Relocate opt-out option for anonymous data collection so it follows the pattern used by other AWS solutions (#388)
• Rename s3 buckets to follow the build patterns used by other AWS solutions (#436)

Security:

• Allow user-specified KMS keys for Comprehend (#407, #409)

CI/CD Automation:

• Resolve cfn nag failures and warnings (#393, #440)
• Resolve viperlight failures and warnings (#418)

Documentation:

• Fix broken hyperlink to Implementation Guide (#385)
• Document uninstall instructions (#412)
• Apply feedback from tech writing (#416)