Media Insights Engine 2.0.4

Version 2.0.4 of MIE features optional anonymous data reporting and new support for customizing Amazon Translate jobs with parallel data.

Changes:

Add a Cloud Formation option to send anonymous data about MIE performance to AWS to help improve the quality of the MIE solution. (#388)
Add Parallel Data as an input to the TranslateWebCaptions operator (#386)

Security:

Enhance strategies for achieving least privilege (#383) (#393)

Documentation:

Fix broken links in the Implementation Guide (#385)

Media Insights Engine 2.0.3

Version 2.0.3 of MIE includes minor bug fixes and documentation improvements.

Changes:

Update AWS Lambda functions to use the latest python runtime, Python 3.8. (#362)

Bug Fixes:

Fixed workflow IAM policies to support managing custom vocabularioes and terminologies with Transcribe and Translate. (#359)

Improved the robustness of asset reprocessing. (#369)

Added the default MaxConcurrentWorkflow configuration to the table used for storing system configuration. (#360)

Documentation:

Added Implementation Guide for MIE #353, including new info about the kinesis data stream and limitations with the /workflow/operation API resource. (#353)

Added status badges for automated tests to README.

Media Insights Engine 2.0.2

Version 2.0.2 of MIE added many new features to help developer usability and resolved several bugs. Notable changes include; simpler command line usage of the build script with named parameters, MIE / API versions returned via a new API route and as a Cloudformation Output, and tagging of all MIE resources.

We also have a new Github pages site that contains API reference documentation:

https://awslabs.github.io/aws-media-insights-engine/

Changes:

All MIE resources are now tagged #292
New Transcribe operators that can be used for either video or audio files #280
New auto-documenting API functionality that parses API method docstrings #295
Added a new API route /service to the workflow api for AWS Service configuration #312
Added new API routes /version to both MIE APIs that return MIE version and API version #301
Several build script updates #293
Missing docstrings in APIs added #326

Bug Fixes:

Fixed issue where build script would fail if docker was not running #64
Fixed issue where resource names being too long caused stack create failure #304
Fixed issue in GET /asset/metadata test #285

Security:

Implemented a security mechanism that allows the StepFunction role to be scoped down to MIE specific lambdas #291

Documentation:

New documentation website that is hosted on Github Pages #295

Misc:

Build no longer compiles mediainfo from source and instead uses the published version #265

Media Insights Engine 2.0.1

Version 2.0.1 of the Media Insights Engine introduces one major feature alongside the addition of automated build, test, and release pipelines. Minor bug fixes / security enhancements were included as well.

The new feature provides the ability to support human in the loop subtitle generation and editing workflows. This work required several new operators and substantial changes to the workflow API.

The new release pipelines enable the MIE development team to easily accept Pull Requests from community contributors and allows us to release new versions of MIE at a more rapid pace.

Changes:

• Refactored technical cues and shot detection operators to use service provided configuration #307
• Modified the build script to write template url to a file #323
• Created a second build script that does not attempt to build lambda layer or helper library #323
• Reduced the default configuration for concurrent workflows from 10 to 5 #299
• New wait state lambdas for editing and human in the loop workflows #299
• Several new operators for subtitle generation #299
• New API routes in the workflow API for transcribe service config #299
• New workflow statuses for resume and waiting #299
• Several modifications to the workflow API handler for supporting editing workflows #299
• DynamoDB stream configured for the workflow execution table #299
• Added exit codes to testing scripts #323
• New "PR" test workflow #323
• New "Scheduled" build, test, deploy, workflow #323
• New "Release" workflow #323
• Added code coverage analysis to unit tests #323

Security:

• Enabled access logging and encryption on dataplane S3 bucket #282

Bug Fixes:

• Fix bug in retrieve asset metadata method in the MIE helper lib #299

Misc:

• Version bumped MIE helper lib

Release PR: #324

Media Insights Engine 2.0.0

Version 2.0.0 of the Media Insights Engine introduces some significant changes and important new features. Most notably the ability to deploy the framework multiple times within the same region and the ability to trace requests with AWS X-Ray. This release also introduces an overhaul to the testing strategy of the framework and provides updated documentation on it. Several minor changes and bug fixes were also included.

Changes:

• source/tests moved to test#266
• Renamed test stack to accurately reflect the contained resources #266
• Removed operator library deployment parameter (setting to false prohibited the stack from being deployed) #266
• All stack resources updated to use a unique name #259
• Updated the workflow API to not create actual stepfunctions resources for stage objects #256
• Handle errors that terminate MIE state machines #272

New Features:

• Add X-Ray tracing to MIE stack #252
• Multiple deployments of the framework supported in one region #260
• Tiered test strategy in place (unit, integ, e2e) #253, #266
• IAM authentication support for tests #266

Bug Fixes:

• Added a function to only patch modules for xray if on AWS compute #266
• Removed the IAM tag condition for step functions execution; this was causing the rollback bug in #190, #266
• Version locked dependencies for the MIE lambda layer build script #264, #263
• Version locked the python runtime for both MIE API's #257
• Version locked the s3 signature version to s3v4 in the dataplane API #255

Documentation:

• Updated documentation on how to test the framework #266
• Texting coverage matrix #266
• Updated one click deploy links

Misc:

• Removed stale pipeline configs

Media Insights Engine 1.0.0

This release (v1.0.0) focuses on removing cruft and reorganizing the core MIE framework to make it easier for developers to build applications on MIE.

Features:

• Simplified MIE code base:

  • Back-end / Front-end split
  • Major version rev indicates incompatiblity with previous front-ends

• New security features:

  • Support for AWS_IAM

• New installation options

  • Option 1: Install front-end only
  • Option 2: Install front-end / back-end bundle

Documentation changes:

• IMPLEMENTATION_GUIDE.md moved to front-end repo.

Media Insights Engine Beta 0.1.8

This release includes new support for Rekogntion Video Segment Detection. More info on Video Segment Detection can be found here: https://aws.amazon.com/blogs/media/streamline-media-analysis-tasks-with-amazon-rekognition-video/

Deployment instructions are at https://github.com/awslabs/aws-media-insights-engine/tree/v0.1.8

New Features:

You will have two new Video operations to choose from in the workflow configuration dialog. You can detect both technical cues and shots.

Documentation:

General reformatting of the readme page.
Additional steps on the installation of MIE are now available.

Users are encouraged to join the MIE public chat forum on Gitter. This forum was created to foster communication between MIE users external to AWS.

Bug fixes:

Several minor bugfixes are included in this release.

Media Insights Engine Beta 0.1.7

This release includes a new feature for reprocessing videos and an important bug fix for the MediaInfo operator. Deployment instructions are at https://github.com/awslabs/aws-media-insights-engine/tree/0.1.7.

Details:

New Features:

• The analysis view in the GUI includes a new link to “Perform Additional Analysis”, as shown in the screenshot below. This link takes you to the upload page where you can run a different workflow configuration without uploading the video again. The resulting analysis data will be saved using the same asset id.

Documentation:

• Users are encouraged to join the MIE public chat forum on Gitter. This forum was created to foster communication between MIE users external to AWS.

Bug fixes

• MediaInfo released a new version (20.03) last week which broke the existing MediaInfo operator in MIE. As a temporary workaround this MIE release is configured to use the previous version of MediaInfo (v19.09).

Media Insights Engine Beta 0.1.6

This release includes new operators, cost optimizations, improved documentation for developers, security enhancements, and lots of bug fixes. Deployment instructions are at https://github.com/awslabs/aws-media-insights-engine/tree/v0.1.6.

Details:

New operators:

• Text in Video: words are searchable and shown under the ML Vision tab in the GUI
• MediaInfo: codec info and other file metadata is searchable and shown in the GUI under the video player
• Transcode: MIE leverages MediaConvert to support many more video and image formats including Flash, Quicktime, MXF, and MKV. See https://docs.aws.amazon.com/mediaconvert/latest/ug/reference-codecs-containers.html for a full list of supported video formats.

Cost

• Reduced cost by deploying the free tier for Elasticsearch
• Pricing information for MIE resources is now included in README.md (https://github.com/awslabs/aws-media-insights-engine/blob/master/README.md)

Documentation

• The Developer guide is now included in IMPLEMENTATION_GUIDE.md (https://github.com/awslabs/aws-media-insights-engine/blob/master/IMPLEMENTATION_GUIDE.md)

Security

• Subresource integrity (SRI) checks ensure the validity of GUI assets
• GUI prevents users form uploading unsupported file types (such as .exe and .zip)
• If users upload invalid media files then those files will be removed by the Mediainfo operator.

Bug fixes

• Bounding boxes no longer appear outside the video player
• Videos without sound or dialog no longer produce a workflow error

Please reach out to us at [email protected] if you run into any issues or have questions.
Thank you!

Media Insights Engine Beta 0.1.5

This Media Insights Engine Beta 0.1.5 release includes changes necessary to support 2 hour long videos.

Details:

The key to supporting 2 hour videos was to allow step functions to pass a pagination token from one "check status" Lambda invocation to another. Now, Rekognition operators will persist 10 pages at a time, then stop and pass the pagination token to the step function so it can repeatedly restart the "check status" Lambda until there are no more pages left to read.

Prior to this release, Rekognition operators would timeout when trying to save large quantities of paged results, which was often the case with label_detection and face_detection.

Other changes:

• Increase timeouts and memory allocations for Lambda functions based on test results from a 2 hour movie (Amélie).
• add API documentation to README
• Split input text in the translate operator so it does not exceed the 5000 characters max allowed by AWS Translate service limit.
• split bulk elasticsearch inserts in order to avoid exceeding max payload size
• If data is empty, skip ES insert. Data is often empty for operators like content moderation when processing non-explicit videos.

GUI changes:

• Remove unusued GUI artifacts for Polly and AutoML.
• Fix autofill for 1Password on the Login form
• Raise max file upload size to 2GB in the GUI.
• allow analysis button to open in new tab
• fade delete alert after 5 seconds
• Change workflow configuration form so users only have to set the language for Transcribe and Translate once. Used to be that users would have to set that language preference twice, but now, since both Transcribe and Translate use the same source language, users can just specify this option once.

CloudFormation template changes:

• Make the Cloudfront URL a clickable link in the outputs from both the webapp CF template and the base stack template.
• Update the email template for the Cognito invite message so it includes a link to the stack.