Dalet Flex 2023.4.0 Release Notes

Dalet is excited to present the April release of Dalet Flex 2023.4.0

This release of Dalet Flex provides the new features, quality and security enhancements, bug fixes, and other changes listed below.

Dalet Flex

New Features

AmberFin plugin supports importing files from a subpath

The Launch Job Amberfin plugin now supports importing files with subpath from the AmberFin output result. AmberFin output files with a subpath under the basepath as configured in the Output Storage Resource field in the plugin will be imported in Dalet Flex as Managed asset. This is supported both for S3 and FILE protocol. 

Support using account properties in run rule expressions

Dalet Flex now supports using account/system properties in run rule expressions. This enables configuring the visibility of an action/wizard in FlexMAM conditional on a specific account. 

Use Spring expressions to set a run rule and take a business decision based on account/system property:

Use this expression: @[propertyName] to resolve an account/system property

Use this expression: ${“@[propertyName]” == “value-to-check-with”} to resolve the account/system property and then to resolve based on the value of property value

Use this expression: ${@[accountProperty]} to resolve an account property with the value true

Upgrade Flex Enterprise to Java 17

Flex Enterprise upgraded to use Java 17. The upgrade has been done together with the upgrade of Wildfly from 24.0.1 Final to 26.1.2 Final.

Move Workspace supports UDOs

The Move Workspace plugin now supports UDOs in addition to assets. 

JEF Grafana boards reorganized to improve represented data

As part of the improvements to JEF performance, in particular with reference to timeouts, the JEF Grafana boards and captured metrics have been reorganized to 2 different boards, JEF Plugin to display high level plugin behavior and JEF Execution to display internal and advance JEF metrics.

Known Limitation

It is NOT possible to create a single-option, multi-option or drilldown field named `value`. This field causes metadata merge to fail.

This query should be run on client environments to ensure there are no fields with the name `value`. If this field is found, contact Dalet Flex representative for a migration strategy.

select count(*) from MIO_VARIABLE_DEFINITION 

where CLASS_  in ('MioSingleOptionVariable', 'MioMultiOptionVariable', 'DrillDownOptionVariable')

and NAME_  = 'value'

Dalet FlexMAM

New Features

FlexREVIEW interface redesigned and updated

The FlexREVIEW interface has been redesigned and updated:

• Shares the Global Header bar from FlexMAM including: theme logo, search bar, app switcher, user icon
• Displays a table of review sessions with fixed columns that support single column sorting in ascending/descending order
• All columns and icons support tooltips and label truncation
• Displays the Summary Panel including: Proxy preview, Review Details and Comments tabs
• Free text search in the search bar
• Fully controlled player including hotkey support
• Finish Review Session dialog

The legacy and new FlexREVIEW apps can be deployed simultaneously to try out the new experience (use the URL https://<account_url>/fmp/review/index). A Consul KV must also be configured “flexReviewerAppEnabled”. A further update will be released in the future to allow you to configure the reviewer app switcher link.

Japanese language release

The 2023.4.0 release of FlexMAM includes the first “officially” supported Japanese language release.

Changelog

2023.4.0

Enhancements DaletFlex

• JEF Plugin timeout resilience: Multiple tickets implemented to improve JEF performance for jobs running in ExecutionStep or Executor state and timing out. 

• Catch error for misconfigured Job Executor V2 event handler and display an informative error message on the Event Handler that the option “Set Job Created by from Event Created by“ should not be set to true for events that are generated by the system.
• Add support for external ID for a taxon via SDK. The field should be a single string, non-mandatory and unique within the taxonomy.
• Video Codec support for DVVIDEO, H264 and H265 added to Dalet Flex. These codecs are extracted by the Extract Metadata plugin and displayed in the UI.
• FastObject: Improve retrieving annotation metadata tag fields by caching tag names retrieved from Tag service. 
• S3 'folders'(key) ending with "/" could have ContentLength = 1.
• Get annotation by UUID via the groovy SDK.
• Get annotation by UUID via the Enterprise REST API.
• Fix Codec Format in AssetAPIQuery to support Photo JPEG and JPEG 2000.
• Added support for profiles to the Groovy SDK: createProfile, getProfile, getProfiles methods added.
• AmberFin - Change error message when output storage is not selected under AmberFin stencil and make the Output Storage mandatory when AmberFin stencil is added.

• Upgrade Enterprise to Java 17

• Upon a JEF plugin exception, the popup in Flex Core reports the full log trackstack.
• Updated the text on the Multi Factor Authentication screen, after first login.
• Improve stitch throughput for chunk stitching. 
• Flex technical metadata MP4 format values can capture different variant options: "QuickTime", "MP4 v1", "MP4 v2", "ISO Base Media". This is set in a new formatVariant variable available in the technical metadata via readable API REST/SDK access.
• Add support to fetch Job and Workflow dashboard summary counts from SQL (by default) in Data Aggregation. Use a feature toggle Consul KV flex/flex-dataaggregation-service/aggregationDataSource to fallback to REDIS.
• Search for IDs API is now defensive and will not allow the flex-collections index to be targeted.
• Improved the logging capabilities of nodejs services by modifying their startup logic to ensure correct logging of the consul.

Fixed Issues DaletFlex

• Fixed an issue where incorrect results were displayed when searching for tasks by Owner and Status.
• Fixed an issue where a Rest API call did not return the correct results when using the  taskDefinitionId parameter.
• Fixed an issue where a JEF Move action failed to move a media asset to a file mounted storage.
• Fixed an issue where Move is failing while trying to move a file from GCS to s3 and Azure to file type of storage.
• Fixed an issue where an uploaded logo Image was not properly positioned in Flex Core.
• Fixed an issue where UDO object metadata field does not respect workspaces. Switch Account & Workspace permissions must be disabled to support this fix, otherwise all UDOs in all workspaces are visible.
• Fixed an issue where Metadata was still shown in the Workflow panel even though it was set not to show the values by using prepopulateMetadataValues=false.
• Fixed and issue where a change metadata event displayed the ID instead of the taxon or tag name.
• Fixed an issue where Asset object shows associated metadata definition as null even when a metadata definition is associated with the asset.
• Fixed an issue where Task FQL query always returns 0 results. Issue fixed by setting mandatory assignment IDs for Tasks when FQL is passed in the Tasks API.
• Fixed an issue where an `IllegalArgumentException` was thrown when doing a Composition Proxy and Publish (Asset Publish V2) action for an AS02 Version Asset.
• Fixed issues where SDK calls to getTerms and getThesauri were not working because @ModelAttribute was being used but did not work.
• Fixed an issue where it was not possible to clear (set to null) non-editable metadata fields via a script.  
• Fixed an issue where metadata file attachments of a media asset were not removed when the media asset was removed.
• Fixed an issue where the Enterprise API search did not perform correctly when the createdFrom and createdTo criteria have been set. Issue fixed by ensuring that these fields are considered when generating FQL for the query. 
• Fixed an issue where events were not updated with the current user when changing a taxonomy or taxon.
• Fixed an issue in IndexElastic where under load (e.g. full reindex where a number of assets have >10k annotations) communication to FastObject breaks down and renders indexing ineffective.
• Fixed an issue where REST API to return UDO metadata did not return the metadata values. 
• Fixed an issue where the Create Proxy job failed with a Conversion failed error.
• Fixed an issue where SDK calls were pausing between invocations and scripts were taking a long time to complete. To enable the fix set the Consul KV `/flex/flex-jobasyncexecutor-acceptance-tests/featureToggles/disableConnectionReuseForSdkEnterpriseRestCalls` to true.
• Fixed an issue where any update to a workflow definition reset the concurrent workflow limit to zero for that workflow definition.
• Fixed an issue where downloading assets with spaces in their name was adding + symbol to the downloaded filenames.
• SearchElastic: Fixed an issue where GraphQLSuggestions API was displaying this error `Expected type 'Int' but was 'Long'` by correctly mapping Elasticsearch mapping fields having long data type with Long type in GraphQl schema fields.
• Fixed an issue where it was not possible to delete timeline comments from FlexMAM when Originator_Correlation_Id did not exist.
• Fixed an issue where an NPE error was thrown when importing a workflow definition as a draft if no workflow with the same name exists so that the import no longer fails.
• Fixed an issue where the color code was not updated properly in the customReviewStatusses API call.
• Fixed an issue where the Worfklow Created By” field in the Inbox Resource tab could not be edited.
• Fixed an issue in the Advanced Search results where the pagination did not correctly reflect the true number of search results.
• Fixed an issue where the User Settings Service rejected requests when account names contained dashes (-), even though dashes are not part of the forbidden characters group. Updated User Settings Service to use same special character rules for account names as Enterprise. 
• Fixed an issue where users were unable to fetch result in metadata in advanced search result when ingesting a file from default web upload.
• Fixed an issue in the Collection service where Collection UUID were incorrectly used as account ID in collection updated events.  
• Fixed an issue where UDO metadata is not indexed and this NPE is thrown Cannot invoke "com.ooyala.flex.objecttypes.ObjectTypeEnum.getResourceType()" because the return value of "com.ooyala.flex.objecttypes.ObjectTypeEnum.getById(long)" is null.
  
• Fixed an issue where Import Camera Card job failed when importing to an AWS S3 storage.
• Fixed an issue where the number of video assets in FlexMAM was lower than the number in Enterprise.
• Fixed an issue where any update to a workflow definition reset the concurrent workflow limit to zero for that workflow definition.

Enhancements FlexMAM

• Tooltips added to Global header buttons and filter icon in free text search.
• Activate collection lookup in the collection search field.
• Asset level statuses - Publishing status table added to the Details tab for assets in FlexMAM.
• Clip duration in ClipBin in FlexMAM respects the Video Duration Format set in FlexADMIN> Application Management > Global Settings.
• Added FlexMAM UI Japanese translation.
• S3 schemes can now be used in metadata URL fields.
• Disabling the warning ‘Your search has been limited to the first 10,000 results...’ is now saved across login sessions by saving the flag in the local storage instead of in the session.

Fixed Issues FlexMAM

• Fixed an issue where it was not possible to update and delete Custom Marker templates.
• Fixed an issue where a scroll bar was displayed on the hotkey Help menu.
• Fixed an issue where it was not possible to share an asset using the Access tab in FlexMAM.
• Fixed an issue where it was not clear a taxonomy value added to a custom marker when the multiplicity for the field is 1..*.
• Fixed an issue for the Details tab of the Summary pane when opening an Image asset in the Manage Page.
• Fixed an issue where the subtitle selection dropdown is not displayed correctly when previewing in full screen.
• Fixed an issue where the Unpin icon disappeared from the Collections panels.
• Fixed an issue where the Collection search box showed no results even though suitable matches did exist.
• Fixed an issue where the backslash character ('\') caused suggestions to fail in FlexMAM. Fixed by appending an additional backslash to escape the character.
• Fixed an issue where User Defined Object received incorrect icons.
• Fixed an issue where an update to the ‘Expires On’ field of a user in User Management failed to save.

List of Services upgraded between 2023.2.0 and 2023.4.0 

For the new 2023.4.0 release, most services have changed.