Dalet Flex 2024.4.0 Release Notes

Dalet is excited to present the May release of Dalet Flex 2024.4.0

This release of Dalet Flex provides the new features, quality and security enhancements, bug fixes, and other changes listed below.

Dalet Flex

New Features

Implemented Move and Export Jobs for Aspera Integration

This version gives the ability to move and copy assets using an Aspera server within Flex's workflow engine. A new action plugin has been introduced along with a Flex resource to connect to the Aspera servers.

Upgrade to Spring-Boot 3 – Java Apps

Continued upgrading microservices and libraries to Spring-Boot 3.

Changes to semantics in VFS affect Copy/Move API with API behavior

JEF Copy/Move: Changes to semantics in VFS mean that any scripted actions making use of FFP API to perform copy/move may be affected if the source location is a folder. In this case the FFP job will now move/copy the source folder (including the folder itself and not just its contents) to the target. To ensure just the contents of the folder are moved/copied, the source VFS location should include the property includesRegex: ".*" . Further details on this change to the semantics for copy/move are outlined here.

Dalet FlexMAM

New Features

Changes in marker metadata display and behavior

• Header for a selected Custom marker has a Back to All Markers button, IN & OUT timecodes and Save button.
• Save button is disabled by default and is enabled when metadata is changed.
• Clicking Save saves the metadata without closing the metadata form.
• Save/Cancel buttons at the bottom of the marker metadata form removed

Changelog

2024.4.0

Enhancements DaletFlex

• Added new endpoints to the jobexecutionmanager service to help support JEF-related diagnostics.
• NodeJs Apps: Support Client Credentials granting usage for non-Enterprise APIs: set the user context fields by reading actAsUserId header.
• FFP Plugins: Copy/Move (might be others in FFP or FSP plugins) protect moving/copying segmented asset with manifest folder with the same root folder as the Storage Resource base path.
• JEF Aspera Transfer: Support transfer (Copy/Move) of all non-single fie assets: Packages, Aso2Asset, OmpAsset, ProjectAssetImageSequenceASst, TarAsset, CameraCardAsset, (new) OpAtomAsset.  Copy/Move the folder containing the segmented assets or the package.
• Add `created-asset-ids` variable to workflow context with id of created asset on Transcode, CreateProxy, Conform, CompositionSEquenceProxy, ImageTranscode plugins.
• Capture FSP format timecode and videoStream timecode in String for operation/migration purposes (no GET API, no FO, no Index, no UI).
• Review config param, name/description and support for Aspera recv/send options.
• Search-related changes to support the Asset/UDO split  ACL read/write permissions.
• Export: Flex Sequence - Support mixed framerates when generating FCP XML files.
• AFF Export to generate dependencies on the fly so that XML generated from Edit Asset created in Dalet Cut can be imported properly into Adobe Premiere.
• In Custom Marker tab, selected custom marker highlighted in Manage page as well as in Summary page.
• Support mixed framerates when generating FCP XML files.
• Support selecting and highlighting custom marker from list in Manage page and returning results after cancelling filter search.
• Update Core's Review Asset tab to navigate to new FlexRVIEW review URL instead of opening legacy reviewer.
• Improve the error message when the configured Vantage Output Name is not found
• Add KV `flex/flex-enterprise/defaultWaveformTypeIfNull` to set value of waveform type when asset.waveformType is null. Default value uses WAVEFORM_IN_BASE_FOLDER.
• Added mechanism to automatically realign collection item edges in case of data inconsistency.
• To prevent message processing failing, stop Rabbit Message consumers when flex-master / flex-job is not healthy
• Support WORKER deployment node for FlexFileProcessor and support configurable job concurrency similar to FlexStreamProcessor.
• Add support for extraction to Dalet VOL file format for waveforms. This can be specified per waveform job via a new `waveformFormat` property or default behaviour can be set using a new Consul KV `flex/flex-streamprocessor-service/defaultWaveformFormat` set to `VOL,JSON+BIN` to ensure both formats are extracted simultaneously.
• Flex IndexElastic Service: Check and update all ACL operations.
• Support .tcd timecode files for proxies.
• The metadata field description field is now limited to 500 characters.
• Change the SDK to use FastObject rather than Enterprise to fetch user details when updating bulk metadata.
• Fix copy/move semantics for source folders.
• Make Collection account-sharing to group ACL membership migration script resilient to poor data entry of valid values (numerical strings only). 
• Implemented readable stream based listing usage for copy, move and remove operations to allow processing of very large numbers of items.
• Design: Save marker metadata without closing metadata form.

Fixed Issues DaletFlex

• Fixed an issue where a Decision script trying to cancel continuously from ExecutionStep and hammering Enterprise with events. Issue solved by maintaining a list of running jobs to avoid bottleneck on cancelled job cleanup.
• Fixed an issue raised when sending an asset api query for deleted assets. Issue fixed by adding a null check to get asset via api when it does not have vfs location and asset is no longer Placeholder.
• Fixed an issue with Events Handlers requests hitting the Events API before the corresponding event has been fully created, resulting in a false error. Fixed by adding retried to the Get Events API /api/events/<eventId>, by default at 0, 1.5, 4.5 seconds, but can include also attempts at 10.5, 22.5, 46.5 seconds. The configuration KV is flex/flex-events-service/getEvent/maxAttempts can be set to any integer 1-6, default 3.
• Fixed an issue where with S3 calls to get acceleration configuration for none supported region. 
• Fix Mapstruct mapper for legacy script getAsset.
• Updated Spring-Boot apps to fix an issue where a trailing slash was added and  HTTPS was downgraded to HTTP.
• To prevent corruption of Arrango DB and its being irrecoverable after one host is down. For Spring Boot Apps using Arango: Replication factor of `arangolock` / `dbchangelog` collections should be at least 2. For existing environment collections this should be done manually.
• Fixed an issue in the Xtend Adobe Panel extension failing. Fixed by allowing file:// as a CORS origin for the Login App.
• Fixed an issue where JEF copy/move Failed when moving Segmented asset. Issue fixed by including the package name in the destination vfs location.
• Fixed an issue where a disabled effect on the timeline was not removed when creating the conformed asset.
• Add checkbox for optional configuration parameter to Copy/Move protect moving/copying whole Storage Resource if Segmented Asset is in root: support copying/moving if filename manifest==media folder
• Fixed an issue to ensure backwards compatibility for FFP restore jobs after restoreTier property renamed to restorePriority.
• Fix an issue with infinite pagination for AI calls by adding logic to Authorisation service pagination utils to end pagination not only if the totalCount has been reached, but also if the current page contains no data.
• Improved logging messages when "add items" operation to collection fails because the  items in error have mis-formatted dates.
• Fixed an issue where FO objectsid endpoint returns inconsistent results
• Fixed a UI issue in Flex Core where the Events/History tab messages were not cleared properly when auto-refreshing.
• Fixed an issue where capturing recent items can cause a DB deadlock.
• Fixed an issue to support NetApp S3 implementation so it is possible to start/enable the netapp storage resource.
• Fixed an issue where Create Proxy job was failing for segmented assets because the file extension was supplied in the "File Name" configuration. Description changed in the Create Proxy configuration to leave out file extension for custom filename for MPEG-DASH and HLS manifest files.
• [Flex Cut] Fixed an issue where a conform job fails for project with voice-over.
• Fixed an issue in FlexMOVE where the workflow is not kicked off and although the asset is uploaded it is not visible in FlexMAM or Flex Core.
• [Flex Cut] Frame rate: Conform fails when rendering media with a frame rate that does not match the project frame rate with this error `The imported clip has a different frame rate than the project: render is not possible, you can only save an EDL`.
• Unable to load FlexMAM when "Act As" permission is disabled for specific user role.
• Fixed an issue where archive operation is completed successfully eventhough the missing file is not there in the source path also the package path is wrong when user provided "isPackage": true.
• Fixed an issue where copy operation is copying the tags when user is trying to copy a asset from GCS location using "copyTagsFromSource": false
• Fixed a CORS issue in Web transfer where including Drilldown and Tag Fields triggered errors.
• Fixed an issue where a file is deleted from the source location when user is trying to perform archive operation using the same input storage resource for the target location. After fix, the file is not deleted or moved.

Enhancements FlexMAM

• FlexADMIN: Permissions set in the Flex Core are respected for Create, Delete and editing of user in FlexADMIN.
• FlexMAM: Display Format Variant in Technical Metadata UI. Displayed in technical Medatata tab, Chip filters, Listing of table and tile templates.
• Updated the usage of the Value Suggestions API on SearchElastic, to use `fqlFilter` in place of a number of query parameters. Returns all suggestions for fields in metadata form.
• Simplify and improve collection item retrieval.
• FlexMAM: Improve interdependent field behavior to support an interdependent field expression that can match on a null value, for example `if field a is null, then hide field b`.
• Consume Flex enterprise app permission and display apps in app switcher dropdown based on configured permissions in Roles in Flex Core..
• Drill down menus of Metadata fields in Dalet Flex MAM will now immediately show values in relevant fields even if no text input has yet happened. Thus potentially matching values can be provided quicker than ever.
• FlexREVIEW should be enabled by default (if deployed) so all use of flex/shared/featureToggles/flexReviewerAppEnabled KV removed.

Fixed Issues FlexMAM

• Add support for Color Type Field in metadata form.
• Fixed an issue where the search value in the chip bar was not displayed when using searchable icon from the metadata tab. The username displayed in the typehead user field differed from the asset listing and user field selected type. The values for both scenarios were undefined
• Summary panel: Fixed an issue where it was not possible to play wav or aiff audio from UDO page.
• Fixed an issue with UDO creation by adding an option to create skip setting the default metadata instance when creating a child UDO with API script.
• Fixed an issue where UDO navigation is not working when if the UDOT plural name has been updated
• Fixed an issue when performing bulk metadata update on complex fields with multiple cardinality removed existing values. The fix sets the behavior for bulk metadata update for complex fields: Metadata is merged when original field cardinality is 1 and updated field cardinality is 1, in all other cases multiple existing metadata values are overwritten with the new values.
• Fixed an issue where an mp3 file with a file in extension in capitals was not playing. Issue fixed by adding a check for capitals and if the check is true skipping the proxy check since no proxy required for mp3.
• Bulk edit on drill down fields with UDO baking stores doesn't allow to select any value
• FlexMAM: Fixed an issue where it was not possible to change the variant/metadata definitions from the Manage page details tab.
• FlexMAM: Fixed an issue where UUID and ID values and more than one ID field is displayed in the Workspace summary panel.
• FlexMAM: Access Tab: Sharing assets to sub account user from the Access tab takes a long time and does not always succeed.
• Fixed an issue where a complex field is always shown in expanded mode in Summary and Manage pages even though "Expanded metadata complex fields" option is unchecked in FlexADMIN.
• Task Notification Panel: Fixed an issue where Player full screen mode not working properly in Task modal.
• Fixed an issue when selecting a value in a drilldown UDO field in the metadata form for FlexREVIEW, legacy Reviewer and Task modal and FlexMOVE.
• Action execution page: Fixed an issue so Action Configuration metadata details updated from FlexMAM in the Action Execution page are honored.
• Fixed an issue where UDO breadcrumbs have double arrow instead of a right-facing arrow.
• Flex Cut: Fixed an issue where no error message is displayed when the upload VO file fails when saving an edit asset. If the upload fails this toast message is displayed `Failed to upload the voiceover asset`.
• Fixed an issue where the workflow did not trigger for the FlexMAM ASPERA Uploader.
• Global Header: Fixed an issue with behavior for closing the app switcher/ add icon.
• App Switcher: Fixed an issue so all app names in the app switcher are always displayed correctly in English regardless of the language selected for the UI.
• Fixed an issue where the Drilldown Dropdown for taxonomies and UDOs was not always retrieving a suggestion.
• [Flex Cut] Local VO Recording: Fixed an issue where import fails with a warning when importing VO reference asset (EDL) to the timeline.
• Fixed an issue where redirection to FlexMAM from any internal apps [flex review, flex admin, flex move] through app switcher is not working.

List of Services upgraded between 2023.3.0 and 2023.4.0

For the new 2023.4.0 release, most services have changed.