Dalet Flex 2024.11.X (LTS) Release Notes

Dalet is excited to present the December release of Dalet Flex 2024.11 (LTS).

This release of Dalet Flex provides the new features, quality and security enhancements, bug fixes, and other changes listed below.

MariaDB version Now Documented in Flex Release Manifests

The details of the MariaDB version, in format major.minor without specifying the patch version is now included in the Flex release manifest YAML file. For 2024.11.14 the version is 10.11.

Important Note Regarding Vulnerabilities for 2024.11.9

The Login App referenced by the manifest for 2024.11.x has been patched to overcome a critical CVE vulnerability on external authentication mechanisms. To receive the upgraded version of Login App as soon as possible, it is recommended to upgrade all customers to the latest patch in 2024.11.x (LTS). Customers working with interim Flex versions or with a version override for the Login App should contact their Dalet representative for further information.

Dalet Flex

New Features

Support NRAW and Nikon RED Technical Metadata Extraction (new from 2024.11.16)

"From this version of Dalet Flex, FSP is upgraded to support NRAW and Nikon RED Technical Metadata Extraction.

Support search queries with special characters (new from 2024.11.15)

From this version of Dalet Flex, to support search with special characters, add “ “ around any search query that includes special characters.

List of validated special characters: / ? * < > ( ) . $ % ! ^ & # [ ] { } 

NOTE: In a quoted search query, ? and * are considered as wildcards.

Configurable taxonomy search result limit (new from 2024.11.14)

From this version of Dalet Flex, you can use a KV to configure the number of search results displayed for these typeahead fields:  taxonomy dropdown, UDO dropdown and Enterprise object variables, such as users, assets, actions.

Use Consul KV flex/ flex-fmp-app/flexFormConfiguration and set the values:

{
    "optionSize": {
        "taxonomy": xxx,
        "udo":yyy,
        "enterpriseVariable":zzz
    }

Default value (current behavior): 10, Minimum value: 10, Maximum value: 50. 

NOTE: After adding the KV, flex-fmp-app microservice MUST be restarted.

Support creation of HEIC proxy images (new from 2024.11.14)

To enable compatibility with all Apple devices, from this version of Dalet Flex, HEIC proxy images can be created using the JEF Transcode > Image Transcode (FMP) plugin.

Support creating FCPXML for SpannedMedia and ImageSequence (new from 2024.11.10)

To improve integrations with external 3rd party post-production solutions, from this version of Dalet Flex, we support exporting Spanned Media and Image Sequences in FCPXML file format using the Export Edit plugin.

Add support for displaying VOL waveforms in FlexMAM (new from 2024.11.9) 

From this version of Dalet Flex, FlexMAM supports displaying VOL waveforms. The VOL waveform is generated in Flex using an Extract Audio Waveform action configured to generate VOL, JSON+BIN waveform format. When Dalet Brio performs an ingest, it also generates a VOL file for the proxy asset it creates.  

The VOL waveform is extracted from proxy assets and stored in the same location as the proxy file. FlexMAM first checks if there is a JSON+BIN waveform and uses that and if that does not exist, it looks for a VOL waveform to display.  

Improve ParameterValidationFilter error messages and logs (new from 2024.11.9)

From this version of Dalet Flex, improvements have been made in the error message and logging for the ParameterValidationFilter. These improvements make it easier for users and for the support team to diagnose validation failures.

The new error message clarifies the rejection reason, shows invalid parameter and value, and includes a flex.request.id for support reference.

WARN-level logs record rejected parameter, regex pattern (post-whitelist), and guidance on relaxing rules for forbidden values using Consul KV whitelist. 

The WARN message has the following text: 
ParameterValidationFilter rule failure: parameter value: 
<insert value here, on a line of its own> 
was rejected by regular expression: 
<whatever the regex pattern actually is, after having been modified by the existing KV whitelisting, if any) 
This could reflect malicious usage. If after careful consideration the usage is deemed valid, then it is possible to relax of the filter rules by configuring the Consul KV `flex/enterprise/whiteListParamFromXSSFilter` to be a comma-separated whitelist of tags that should be taken out of the regex (e.g. `alert,meta`).

Improve API URL validation to improve performance (new from 2024.11.9)

To prevent API calls for asset children causing high DB usage and talking a long time to complete, if the API URL has a double slash even if by mistake, it throws the following 400 response:

{
  "errors" : [ "Invalid URL format: Double slashes (//) are not allowed in the path. Please use single slash to separate path segments. Use the provided flex.request.id to locate relevant logs in the system." ],
  "flex.request.id" : "x_glBxCretZR9Hln9ZQjG"
}

An example of an incorrect call is https://cio.images-mam.org/api/assets//children.

Configure writing tcd files for MXF in Extract Technical Metadata actions (new from 2024.11.8)

From this version of Dalet Flex, a new confguration option has been added to write timecode .tcd files when performing an Extract Technical Metadata action on an mxf file that has a proxy file associated to it. The new configuration# Overall version for this release - must match the filename ooyalamam_version: 2024.11.8 # Individual versions flex_cut_app_version: 0.4.85-18 flex_fmp_app_version: 6.5.105-4 flex_fmpadmin_app_version: 3.4.118-20 flex_fmpreviewer_app_version: 2.4.134-29 flex_globalheader_app_version: 5.7.105-29 flex_search_app_version: 8.1.46-117 flex_usersettings_service_version: 2.2.80 # Array of compatible Flex Core versions compatible_flex_versions: - 2024.11.8 supports creating a tcd file regardless of whether the proxy file was created by Dalet Flex or by a 3rd party, such as Vantage or AmberFin. 

If this option is enabled and the asset does not have a proxy file associated with it, the job will fail. The tcd file is stored in the location of the Segmented Proxy asset and if no Segmented Proxy exists, it is created in the location of the first available Proxy asset.

NOTE: This setting replaces and overrides any Consul KVs or job properties that were used in earlier versions of Dalet Flex.

Improve scripting lock management and script lock release (new from 2024.11.7)

Previously, JEF Script could release Script locks when the script threw an exception and terminated failing the job.  JEF Script locks are now also released when the Job Execution (Job Async Executor service) goes down unexpectedly. This allows other JEF Scripts waiting for the Script lock to acquire it once the original script lock owner has failed, regardless of the reason for the failure.

Update Remove ACL plugin (new from 2024.11.6)

In this version, updates have been made to the Remove ACL plugin. To make it easier to remove all ACLs on assets, the option, Remove All ACL, has been added to the Remove ACL plugin in the Permission Action Type. If this option is selected, all ACLs and the action ignores individual Groups/Users in the configuration.

The mechanism of all Remove ACL actions has been made idempotent, so that jobs will complete even if they are applied to assets that do not have an ACL or if the Group/User in the action is not valid and an appropriate warning will be displayed in the Job History. Remove ACL jobs will only fail if the Role of the user running the job does not have Manage ACL permissions for the given asset type.

Support publishing events by flex-fileaccess-service (new from 2024.11.8)

Event publishing for flex-fileaccess-service has been implemented.  Currently, an event is pushed only when an asset is downloaded.

Event publishing is available by default. If required, it is also configurable through consul KV or through Environment variable.

Consul KV: flex/flex-fileaccess-service/enableEventPublish (default=true) 

Environment variable: EVENT_PUBLISH_ENABLE  

Event name: DOWNLOADED  

The environment variable takes precedence over the KV when both are specified.

Selection and Bulk Selection are Unsynched (new from 2024.11.8)

From this version of Dalet Flex asset selection and bulk selection are no longer synched. When you select multiple items they are not automatically added to the Bulk Assets listing. You can ONLY add assets to the Bulk Assets listing by selecting the Bulk selection checkbox.

Lookup search for saved searches (new from 2024.11.6)

Only the first 25 Saved Searches are displayed in FlexMAM in the left-hand navigation panel. To allow you to find saved searches easily a look up field has been added in My Searches.

Flex Cut supports adding subtitles with media (new from 2024.11.4)

From Dalet Flex 2024.11.4, TTML format subtitles associated as children of a Flex asset are automatically imported into Flex Cut in a dedicated CC track when the parent asset is added to the Timeline. You can edit the CCs in the track using the CC panel and all changes, including font and size, are saved as part of the EDL project. When the project is reopened in the Timeline all the saved changes are available.

Limit: 2 CC tracks and size of the uploaded subtitle is <=10mb.

Improve search to support accent-insensitive and apostrophe-formatting-insensitive searches (new from 2024.11.4)

To improve the search functionality in Dalet Flex to support accent-insensitive and apostrophe-formatting-insensitive searches, the analyser configurations in the index configuration templates defined by flex-indexelastic-service has been updated to use ASCII folding filter.

To use this in Dalet Flex 2024.11.x (LTS):

• The Consul KV flex/shared/featureToggles/search/asciiFolding must be set to true
• All instances of flex-indexelastic-service and flex-searchelastic-service must be restarted
• A full reindex must be initiated and completed successfully.

Additional languages added (new from 2024.11.4)

To improve user experience and accessibility, the following have been added as official languages in the FlexMAM:

• Italian
• Spanish
• German
• Hebrew

Additionally, the existing Arabic translation has been updated. These additions enable users from diverse linguistic backgrounds to fully utilize the platform's features and functions.

Productizing Flex Solutions (new from 2024.11.3)

Dalet Flex 2024.11.3 delivers an MVP Packaged Flex Solution that contains pre-configured packaged workflows to simplify the complexity of the system that allow quicker deployment and reduce the time-to-value for customers. The default workflows and ready to use configurations delivered on deployment can be changed and updated according to specific customer requirements as required. In a Packaged Flex Solutions there are two types of workflows: 

• Ready to Use (RU): the workflows are operational without any configuration changes
• Ready to Modify (RM): the workflows are pre-configured but need adaptation (specific metadata fields depending on customer data model) to be executed 

Deployment of a Packaged Solution is managed by the Dalet team in conjunction with customers using the Flex CM tool. 

Auto refresh functionality for Asset results (New from 2024.11.3)

From this version of Dalet Flex 2024.11.x, it is possible to enable Auto Refresh for asset and/or marker results so that you can see the latest data without manually refreshing the page. Auto-Refresh is disabled by default.

To enable auto-refresh, turn on the option at the bottom of the Asset Results page.

The default refresh frequency is 30 seconds and the value is configurable. The minimum refresh frequency is 5 seconds.

Auto Refresh does not:

• Interfere with currently selected assets or markers
• Disrupt playback
• Interfere with open/in progress wizards
• Reset or change actice search filters

You can use the manual Refresh button at any time even if Auto Refresh is enabled.

Primary membership in Collections (New from 2024.11.2)

As part of the overall changes to the Collection ACL, this feature clarifies several points which are also important for the Dalet Pyramid integration:

• Assets can only be in 0 or 1 “primary” collection; and can be in any number of collections without having a “primary collection.
• A collection can always be deleted without clearing the collection of items. Any permissions on the asset inherited through the membership of a collection are deleted when the collection is deleted.

Improvements in the JEF Launch Vantage Workflow plugin (New from 2024.11.2)

This release contains improvements and fixes in the JEF Launch Vantage Workflow plugin to cover scenarios that were available previously in the deprecated Enterprise plugin.

• Correct unique reference names for child assets are assigned when multiple outputs are generated by the Vantage workflow.
• Windows file storage location mappings using backslashes are correctly resolved by the plugin.
• Option to use a Wildcard, `*`, in the Vantage Output Name field, to input all multiple output files generated by Vantage as child assets without specifying expected Vantage nicknames. NOTE: When `*`, is any output that has the same nickname as an input will NOT be imported again. So, if the Vantage workflow takes 'Original' as an input, and produces two outputs, 'Original' again and 'Copy', only 'Copy' will be imported.  

Special Characters in File Names (New from 2024.11.2)

To prevent issues when playing files, special characters in file names are encoded. Please note the following recommendations regarding the use of special characters in file names. More information at this reference.

New download service flex-fileaccess-service

From this version of Dalet Flex, 2024.11.0, FlexMAM UI downloads are facilitated by the new flex-fileaccess-service. This improves download reliability and supports resume should a download fail. flex-fileaccess-service improves performance when downloading large assets from S3, Azure, GCS in FlexMAM and FlexREVIEW.

The new 'flex-fileaccess-service' MUST be deployed as part of upgrading to this version and above. If the new service is not deployed, file download from FlexMAM and FlexREVIEW will fail.

Collection Access Control List (ACL) Permissions Update

Dalet Flex Collections are used to catalogue and browse assets. Collections can be shared between Dalet Flex users and user groups. Collections may be shared with users/groups who do not have access to all the individual assets within it. Previously, these users could only view the assets to which they had been granted access (either individually or by Workspace membership). For end users to access all assets in a collection, the collection owner had to locate and grant the end user access to individual assets.

From Dalet Flex 24.11.0, collection owners/admins can now modify ACL permissions on the collection level, granting end users permission to view all assets within a collection. This eliminates the need for collection owners/admins to grant access on an asset-by-asset basis. For example, to allow a user to view assets in workspaces that the user does not have access to, you must assign View Collection rights and View Items rights.

NOTE: Although end users can be granted view rights to all assets in a collection, they will only be able to modify the metadata of assets they have access to them on the user ACL level.

Additionally, collection-level permission may now be granted to groups/users to allow them to modify metadata and ACL permissions for a collection. This permission is called Manage.

Modify permissions for all assets in a primary collection can be granted using API. This capability will be expanded in the future.

JEF Hotfolder: Improve overall resiliency by scanning only in-process files

From this version, hotfolder resilience has been improved for workflows where hotfolders contain large numbers of files that are not removed after import. This resilience is enabled via the flex/enterprise/hotFolder/expireProcessedFileItems KV, which defaults to false in this release. From this version and when expireProcessedFileItems is enabled, hotfolders no longer support retriggering an import when files that have already been imported are updated in the hotfolder. To improve data integrity, a housekeeping process has been added to remove processed storage items when hotfolder expiry is enabled. If KV flex/enterprise/hotFolder/expireProcessedFileItems is enabled, physical files are not removed when the corresponding storage resource item is removed. 

Legacy Plugins deprecated: Copy/Move/Hotfolder

From Dalet Flex 2024.11.0, Enterprise Move and Copy actions and Hotfolder are deprecated in favor of JEF actions and resources.

Consul KVs are available to support legacy configurations (between deprecation and removal) but they are disabled by default and must be enabled explicitly to work with them

User Interface Visual Improvements

The summary panel player’s size can now be expanded using the handle below the player controls. The minimum height of the Player has been adjusted in the Manage page so that the layer resizes correctly when adjusting the size of the Timeline area.

User interface color enhancements have been included in Dalet Flex Release 2024.11.0 to improve visibility and user experience.

Workspace Chips

When searching multiple Workspaces at once, the Workspaces selected in the left navigation pane will be displayed as search chips in the global filter bar. Users can deselect a Workspace by clicking it in the navigation pane or by clicking the x on the search chip.   

UI improvements on table column headers

• When using tick boxes to make bulk asset selections, a “deselect all” icon is available in the column header.
• Column headers with click actions are highlighted when hovered over, indicating they are clickable.
• When adjusting column width, hovering between two column headers reveal a green line and a “move left or right” cursor icon.

New default behavior for GET and LIST UDO API (implemented in 2024.10.0)

NOTE: From 2024.11.0 the `skipChildren=false` matrix parameter is no longer available as per FLEX-72379: UDO get and list api to handle children property

• skipSubChildren matrix parameter no longer available for UDO list and get APIs
• skipChildren matrix paramter used with value as false for UDO list and get APIs returns the following message:

False value for 'skipChildren' matrix parameter is no longer supported.

Please use '/<host>/api/%s/%s/children' to fetch the children of an UDO; note that this API is paginated.
- first %s will be replaced with udo plural name
- second %s will be replaced with <udo-id> for list api and actual udoId for get api

Breaking Change

Update to representation of 23.976 fps framerate

OpAtom transcode is failing for media with 23.976 fps. To fix this, FSP has been updated to represent 23.98fps or 23.976fps as a ratio of 24000/1001 instead of 4000/167. 

This is a breaking change because the frame rate value returned from FSP for such media will now be 24000/1001 instead of 4000/167. Any script using 4000 or 167 to detect 23.976fps may need to be updated and should be checked.

Changelog

2024.11.18

Enhancements DaletFlex

• Flex Login App: require app.flex-mam role for the FlexMOBILE PKCE scopes grant.

Fixed Issues DaletFlex

• Fixed an issue where the French translation of Clip in the Browser is incorrect.
• Fixed an intermittent issue where it was not possible to create a UDO in FlexMAM.

List of Services upgraded between 2024.11.17 and 2024.11.18

2024.11.17

Enhancements DaletFlex

• Enable Force Purge = Yes in a Purge action continues the Purge action when the technical metadata is missing for an Asset. A log warning is written to History and the logs.
• Default Consul KVs flex/flex-videoproxy-service/readPermissionAuthEnabled and flex/flex-fileaccess-service/readPermissionAuthEnabled to true.
• Add support for Consul KVs to override the default values of 60 seconds for the no change in growing size for Packages and MXF files:  
  flex/flex-streamprocessor-service/growingMxfNoSizeChangeExpirySeconds

flex/flex-streamprocessor-service/growingPackageNoSizeChangeExpirySeconds

Fixed Issues DaletFlex

• [AS02 Packages] Fixed an issue with Aspera Transfer (JEF) and Move (JEF) jobs on AS02 assets that were not updating the new location of moved files correctly, particularly when there is a placeholder in the asset. This was causing issues with subsequent actions in the workflow.
• Improve error logging in flex-collection-service.
• [Collection Service] Fixed an issue with collection API when root only collection is requested and the collection has more than one level of child hierarchy.  
• Added support for display of leading and tailing spaces (space before or after the value) of file and path in the UI, as this caused file processing to fail.
• [Timeline] fixed an issue where setting timecode on the Timeline is not accurate when the Timeline is Zoomed In.
• Fixed an issue where a Pinned child collection disappears on refresh.
• Fixed an issue where FSP and FFP operations are failing for assets available in GCS, FILE and AZURE storage when user has space in the front and end of file name + folder name .
• [AS02 Packages] Fixed an issue where Move JEF skips updating paths of assets when there is a placeholder in the AS02 Asset members.

List of Services upgraded between 2024.11.16 and 2024.11.17

2024.11.16

Enhancements DaletFlex

• Implement get UDO thumbnail for flex-fileaccess-service.

Fixed Issues DaletFlex

• Support uploading file with leading and tailing spaces in folder and filename in FlexMOVE and support import, copy etc to Storage resources for folders with leading and tailing spaces in their name.
• Fixed an issue where MP3 ingest is failing due to large Adobe XMP metadata in ID3 tag. Issue fixed by truncating large tag values.
• Fixed an issue where specific shared saved search is not available to user when permission is assigned to that user by simultaneously adding multiple users to a group.
• Fixed an issue where the Marker templates dropdown list is not available on the Custom Markers tab.

List of Services upgraded between 2024.11.15 and 2024.11.16

2024.11.15

Fixed Issues DaletFlex

• Fixed an issue with Timecodes mismatch between IMF package level and CPL asset level. Issue fixed by displaying CPL technical details in the asset Summary panel and not proxy details.  
• Fixed an issue where FlexMove uploading an asset with a space in front of the filename with FlexMOVE does not process to FlexMAM.
• Fixed an issue where Extract Metadata action is failing due to an incorrect path when there is a space at the end of a folder name.  
• Fixed an issue where it was not possible to save changes on a complex table field with multiple instances in a metadata form. 
• Fixed an issue where after retrying a failed sub job executed against a group asset, the group job status is not set to failed once the retried sub job fails again.  
• Fixed an issue where some image assets were not imported through FlexXtend.
• Fixed filter order when resize and interlacing from progressive source.
• Keyframe extract times are sorted alphabetically instead of numerically causing total length duration calculation issue.
• Fixed a performance issue on metadata forms containing nested elements, such as complex fields.
• Fixed a unit mismatch issue where CPL Asset API values for videoStreamContexts.startTime and formatContext.startTime were being interpreted as microseconds instead of seconds.
• [SDK] Fixed an issue where API Resource fetch fails using resourceSubType parameter.

List of Services upgraded between 2024.11.14 and 2024.11.15

2024.11.14

Enhancements DaletFlex

• Improve typeahead suggestion performance by using searchelastic service to show typeahead suggestion values for Asset variables.
• Check for Consul availability for FSP and FFP after service starts and provide callback to drive liveness state so there is no need to manually restart services.
• Add support to optionally return workflow progress in the response of /api/workflows/{workflowId} using the includeProgress flag.
• Apply default limit for the API - GET {objectId}/variables/{variableId}/values{matrixParam:.*} using the KV flex/enterprise/objectVariableOptionsDefaultLimit. The default value is 500 values retrieved in a call.

Fixed Issues DaletFlex

• Fixed an issue with Timecodes mismatch between IMF package level and CPL asset level. Issue fixed by displaying CPL technical details in the asset Summary panel and not proxy details.  
• FMP: Fixed an issue where adding a filter was not working properly after uprade. Issue caused because fields with default values in the Metadata Definition were not being indexed.  
• [Metadata Designer] Fixed an issue where not all Object Types are displayed when trying to create anew variant. 
• Fixed an issue errors were being thrown while indexing MD definition rules.
• Flex Cut: Fixed an issue where errors occur in media playback (mp4 and mpd) when the token expires. Issue fixed by using URL instead of authentication tokens. 
• Fixed an issue where taxonomy metadata fields are sorted by taxon IDD instead of by value, so the sort is illogical.  
• Fixed an issue where it was not possible to retrieve images on unmanaged storage via API raw endpoint.   
• Timeline FlexMAM: Fixed an issue where Zoom gets reset when there is a growing asset on the Timeline. 
• Fixed an issue where Drilldown sorting fails for fields with multiplicity.

List of Services upgraded between 2024.11.13 and 2024.11.14

2024.11.13

Enhancements DaletFlex

• Correct timecodes mismatch between IMF package level and CPL asset level. Consul property to set whether to use timecode-rate or edit-rate from cpl.xml when deriving time field details for a CPL asset during an API call.  
  Consul property is flex-enterprise.featureToggles.useCplTimecodeRate. The property is set to false by default. Set this to true to use timecode-rate instead of edit-rate from cpl.xml to calculate FormatContext.startTime, and startTime, startTimecode,frameRate, timeBase (if proxy not available) of VideoStreamContext.
• Improve lipsync in audio tracks in FlexMAM player for multi audio track playback - PoC Integration for HLS streams.
• Edit Export plugin generates FCPXML using the Assets found by specified Asset Origin.
• Subtitle – Add support for start time offset in subtitle WebVTT files associated to a video.
• Changed token mechanism in video proxy service in a transparent manner to generate short lived token auth for HLS/DASH and ancillary files and support authenticated access for Pyramid use cases.
• Resolve IMF Tech metadata from CPL itself instead of from Proxy.
• Modify Import Image Sequence plugin so `first-frame` field is always present in metadata of  imageSequenceDetails so Export to FCP XML referring to an Image Sequence does not fail. 
• Add lenience support for sample decode on waveform extract in FMPE based jobs (1 frame of audio decode error). Can be disabled using Consul KV flex/flex-streamprocessor-service/disableAudioDecodeErrorLeniency.
• Allow custom headers for CORS config to be specified in consul KV flex/shared/additionalCorsAllowedHeaders. 

Fixed Issues DaletFlex

• Fixed an issue with lipsync in audio tracks in FlexMAM player.
• Fixed an issue where the player in FlexMAM does not support playing subtitle assets that have a non-zero-based start time offset. 
• FMP player that does not support a non-zero-based timecode.
• Fixed an issue with poor proxy quality with random assets after performing transcode.
• Fixed an issue where there is a Null Pointer Exception failure while trying to export an Edit Asset with Edit Type== FCP XML (when the edit asset contains image sequences). 
•  Fixed an issue where Identical FXP XMLs are created after exporting source, proxy and transcode using Export Edit with FCP XML edit type. Issue cause because Asset Origin was not respected.
• [Marker Display] Fixed an issue where custom Date & Time metadata fields were not respecting the User Time Zone. System now displays the correct format, including User Time Zone as configured in the metadata definition.
• Fixed an issue with discrepancy in timecode displayed in Flex Core and in FlexMAM.
• Fixed an issue where playing a video, pausing it for 30 minutes, switching the audio stream and then replaying the video does not work and the player just loads and displays this error `Invalid token: %s`.

List of Services upgraded between 2024.11.12 and 2024.11.13

2024.11.12

Enhancements DaletFlex

• When downloading files with flex-fileaccess- service, extract extension for name parameter and use it as download extension if provided.
• Implement download bundle support using flex-fileaccess-service. This covers assets containing multiple files, such as an image sequence or package asset.
• FFP: Add support for deleting running (queued, running, completed) FFP jobs using DELETE API endpoint.

Fixed Issues DaletFlex

• Metadata Designer: Fixed an issue where validation message does not appear for different user scenarios, such as importing a metadata definition with invalid data, duplicating the name of a metadata definition, updating the description of an enabled metadata definition.

List of Services upgraded between 2024.11.11 and 2024.11.12

2024.11.11

Enhancements DaletFlex

• [JEF Copy Configurations] Add option to accept optional Target Asset placeholder (including expression) in JEF Copy action configuration.  Added a configuration option for creating child assets from a source asset. By default, the new asset will be marked as a child asset. If a different option is selected, the asset will not be a child. 
• In the import IMP action, add a configuration option to optionally import IMP files as attachments rather than as members of the package. By default, the option is set to Yes.
• During Transcode action, all forbidden characters in file names are replaced with `-` to prevent jobs failing. The change is logged.
• Fixed an issue where the Delete action is failing when it has the configuration Traverse Children=Yes.

Fixed Issues DaletFlex

• Fixed an issue where Transcode fails with error outputFileDetails is null because forbidden characters are used in the file name.
• Fixed an issue where archive workflows failing because the metadata included a reference to an asset that had been deleted.
• Fixed an issue where Import job fails for large files with error Transaction was rolled back in a different thread!.
• Allow saving metadata instances that reference deleted assets in the asset variables of a JEF script.
• To support the ingest of large and complex IMF packages, fix logic for multiplexing packets based on current output clock time for composite sources in FMPE.
• Acquire correct instantaneous duration of a growing MXF file as part of clip validation.
• Remove Subtitle asset type from Type filter dropdown.
• Fixed an issue in the status of workflows when actions fail in a workflow with more than one action after a fork. If any of the actions after the fork fails the workflow is set to Failed. When retrying any of the actions the workflow will move to Running state, however when execution of all nodes of the retried branch finish the workflow is reset to Failed if there are no running jobs and at least one failed job in another branch.

List of Services upgraded between 2024.11.10 and 2024.11.11

2024.11.10

Enhancements DaletFlex

• Expose a method in the Enterprise API and JEF SDK to delete multiple annotations at once, by providing the asset ID and a list of annotation IDs: DELETE /api/assets/{assetId}/annotations/bulk
• Bulk annotation creation API should return a list of the new annotation through APIs (through the REST API and JEF SDK).
• Allow CORS and X-Requested-With support from File Access Service.  
• New mechanism to determine duration of growing MXF files so that MXF file duration reported by FSP is always accurate.

Fixed Issues DaletFlex

• [Purge] Fixed an issue where performing a Purge only file action on an asset removes the asset associated to the file from a collection.
• Flex Enterprise: Fixed an issue where search based using Technical Details filter does not return correct results when filtering on both Frame Width and Frame Rate.
• Fixed an issue where exporting an edit from FlexXtend to a target folder in FlexMAM was failing. Issue solved by updating the mechanism of a typeahead type metadata field used in a metadata definition in FlexXtend.
• Fix an issue so that image sequence technical metadata details are extracted correctly.
• To improve reading zip content, modified unzip/zip implementation to parse entries from a central directory rather than streaming through entries.
• Fixed an issue where the Bits Per Sample is not showing in the technical metadata for EXR codec.
• Fixed an issue where the create proxy operation is failing for Image Sequence asset with indexes that start from 0.
• Live Assets: Fixed an issue where the live media duration is not recognised by the Shaka player.
• Fixed an issue where wizards were handling timecode incorrectly when triggering a transcode job. 

Consul KV flex/shared/featureToggles/decoupleStartTimecodeEnabled + false alone or together with Consul KV flex/shared/featureToggles/forceAbsoluteTimeInAnnotations = true – absolute timecodes are used for the job

Consul KV flex/shared/featureToggles/decoupleStartTimecodeEnabled = true – relative timecodes are used for the job

NOTE: In a Transcode action: 
When decoupleStartTimecodeEnabled KV value is false, transcode action configuration Relative Timecode should be set as false.

When decoupleStartTimecodeEnabled KV value is true, transcode action configuration Relative Timecode should be set as true.

• Fixed a logic issue preventing unspecified outputFilename in inputs array for pack job.
• Fixed an issue where transcode jobs are failing with the Error "this.assetService" is null.
• Fixed an issue where a System Error was displayed when trying to view any objects via Act As permission from master account after selecting the tenant account and workspace.
• FlexREVIEW: Fixed an issue where the Priority and asset type filter for reviewer is not working fro the second page.
• Fixed an issue where importing an asset with copy/move file configuration with only Target Folder Resource provided was displaying incorrect details in Asset file tab even though the file is saved in the correct storage path in S3. After the fix, the details are displayed correctly.
• OKTA(SAML): Fixed an issue in Okta authentication so that logging with Okta credentials using an email linked to an existing Flex user is not supported and this error is displayed The user already exists as an internal (Flex) user in the system.
• Fixed an issue where the Playhead is not positioned exactly at 00:00:00 when loading a file in the FlexMAM player.
• Fixed an issue where it is not possible to retry a failed workflow with a Fork and Join node with an incorrect configuration in the job node, even after correcting the invalid configuration of the failed job node.
• Fixed an issue where the Edit Export plugin was not exporting all the files of a spanned media asset. Updated Edit Export plugin to export all files of a Spanned Media when Edit Asset (.aff file) contains Spanned Media Asset.
• Fixed an issue where Enterprise does not respect the Flex Request ID passed by calling applications, making log correlation unnecessarily hard.

List of Services upgraded between 2024.11.9 and 2024.11.10

2024.11.9

Enhancements DaletFlex

• Support purge action deleting associated tcd file when deleting an MP4 asset.
• A KV, flex/shared/featureToggles/forceAbsoluteTimeInAnnotations, to force the use of Absolute Time Code in annotations has been added. When flex/shared/featureToggles/forceAbsoluteTimeInAnnotations = true and flex/shared/featureToggles/decoupleStartTimecodeEnabled = false, the timecode of annotations created for a placeholder is not changed when an asset is associated to the placeholder the annotations were created for. NOTE: This KV should not be used without consulting Support first.
• Address issue with large NDF fractional timecodes performing incorrect calculation of timecodes and displaying incorrect values.
• Add support for still image sources in transcode profile. 

- When performing transcode on an image (e.g. a static image video stream to accompany audio), the output video profile MUST have a frameRate value set. 

- If there is no accompanying audio stream then the input must include a clip specification with a duration or end value.

• Add support for flattening Un-TAR output instead of unpacking to relative paths for pack implementation. To flatten the output, set the Consul KV flex/flex-fileprocessor-service/enableDefaultUnpackDiscardRelativePaths to true. Default behavior is Consul KV to unpack to the directory structure of the TAR file when flex/flex-fileprocessor-service/enableDefaultUnpackDiscardRelativePaths = false or is not specified.
• Support passing start timecode to DMT for transcode or render (clipping) for growing MXF without Dalet Cut project.
• Apply forced index usage for workflow search by start date/end to improve performance. Created a Consul KV flex/enterprise/featureToggles/disableMysqlIndexForce with default value = false. This KV can be used if there are issues, such as SQL not supporting force index command.

Fixed Issues DaletFlex

• Fixed a Metadata Update issue where the value of the Asset Status was reverting back to the previous value. Issue caused when metadata values are updated whilst a metadata merge is in process. After the merge completes, the metadata reverts to the previous value. Issue fixed by not merging metadata that has already been merged. To perform this check use this Consul KV flex/flex-metadatamerge-service/performMergeCheck set to true.
• Workflow Designer: Fixed an issue where deleting a node with a transition was causing the browser to freeze.
• Fixed an issue where an incorrect GET asset children call over the B2B api (with double slashes) results in high DB usage and slow retrieval of results. Issue fixed by adding a URL validation filter.
• [Profiles] Fixed an issue where validation actions are failing because the Video Codec is being saved in Uppercase and the validation expects lower case.
• Support creation of MKV uncompressed package with still image source.
• Fixed an issue where FlexTRACK does not show any data when filtering by workflow start/end time.
• Fixed an issue where FFMPEG inputs are not in the same order as the FSP inputs in an FSP command.
• Fixed an issue where Get API call on a UDO was failing with an exception error due to missing metadata values.
• Update pending translations in French, arabic, Japanes, Italian, Hebrew, Spanish, German.
• Avoid merging metadata of an object if it has already been merged with the latest metadata definition.
• Fixed an issue so that s3 region determination logic can handle vpce.amazonaws.com hostnames.
• Browser hang caused by deleting orphan workflow node.
• Fixed range loop issue with forced engine image sequence asset info extraction on any image sequence with more than 1000 images that was causing jobs to take a very long time to complete.
• Changed the input creation logic in FSP to deterministically preserve order of inputs in job spec so that transcoding jobs do not fail.
• Fixed an issue where a parent workflow that has multi-nested child workflows below it does not move to a “Running” state when a when child workflow is retried.
• Fixed an issue where Get metadata API fails when the metadata variable contains an invalid or destroyed object value.
• Live Assets: Fixed an issue where the live media duration is not recognised by the Shaka player.
• Prevent truncation of growing files (M3U8 and MPD) due to reporting of earlier smaller file size in content length header. Read the whole file before setting the Content-Length.
• Custom marker annotation's time field display is not considering the user timezone.
• Fixed an issue FSP and FFP operations are not working when performed on S3 storage using http and not https, for example minio storage.

List of Services upgraded between 2024.11.8 and 2024.11.9

2024.11.8

Enhancements DaletFlex

• Use this Consul KV flex/shared/vfs/multipartIndirectCopyEnabled=true to improve performance of indirect multipart write. Validated for:

- Copy from object storage (any) to local file

- Copy from local file to object storage (AZBS, S3)

- Copy from object storage (any) file to object storage (AZBS, S3 - different than source storage)

• Add new configuration parameter in Launch Vantage Workflow (JEF) action to configure the Variable name used to store the Vantage output response.
• Add a message in Job History providing a reason why jobs/workflows go to a pending state. Messages displayed for these reasons: JOB_DEFAULT, JOB_SEND_TO_EXECUTION_FAILED, JOB_QUEUED_STATE_TIMEOUT, JOB_FAIL_TO_SEND_TO_QUEUE, WORKFLOW_LIMIT_EXCEEDED.
• Add a new configuration field parameter in Launch Vantage Workflow (JEF) action to capture the Media Output Location Name. The format of the name is <variableName>-<fileIndex> and the path is resolved with SR folder mappings.
• Migrate VFS to use AWS SDK V3 for JavaScript.
• Support ability to write TCD files for MXF when performing Extract Technical Metadata jobs on assets after a proxy file has been created. This must be enabled at the job level via "mxfTcdSidecarFileOutput": true or via the Consul KV flex/flex-streamprocessor-service/enableDefaultMxfTcdSidecarFileOutput = true.

Fixed Issues DaletFlex

• Fixed an issue where authorization was failing for a RemoteSSHScript plugin when using SSH private-public key with Error Auth fail.
• Fixed issues with multi-selection behavior in asset list for quick action.
• Fixed an issue where the Launch Vantage Workflow (JEF) plugin does not support configuring the "Variable Name" of the media output and all otputs are stored in the `vantage-media-output` complex so that when a workflow has two vantage outputs the first "vantage-output-media" output variable value is rewritten by the second output value.
• Fixed an issue where in the Launch Vantage Workflow (JEF) plugin all vantage output information is being captured in the single vantage-output-media context using a JSON file containing all the outputs unlike in the legacy launch Vantage plugin. Issue resolved by adding a new configuration field in this format <variableName>-<fileIndex> to capture the output path.
• Fixed an issue with in-place metadata merge failures caused by not saving changes to the Name field in Single option value field properly.
• Fixed an issue where a 403 Forbidden response was received from MAM api calling from http://localhost:3000 eventhough this domain is set as a CORSTrustedDomain via a Consul KV. Issue solved by readding support for the consul KV flex/enterprise/CORSTrustedDomains which controls allowed CORS origins in flex-enterprise.
• Fixed an issue when rendering from a growing file, the output is missing a few frames at the start of the clip.
• Fixed an issue where VFS copy/move hangs when S3 source is deep-archive or the output credentials are incorrect.
• Fixed an issue where failure in unpack of one file was aborting entire job immediately. Now a failure in unpack of one file should cause a retry and should not impact other pack files in the sequence.
• Disable automatic index creation, to prevent edge-case conditions where cancelling a full reindex requires manual intervention afterwards.
• Sorting logic rewritten to fix an issue where Vantage job input workflow sorting implementation throws an exception for certain inputs.
• Ensure DMT is used for transcode on growing MXF files regardless of output profile using implicit or explicit streams.
• Fixed an issue where the Single option "value" field is not properly updated in a modified metadata definition. Issue fixed by making saving changes in the Single option value field itself mandatory before continuing.
• Fixed an issue in Metadata Designer where an Error message is displayed when expanding a Timeline object that has no icon defined for it.

List of Services upgraded between 2024.11.7 and 2024.11.8

2024.11.7

Enhancements DaletFlex

• Enable support of Multi-Audio Track playback for MPD Proxies in Flex MAM.
• Enhance Workspace Move action plugin to support Group assets.
• JEF Wait for Script plugin:  In the script use YYYY-MM-dd HH:mm:ss Z Date format pattern to find Date variable for consistency with Enterprise API.
• Marker Behavior: Improve the behavior when editing and saving changes to a marker. The marker listing always returns to the page it was on before the edit. If the page no longer exists after the edit, (for example because markers are deleted), the system jumps to the first page of markers.
• Change tag typeahead matching behaviour (as used for suggestions) to match the start of any word in the tag, not just the start of the tag.
• Implement support for FSP transcode jobs for growing/love sources. Implemented by routing FSP transcode jobs using growing/live source MXF files to DMT instead of FFMPEG to correctly handle clipping of growing MXF files.
• Improve keyframe extract accuracy by selecting frame based on PTS (Presentation Timestamp).
• FSP support for remuxing and delivery to FTP of growing MXF files via DMT instead of via FFMPEG to ensure files are readable on the location as they are being written.
• Skip Spatial Audio source streams with unknown codec when processing transcode/stitch and sequence jobs.

Fixed Issues DaletFlex

• Fixed an issue where the Flex panels wizard stopped updating live progress of a failed workflow and when the workflow completed after a retry, it still showed as failed in FlexMAM wizard. Issue fixed by adding polling for workflows other than completed and cancelled status.
• Fixed an issue where Extract Keyframes jobs fails with Error: Count of images generated: 0 != expected count from extractSpec.
• [Core UI] Fixed an issue where tracking User activities through Activity Tab does not work.
• Fixed an issue where the Workspace Move action plugin did not support moving Group assets.
• Fixed an issue where the switch workspace warning message in FlexCORE was displayed with no text inside it.
• Fixed an issue where JEF Wait for Script with option Update Workflow Variables = YES overwrites the values of the workflow variables because FlexContextVariable is matching String as a date type variable on receiving WorkflowContextVariable in JEF Wait for Script. For the fix to work set workflow variable use_lenient_for_workflow_date_variable_conversion to false, by default it is true. 
• Fixed an issue where Extract Technical Metadata returns incorrect format value. 
• Fixed an issue where the selected markers page was not persisted after viewing or editing markers and the system was jumping to random markers pages. 
• Fixed an issue where it is not possible to reset user’s password.
• [Encode Subtitle]: Fixed an issue where the Encode Subtitle plugin was creating an incorrect subtitle file name. After the fix, the plugin includes a full stop before the subtitle file extension if this is missing.
• Fixed an issue where SSL certificate validation fails when exporting assets to S3-compatible storage (MediaHub) after upgrading Dalet Flex. Issue solved by revalidating support for http schema for S3 compatible storage service locations. Connection is supported by http hostname and IP address.
• To improve the mapping of codecs when extracting technical metadata when there is no matching Enum value identified for the codec in JAE, codec and format values will be stored as a free string instead of Enum, for example Mpeg2 files are now mapped as codec=Mpeg2 and MPEG4 codec retrieved fron FSP is mapped by JAE to MPEG-4 Video codec format. Search in FlexMAM and in Flex CORE works on a list of codec and formats. Unmapped codec/formats are recognized as Unknown.
• Fixed an issue where the Encode Subtitle plugin was creating an incorrect subtitle file name. After the fix, the plugin includes a full stop before the subtitle file extension if this is missing.
• For events on object types that do not support workspaces, such as Collections, Event Handler service should not require account workspace.
• Fixed an issue where JEF SDK getChildren() in UDO service does not return children eventhough they are returned by REST API. Change in code to expose a new method which delegates to the getUserDefinedObjectChildren method in the UdoApiService and remove the ability to set the skipChildren flag in the getUserDefinedObject() method. Update REST API to remove the children from the UserDefinedObject API class and remove all references to skipSubChildren field.
• Fixed an issue where no results are returned when searching for objects that do not support workspaces. Solved by not sending workspaceIds to SearchElastic if the targeted object type(s) do not support workspaces.
• Fixed an issue where http protocol for s3 compatible storage was not working because of an update to AWS S3 SDK to V2.
• Fixed an issue where "%" character for suggested values is not working for tag field in wizard but is working in metadata forms.
• Fixed an issue where purge job failed for a segmented asset if a physical file associated with the asset does not exist in the storage location. A warning that the asset is not found in the vfs-location is now displayed.
• Collection service: Fixed an issue where items that have been deleted/purged from the system appear in a Collection as a blank line in FlexMAM.
• FlexREVIEW: Fixed an issue where the Download icon is shown in summary page of FlexREVIEW even when the role permission for Downloads From UI is disabled for the user.
• Fixed issues in Task Player where the TCIN and TCOUT did not match the values in the player in the Summary Panel.
• Fixed an issue where Switch Account/Workspace was not working properly.
• Fixed an issue where the Unpublish action is failing with NPE because of missing parentId and childId fields in the database.
• Fixed an issue where the error `No Access to the workspace error` is displayed when a user is trying to view asset for which the ACL is applied via Group permissions.
• Fixed an issue where edit of Event Handler filter is not working.
• Fixed an issue where Preview does not work for assets in folders with a space in the name, the preview does not function. Issue seen for mp4 and m3u8 files.  

List of Services upgraded between 2024.11.6 and 2024.11.7

2024.11.6

Enhancements DaletFlex

• Reviewer summary panel: Resize functionality has been added to FlexREVIEW summary panel in line with the resize of the asset summary panel. Can resize the height and width of the summary panel and player in FlexREVIEW and all controls are displayed correctly.
• Add support for REDCODE Codec + Profiles in Technical Metadata.
• Get all metadata annotation API should dynamically create the annotation mapping if this information is missing in the Arango collection metadata_entity_mapping_annotations.
• Export Edit plugin modified so that it does not create a large number of subfolders when exporting an Edit Asset when using the Export Referenced Source Assets setting. The Spanned Media file is exported inside a single sub directory in a specified target location.
• Media Cortex Video plugin updated to work when Asset file is located inside sub-folder of Resource path.
• JAE: Add support for RW2 and ORF image sequences to the Import Image Sequence Plugin. RW2/ORF can be imported as an imagesequence asset using import image sequence plugin. RW2/ORF can be imported as image asset using asset import action. Create proxy is not supported for RW2/ORF.
• Job Search API: Improve searching jobs from API by merging all job search API into one with support for new workflowId matrix parameter.
• Support explicit naming of extracted keyframe files to include milliseconds in filename output for keyframe extract jobs.
• Support TTML files in asset map for conforming Dalet Cut projects containing ttml files.
• Handle rotation metadata when extracting keyframes so that keyframes are not distorted.
• Fix sequence handling issue discovered on non-zero padded sequences.
• Handle .mov extension explicitly set in output name and consolidate implementation so that .mp4 extension is not added unnecessarily.
• Remove possibility of using expired S3 token. Ensure that long running jobs continue and use a new token each time the current one expires.

Fixed Issues DaletFlex

• Action permission; Plugin add ACL: Fixed an issue where the plugin does not have the configuration fields to specify the ACL mode (READ/MODIFY).
• Workflow Designer: Fixed an issue where it was not possible to drag existing transitions between new components.
• Fixed an issue where JEF Wait for Script with option "Update Workflow Variables = YES" overwrites the values of the workflow variables because FlexContextVariable is matching String as a date type variable on receiving WorkflowContextVariable in JEF Wait for Script. For the fix to work set workflow variable use_lenient_for_workflow_date_variable_conversion to false, by default it is true.
• Fixed an issue where it was not possible to reimport and replace an asset high res when the asset is published and is in an active Pyramid media bin. Issue resolved by updating the run rule to allow reimport on assets marked as Published.
• Fixed an issue where large number of subfolders created when exporting an Edit Asset with the Export Edit Asset plugin. Issue occurs when Edit Asset refers to more than one Spanned Media file or when the job fails when trying to copy the first file of Spanned Media because of subpaths.
• [metadata service] Fixed an issue where it was not possible to set metadata.
• Fixed an issue with intermittent advance frame freeze for 23.976 fps video.
• Fixed code to prevent Add and Remove ACL plugins validation issues.
• Fixed an issue where FFP copy jobs complete but the file is not copied or is not copied to the correct location. The fix supports copying from S3 to S3 across buckets belonging to different AWS accounts and the same AWS account and copying to a root folder.
• [FFP] Fixed an issue where copying data spread in multiple files from AWS to OVH was failing with this error “A conflicting conditional operation is currently in progress against this resource”. Issue solved by ensuring that the object's parent folder key is only added once when encountering a source folder rather than for each file in the folder.
• Fixed an error when rendering a marker using a wizard in FlexMAM.
• Fixed an issue where clicking the Set Out button did not display the correct End Timecode annotation.
• Fixed an issue where image sequence, CPL and AS02 version assets were not displaying the duration in the asset listing in Search Results.  
• Support re-import plugin on published asset by relaxing the run rule.
• Fixed an issue where Mark Out was not being set properly due to a seeking time race condition.
• Fixed an issue where Flex Panel was adding a double quote around the String variable in the wizard.
• Fix logic error in channel layout mapping to display x.1 style value correctly, 5_1_SIDE instead of 5.1(SIDE). Prerequisite is flex/flex-streamprocessor-service/enableLegacyChannelLayoutNames set to false.
• Fixed an issue where the Add/Remove ACL plugin config does not show Group/User input fields. Group/User fields are displayed for the Add/Remove ACL plugin. ACL mode field are not displayed for the Remove ACL plugin.
• Fixed an issue where media preview stops before end when playing MPEG-DASH content from S3 on FlexMOBILE. Issue solved by fixing the setting of FRAME-RATE attribute in converted HLS M3U8.
• Fixed an issue where Copy/Move is not working for Brio FTP because of errors in requests to store files in non-existing paths. Issue fixed by fixing the remote path management.

List of Services upgraded between 2024.11.5 and 2024.11.6

2024.11.5

Enhancements DaletFlex

• OpAtom MXF: Export Edit: Display correct timecodes for media with multiple framerates for generated EDL. Exported EDL uses the frame rate specified in Edit Asset.
• Enhance Annotation Update API (and corresponding JEF SDK methods) to allow the bulk updating of multiple metadata and timeline annotations.
• Vantage plugins to support importing.ts transcode outputs.
• Index/Search Elastic Service: IndexElastic service updated to support indexing and searching Asset Usge rights fields into Opensearch. Updated IndexElastic service to index assets usage rights fields into Opensearch. The SearchElastic has also been updated with required models.
• Support explicit naming of extracted keyframe files to include milliseconds in filename output for keyframe extract jobs.

Fixed Issues DaletFlex

• [FlexCORE] Fixed an issue where the Account’s theme theme was not created on a new master account (applicable for fresh deployment only).
• For similar problem on existing environments, please contact Customer Services.
• Fixed an issue where the value of an object metadata field in a tile display template is not displayed properly. 
• Fixed an issue where the logo was missing in Flex Web uploader. Issue fixed by adding additional logic to find account using host name if accountName is not found. 
• Fixed an issue where the styling of display templates was updated to accommodate larger metadata infos. Previously metadata fields with large amounts of information were truncated in display templates for tile view.
• Add support to import .ts transcode outputs from "Launch Vantage Workflow" plugin.
• Fixed an issue where square bracket characters `[` and `]` are not always URL-encoded.
• JEF SDK mistranslates Date values when delegating to the Enterprise API with matrix parameters (e.g. lastModifiedFrom, lastModifiedTo). Fix ensures that a 24hr 0-23 hour value is used.
  JEF SDK: Fixed an issue where JobService.getJobs() does not correctly map the `includeVariables` parameter through to the Enterprise REST API call.
  Fixed an issue where freetext search xyz fails to match in some cases, where `all_field ~ xyz` matches. When Consul KV flex/flex-searchelastic-service/featureToggles/wrapFreeTextQueriesWithWildcards is enabled the search performs OR searches for queries sent with or without wrapping asterisks.

List of Services upgraded between 2024.11.4 and 2024.11.5

2024.11.4

Enhancements DaletFlex

• Expand default whitelisting of classes for JEF script actions to prevent them throwing an error and causing the jobs to fail
• IndexElastic: Improve indexing operation to prevent user modifications not being displayed in FlexMAM. Handle Locked / Unlocked events with an UpdateByQuery, instead of performing a full indexing operation.
• Separate the aggregation of annotation created/updated/deleted events from the main inbound flow; increase the default aggregation window for these event types; make all aggregation window settings configurable using Consul KVs.
• Add support for fragmented/segmented and growing MP4 and DASH packages to be repackaged to HLS packages.
• Set colour values to defaults to prevent issues with colour conversion.
• Fallback to indirect copy if direct copy does not work for S3 to S3 copy and throws a 403 permission error. Set Consul KV flex/shared/vfs/s3DirectCopyFallbackToIndirect =true.
• To solve an issue where FFP Copy jobs fail with this error job stalled more than allowable limit. Adjusted S3 queue size based on part size to constrain memory usage. Improved buffer memory usage in DownloadChunkedReadable logic.
• Update aff-converter used when exporting a Dalet Cut edit to and FCPXML.
• Pyramid asset syndications should have purgeRestricted property set to false to allow purging an asset even if it is a member of a media bin in Dalet Pyramid.
• Improve logging for Asset Import job to provide more informative details to the Job History. 

Fixed Issues DaletFlex

• REST API: Fixed an issue where updating action metadata and asset metadata with expression value with`isExpressionas false` was not working properly.  
• Fixed an issue where configurations in nested child options were not being saved well for action plugins, for example, it was not possible to save the  configuration Parent Asset ID for action Import plugin Asset Import.
• Fixed an issue where format information such as width, height and format is not being shown in a display template for image assets. Issue fixed by making image height, image width, image format available in Technical section of template configuration. Also added an option to filter for image format. 
• Fixed an issue to support sorting child assets in an Image Sequence in FlexMAM.
• FlexMAM: Fixed an issue where selecting a saved search to display Marker result was not loading properly unless the page was refreshed. 
• Fixed an issue where it was not possible to add fields from metadata definitions created in different accounts to display templates even though the metadata definitions are visible to the current account. 
• Fixed an issue where a JEF script to migrate metadata backed by taxonomies into timeline annotations stops running and hangs and JAE service seems to hang if it loses connection to the Taxonomy service. Click here for more configuration information.
• Fixed an issue where fields in columns are overlapping each other the in right panel in FlexMAM. 
• [Technical Data] Fixed an issue where Format Variant information was not displayed, specifically for audio only files. 
• Allow FQL to filter date fields as negative numbers so you can search using negative millisecond timestamp values (for dates older than 1st Jan 1970).
• Fixed an issue where Import & Copy jobs are failing with the error Row was updated or deleted by another transaction (or unsaved-value mapping was incorrect). Issue was fixed by fixing the auto-retry for jobs in the case of StaleObjectStateException. 
• Improve the ACL Update event to capture the full information about the update in the mode, the old mode and the new mode. For example, userAclModes: 1017:READ_ONLY updated to READ_WRITE,1016:READ_WRITE updated to READ_ONLY and groupAclModes: 1023:READ_WRITE updated to READ_ONLY.
• Bypass metadata validation when task is saved from the TV2 task. 
• Flex Assets API: Fixed an issue where Get Assets filtered by parentAssetId always returned all assets instead of only those matching the filter.
• Fixed an issue where workflows were failing because an xlsx file in Groovy Script could not be read.
• Fixed an issue so the Search Results page displays the "..." ellipsis when a column contains data but is not expanded enough to display the data.
• Fixed an issue where Flex panel app does not display a workflow variable properly when the variable is long. Issue fixed by adding a line break for long variables. 
• Fixed an issue where FlexMOVE with Aspera file accelerator os-native file selector dialog does not have "all files" filter option available.
• Fixed an issue where bulk metadata editing is not updating metadata on all selected assets particularly for fields including drill down object types.
• Fixed an issue when filtering markers using the column headers in the table on the Custom Markers tab does not work properly for multiple pages of markers .
• Fixed an issue where the Extract Waveform action is failing for MPD (Segmented asset). 
• Search: Fixed an issue where it was not possible to search custom metadata fields from advanced filter/ metadata form using searchable icon.
• Fixed an issue where creating edit asset with multiple subtitles with media throws this error 413 payload too large.
• Fixed an issue where the Purge action was failing for segmented assets when the file is missing from the physical location.

List of Services upgraded between 2024.11.3 and 2024.11.4

2024.11.3

Enhancements DaletFlex

• Highlight the currently selected saved search in the left panel to improve the context of the current result set in the Search Results list.
• Use Ctrl + double-click on a parent to open the udo in new tab. Works from all listing pages and the Relationship tab, from collections, and on the Package listing.
• Windows file storage location mappings using backslashes are correctly resolved by the plugin.
• Flex CM : Update uuid to the configuration of resource and action in the arangodb for execution-configuration service when object's uuid is updated.
• Update styles for dropdown menus.
• Handle account rename events, to update the name of the account tag collection if the account name is chnaged from the master account.
• Added support for ACL read/write modes to the Action Plugin "Add ACL".
• Add more leniency for frame extract from variable framerate, suspect framerate or known untrusted duration formats to stop Extract Keyframe jobs failing.
• Fixed an issue where Segmented asset purge fails because it is not possible to delete a segmented proxy file in Azure blob. Issue fixed by adding support delete of imaginary file and folder for azure blob storage
• Added support for FTP in VFS layer and exposed in FPP.
• Added support for a new TIMES mode for keyframe extract jobs which supports an array of time values.
• Changed logic in VFS layer to use wrec detection method for growing files before MXF open/closed detection method as it is quicker. Added concurrency to check 3 growing files simultaneously.
• Added desat to the HDR tone mapping filter.
• Cache user's accessible workspace ids to improve script execution time.
• Modified MXF specific growing file check to look for open/close indicator in first 16 bytes of the file for improved growing MXF file detection.
• Added a consul KV to disable extracted frame count verification. consul KV flex/flex-streamprocessor-service/disableMissingExtractedFrameDetection.
• Set the video encoder context bitrate based on source video bitrate value.

Fixed Issues DaletFlex

• Fixed an issue where a Resource shows the wrong number of files & size. Issue caused because a file is successfully moved from the source storage resource to the target storage resource during an import action, but the resource item remains listed in the source storage resource in the database, even though the file no longer exists physically.
• Segmented asset purge fails: Fixed an issue where  a segmented proxy file in Azure blob was not deleted.
• Fixed an issue where Extract Keyframes jobs fails with "Error: Count of images generated: 0 != expected count from extractSpec".
• Fixed an issue where flex-master was slowing down after processing requests. Issue foxed by caching user’s workspace ids.
• Fixed issue where the Proxy Asset file name was not used upon an EDL export even though exportOrigion=PROXY in the Edit Export plugin.
• Reopen FLEX-63107: Fixed an issue where moving large files (2TB+) were failing.
• Fixed an issue where running a seacrh to filter "frame rate" with multiple options including "Other" frame rate gives 500 Internal Server Error.
• Fixed an issue where select/add UDO Instances via UDO Selector in Web-Transfer page was failing with an error.
• Fixed an issue with the Media restriction Status calculation.
• TagCollection API - Tag Collection is not returned by userId as masteruser and accountId as other account.
• Added meaningful description to the FlexValidationFailedException error
• Fixed an issue where AS02/IMP: AS02 VERSION/CPL is not pointing to AS02 VERSION/CPL.xml and same with Members .mxf after performing a MOVE action.

List of Services upgraded between 2024.11.2 and 2024.11.3

2024.11.2

Enhancements DaletFlex

• Introduced a new configuration variable ‘Update Workflow Variables’ in JEF ‘Wait for Script’ plugin. If configured as Yes, it fetches the latest workflow variables from Enterprise to be used in a script.
• Improved the behavior of Timed Actions and their related job statuses. Running timed actions will no longer recieves the status Timed_out or other inconsistent statuses. In addition each timed action job iteration sends a log message to the job history, to prevent unnecessary failing of jobs.
• Improved the mapping of channels layout with a non-structured free string generated by FSP extract tech metadata, including the channel name, to reduce the number of unknown layouts.
• Added support of userUuid field in the payload of the create-job endpoint and a new endpoint to support userUuid in the update-user-password endpoint.
• Improved the behavior of Saved Searches, ensuring that when performing a saved search, it will contain updated values.
• Fixed an issue with logic applied to a UUID filename appearing as an image sequence index.
• Fixed an issue where poster frames, keyframes and proxy images were not displayed in FMP, and the Download from FMP function failed due to an incorrectly-set expiry windows for role-based credentials auth in AWS.

Fixed Issues DaletFlex

• Fixed an issue with UTF8 in path not supported in Shaka packaging.
• Fixed an issue where mandatory fields in the Uploader form were greyed out instead of red.
• Fixed an issue in FlexMOVE where form can be submitted altough the required drill-down field has not been filled-in.
• Fixed an issue in FlexMOVE where filled-in drill-down metadata field showed no indication they were filled-in.
• Fixed an issue with ALE_EDL Export Spanned Media not copying all spanned media files.
• Fixed an issue which accidentally enabled debug logging when spawning ffprobe, greatly increasing log sizes.
• Fixed an issue in the Timecode wizard with a missing time range parameter.
• Fixed an issue where when a user switches from any template back to the Default template, the Default template was not updated with the most recent changes, typically column width.
• Improved metadata saving based on type of entity to fix impersistent metadata issues
• Fixed an issue with Bulk editing overriding data with default values. Fixed by deactivating default values for bulk editing.
• Fixed an issue where an asset export dry run was running indefinitely. Fixed by setting the asset ignore status to true for dry runs.
• Fixed an issue with a drill down UDOs caused by incorrect ordering of taxons.
• Fixed an issue where when opening child assets in drill down when pagination was 2 and above, the child assets were not visible.
• Fixed a job slowness issue cause by a bottleneck in Workspace checks.
• Fixed a rare pagination issue where the call to get udo children was made before paging has had a chance to initialize to page 1.
• Fixed an issue where a permitted user could not set a value in a metadata definition.
• Increased the size of the pagination footer, i.e. the number of search results at the bottom.
• Fixed an issue where action icons were not displayed in FlexCore and FlexTrack.
• Fixed an issue where Keyframes were downloaded with the filename instead of keyframe title.
• Added skipping a permission check in the GET call System Tags, allowing users to get system tags even if the Account has no permission. All other calls have not been altered.
• Fixed an issue where Keyframes were downloaded with the filename instead of keyframe title.
• Fixed an issue in the Workspace\collection filter where when typing in letters, the matching results do not highlight the typed letters.
• Removed Mandatory fields checks when updating bulk metadata.
• Fixed an issue where permitted external users were not allowed to create new users. 

List of Services upgraded between 2024.11.1 and 2024.11.2

2024.11.1

Enhancements DaletFlex

2024.11.0

Enhancements DaletFlex

UI improvement: Tick boxes will be present in the “Type” sorting dropdown menu, better indicating that multiple asset types can be selected.

• A Technical Metadata tab is now available for image sequence assets.
• JEF Wait for Signal Action (and Timed Action) has an issue where it is not running with latest WF variables after resuming + Enterprise might be 'erroneously' re-queuing Wait for Signal. To fix, Update the workflow variables that are received from Job control request and copy the old workflow variables to job variables with keys prefixed PREV_WF_
• UI improvement in FlexADMIN in Account Management > Flex Authentication.
• Improve sorting assets in a User Defined Objects (UDO) page:
  Sorting will be available on Name, Created and Modified columns on View UDO details page.
  When a sorting filter gets added, the expanded children are kept open and the sorting is applied to both top level children and then on nested children
  Reloading the page, the sorting preference is retained and expanded assets remain expanded.
• Populate Media Cortext brands analysis after brand recognition.
• Add ingress entry for the Spring-Boot Admin App.
• API returns 400 error when creating/updating annotations
• FlexADMIN: Fix the behavior of Default Saved search configuration in FlexADMIN.
• Job Scheduler: Update behavior to fail jobs to prevent Job Scheduler from processing the same job on each polling cycle when JBPM token is missing for any workflow action job or when the referenced context object does not exist.
• Flex Enterprise API - List usage restrictions
• Flex Enterprise API - Delete usage rights
• Flex Enterprise API - Update usage rights
• REST API: Update Status endpoint added to API.
• Limit concurrent downloads to prevent memory overusage.
• Add new optional technical metadata field channels which is an ordered array of channels for a channel layout. Added logic to extract channel names from channel layout if they exist and map this new naming convention to FSP channel layout values.
• Changes to Technical Metadata fields may be made, with the exception of changes to start time, start timecode, video stream start timecode, and video stream GOP start timecode.
• UDO get and list api to handle children property
• Create feature toggle to optionally always wrap freetext queries with the wildcard character (*). Set the Consul KV flex/flex-searchelastic-service/featureToggles/wrapFreeTextQueriesWithWildcards to true to enable this behavior. This improves search results where file names contain underscores.

Fixed Issues DaletFlex

• Fixed an issue where Untar action is not being completed.
• Support for Summary Panel of Project asset type. Panel has tabs for details, metadata, relationships, access, history tabs.
• Relationship tab: Fixed an issue where the Run option is missing for assets in the Relationship tab. There is no Run action on UDOs and attachments.
• Fixed issue: Double clicking on an image asset that is the child of a media asset in the Manage page will now open the Image Manage page. 
• Fixed an issue so that the Wizard button works when you click on the icon or on the text.
• Fixed an issue wuth the behavior and the display of the TAG typeahed dropdown.
• Fixed issue: When launching an Amberfin job, two children of a parent can no longer have the same name.
• Admin app: Create/Enable buttons are enabled/disabled based on the permission.
• Fixed issue: Right-to-left text directional issues fixed in Arabic UI.
• Fixed issue: When manually entering timecode into the player to position the playhead, the playhead now navigates to the correct frame. Previously, the playhead position on proxy files with the following framerates was offset by approximately three seconds when timecode was manually entered to position the playhead: 29.97, 23.976, and 59.94.
• Fixed issue: Users who lack edit permissions can no longer update asset markers and annotations. A 403 Forbidden error may be received if updates are attempted by a user without edit permissions.
• Fixed an issue where the Stop Video Session fails in Core Enterprise.
• Player: Fixed an issue where the timecode clock in Player was checking during playback.
• Flex job execution can move a Storage Resource to Offline when the validation of the storage fails multiple times during the job preparation. Under certain conditions the job was moved to WAITING_FOR_RESOURCE while the referenced Storage Resource was still Online so that the job was stuck waiting for an offline to online transition that would never happen. This fix guarantees that a job is only moved to WAITING_FOR_RESOURCE when the associated source Storage Resource is in Offline status.
• Fixed an issue where Flex Login App screen is showing an error. Issue fixed by canceling the caching of disabled account entries in accountHostnameCache.
• Fixed issues with the French translation in FlexMAM.
• Fixed an issue where items are unavailable for users if removed from collections when the item is part of multiple collections. When a permission is removed from a collection, the system will verify its existence in other collections before proceeding with the removal.
• Fixed an issue where VO asset appears as video instead of audio. VO assets are saved as Audio asset types and have an Audio icon.
• Fixed an issue where the Recommendation and search result popups do not reappear if the user selects the check box to hide them.
• Default KV value flex/shared/flex-collection-service/collectionItemLimit updated to 2000.
• [FMP][Marker]: Fixed an issuew where a marker metadata  was not saved even if mandatory fields are filled.
• Fixed an issue where asset downloaded files do not include file extension if Accept header is not present.
• Fixed issue: A failure in the media processing engine was corrected to prevent “Create Proxy / Transcode” jobs for OPATOM from running indefinitely.
• Fixed an issue preventing the closure of the multiselect dropdown menu in the advanced search bar when clicking outside of it.
• Drag/reorder behavior within collections for users with Read Only access has been removed.
• Fixed issue: Users can now navigate back to the Asset Results page from the UDO results page by clicking the Flex logo icon.
• FlexADMIN: When permission to create users, groups, and workspaces is not granted, the UI icon is disabled.
• FlexADMIN: Disabled groups and users are not listed in workspace membership modal typeahead suggestions.
• Flex CM: Fixed an issue where there is an accountId invalid error while applying the bundle to Account other than MasterAccount.
• Fixed issue with timeout polling method not being executed correctly. This allows the Kubernetes NodeJS discovery to cope with the target service coming up after the client service.
• Fixed an issue where it was not possible to remove assets from collection and errors.collection.removeItems error is shown in the toast message.
• Fixed issue causing the date picker in the metadata form to freeze.
• FlexMAM: Fixed an issue where the incorrect icon is displayed for a Project Asset.
• FlexMAM: Fixed an issue with the alignment of the buttons in the Task tab.
• FlexMAM: Fixed various issues where the horizontal scrollbar is overlapping and hiding the pagination in different screens.
• Fixed an issue where the Date filter for the the same day was showing previous day results. The fix deals with all date, date time, duration and time code  queries where `from` and `to` are identical in FQL.
• Fixed an issue where the Player progress bar does not extend to the full length of the player.
• Fixed issue causing error when attempting to access HLS and MDP proxy files that were exported to a shard resource.
• Hover state will no longer appear on non-editable metadata fields.  
• Metadata annotations are now accessible using an in-place merge via the Enterprise REST API.
• Summary panel: Fixed an issue where data is not loaded immediately on selecting in asset in the Asset Results table.
• Fixed UI styling and translation issues with Arabic language.
• Fixed an issue where UDO listing page shows "Add to" option in the more actions menu instead of "Manage Collection".
• Fixed an issue where Class Inheritance is no longer working In Legacy Groovy script.
• Add mssing fields such as UserType to object models and index mapping configurations.

List of Services upgraded between 2024.10.0 and 2024.11.0 (LTS) 

For the new 2024.11.0 release, most services have changed.