Dalet Flex 2023.10.0 Release Notes – Support Hub

September 15, 2024 13:26
Updated

Dalet is excited to present the November release of Dalet Flex 2023.10.0.

This release of Dalet Flex provides the new features, quality and security enhancements, bug fixes, and other changes listed below.

Dalet Flex

New Features

Support inboxes/http resources/web transfer backend app on satellite nodes

This version creates the backend apps for supporting Inboxes and Hot Folders on satellite nodes without uploading files to S3 storage.

Validation of implementation with updated Vantage

The Dalet Flex integration with Telestream Vantage was validated for Version 8.1 with Update Pack 5.

Changelog

2023.10.0

Enabled the use of Kubernetes discovery native service for Flex services running on a K8s cluster.
Added Auth service support for a shared Flex-Pyramid user authentication.
Added a function to extract minimal technical metadata in order to play a proxy asset with a placeholder as a parent asset in FMP. Includes MP4, Mepg dash and HLS proxy assets.
Deprecate Enterprise write + UI codecSpecificMetadata and codecTimeBase and remove all support for FastObject and WriteObject services. Support API reading of codecSpecificMetadata only.
Java Enterprise Client: if an Authorization is already present in the context, use it when calling Enterprise, and do not set the actAsUserId header.
To better support troubleshooting for issues where Event handler did not trigger, added an event handler REST endpoint with required parameters eventID and eventHandlerID to retrieve information whether an event would have triggered the event handler.
Added support for fetching Task Dashboard summary counts from SQL in Data Aggregation.
Manage DLQ jobs resource start event and explore TTL for WAITING_FOR_RESOURCE
Extend Export plugin to export FCP XML from Flex Cut Edit asset (aff): part I. Add option to create an FCP xml file type in the export action.
Update config labels for the Dalet Cut storage resource in the Account metadata definition tab to be Dalet Cut Edit Folder.
Add a new Rest API endpoint: Get object details for a key – returns the start data and tags associated with the key.
Fixed an issue where Flex SDK was not fetching taxon data by adding a method to the SDK.
Added the configurable option for Amberfin jobs to succeed the JEF job in case of Amberfin job failure.
[Mobile BFF] Retrieve list of available wizards for an asset.
[Mobile BFF] Retrieve wizard details for a given wizard ID.
[Mobile BFF] Retrieve metadata definition details.
[Mobile BFF] Launch workflow.
[Mobile BFF] Retrieve workflow details.
Make URL configuration field for JEF HTTP Message actions and JEF HTTP Message timed actions expression enabled.
Fixed an issue with the marker timecodes not respecting the correct start timecode
Added a method to return all root taxons.
Introduce a consul KV, flex/shared/authentication/alwaysUseMasterAuthInEnterpriseClient to disable the request context propagation headers while calling Enterprise APIs. Default value is false.
Resilience: Executor not progressing - stops trying to re-QUEUE attempts [IOC memory overflow and stuck Executors].
[Mobile BFF] Show progress for launched workflow on FlexMOBILE.
Added JEF SDK support to retrieve and updated attachements: getAttachment and updateAttachment.
Add additional log statements as a WARN for Workflow and Job Limits.
Azure Media Services SDK (com.microsoft.azure:azure-media:0.9.8) and related functionality removed from PublishIndexer. In the UI, Azure Stream Publish and Azure Stream Unpublish plugins removed from the Publish/Unpublish Plugin type.
Add consul KV flex/flex-streamprocessor-service/disableSourceStreamNameUsage. When set to true the system to ignore source stream names when performing a transcode and labels the tracks sequentially.
VFS support for identification of growing/live files or folders.
Force invalid DF timecodes to NDF on 30fps video. Add a consul KV flex/flex-streamprocessor-service/disableForceDropToNonDropTimecodeForNonDropFrameRate to disable this behavior for legacy compatibility.
Define additional presets for FlexStreamProcessor conform media profiles.
Improve migration of large collections on clustered environments with large datasets.
Increase Kue queue shutdown timeout and make configurable via Consul KV `flex/flex-streamprocessor-service/queueShutdownTimeoutSeconds`. Default is 1 second.
Add support to get publish url and add to the location for Twitter v2 publish api. Support multiline tweet messages.
Better VFS API support for determining if a provider supports tags (non Amazon S3 provider)
Enterprise API: Allow searching externalId for values which contain a colon (e.g. a URI)
Improvements to job node support in FSP. Allow deleting completed and failed jobs via the API. Allow deleting active jobs when running in SPLIT_MODE via the API. Add logic to ensure that once a job queue is started on job node, no other job queues are started.

Fixed Issues DaletFlex

Fixed an issue where Incorrect format size and bitrate reported for package formats in extract asset info.
Add support to fetch Task dashboard summary counts from SQL in Data Aggregation.
Fixed an issue in the User > Ownership tab where the asset summary is different from the asset summary in the Desktop asset summary and the Summary tables in the Ownership tab are spinning.
Fixed an issue where there is spinning in the UDO summary tab.
Fixed an issue where Grafana is not updated for failed jobs. Metric: Locks released when job status is Failed or Cancelled or Completed. Issue fixed by passing the release lock on failure value to the launched job.
WorkflowContext variable has been removed from plugins. JEF Plugin and Groovy SDK developers can remove now workflow variables from context. JEF Groovy SDK should use context.removeWorkflowVariable for this. Better handling of jobs updating same workflow context when they are running in parallel on workflow fork-joins.
Stop keyframe image conversion in Enterprise regardless of image format when retrieving keyframes with API call.
Fixed a backward compatibly issue with the workspace move plugin where actions created in older versions did not operate properly after an upgrade.
Fixed an issue where after extracting technical metadata, the asset was moved to an Unmanaged storage instead of staying in the same folder, due to a failed VLF message.
Fixed an issue where the default icon is not displayed in the Permission page for certain objects.
Fixed an issue where downloaded files names from Flex Enterprise were not identical to the asset name.
Fixed an issue where the Hot Folder service did not process workflows.
Fixed an issue where a task could not be completed if the task metadata fields contained both a Multi option field and a Resource field.
Fixed an issue with Flex Configuration Manager where decencies trigger an error message in an UUDI command.
Fixed an issue where the Custom review status in the Finish Review dialog are returned in a random and inconsistent order. After the fix, they are returned in the correct order.
Fixed an issue where Bulk Asset download operation is not working in Asset Basket when a duplicate file entry is found in the Asset Basket.
Fixed an issue with the FSP where the application attempted to write log files directly to the root folder without permission. Fixed by forcing the log file to a different folder with correct rights.
Fixed an issue where removing udo is slow when udo being removed is child of parent that has over 5k+ children. Issue resolved by updating the parent child relationship using an SQL query instead of using a list of objects.
Fixed an issue in the Flex Mobile Service (BFF) where Reviewer Lists were not visible in the mobile app.
Fixed an issue where it was not possible to cancel a workflow when the subworkflow is null. Issue solved by adding a condition to avoid an NPE.
Fixed an issue with AS02 assets where the stream count value was not correctly displayed in the format context field under Technical Metadata.
Fixed an issue where a valid error message is not displayed when we edit and change the account name in the URL received from the password reset link.
To fix an issue with running workflows that are not cancelled manually, created a stored procedure to cancel workflows which is running for more than 30 days and above.
Fixed an issue where the Amberfin Output variable made the JSON file invalid. Fixed by properly converting the output to a supported JSON string.
Object Lock: Grafana dashboard improvements.
Fixed an issue where it was possible to change the password for a different account using the automatic password reset URL link. After the fix, a valid error message is displayed when you edit and change the account name from the password reset link.
Fixed an issue in FlexMAM where a user only sees tasks in the default workspace. Issue fixed by searching all workspaces available to the user for the specified object type.
Event handler service: Fixed an issue where metadata expression parsing errors block other event handlers for the same type of event from running.
Fixed an issue where accurate frame rate value displays in frame rate (29.97003) column instead of rounded off value (29.97).
Added a retry loop before failing Fex Stream Processor jobs to improve issue where transcode jobs were hanging.
Fixed an issue with the Fast Object service where metadata instance details were not returned when fetching a single metadata annotation.
Fixed an issue where flex-cm logs were not working when running from docker.
Fixed an issue with S3 folder asset import.
Fixed an issue where a System error was displayed on the job config/metadata page for a job.
Fixed an issue where custom markers post upgrade received an absolute timecode, but new markers are created with relative timecode.
Fixed an issue where the Metadata Service added the "key" value in the metadata Json even when the "withKey" parameter was set to false. Fixed by using the value specified by the user in REST call instead of the “withKey” parameter.
Fixed an issue to allow tasks to have more than one incoming transition.
Following the addition of KV disableConnectionReuseForEnterpriseRestCalls, Updated KV disableConnectionRevisionForEnterpriseRestCalls with disableConnectionReuseForEnterpriseRestCalls and set to false by default.
Fixed an issue where the Fractional framerate (29.97f|59.94f) failed to add the dropFrameMultiplier when the framerateValue was not exact (29.97f|59.94f), leading to the wrong TC-millisec calculations
Fixed an issue with Invalid timecode in the post response (not using KV decoupleStartTimecode to pair with GET response).
Job Async Executor: Spring Scheduling thread is getting blocked, causing '401 Unauthorized' errors for scripts which use Enterprise APIs. Fixed by setting the Consul KV to increase the number of threads available to Spring @Scheduled methods from the default (of 1) to 3.
Fixed an issue in the Job Async Executor where numerous "Invalid cookie header" warnings were listed. Fixed by switching to a standard cookie spec.
Fixed an issue where it was not possible to cancel a running JEF job.
Updated the error displayed when adding an attachment that does not have any content to The following mandatory fields are not set: fileContent or compressedFileContent.
Fixed an issue with older event handler configuration where after an upgrade there were event errors due to variable name issues. Fixed by using a dedicated script to address this issue.
Flex Login App: Fixed an issue where Library fails to extract the correct account when request URL contains localhost in "redirect_uri" query parameter.
Fixed an issue where the Job listing api failed data conversions if the Timedout Job was available in the system.
Fixed an issue where using a sequence object with a transcode action fails if the first clip of the sequence has a non-zero start TC.
Cannot Pull Taxonomies in Flex CM. From 2023.9.0, flex-cm uses Enterprise API and a single endpoint only to retrieve taxonomies and single endpoint. Flex-cm does not access flex-taxonomy-service directly.
Fixed an issue where JEF Script completes successfully, but workflow variable set in script is missing.
Fixed an issue where extracted bitrate is incorrect after creating MpegDash proxy. Issue fixed by extracting the full package size to provide better values for bitrate and duration. Legacy behavior can be restored via Consul KV flex/flex-streamprocessor-service/disableTotalPackageSizeExtraction = true.
Fixed an issue where Flex SDK was not fetching taxon data by adding a method to the SDK.
FFMPEG ERROR: no path between colorspaces. Issue fixed by Flex stream Processor update.
Fixed an issue where extract keyframe fails on long videos. Issue fixed by improving the efficiency for extracting keyfames on long files depending on whether keyframes are extracted at small or large time intervals.
Fixed an issue where Flex Stream Processor job pods stuck running in EKS. Issue fixed by adding logic to ensure Flex Stream Processor job nodes exit instead of remaining running in a zombie state when there is a Redis outage.
Fixed an issue where Extract Tech metadata fails with the error Frames cannot be equal to or greater than the framerate, was 21 vs 16.666666.
Fixed an issue where Asset import with move fails with this error The specified copy source is larger than the maximum allowable size for a copy source. Issue caused by a hard limit in AWS.
Flex move not recognizing Mime Type BMP as valid.
Fixed an issue where the copied file is not downloaded with proper name after performing rename operation with Preserve file extension condition as false.
Fixed a CSS UI overlap issue in the Wizard configuration page.
Report definition: Fixed an issue where downloaded records are not showing for workflow and task search.
Resource summary - storage/folder resource items count mismatch issue in UI.
Fixed an issue where users were unable to create a timed action using Execute Action on the Metadata Condition Plugin.
IOS: Fixed an issue where the Profile avatar is wrongly displaying.
Fixed an issue where appropriate error message is not showing when user is trying to check the status of master with /ready end point after manually stopping MySQL instances.
Fixed and issue where Vantage workflow failed in S3 protocol.
Fixed a global header issue were updating a metadata field using a task as part of a workflow failed.
Fixed an issue where Enterprise API returns an invalid framerate for IMP Asset proxy.
Fixed an issue with Storage/Folder Resource Duplication in Resource Summary Tab.
Fixed an issue where the API did not return the framerate for an AS02 asset.
Enterprise: Fixed an issue where QC action was failing.

Enhancements FlexMAM

Flex Cut – When saving from Dalet Cut to Dalet Flex, a default value of Name+time is added to the asset.
Added support for UDO when launching a workflow wizard. A dedicated true/false value, prepopulateMetadataValues, will pre-populate metadata fields based on UDO values.
Dalet app switcher descriptions in English only.
New Japanese translation of "open" button above Preview window.
New French translation of "open" button above preview window.
New French Translations for “Search All Assets” in search bar.

Fixed Issue FlexMAM

Fixed an issue where automatic logout was not forced after specified inactivity interval had been reached.

Fixed an issue to support updating from a value to null as a value for custom marker metadata.
Fixed an issue in FlexMAM where filtering the Search Results using Frame Rate = Other was not working properly.
Flex MAM: Fixed an issue where the Edit button in the Collections window is in the wrong position.
Issue fixed of deleted collection name is visible even after deletion is successful.
Fixed an issue where a very long user name is not displayed properly in the User Profile tab. If the user name does not fit in the tab it is displayed with an ellipsis.
Fixed an issue where you are able to edit timeline comments with empty spaces alone.
User is unable to play or see the video for CPL Asset in FlexMAM.
Fixed an issue where it was possible to perform ‘Back to Search' by clicking anywhere at the top of the page near the ‘Back to search’ button and not just when clicking the Back to search button itself.
Fixed an issue where in the Flex Reviewer App- Start time code format is incorrect on the Manage Review page
Flex-Cut: Added the abilitiy in the FlexAdmin App to set a default name for the ClipBin which displays in FlexMAM and FlexCut
Flex-Cut: When opening FlexCut, before loading clips in collection, a label is displayed saying "flex-collection.loading"
Flex-Cut: In Flex Cut if the collection name is long, it gets truncated as to not overlap with image showing empty Collection.
Fixed an issue where the timestamping variable sent when a wizard is launched on a clip is different depending on whether the wizard is launched from Asset Results/Summary Panel/Manage Page.
Fixed an issue in the Keyframes popup window where the extracted keyframe image hides the title and description.
Issue has been resolved when accessing the FlexMOVE application from the FlexMAM app switcher.
Issue fixed when User sets the Keyframe as Master from Keyframe popup then Image keeps loading
Validated that multi audio select in the player is only available for HLS format.
When entering marker metadata and saving, the new metadata will appear without refreshing page.
The summary page appears faster as it does not wait for the proxy and keyframe to be available via API
On the Marker tab and the marker search result a Boolean metadata value is displayed the same.
Segmented asset tooltip was corrected to display the correct display.
In FlexMAM, users can enter preferred start and end timecodes rather than relative time.
When completing a review with FlexREVIEW, User fields lookup has been fixed.
An issue has been fixed where for required date fields, the display of “Required Field’ only displays once.
Long asset name is truncated in the task notification panel
With the correction of Long asset name being truncated in task notification panel, difficulty accessing task has been resolved.
With the correction of Long asset name being truncated in task notification panel, difficulty accessing task ‘Start button’ has been resolved without having to scroll to the right.
An issue has been fixed where FlexCut cannot access proxies on local storage due to dependencies of an upgrade.
Fixed an issue where the adding all clips of a specific frame rate to timeline functionality is not working in the Sequence page.
Issues has been resolved where you choose a Drop frame format and then other metadata and saving fails.
Issue has been resolved where you open the keyframes window and click the right arrow multiple times, and the left arrow disappears even though it is needed to move to the left.
FlexMAM/FlexREVIEW: Fixed an issue where timeline comments are not persisted properly.
Issue has been resolved in Dalet FlexCut, where if user clicks the Profile Avatar button the profile window does not appear.
Issue has been resolved where if you set a UDO Child and reload the page the previous UDO child selection is ignored intermittently.
Issue has been resolved where you create a default table template or a default marker template and its not available to choose in the FlexAdmin page.
Flex-Cut: Issue has been resolved that one is unable to add assets to FlexCUT timeline saying that proxy is missing even though you can preview in FlexMAM.
Issue has been resolved with the Keyframe Carousel ignoring Drop frame
Issue has been resolved for custom markers so that actual timecode can be applied to in and out markers instead of relative time.
Issue has been resolved in the sequence player, where playing of sequence stops before the sequence is complete.
Issue has been resolved where the preview of video is minimized in the Reviewer and Task Playing the video in full screen mode.

List of Services upgraded between 2023.8.0 and 2023.10.0

For the new 2023.10.0 release, most services have changed.