Dalet is excited to present the release of Dalet Flex 2023.6.0 (LTS).
This release of Dalet Flex provides the new features, quality and security enhancements, bug fixes, and other changes listed below.
Flex 2023.6.0 is an LTS (Long Term Supported) release track and will receive both critical bug fix updates and security updates until it reaches end-of-life.
Dalet Flex
MariaDB version Now Documented in Flex Release Manifests
The details of the MariaDB version, in format major.minor without specifying the patch version, is now included in the Flex release manifest YAML file. For example, for 2023.6.20, the version is 10.6.
Important Note Regarding Vulnerabilities for 2023.6.15
The Login App referenced by the manifest for 2023.6.x has been patched to overcome a critical CVE vulnerability on external authentication mechanisms. To receive the upgraded version of Login App as soon as possible, it is recommended to upgrade all customers to the latest patch in 2023.6.x (LTS). Customers working with interim Flex versions or with a version override for the Login App should contact their Dalet representative for further information.
Important Information regarding MariaDB and Dalet Flex 2023.6.5 and above in 2023.6.x (LTS)
Flex 2023.6.5 is NOT compatible with MariaDB 10.4. You MUST upgrade MariaDB to 10.6 if upgrading Flex to 2023.6.5 or above in 2023.6.x series.
Please plan for a full back-up restore operation when upgrading to 2023.6.5 and above in 2023.6.x (LTS).
Important Note for Versions 2023.6.0 and 2023.6.1
Due to a missing metadata issue, 2023.6.0 and 2023.6.1 versions should upgrade to 2023.6.2 and above ASAP.
In 2023.6.02 an issue was fixed where the Metadata Service added the "key" value in the metadata Json even when the "withKey" parameter was set to false. Fixed by using the value specified by the user in the REST call instead of the “withKey” parameter.
New Features
Support NRAW and Nikon RED Technical Metadata Extraction (new from 2023.6.22)
From this version of Dalet Flex, FSP is upgraded to support NRAW and Nikon RED Technical Metadata Extraction
Support creation of HEIC proxy images (new from 2023.6.20)
To enable compatibility with all Apple devices, from this version of Dalet Flex, HEIC proxy images can be created using the JEF Transcode > Image Transcode (FMP) plugin.
Support publishing events by flex-fileaccess-service (new from 2023.6.14)
Event publishing for flex-fileaccess-service has been implemented. Currently, an event is pushed only when an asset is downloaded.
Event publishing is available by default. If required, it is also configurable through consul KV or through Environment variable.
Consul KV: flex/flex-fileaccess-service/enableEventPublish (default=true)
Environment variable: EVENT_PUBLISH_ENABLE
Event name: DOWNLOADED
The environment variable takes precedence over the KV when both are specified.
Improve scripting lock management and script lock release (new from 2023.6.12)
Previously, JEF Script could release Script locks when the script threw an exception and terminated failing the job. JEF Script locks are now also released when the Job Execution (Job Async Executor service) goes down unexpectedly. This allows other JEF Scripts waiting for the Script lock to acquire it once the original script lock owner has failed, regardless of the reason for the failure.
Flex Stream Processor updated to use Ffmpeg 7.0.1 (new from 2023.6.6)
Update to FFmpeg 7
Improve Type filter options in FlexMAM (new from 2023.6.6)
In this version the Type search filter had been improved so that each asset filter type has a unique meaning. Only these options are available in the Type filter:
Video: Only filled videos, excluding live feeds and placeholders
Audio: Only filled audios, excluding live feeds and placeholders
Live: Only segmented assets (live audio or live video)
Image: Only filled images, excluding placeholders
Document: Only filled documents, excluding placeholders
Placeholder: Only placeholder videos, images, document and audios
Package: Only Package Asset (IMP)
Camera Card: Only Camera card
Group: Only Group assets
Edit: Only Project asset, Sequence asset and Edit asset
UDOs: Display only root UDO
Improvements to encoding profile settings for proxy creation (new from 2023.6.5)
Improved general encoding profile settings and specific settings for H264 encoding (using libx264). This should result in better quality proxy encodes with a lower variability in bit-rate.
Improve optimization of volume of jobs consumed by Job Executor (new from 2023.6.4)
This release includes multiple enhancements and bug fixes that optimize the volume of jobs consumed by Job Executor with long and blocking jobs, for example scripts that take a long time to complete. The enhancements include improving warning messages, job distribution, restart performance and more.
Changes to semantics in VFS affect Copy/Move API with API behavior (new from 2023.6.4)
JEF Copy/Move: Changes to semantics in VFS mean that any scripted actions making use of FFP API to perform copy/move may be affected if the source location is a folder. In this case the FFP job will now move/copy the source folder (including the folder itself and not just its contents) to the target. To ensure just the contents of the folder are moved/copied, the source VFS location should include the property includesRegex: ".*" . Further details on this change to the semantics for copy/move are outlined here:
Reconcile selected unmanaged assets in a workflow contex (new from 2023.6.3)
The previously created Reconcile UnManaged Asset under the Reimport Action has been renamed Reconcile all Unmanaged Assets and associates a given Storage Resource to the Unmanaged assets and converts ALL of them into Managed Assets. This action currently only supports S3 storage. This action is not available by default as it requires coordinating with Professional Services before using it. By default, it is delivered as an obsolete action. Set the KV /flex/shared/flex-enterprise/featureToggles/enableObsoleteReconcileallUnManagedAssetPlugin/ to true to enable it.
A new plugin, Reconcile Unmanaged Asset, has been created under the Reimport Action. This action converts SELECTED assets from unmanaged to managed assets. Multiple assets can be converted by supplying comma seperated assetIds. If all the assets in the supplied list fail to be converted to managed assets because the path does not match the storage, the job fails. If any one of the assets in the list is not matched, the job does not fail and a warning is written in the History. This action is not available by default as it requires coordinating with Professional Services before using it. By default, it is delivered as an obsolete action. Set the KV flex/shared/flex-enterprise/featureToggles/enableObsoleteReconcileUnManagedAssetPlugin to true to enable it.
Rendering Dalet Cut Projects in Dalet Flex (new from 2023.6.1)
You can render Dalet Cut projects in Dalet Flex to create media files using the Conform plugin added to the Transcode plugin type. This action has these additional options:
Render as proxy. The generated media file will be added as PROXY of the Flex Edit input (optional)
Reconcile referenced source asset IDs. This will reference all existing assets in the account as children of the Flex Edit input.
Twitter V2 API supported (new from 2023.6.1)
Support for Twitter V2 API for Twitter Publish/Unpublish actions implemented.
Support for saving Dalet Cut projects in Flex
Dalet Cut projects can be saved as Flex Edit assets. The entire timeline will be saved into the Clip Bin (or active collection if configured) with the timeline configuration, as JSON, being stored in a storage resource configured in the account metadata.
Return original keyframe image by default (Change to API behavior for retrieving keyframe images)
From 2023.6.0 (LTS), downloading original keyframe images instead of converting to a .png file before download is the default behavior for this API call /api/assets/{assetId}/keyframes/{keyframeId}/image. From 2023.6.0 (LTS) release, the Consul KV, flex-enterprise/featureToggles/returnOriginalKeyframeImage has been set to true by default.
Until now this KV was set to false for backwards compatibility. If you have been using /api/assets/{assetId}/keyframes/{keyframeId}/image API endpoint and expect this endpoint to always return converted .png images (irrespective of the original format) then this is a BREAKING change and you MUST add the new consul KV flex-enterprise/featureToggles/returnOriginalKeyframeImage with value false to switch back to the previous behavior.
NOTE: Image conversion support will be removed in future releases so it is recommended to stop relying on this endpoint to return converted images. As of now, this is planned for the 2023.12.0. Release.
Migrate users from internal authentication to external authentication
A migration tool to move users from internal authentication to external authentication has been created. This means that you can migrate existing locally authenticated users to an external IDP, such as SAML, without having to recreate the users and preventing losing their history, ACLs etc.
New asset model for pixelAspectRatioFraction and frameRateFraction
In a previous release:
pixelAspectRatio as Float value was deprecated in favor of pixelAspectRatioFraction
frameRate as Float value was deprecated in favor of frameRateFraction
In this release, support for writing from API (POST/PATCH/PUT) has been removed. For GET calls, float values are returned dynamically calculated from the fraction values pixelAspectRatioFraction and frameRateFraction.
This may impact accounts using script and writing/reading from pixelAspectRatio and frameRate instead of pixelAspectRatioFraction and frameRateFraction. To track new assets with this change, the Asset.format.version is now 6.
Improve behavior when deleting collections that leave orphan sub-collections
To prevent issues caused when deleting shared collections that have unshared sub-collections, these improvements have been made:
Dalet Flex will try and delete all sub- collections and will only delete sub-collections belonging to the owner deleting the parent collection.
Dalet Flex does not delete sub-collections that a user does not have access to and does not throw an exception that impacts further deletions.
In the stored data of the sub-collection, the parentUuid is updated to null. A collection with parent = null is a root collection, so after this change, orphaned collections which were not deleted, will reappear as root collections.
You MUST run a full reindex after upgrading to this version.
Removed old Deprecated Enterprise Actions
The following Enterprise Actions were deprecated a few years back and are no longer available:
Azure Stream Publish
Azure Stream Unpublish
Launch Vantage Workflow
Vantage Workflow Wait
Vantage Workflow Resource
Vantage Package Resource
NOTE: If you have any of these actions or resources you should remove them and recreate them using the latest versions (i.e. using the equivalent JEF plugin) before upgrading to 2023.6.0. Please contact your Flex representative for any questions.
Infrastructure for Flex-Brio integration: Live content recording and previewing
To enable support of recording live feeds in Dalet Brio and previewing the growing media in Dalet Flex, the following functionalities have been implemented:
Hot Folder supports watching growing (live) assets recorded by Dalet Brio. It supports both growing MXF files and dynamic MPEG-DASH files. These growing files can be identified in Flex by the asset live property set to true while the recording is in progress.
To enable the e2e integration between Dalet Brio and Dalet Flex, the dedicated "Prepare Import from Brio Live Recording" workflow containing a single Groovy script that bundles the integration must be deployed. This workflow processes Dalet Brio recording files using a proprietary integration protocol between Flex/Brio. Both Dalet Brio scheduled recording and Brio while scenarios are supported. High Res and proxy recordings can be imported simultaneously if configured in Dalet Brio.
Dalet Flex support for NetApp Storage Grid S3
Support of NetApp Storage Grid S3 for working with Dalet Flex has been validated.
NOTE: See Known Limitations.
Adobe Xtend Panel migrated to use PKCE authentication
Login to Adobe Xtend Panel in Dalet Flex uses PKCE authentication and loads the login screen in a real web browser instead of embedded in the FlexXtend panel. This is a breaking change to the FlexXtend authentication and is not backwards compatible with older versions of Dalet Flex. The minimum supported versions are Flex 2023.6.0 (LTS) and FlexXtend (ZXP) 1.1.0.
NOTE: With Dalet Flex 2023.6.0, you can continue working without PKCE authentication using the older FlexXtend (ZXP) 1.0.3.
Dalet FlexMAM
New Features
Notifications for New Tasks (new from 2023.6.3)
Tasks have been connected to the notification framework so that users are notified when new tasks are available in either of the My Tasks or Available Tasks lists. When new tasks are added to the list a count appears in the Tasks sub-tab. A Refresh button is displayed in the Available Tasks to update any new tasks that have not yet been displayed. When the Tasks sub-tab contains new items, a dot notification is displayed on the notification bell in the Global Header, in the same way it is displayed for new Workflows.
Dalet Cut integrated into Dalet Flex
From 2023.6.0 Dalet Cut is available using the app switcher in Dalet Flex for authenticated users. Planned functionality for Dalet Cut from Dalet Flex allows you to:
Launch Dalet Cut from the app switcher
Share authentication with FlexMAM
Browse collections to find media assets (video, audio, clips)
Import assets to Dalet Cut
Add assets to the Timeline and save the Timeline back to Dalet Flex as a Flex Edit asset
Send Flex Edit assets to a workflow for a rendering using the new Conform action
Accessing New FlexREVIEW app
From Flex 2023.6.0 LTS, CS Ops set the Consul KV
flex/shared/featureToggles/flexReviewerAppEnabled
to true and the updated FlexREVIEW is accessed from the App Switcher in Dalet Flex.
Customers can ask CS Ops to deploy the old or new FlexREVIEW version.
New FlexREVIEW URL is https://<account_url>/fmp/review/index.
Add label property to identify audio tracks for Mpeg-Dash
There is a new identifier label for identifying audio tracks. This means that all audio tracks are displayed in the Timeline.
Item key displayed on items in a collection
The item key for items in a collection is displayed as a column in the collection table. Numbers count from 1 and continue over multiple pages. After drag and drop or MoveUp/Down actions on items in a collection, manually refresh the page to reorder item numbers in a collection.
Breaking Change
Update to representation of 23.976 fps framerate - from 2023.6.6
OpAtom transcode is failing for media with 23.976 fps. To fix this, FSP has been updated to represent 23.98fps or 23.976fps as a ratio of 24000/1001 instead of 4000/167.
This is a breaking change because the frame rate value returned from FSP for such media will now be 24000/1001 instead of 4000/167. Any script using 4000 or 167 to detect 23.976fps may need to be updated and should be checked.
Known Limitations
Refresh Task Notifications
The real time update, done via websocket, for new Tasks is currently disabled, refresh FlexMAM manually to see new Tasks in the Task panel.
Support for NetApp Storage
When the source and destinations storage resources are on Netapp Storage, the Publish action fails and you cannot publish an asset.
No Audio Player in FlexREVIEW - Resolved in 2023.6.1
When starting a Review session on an audio asset containing a master keyframe, the Audio Player is not displayed in FlexREVIEW.
Changelog
2023.6.23
Enhancements DaletFlex
Default Consul KVs flex/flex-videoproxy-service/readPermissionAuthEnabled and flex/flex-fileaccess-service/readPermissionAuthEnabled to true.
Add support for Consul KVs to override the default values of 60 seconds for the no change in growing size for Packages and MXF files: flex/flex-streamprocessor-service/growingMxfNoSizeChangeExpirySeconds
List of Services upgraded between 2023.6.22 and 2023.6.23
flex_fileaccess_service
flex_fileprocessor_service
flex_job
flex_master
flex_sequencemanifest_service
flex_streamprocessor_service
flex_videoproxy_service
flex_fmpadmin_app
flex_globalheader_app
flex_search_app
2023.6.22
Enhancements DaletFlex
Implement get UDO thumbnail for flex-fileaccess-service
Fixed Issues DaletFlex
Fixed an issue where MP3 ingest is failing due to large Adobe XMP metadata in ID3 tag. Issue fixed by truncating large tag values.
List of Services upgraded between 2023.6.21 and 2023.6.22
flex_fileaccess_service
flex_fileprocessor_service
flex_job
flex_master
flex_sequencemanifest_service
flex_streamprocessor_service
flex_videoproxy_service
2023.6.21
Fixed IssuesDaletFlex
Fixed an issue with Timecodes mismatch between IMF package level and CPL asset level. Issue fixed by displaying CPL technical details in the asset Summary panel and not proxy details.
Fixed an issue where some image assets were not imported through FlexXtend.
Fix filter order when resize and interlacing from progressive source.
Keyframe extract times are sorted alphabetically instead of numerically causing total length duration calculation issue.
Fixed a unit mismatch issue where CPL Asset API values for videoStreamContexts.startTime and formatContext.startTime were being interpreted as microseconds instead of seconds.
List of Services upgraded between 2023.6.20 and 2023.6.21
flex_fileaccess_service
flex_fileprocessor_service
flex_job
flex_master
flex_sequencemanifest_service
flex_streamprocessor_service
flex_videoproxy_service
2023.6.20
Enhancements DaletFlex
Check for Consul availability for FSP and FFP after service starts and provide callback to drive liveness state so there is no need to manually restart services.
Resolve IMF Tech metadata from CPL itself instead of from Proxy.
Allow custom headers for CORS config to be specified in consul KV flex/shared/additionalCorsAllowedHeaders.
Fixed IssuesDaletFlex
Fixed an issue where image proxy can not be viewed in the management page. Issue fixed by setting maximum width/height to 2500px for output size of images when they are converted to proxy format.
Fixed an issue with Timecodes mismatch between IMF package level and CPL asset level. Issue fixed by displaying CPL technical details in the asset Summary panel and not proxy details.
List of Services upgraded between 2023.6.19 and 2023.6.20
flex_fileaccess_service
flex_fileprocessor_service
flex_job
flex_master
flex_sequencemanifest_service
flex_videoproxy_service
flex_search_app
2023.6.19
Enhancements DaletFlex
Correct timecodes mismatch between IMF package level and CPL asset level. Add Consul property to set whether to use timecode-rate or edit-rate from cpl.xml when deriving time field details for a CPL asset during an API call. Consul property is flex-enterprise.featureToggles.useCplTimecodeRate. The property is set to false by default. Set this to true to use timecode-rate instead of edit-rate from cpl.xml to calculate FormatContext.startTime, and startTime,startTimecode,frameRate,timeBase(if proxy not available) of VideoStreamContext.
Changed token mechanism in video proxy service in a transparent manner to generate short lived token auth for HLS/DASH and ancillary files and support authenticated access for Pyramid use cases.
[FSP]: Implement support for new VOLH waveform format.
Add lenience support for sample decode on waveform extract in FMPE based jobs (1 frame of audio decode error). Can be disabled using Consul KV flex/flex-streamprocessor-service/disableAudioDecodeErrorLeniency.
List of Services upgraded between 2023.6.18 and 2023.6.19
flex_fileaccess_service
flex_job
flex_master
flex_streamprocessor_service
flex_videoproxy_service
2023.6.18
Enhancements DaletFlex
FFP: Add support for deleting running (queued, running, completed) FFP jobs using DELETE API endpoint.
Fixed Issues DaletFlex
Fixed an issue where an Image asset cannot be viewed in the management page even though it is displayed in the Asset Results screen. Issue fixed in FlexMAM and FlexREVIEW.
List of Services upgraded between 2023.6.17 and 2023.6.18
flex_fileaccess_service
flex_fileprocessor_service
flex_job
flex_master
flex_sequencemanifest_service
flex_streamprocessor_service
flex_videoproxy_service
flex_fmpreviewer_app
flex_search_app
2023.6.17
Enhancements DaletFlex
When downloading files with flex-fileaccess- service, extract extension for name parameter and use it as download extension if provided.
In the import IMP action, add a configuration option to optionally import IMP files as attachments rather than as members of the package. By default, the option is set to Yes.
Implement download bundle support using flex-fileaccess-service. This covers assets containing multiple files, such as an image sequence or package asset.
Fixed Issues DaletFlex
Fixed an issue where a user cannot access collection content when there are multiple collection-services instance running on site
To support the ingest of large and complex IMF packages, fix logic for multiplexing packets based on current output clock time for composite sources in FMPE.
Acquire correct instantaneous duration of a growing MXF file as part of clip validation.
Fixed in issue in flex-collection-service fix cache eviction logic when multiple instances of the service are deployed
List of Services upgraded between 2023.6.16 and 2023.6.17
flex_collection_service
flex_fileaccess_service
flex_fileprocessor_service
flex_job
flex_jobasyncexecutor_service
flex_master
flex_sequencemanifest_service
flex_streamprocessor_service
flex_videoproxy_service
2023.6.16
Enhancements DaletFlex
Allow CORS and X-Requested-With support from File Access Service.
New mechanism to determine duration of growing MXF files so that MXF file duration reported by FSP is always accurate.
Fixed Issues DaletFlex
Fix an issue so that image sequence technical metadata details are extracted correctly.
To improve reading zip content, modified unzip/zip implementation to parse entries from a central directory rather than streaming through entries.
Fixed an issue where the Bits Per Sample is not showing in the technical metadata for EXR codec.
Fixed an issue where the create proxy operation is failing for Image Sequence asset with indexes that start from 0.
List of Services upgraded between 2023.6.15 and 2023.6.16
flex_fileaccess_service
flex_fileprocessor_service
flex_job
flex_master
flex_sequencemanifest_service
flex_streamprocessor_service
flex_videoproxy_service
2023.6.15
Enhancements DaletFlex
Add support for still image sources in transcode profile.
- When performing transcode on an image (e.g. a static image video stream to accompany audio), the output video profile MUST have a frameRate value set.
- If there is no accompanying audio stream then the input must include a clip specification with a duration or end value.
Add support for flattening Un-TAR output instead of unpacking to relative paths for pack implementation. To flatten the output, set the Consul KV flex/flex-fileprocessor-service/enableDefaultUnpackDiscardRelativePaths to true. Default behavior is Consul KV to unpack to the directory structure of the TAR file when flex/flex-fileprocessor-service/enableDefaultUnpackDiscardRelativePaths = false or is not specified.
Support passing start timecode to DMT for transcode or render (clipping) for growing MXF without Dalet Cut project.
Fixed Issues DaletFlex
Fixed an issue where residual UDO placeholders are left behind in the collection after the UDO itself is deleted.
Fixed an issue so that s3 region determination logic can handle vpce.amazonaws.com hostnames.
Fixed range loop issue with forced engine image sequence asset info extraction on any image sequence with more than 1000 images that was causing jobs to take a very long time to complete.
Changed the input creation logic in FSP to deterministically preserve order of inputs in job spec so that transcoding jobs do not fail.
Prevent truncation of growing files (M3U8 and MPD) due to reporting of earlier smaller file size in content length header. Read the whole file before setting the Content-Length.
Custom marker annotation's time field display is not considering the user timezone.
Fixed an issue FSP and FFP operations are not working when performed on S3 storage using http and not https, for example minio storage.
List of Services upgraded between 2023.6.14 and 2023.6.15
flex_collection_service
flex_job
flex_login_app
flex_master
flex_publish_service
flex_searchelastic_service
flex_videoproxy_service
2023.6.14
Enhancements DaletFlex
Use this Consul KV `flex/shared/vfs/multipartIndirectCopyEnabled=true` to improve performance of indirect multipart write. Validated for:
- Copy from object storage (any) to local file
- Copy from local file to object storage (AZBS, S3)
- Copy from object storage (any) file to object storage (AZBS, S3 - different than source storage)
Migrate VFS to use AWS SDK V3 for JavaScript.
Support ability to write TCD files for MXF when performing Extract Technical Metadata jobs on assets after a proxy file has been created. This must be enabled at the job level via "mxfTcdSidecarFileOutput": true or via the Consul KV flex/flex-streamprocessor-service/enableDefaultMxfTcdSidecarFileOutput = true.
Fixed Issues DaletFlex
Fixed an issue where VFS copy/move hangs when S3 source is deep-archive or the output credentials are incorrect.
Fixed an issue where there is spinning in the UDO summary tab.
Fixed an issue where failure in unpack of one file was aborting entire job immediately. Now a failure in unpack of one file should cause a retry and should not impact other pack files in the sequence.
Ensure DMT is used for transcode on growing MXF files regardless of output profile using implicit or explicit streams.
List of Services upgraded between 2023.6.13 and 2023.6.14
flex_fileaccess_service
flex_fileprocessor_service
flex_job
flex_master
flex_sequencemanifest_service
flex_streamprocessor_service
flex_videoproxy_service
2023.6.13
Enhancements DaletFlex
Implement support for FSP transcode jobs for growing/love sources. Implemented by routing FSP transcode jobs using growing/live source MXF files to DMT instead of FFMPEG to correctly handle clipping of growing MXF files.
Improve keyframe extract accuracy by selecting frame based on PTS (Presentation Timestamp).
FSP support for remuxing and delivery to FTP of growing MXF files via DMT instead of via FFMPEG to ensure files are readable on the location as they are being written.
Skip Spatial Audio source streams with unknown codec when processing transcode/stitch and sequence jobs.
Fixed Issues DaletFlex
Fixed an issue where Extract Keyframes jobs fails with "Error: Count of images generated: 0 != expected count from extractSpec".
Fixed an issue where authorization was failing for a RemoteSSHScript plugin when using SSH private-public key with Error Auth fail.
Fixed an issue where "%" character for suggested values is not working for tag field in wizard but is working in metadata forms.
Sorting logic rewritten to fix an issue where Vantage job input workflow sorting implementation throws an exception for certain inputs.
List of Services upgraded between 2023.6.12 and 2023.6.13
flex_fileaccess_service
flex_job
flex_jobasyncexecutor
flex_master
flex_streamprocessor_service
flex_panels_app
2023.6.12
Fixed Issues DaletFlex
Fixed an issue in Flex CORE where a continuous spinning wheel is displayed when loading the metadata tab for a UDO.
Fixed an issue where the Flex panels wizard stopped updating live progress of a failed workflow and when the workflow completed after a retry, it still showed as failed in FlexMAM wizard. Issue fixed by adding polling for workflows other than completed and cancelled status.
Fixed an issue where the switch workspace warning message in FlexCORE was displayed with no text inside it.
Fixed an issue where Mark Out was not being set properly due to a seeking time race condition.
Fixed an issue where Flex Panel was adding a double quote around the String variable in the wizard.
Fixed a issue in Channel Layout mapping that was displaying the value Unknown for surround audio. Issue fixed by fixing logic error in channel layout mapping to display x.1 style value correctly. Prerequisite is flex/flex-streamprocessor-service/enableLegacyChannelLayoutNames set to false .
Fixed an issue where Copy/Move is not working for Brio FTP because of errors in requests to store files in non-existing paths. Issue fixed by fixing the remote path management.
List of Services upgraded between 2023.6.11 and 2023.6.12
flex_fileprocessor_service
flex_job_version
flex_jobasyncexecutor_service
flex_master
flex_streamprocessor_service
flex_panels_app
flex_search_app
2023.6.11
Enhancements DaletFlex
Support explicit naming of extracted keyframe files to include milliseconds in filename output for keyframe extract jobs.
Support TTML files in asset map for conforming Dalet Cut projects containing ttml files.
Handle rotation metadata when extracting keyframes so that keyframes are not distorted.
Fix sequence handling issue discovered on non-zero padded sequences.
Handle .mov extension explicitly set in output name and consolidate implementation so that .mp4 extension is not added unnecessarily.
Remove possibility of using expired S3 token. Ensure that long running jobs continue and use a new token each time the current one expires.
Updated reindex behaviour to collections to mitigate potential ArangoDB issues.
Fixed Issues DaletFlex
Fixed an issue where JEF script actions were failing with this error NoClassDefFoundError: Could not initialize class org.codehaus.groovy.ast.expr.VariableExpression. Issue fixed by removing conflicting Groovy libraries from the code.
Fixed an issue where clicking the Set Out button did not display the correct End Timecode in annotations.
Allow child assets in an Image Sequence to be sortable.
Fixed an issue indirect copy fallback for S3 across AWS account direct copy of root folder places target in incorrect "." sub-folder.
JEF SDK mistranslates Date values when delegating to the Enterprise API with matrix parameters (e.g. lastModifiedFrom, lastModifiedTo). Fix ensures that a 24hr 0-23 hour value is used.
JEF SDK: Fixed an issue where JobService.getJobs() does not correctly map the includeVariables parameter through to the Enterprise REST API call.
Fixed an issue so FFP copy jobs do not attempt to create parent folder multiple times in object store when recursively copying files that reference the same source folder.
Fixed an issue where media preview stops before end when playing MPEG-DASH content from S3 on FlexMOBILE. Issue fixed by fixing the setting of FRAME-RATE attribute in converted HLS M3U8.
List of Services upgraded between 2023.6.10 and 2023.6.11
flex_collection_service
flex_fileaccess_service
flex_fileprocessor_service
flex_indexelastic_service
flex_job
flex_jobasyncexecutor_service
flex_master
flex_streamprocessor_service
flex_videoproxy_service
flex_search_app
2023.6.10
Enhancements DaletFlex
Expand default whitelisting of classes for JEF script actions to prevent them throwing an error and causing the jobs to fail.
Add support for fragmented/segmented and growing MP4 and DASH packages to be repackaged to HLS packages.
Set colour values to defaults to prevent issues with colour conversion.
Fallback to indirect copy if direct copy does not work for S3 to S3 copy and throws a 403 permission error. Set Consul KV flex/shared/vfs/s3DirectCopyFallbackToIndirect =true.
To solve an issue where FFP Copy jobs fail with this error job stalled more than allowable limit. Adjusted S3 queue size based on part size to constrain memory usage. Improved buffer memory usage in DownloadChunkedReadable logic.
Support explicit naming of extracted keyframe files to include milliseconds in filename output for keyframe extract jobs.
Fixed Issues DaletFlex
FlexMAM: Fixed an issue where search using is/is not filters with no set value was not working properly and required a browser refresh.
Fixed an issue where moving large files (2TB+) were failing.
Fixed an issue where JEF script actions were throwing this error NoClassDefFoundError: Could not initialize class org.codehaus.groovy.ast.expr.VariableExpression and jobs were failing.
Fixed an issue where workflows were failing because an xlsx file in Groovy Script could not be read.
AS02/IMP: Fixed an issue where AS02 VERSION/CPL is not pointing to AS02 VERSION/CPL.xml and same with Members .mxf when performing a Move action.
Fixed an issue where the Extract Waveform action is failing for MPD (Segmented asset).
List of Services upgraded between 2023.6.9 and 2023.6.10
flex_fileaccess_service
flex_fileprocessor_service
flex_job
flex_jobasyncexecutor_service
flex_master
flex_streamprocessor_service
flex_usage_service
flex_search_app
2023.6.9
Enhancements DaletFlex
Added support for FTP in VFS layer and exposed in FPP.
Added support for a new TIMES mode for keyframe extract jobs which supports an array of time values.
Changed logic in VFS layer to use wrec detection method for growing files before MXF open/closed detection method as it is quicker. Added concurrency to check 3 growing files simultaneously
Added desat to the HDR tone mapping filter.
Modified MXF specific growing file check to look for open/close indicator in first 16 bytes of the file for improved growing MXF file detection.
Added a consul KV to disable extracted frame count verification. consul KV flex/flex-streamprocessor-service/disableMissingExtractedFrameDetection
Set the video encoder context bitrate based on source video bitrate value.
Fixed Issues DaletFlex
Fixed an issue where certain assets could not be previewed in FMP Reviewer do to an internal sorting issue.
List of Services upgraded between 2023.6.8 and 2023.6.9
flex_fileaccess_service
flex_fileprocessor_service
flex_job
flex_master
flex_streamprocessor_service
flex_videoproxy_service
2023.6.8
Enhancements DaletFlex
Allow FSP jobs to configure forcing overwrite of output locations
Fixed Issues DaletFlex
Fixed an issue with logic applied to a UUID filename appearing as an image sequence index.
Fixed an issue where poster frames, keyframes and proxy images were not displayed in FMP, and the Download from FMP function failed due to an incorrectly-set expiry windows for role-based credentials auth in AWS.
Fixed an issue with UTF8 in path not supported in Shaka packaging
Fixed an issue where an error was received upon creating a sequence due to missing sequence metadata
Fixed an issue where when saving a new logo or favicon through account management in FlexADMIN, the new mages do not appear upon reloading the UI.
Fixed an issue where a required metadata field in the uploader was not marked in red as all other required fields, but was greyed out.
Fixed an issue which accidentally enabled debug logging when spawning ffprobe, greatly increasing log sizes.
Fixed an issue where an error was received upon creating a sequence due to missing sequence metadata.
2023.6.7
Enhancements DaletFlex
Event handler service: Catch all exceptions when applying an event handler's filter.
AS02: Add functionality to import file and qc entries included in the AS02 manifest, if they are in a supported caption/image format. File and qc assets are created as child assets of the AS02 asset. Assets with unknown file extensions are created as to Text assets and a warn event is published reporting the name of the file and that it is mapped to Flex Asset Text as there is no matching extension in Flex types.
Use and pass configured Folder Resource from action plugin instead of Storage Resource to Enterprise to skip finding Folder Resource by passed Storage Resource in Enterprise which causes an issue where assets are not found.
Fixed an issue where workflow runs two node concurrently. Issue fixed by preventing the system from sending signals to the workflow when jobs were moved from pending to running that was causing the nodes to run concurrently.
To fix excessive memory usage and logging in large image sequence jobs that cause jobs to get stuck in a running state, add logic to reduce log level if extracting from image sequences. Fix logic to ensure large image sequences are handled in chunks. Fix logic to ensure large amounts of spawned process kill functions are not retained unnecessarily.
Asset Import: Add a new flag to the Asset import action plugin configuration which will allow to overwrite file on destination location. NOTE: A new action must be created to support this flag.
Fixed Issues DaletFlex
Fixed an issue where audio channel layout returned the ‘unknown’ value. Fixed by improving channel layout names so that they match the names supported in transcode profiles. Because this changes the values of returned channel layout names for asset info, added a new Consul KV flex/flex-streamprocessor-service/enableLegacyChannelLayoutNames (default: true) which can be set to false once upstream integration is performed and the legacy names are no longer require.
Fixed an issue of incorrect mapping of H264 and MPEG2 profile values.
Fixed an issue where Content Type is not set when image file is uploaded to S3 bucket.
Fixed an issue in Kibana Logs that were not showing updated User Task data.
Copy Jobs fails and Expose Key and Secret in the Job history. Fixed logging to correctly sanitize VFS locations.
List of Services upgraded between 2023.6.6 and 2023.6.7
flex_eventhandler_service
flex_fileaccess_service
flex_fileprocessor_service
flex_job
flex_jobasyncexecutor_service
flex_master
flex_streamprocessor_service
flex_videoproxy_service
2023.6.6
Enhancements DaletFlex
Added functionality to import caption and graphic assets included in the AS02 manifest, if they are in a supported caption/image format. Files referenced in the manifest that are located 2+ layers deeper in the directory structure are imported correctly.
Support channelMix and "audio fill" on output audio profile for stitch and sequence jobs and support transcode actions if some clips do not have audio.
Enable feature toggle support for Hibernate Second Level Cache to prevent issues with API not returning real time values.
Job Scheduler: Update behavior to fail jobs to prevent Job Scheduler from processing the same job on each polling cycle when JBPM token is missing for any workflow action job or when the referenced context object does not exist.
The deleteAnnotationMessageHandler processing on the 'leader' IndexElastic instance unnecessarily retains all messages for 30 seconds, instead of only those that are relevantAdded filtering before handling by IndexElastic for most MessageHandlers, and especially for the ones which use Delayers, to prevent OOM crashes of IndexElastic due to unnecessary retention of all messages.
Limit concurrent downloads to prevent memory overusage.
Added <role>=main element to first audio adaptation set in DASH manifest to indicate to the FMP player which audio stream should be played by default.
EF SDK: Adds new method context.getWorkflowObjectVariables(variablesName) to retrieve an object variable that is a List as opposed to a singe FlexObject. The method gives a useful warning if variablesName represents a singular workflow object variable and advises using the singular method context.getWorkflowObjectVariable(variableName).
Provide a new property inputDisplayAspectRatio in the media profile jsoin to override detected value for incorrectly encoded sources.
Patched FFmpeg to seek backwards segment by segment if the initial seek overshoots the desired timestamp. This can occur when segment durations cannot be used for frame accurate calculations when frame rate is 29.97fps.
Added new optional technical metadata field `channels` which is an ordered array of channels for a channel layout. This ensures that channel metadata id extracted correctly for files with additional channel layout information.
Changes to Technical Metadata fields may be made, with the exception of changes to start time, start timecode, video stream start timecode, and video stream GOP start timecode.
Resolved issue creating DASH and HLS packages when commas are included in text or audio stream names.
Calculate timecode overlay absolute box height based on font size rather than relative text border
Added support for detection of variable frame rate. If detected the video stream in the job result will have a new property isVariableFrameRate: true.
Fixed Issues DaletFlex
Fixed an issue where a user with no "edit" permission on media asset can delete membership of the asset.
Support for Summary Panel of Project asset type. Panel has tabs for details, metadata, relationships, access, history tabs.
Relationship tab: Fixed an issue where the Run option is missing for assets in the Relationship tab. There is no Run action on UDOs and attachments.
Enhance the scrubbing behavior of Flex Player.
Calculate video frame rate duration if required BEFORE rejecting zero duration frames.
Core assets API to return appropriate error codes on permission failure and restrict acesss correctly.
Fixed issue: Users who lack edit permissions can no longer update asset markers and annotations. A “403 Forbidden” error may be received if updates are attempted by a user without edit permissions.
Fixed an issue where an incorrect HLS master playlist where a stream is referenced twice is created for audio only packages.
Added a simple logic check to prevent any changes to detected source asset info if the forced input frame rate equals the detected frame rate.
Fixed an issue where Pack job fails with format=TAR and compression=NONE.
Fix colorspace conversion for HEVC source.
New job listener added globally outside of job processing method for each job executed so that they are not repeatedly added.
Fixed issue: The recording start time will now be displayed for growing files (live recordings) in the Media Info of the asset in Flex MAM.
Fixed issue: The correct duration of growing files (live recordings) will be displayed in the Media Info of the asset in Flex MAM.
Fixed an issue while extracting the waveform on Segmented Proxy.
Fixed an issue where a Conform action was following for media assets with videoStreamCount > 0. Issue fixed by changing the channel mapping logic to handle audio before video in hires sources when preparing conform job.
Fixed an issue where a failure in the media processing engine was corrected to prevent “Create Proxy / Transcode” jobs for OPATOM from running indefinitely.
Fixed an issue where the selected audio stream was not playing when play in the Manage page for an asset with multi audio hls tracks.
Fixed an issue where Class Inheritance is no longer working In Legacy Groovy script.
List of Services upgraded between 2023.6.5 and 2023.6.6
flex_fileaccess_service
flex_fileprocessor_service
flex_indexelastic_service
flex_job
flex_jobasyncexecutor_service
flex_master
flex_metadata_service
flex_streamprocessor_service
flex_videoproxy_service
flex_search_app
2023.6.5
From this release all Enhancements and Fixed Issues are delivered together with no differentiation between Dalet Flex and FlexMAM.
Enhancements DaletFlex
Purge Waveform: Read waveform.json to get name of referenced binary files to purge.
Support output profile with interlacing e.g. convert progressive to interlace or change field order to support mixed source conversion for stitch and sequence jobs.
FSP now supports the Keda (Kubernetes Event-driven Autoscaling) external push-scaler service to trigger job scaling directly.
JEF scripts now support Hazelcast locks as an option to the default Redisson locks.
Augment tar/untar support for zip/gzip and also contents listing. Change tar/untar job type to pack/unpack and add new list job type.
Support forcing check of source folders on object storage before performing folder based copy/move operations in FFP so that the job fails when the folder does not exist as opposed to succeeding but not having any effect so that the fact that the specified resource does not exist is essentially hidden
Add support for packetCount property returned in assetInfoExtract jobs. Specify the property by setting enablePacketCountExtraction=true or by default with the Consul KV set flex/flex-streamprocessor-service/enableDefaultExtractPacketCounts=true.
Add heuristic calculation of AVC in MXF bitrate if AVCSubDesciptor is not available.
Result of FFP list, pack and unpack jobs was extended to include the totalSizeInBytes of the files and folders involved in the operation. The size of individual files is now also included in the following manifest format outputs: SIZES, DETAILS. Folders are now also included in the following manifest format outputs: SIZES, ENTRIES.
Fix mediainfo stream closing issue.
Jobs are auto-retried for OptimisticLockException.
Fixed gap where non-backwards compatibility was introduced in FFP as part of supporting new pack/unpack API. 3 KVs added that support legacy behavior by default and generate a hash file/sha1 file/support batched tar jobs (up to a batchsize of 1000).
Do not automatically disable truncation detection when transcoding with stream copy if is no clipping is requested in the transcode copy job. Use these KVs to enable truncation detection for package format sources and for codec=copy profiles if no clipping is performed: `flex/flex-streamprocessor-service/enableTruncationDetectionForTranscodePackageFormatSources` and `flex/flex-streamprocessor-service/enableTruncationDetectionForTranscodeCopyCodecWithNoClipping`.
Optimise the bulk creation of annotations by adding caching. Performance improved by creating batches of annotations with the SDK call.
Support waveform extraction from segmented DASH packages.
Fixed an issue with the last modified time function in Azure that was causing Inbox to delete files from Azure folder before import happens.
Handle scaling of sources with non-even width or height values via scale instead of zscale filter.
Reduce default caching to prevent playback failing if VFS location has changed after proxy was created.
Fixed Issues DaletFlex
Fixed an issue where file listing fails when filtered out files disappear
while listing.
Fixed a problem where requests for vol, mpd or m3u8 files or those with
noCache query param did skip in the memory stat cache.
Corrected both Dash manifest parsing logic to select correct sub-folder
to scan and VFS layer file listing readable stream logic to ensure package
format asset info does not recursively list unrelated sibling folders.
Jobs are auto-retried for OptimisticLockException.
Fixed an issue where FFP job pods running in EKS do not terminate upon
completion of a job and prevent EKS scaling down when there are no jobs
to be executed.
Fixed an issue where Prometheus stats on FFP job nodes are not being
observed. Ensure all Prometheus stats are captured on controller/standard
nodes so they are not lost on job instance shutdown and are polled for
Prometheus collation. There is now counter and gauge for completed and
failed jobs.
Fixed an issue where Pack/unpack job does not work for folder.
Fixed an issue where a launch and wait action fails when parent workflow
has a StringList variable. Issue fixed by adding the string list variables
from the endpoint.
Fixed an issue where .TCD files are created with the wrong format for
the TimeCode.
Fixed an issue where searching against Time fields does not work as expected
when user timezone is not UTC. Issue fixed by not apply timezone adjustment
when Date or Time metadata field queries specify the comparison value
numerically, i.e. in milliseconds since the epoch
Fixed an issue in SearchElastic: when a "Time" metadata field value is
set to a date/time older than 26th Jan 1970, it is returned by SearchElastic
as milliseconds past the epoch instead of as a ISO8601 string, causing
it not to render in FMP search results.
Use mediainfo instead of ffprobe for growing MXF files to avoid possible
endless increase in growing polling times.
Panels App: Fixed an issue where accheckbox inside a complex field with
multiplicity & multi option field as checkbox type with multiplicity
was not working as expected in wizards and legacy uploader.
Fixed an issue where the
"Type Is Not Video" filter
chip was not returning correct results. The isNot condition for more
than one variable returns filtered results with the AND operator.
Fixed a specific scenario in MPD parsing when only a single segment exists
in the DASH manifest.
Fixed an issue where there were distorted proxies for EXR frames packages.
Issue fixed by adding unimplemented code to ffmpeg to handle larger VLC
lookup code sizes.
Fixed an issue where incorrect frame rate was being retrieved during a JEF Extract technical metadata job.
Sporadic errors in FSP Fixed an issue where an error polling the growing
state of an asset triggered this error
Growing state of job is undefined after 4 minutes
on other jobs starting at the same time.
Fixed an issue where Copy and Move Action from Azure to Azure location
was failing for AS02, IMP, Segmented (HLS), Segmented (MPD) Assets.
Fixed an issue where video preview is not available in FlexMAM.
Handle waveform extract where multiple renditions for same adaptation
set exist.
Added logic to handle ffprobe pixel format YUVJ420P as being equivalent
to YUV420P with colorRange = FULL_RANGE.
Fixed an issue where Save metadata is failing when user add or update
a variable on the associated metadata definition.
Fixed an issue where saving metadata is failing when user adds or updates the variable on the associated metadata definition.
Web transfer: Fixed an issue where values added in date field and time
field with form type "text" are cleared when adding multiplicity for
any other field in the metadata form.
List of Services upgraded between 2023.6.4 and 2023.6.5
flex_fileprocessor_service
flex_hotfolder_service
flex_job
flex_jobasyncexecutor_service
flex_master
flex_metadata_service
flex_streamprocessor_service
flex_videoproxy_service
flex_webtransfer_app
flex_panels_app
flex_search_app
2023.6.4
Enhancements DaletFlex
Added new endpoints to the jobexecutionmanager service to help support JEF-related diagnostics.
FFP Plugins: Copy/Move (might be others in FFP or FSP plugins) protect moving/copying segmented asset with manifest folder with the same root folder as the Storage Resource base path.
Give a common prefix to all name identifiers of entries in the `apps` section of Permissions, add FlexXTEND.
Amberfin: Add a control polling cadence for Amberfin launch actions in JEF configuration. To improve performance, default polling value is 10s.
Return displayAspectRatioFraction in the asset API and mark displayAspectRatio as deprecated.
Add event data to indicate what changed to a medadata definition modified event
Add support for quota service to JEF SDK.
Add support for MessageTemplate and TimedAction services to JEF SDK.
Update waveform migration script to support migrating waveforms stored on S3. The core purpose of the migration script is to migrate the waveform files which were generated with the consul KV waveformNewLocation disabled to the new location where KV waveformNewLocation key is enabled. Additional information is available here .
When using the feature toggle flex/shared/flex-enterprise/featureToggles/queueJobOnCreation, set execution token when job is directly set to queued at the time of creation.
Add Consul KV flex/enterprise/workflow/ignoreTimedOutState. When set to true the status of a workflow is displayed as Running and not move to Timed Out even if jobs associated to the workflow are moved to Timed Out. Default value is true.
Support skipping the Global sync job running limit using a Consul KV. Validate the Consul KV flex/enterprise/workflow/enableSyncJobLimitCheck for Enterprise jobs that have flex-enterprise/featureToggles/queueJobOnCreation = true and flex/enterprise/scheduler/job/maxSyncJobsInProgress >1.
The Description metadata field is now limited to 500 characters.
Invert the workflow state check in job scheduler to continue queueing jobs as long as the workflow is NOT in pending state.
Improve the performance of job summary by applying an index on last_modified column of mio_job table.
Collection service: allow KV to enable recursive collection deletion, regardless of sub collection ownership. Set flex/flex-collection-service/ignoreSubCollectionOwnershipWhenDeleting to force recursive collection deletion, regardless of the ownership of any descendant collections. This is not the default behavior.
Add index for metadataDefinitionId field in metadata collections in Arango db.
Add meta tag <meta name="robots" content="noindex, nofollow" /> to login HTML to prevent search engines from indexing the Flex login page.
Fixed Issues DaletFlex
Fixed an issue where upload failed because when a date and time field
in the metadata form used a Text Form type instead of a Time form.
Fixed an issue where a Decision script trying to cancel continuously from ExecutionStep and hammering Enterprise with events. Issue solved by maintaining a list of running jobs to avoid bottleneck on cancelled job cleanup.
Fixed an issue where RioBroker Restore Plugin is stripping Off Top Level '/' path when setting Asset Current Path causing restore to fail due to an incorrect path.
Fixed an issue where changes in asset metadata do not trigger the update metadata workflow. Issue caused because metadata modified events sent from the metadata service did not include workspace ID, so the event handler used the default workspace ID of the account so events for assets in workspaces could not be used to start jobs. Issue fixed by adding workspace ID to events generated by metadata service.
Fixed an issue with Events Handlers requests hitting the Events API before the corresponding event has been fully created, resulting in a false error. Fixed by adding retried to the Get Events API /api/events/<eventId>, by default at 0, 1.5, 4.5 seconds, but can include also attempts at 10.5, 22.5, 46.5 seconds. The configuration KV is flex/flex-events-service/getEvent/maxAttempts can be set to any integer 1-6, default 3.
Fix Mapstruct mapper for legacy script getAsset.
To prevent corruption of Arrango DB and its being irrecoverable after one host is down. For Spring Boot Apps using Arango: Replication factor of `arangolock` / `dbchangelog` collections should be at least 2. For existing environment collections this should be done manually.
Fixed an issue where JEF copy/move Failed when moving Segmented asset. Issue fixed by including the package name in the destination vfs location.
Fixed an issue where deleting a single external ID via the legacy SDK with Groovy script deletes all of the external IDs.
Add checkbox for optional configuration parameter to Copy/Move protect moving/copying whole SR if Segmented Asset is in root: support copying/moving if filename manifest==media folder
Fixed an issue to ensure backwards compatibility for legacy FFP restore jobs after restoreTier property renamed to restorePriority.
Fixed an issue where FO objectsid endpoint returns inconsistent results.
Fixed an issue where creating a composition proxy on Flex CPL assets which have the same trackId for audio/video/subtitle sequences was creating proxies with incorrect durations. Issue fixed by creating a single sequence for the same trackId by consolidating all the clips with the same trackId.
Fixed an issue where Extract Keyframe set the wrong master keyframe.
Fixed an issue where Task dashboard shows incorrect number of tasks for users that have more then one role (via user group membership).
Hot folder service: Fixed an issue where errors when retrieving the outcome of async file processing leads to reimporting of all files in resource. Issue was reported for hotfolders configured with max depth ==0.
Job Scheduler updated to ignore maximum job limit keys with value zero in Redis.
Fixed an issue where it was not possible to filter on the Created
column of the Results table using the Custom Date Range selector.
Upload with metadata: Fixed an issue where uploading assets using a metadata
form containing taxonomy fields with multiplicity fails with a validation
error.
Add support for GXF file format in the Web Uploader in FlexCORE.
Fixed an issue where Timed action failed and didn't restart. Issue fixed by, a new job being created when Timed Action jobs fails/cancelled and this message is displayed in the job history ` Retry the job again, new job will be triggered`.
Resolved an issue where JAE/Redis outage leads to QUEUE timeout and job active in 2 nodes. After Timeout, extract waveform cannot be retried because the json already exists.
Resolved issue of jobs timing out after being in a Queued state.
Fixed an issue where JEF Wait for Script gets timed-out instead of running for a long time. Issue fixed by optimizing the volume of jobs consumed by Job Executor.
Fixed an issue where jobs remains stuck forever with Status pending /running or failed with timeout. The job scheduler is not updated to keep processing pending jobs as long as the workflow is not in pending state.
Fixed an issue where the Start Session Action was not starting in FlexMAM
Fixed an issue where Purge action is failing for all Package assets. Issue fixed by updating resource root validation check to consider filename when comparing asset location with storage resource root location.
Segmented Asset: Fixed an issue where asset preloading is not working in Video manage page when kv "playerEnablePreloading" is set to true.
Enhancements FlexMAM
FlexMAM: Display Format Variant in Technical Metadata UI. Displayed in technical Medatata tab, Chip filters, Listing of table and tile templates.
Update `displayAspectRatio` field to use retrieved `displayAspectRatioFraction` value in Summary Panel, Manage Page, Search Chips, Column Templates. Values are entered in search as fractions.
Fixed Issues FlexMAM
Fixed an issue where upload failed when the metadata form contains taxonomy fields with multiplicity.
Fixed an issue so that DateTime Fields (Start Date, End Date, Start Time, End Time and Created Date in metadata and marker display template use the timezone setting for the user.
Fixed an issue where Codec H264 technical metadata was not retrieved when used in a search filter because the filter display name was H264 instead of H.264.
Fixed an issue where the search value in the chip bar was not displayed when using searchable icon from the metadata tab. The username displayed in the typehead user field differed from the asset listing and user field selected type. The values for both scenarios were undefined.
Summary panel: Fixed an issue where it was not possible to play wav or aiff audio from UDO page in Summary panel.
Bulk Panel: Fixed an issue where the "Add to Collection" and "Edit Metadata" option under Quick Actions for bulk assets are not working correctly.
Fixed an issue with the date filter modals.
Return ability to use a shortcut to create clips and to create markers via hotkey on the summary panel.
Fixed an issue in the Left Collection menu that was sending multiple network calls from the browser so collections are loading information for a long time after page refresh. Issue fixed by adding a cache of 6 seconds when loading sub-collections.
Legacy Uploader: Fixed an issue where the text “This field is required” appears twice in date type from fields.
Fixed an issue where wizard progress bar was not updating. Progress bar proceeds for these statuses: Pending, Running, Completed, Failed.
Fixed an issue when the KV Proxy Preloading is enabled, so that assets are played using the Space bar in asset summary/ manage & reviewer summary/ manage pages on initial load and on reload.
Fullscreen: Fixed an issue where it was not possible to minimize the screen after selecting the mark with metadata icon and moving to Full Screen.
FlexMOVE: Added support for BMP files in Flex MOVE.
Segmented Asset: Fixed an issue where asset preloading is not working in Video manage page when KV playerEnablePreloading is set to true.
List of Services upgraded between 2023.6.3 and 2023.6.4
flex_blackpearl_service
flex_collection_service
flex_events_service
flex_fastobject_service
flex_fileprocessor_service
flex_hotfolder_service
flex_indexelastic_service
flex_job
flex_jobasyncexecutor_service
flex_jobexecutionmanager_service
flex_login_app
flex_master
flex_metadatadesigner_app
flex_metadata_service
flex_publishindexer_service
flex_searchelastic_service
flex_webtransfer_app
flex_panels_app
flex_fmpadmin_app
flex_fmpreviewer_app
flex_globalheader_app
flex_search_app
2023.6.3
Enhancements DaletFlex
Add validations to ensure that assets ingested incorrectly
to the wrong storage location do not to cause all assets in the folder
to be removed on Purge.
Add SearchElastic API support to the Flex SDK.
The FormatVariant variable is now presented in the Flex Enterprise UI
as well as the API.
To improve resilience, when all the executor threads are running then
the job will be in queued state and the watcher will move the job from
queued to running only if the currect JAE has free executor threads.
And all the failed job entries will be removed from the system in 90
days.
Removed INFO logs to reduce noise and added HotFolder metrics and
respective Grafana dashboards. New metrics: Workflow Requested per Hour;
Current Scanned Files; Current Internally Processed as Candiate Files;
Total Discovered Files; Total Updated Files; Current Deleted Files; Time
Taken from Scan to Processed Candidate Files; Total Waiting for Activity
TimeOut or Throttled before Launching; Total Launched Workflows; Total
Workflows Requested Fail; Total Launched Workflow messages waiting to
be consumed by Enterprise; Flex Enterprise API Calls; and Log Events.
Added a gauge for running jobs and a respective view and the Grafana
Job dashboard.
For the Adobe Premiere Pro integration, added support for Sequences with
audio only.
Added a new KV to support a legacy behavior,
legacyMp4FormatAndMimeTypeEnabled,
set by default to false.
When set to true, When formatVariant
is "QuickTime" or "QuickTime (old)" then UI and API will return format
as "QuickTime" and mimetype as "video/quicktime"
Enterprise API: Allow Tasks to be filtered by any number of `status`
values, instead of just one.
Added PixelFormat and thus
bit per sample as listed enum field strings.
Disabled ETM update for asset version lower then 4 and has asset having
annotations by default. To force ETM update set
{{flex-enterprise.featureToggles.allowTechnicalMetadataChanges }}
to true.
Add missing CIP CAP, SCC subtitle formats. Support importing these formats
as Subtitle Assests as opposed to default Media Assets.
Create proxy of image while preserving exif orientation when performing
an imge transcode.
Better VFS API support for determining if a provider supports tags (non
Amazon S3 provider).
Add format level duration derived from video stream for Red asset info
and add size from VFS.
Added flag to disable the return of purged proxies by the API by default.
By default, the flag
“deleted=false” will only
return active proxies;
“deleted=true” will return
only purged and deleted proxies; and “deleted=all” will return all the
proxies, deleted and active (the old behavior of backward compatibility.
Added support in Task api to search tasks taken by a given user:
`/api/tasks;assignee=<user-id>`.
Removed the workflow age from scheduling computation of the Job Scheduler
to achieve a steady number of jobs on the job queue when there are many
PENDING jobs.
Set the event correlation_id to the job Id for Event type PUBLISHED to
fully enable usage tracking.
Job Scheduler: Logic for Job loading and enqueue sequence in Job Scheduler
logic updated.
Added support to signal workflow manually if it stuck and not moving
to next node using new API endpoint.
Exposed taxonomyId for a drill-down from the SDK.
Job Scheduler improvements: logic for Job loading and enqueue sequence
in Job Scheduler logic updated, exclude jobs for which job quota for
action configuration has been exceeded and excluded jobs remain in a
Pending state.
Ensured script locks are unlocked if a script errors.
Added validation in the Purge plugin to fail a purge job if it tries
to delete any directory which is configured as a storage resource root
location.
Fixed Issues DaletFlex
Fixed an issue where Incorrect format size and bitrate reported for package formats in extract asset info.
Use output pixel aspect ratio in the logic when performing resizing calculation.
Incorrect visual output for stitch acceptance test caused by incorrect pixel format value being used in ffmpeg video filter expressions.
Fixed an issue where Import action fails if import location matches a different Folder Resource with a different bucket.
Job Async Executor: Spring Scheduling thread is getting blocked, causing '401 Unauthorized' errors for scripts which use Enterprise APIs. Fixed by setting the Consul KV to increase the number of threads available to Spring @Scheduled methods from the default (of 1) to 3.
Fixed an issue in the Job Async Executor where numerous "Invalid cookie header" warnings were listed. Fixed by switching to a standard cookie spec.
Changed the JAE executionStep thread pool (size 1) as the default pool for executing different schedulers of the plugin and JAE core. This change created a common/default thread pool size based on the number of available @schedule methods. Also added KV (flex/flex-jobasyncexecutor-service/job/bufferThreadSize) to add a buffer thread only if needed, default 0.
Fixed an issue where FlexFileProcessor was failing to restore small files in list of files. Issue solved by not archiving or restoring files128KB or smaller.
Flex Login App: Fixed an issue where Library fails to extract the correct account when request URL contains localhost in "redirect_uri" query parameter.
Fixed an issue where the Job listing api failed data conversions if the Timedout Job was available in the system.
Disabled timeout for the WaitForNamedSignal action, as it was timing out while waiting for signal.
Fixed an issue with the Login App where SAML authentication stopped working. Fixed by setting the decryption private key to decrypt any encrypted assertions received in SAML response.
Fixed an issue where an uncorrect path was being set in Login App for CSRF config options.
Fixed an issue where the Edit import failed when the file name contained a dot (.) and the Image import failed when the file name contained a space.
Fixed an issue where it was impossible to unlock locked user accounts from Enterprise, because the query was returning duplicate user records when the logged in user was a member of a group. Fixed by updating the query to return distinct results.
Fixed an issue where when changing the metadata definition of an asset via the Core UI or the SDK did not update the metadata mapping collection, and the metadata was unsearchable.
Fixed an issue where jobs remained in PENDING state even if a workflow had a defined time limit.
Standardized the checking of existing output locations for all job types.
Fixed an issue where the metadata instance type ahead UI is broken for fields with multiplicity supported variables.
Fixed an issue where while importing a live asset (growing), the AssetImporter failed as the *.mpd file had no duration.
Fixed an issue where the Sync Workflow Limit task did not remove the limits from the Redis when the limit was removed from the Workflow Definition.
Enterprise: Fixed an issue where TagCollections REST API returns no results when filtered using name matrix parameter with user account. Tag collections are now retrieved from a users’ accessible account.
Further fixes for FlexFileProcessor restore job for small file processing.
Added support for AIFF mapping mime-type in mediacore objects library.
Fixed and issue with the Collection service where deleting a collection that had a parent collection with specified write ACL access resulted in error.
Fixed an issue where Event Handler service does not paginate through the Enterprise /api/users/<userId>/accessibleWorkspaces API, so if the user is a member of >100 workspaces, then permission may be denied incorrectly. Issue fixed by increasing the default limit of available workspaces to 1000.
Fixed an issue where Workflows could get stuck in Pending status due to an issue with checking the workflow limit when a workflow was launched from a Hot Folder.
Collection service: Fixed an issue where there was overeager removal of parentUuids when processing subcollections by ensuring that subcollection deletion stops for branches that encounter subcollections not owned by the deleting user.
Fixed an issue where metadata annotations with no metadata instance cause indexing to fail.
Fixed an issue where extract subtitle technical metadata action was throwing an NPE. Issue caused by WebVTT Cue identifier throws an NPE when text is followed by an empty line. Issue ficed by safeguarding agains blank lines when parsing VTT files.
[JEF SDK]: Fixed an issue with JEF where a RedisTimeoutException: Unable to acquire subscription lock after 9500ms error appeared.
Fixed an issue where the JEF script jobs paused for minutes while running.
Fixed an issue where an error appeared after generating an Adobe Premiere sequence from a collection with only an audio asset. As Premiere requires a frame rate, even for Audio only, the issue was fixed by providing a default frame rate for those clips in the export xml.
Fixed an issue with workflow Sceduler that was causing large numbers of Pending Workflows. WorkflowScheduler: error while moving workflow from pending to running.
Fixed an issue with the integration with NetApp S3 compatible Storage Resource where the storage path could not be resolved.
Fixed an issue where metadata in Cast / Director / Writer fields is not loading / is nor displayed in Flex Core for new Season UDO.
Fixed an issue where there was a NullPointerException when performing Extract technical metadata action on spanned RED media card.
Added missing fields in the format and video stream information for R3D file: Format: Bitrate; Video Stream: Codec, Width, Height, Display Aspect Ratio, Pixel Aspect Ratio.
Enhancements FlexMAM
Switch querying of Tasks back from using FQL to using Enterprise API `status` parameters so user sees all available tasks in FlexMAM.
Only display Delete Action in the More Actions list if the user has permission to delete.
Player supports playing assets regardless of the case of the file extension (lower or upper).
Fixed Issues FlexMAM
FMP Player: Fixed an issue in the FMP Player for Asset Summary page and new reviewer app, where when a user clicks on the play button from created clip then clip plays and ends very quickly.
Fixed an issue where audio tracks are not sorted correctly when the Audio track ordering: By Name option is selected in FlexADMIN.
Fixed an issue in the Summary view, where users have IN and OUT marks, but upon creating a new one, the range selection is not properly updated.
Fixed an issue where it was not possible to download keyframes in FlexMAM for assets with special characters in the file name.
Fixed an issue where the Date filter would become unusable if a taxonomy filter was selected.
Fixed an issue where if a user adds a workspace as a filter chip, it does not appear correctly.
Fixed an issue where the icon to jump to a URL is missing in the metadata form in the Summary panel, Manage page and Marker metadata.
Fixed an issue in Dalet CUT where if content failed to load, the default handling for configuration service endpoints were used.
Fixed an issue where preloading was disabled for AS02 and package assets.
An issue with an invalid tooltip was fixed where when you hover over an audio asset in Dalet FlexMAM, you see ‘Audio’ as the tool tip.
Fixed and issue with the FlexXTEND panel where local media that was uploaded to Flex through media check in was then redownloaded for AME render instead of being used locally. Issue was caused by wrong filename verification.
Fixed an issue where the Time range indication +/- in the Video Manage Timeline is not working properly.
Fixed an issue where the "Add to Collection" and "Edit Metadata" option under Quick Actions for bulk assets are not working correctly.
FlexREVIEW: Fixed an issue where the metadata variables inside the nested complex field in the metadata tab of the review session were not displayed but they were displayed in FlexMAM.
Issue has been resolved in Asset Manage page, where if a timeline comment was made, then when selecting the comment, it wrongly highlighted the duration in timeline section below the player.
FMP: Fixed an issue where the Subtitle icon button was not visible in the summary panel player.
Fixed two issues, the first, where if there were multiple audio tracks, then the scroll bar to see more audio tracks was not present in Reviewer. The second was that in the Summary page, the audio track name was not displayed correctly.
Fixed an issue where the code for the Keyframe Carousel did not take Drop Frame into account when applying timecode for a an asset set with preferredDropFrame.
Fixed an issue with the Operational Dashboard where the asset names were displayed as Undefined.
List of Services upgraded between 2023.6.2 and 2023.6.3
flex_collection_service
flex_eventhandler_service
flex_fastobject_service
flex_fileprocessor_service
flex_hotfolder_service
flex_imageproxy_service
flex_indexelastic_service
flex_job
flex_jobasyncexecutor_service
flex_login_app
flex_master
flex_publishindexer_service
flex_sequencemanifest_service
flex_streamprocessor_service
flex_videoproxy_service
flex_operationsdashboard_app
flex_xtendamepanel_app
flex_xtendamepanel_extension
flex_cut_app
flex_fmpreviewer_app
flex_globalheader_app
flex_search_app
2023.6.2
Enhancements DaletFlex
Added support for drill-down metadata fields to run rules using the syntax
#{"@@new-drill-down-option-field@@"!=("???")}.
Added SDK method to return disabled taxons.
Added the configurable option for AmberFin jobs to succeed the JEF job
in case of AmberFin job failure.
Added JEF SDK support to retrieve and updated attachements: getAttachment
and updateAttachment
Added the ability to associate variantId without metadataDefinitionEntityId to a collection
Upgraded to FFmpeg 6 following several bug fixes
Fixed Issues DaletFlex
Fixed a health check issue where the Flex Master was unable to connect to theHazelcastcluster following an outage
Fixed an issue where JEF scripts were failing if the WorkflowContextVariables
(jobContextVariables?) contained a null option. Fixed by skipping the
null key\value.
Fixed an issue with the Workspace plugin backward compatiblity
Fixed in issue in the FSP service where a Log file permission issue when processing R3D files as part of Extract Technical Metadata Request cause an error.
Fixed an issue where it was not possible to cancel a workflow when
the subworkflow is null. Issue solved by adding a condition to avoid
an NPE.
Fixed an issue with AS02 assets where the stream count value was not
correctly displayed in the format context field under Technical Metadata.
Fixed an issue where metadata values with the single quotation mark character
did not appear in FMP.
Fixed an issue where Cancel requests in Flex Enterprise API were not
processed. Fixed by adding a new service as part of the Watcher schedule
to handle orphan cancel requests.
Fixed an issue where the Amberfin Output variable made the JSON file
invalid. Fixed by properly converting the output to a supported JSON
string.
Fixed an issue where Pre-signed URLs were reused when running a collection
of tasks with limited concurrency for FFprobe and FFmpeg.
Fixed an issue in FlexMAM where a user only sees tasks in the default
workspace. Issue fixed by searching all workspaces available to the user
for the specified object type.
Fixed an issue with Event handler service where exceptions when parsing
metadata filter expressions blocked subsequent event handlers from being
processed.
Added a retry loop before failing Flex Stream Processor jobs to improve
issue where transcode jobs were hanging.
Fixed an issue with the Fast Object service where metadata instance details
were not returned when fetching a single metadata annotation.
Fixed an issue where custom markers post upgrade received an absolute
timecode, but new markers are created with relative timecode.
Fixed an issue where the Metadata Service added the "key" value in the
metadata Json even when the "withKey" parameter was set to false. Fixed
by using the value specified by the user in REST call instead of the
“withKey” parameter.
Following the addition of KV
disableConnectionReuseForEnterpriseRestCalls,
Updated KV
disableConnectionRevisionForEnterpriseRestCalls with
disableConnectionReuseForEnterpriseRestCalls and
set to "false" by default.
Fixed an issue where the Fractional framerate (29.97f|59.94f) failed
to add the dropFrameMultiplier when the framerateValue was not exact
(29.97f|59.94f), leading to the wrong TC-millisec calculations
Fixed an issue with Invalid timecode in the post response (not using
KV decoupleStartTimecode to pair with GET response).
Fixed an issue with older event handler configuration where after an
upgrade there were event errors due to variable name issues. Fixed by
using a dedicated script to address this issue.
Fixed an issue where the language selected in the profile panel did no
persist and reverted back to the default language selected in the admin.
Fixed a permissions issue for 'jakarta.validation.constraints' KV.
Fixed an issue with the Twitter plugin (V2) where a Tweet URL was not
fully stored, but only the tweet ID. In addition to the fix (URL in job
history), multiline tweets are also supported.
Fixed an issue where records for workflow and task which need to be downloaded
did not appear in the search.
Fixed an issue where users were unable to create a timed action using
Execute Action on the Metadata Condition Plugin.
Fixed a global header issue were updating a metadata field using a task
as part of a workflow failed.
Fixed an issue where Enterprise API returns an invalid framerate for
IMP Asset proxy.
Fixed an issue where the Start timecode was showing the wrong values.
Fixed an issue where the API did not return the framerate for an AS02 asset.
Enhancements FlexMAM
Added support for UDO when launching a workflow wizard. A dedicated true/false value,prepopulateMetadataValues, will pre-populate metadata fields based on UDO values.
Following an issue where automatic logout was not forced after specified
inacticvity interval had been reached, Kue queue shutdown timeout increased
to 1 second by default. Added a Consul KV `flex/flex-streamprocessor-service/queueShutdownTimeoutSeconds`
to make this configurable.
Fixed Issues FlexMAM
Fixed an issue with default values when bulk editing metadata.
Fixed an issue with the preview player where when selecting a clip in a sequence, the green line showing the clip range on the timeline was not visible.
Fixed an issue in the FlexXtend panel where templates did not appear in the list in Setting.
Fixed an issue in the Workflow Wizard where the time range values were not consistent.
Fixed an issue with the App switcher where the Uploader icon was missing.
Fixed an issue with FlexMAM Review where the finish status "status "event was not displayed in the API when metadata definitions for a custom status were not set.
Fixed an issue where timecode format for DF and NDF did not clearly display the timecode format.
Fixed UI issues with the Search Suggestions box, the new table template icon, and the export CSV option.
Fixed an issue where when updating metadata of a marker, the updated info did not appear until a refresh.
Fixed an issue where API requests to get proxy and keyframes were slow. Fixed by changing the order of request info.
Fixed and issue where Boolean fields, added to a Marker template, displayed an icon instead of the correct Boolean value.
Fixed an issue with segmented asset children having an incorrect icon and tooltip.
Fixed a timecode validation issue with preferred start timecode.
Fixed an issue where an invalid form configuration caused a lookup issue where values were missing.
Fixed an issue in Flex Review where when on the initial load no reviews are presented if a filter search was not performed.
Fixed a UI issue where the Required Field message was incorrectly displayed twice.
Fixed an issue with notification tasks where long asset names where the name could be fully seen as it did not truncate.
Fixed an issue in preview full screen where pressing ESC did not exit full screen mode.
Fixed an issue where the time range for a marker annotation in the Listing page did not match the time range in custom marker tab due to an absolute/relative TC issue.
Fixed in issue in Flex Review where edited timeline comments did not appear correctly.
Fixed an issue with the keyframe carousel where pressing on the Open Details icon for an extracted keyframe image hid the description panel. As a result, users were unable to close the keyframe carousel.
Fixed in issue in the preview player where when playing a sequence the timecode did not show the correct playhead location on the timeline but stayed on 00.
List of Services upgraded between 2023.6.1 and 2023.6.2
flex_blackpearl_service
flex_eventhandler_service
flex_executionconfiguration_service
flex_fastobject_service
flex_job
flex_jobasyncexecutor_servic
flex_master
flex_metadata_service
flex_publishindexer_service
flex_streamprocessor_service
flex_panels_app
flex_xtendadobepanel_app
flex_cut_app
flex_fmpreviewer_app
flex_globalheader_app
flex_search_app
2023.6.1
Enhancements DaletFlex
Ensured chunk gather sub-jobs are scheduled with high priority to prevent starvation by new chunks from other parent jobs scheduled at the same time.
Disabled MP3 source file output truncation detection as the source duration is estimated from the file size.
Provided a Consul KV, flex/flex-streamprocessor-service/enableLegacyImageOverlayLocation, to enable the legacy image overlay which bases location on the source instead of target frame size. As this is an unwanted behavior, only use this where reconfiguring image overlays is impossible.
Improvements to Wizard Run Rule Expression Evaluation. Improved performance for fetching wizards in the API and UI when there are a large number of wizards configured. Noticeable slow-downs came after about 50 wizards.
Fixed Issues DaletFlex
Fixed an issue where keyframes that were extracted manually in FlexMAM by a user were not loading properly in FlexMAM.
Add retry on Search operations if Elasticsearch returns a 429 error and return 429 if retry still fails instead of immediately failing the search.
Fixed issue where technical metadata failed to extract for GXF video files. GXF format added to the supported formats in the mediacore library.
Fixed issue in Enterprise API where time fields return UTC when "includeMetadata" parameter is included.
Fixed an issue where it was not possible to download the pdf/excel report for asset search
Fixed an issue where old instances of UDOs are no longer editable and throw an error in Flex CORE UI if their UDOT has been updated after they were created and subsequently had a metadata definition assigned to it. Issue fixed by assigning a default metadata instance to the old UDOs when they are loaded instead of throwing an error.
Fixed an issue where system metadata was updated on a restart of JAE and possibly causing a reindex, for no apparent reason. Issue fixed by synching the revision numbers of system metadata definitions in Json files with those generated by Enterprise.
Fixed an issue where AS02 proxy creation was failing for a because of a non-integer sample aspect ratio for specific J2K in MXF files.
Fixed an issue where extract keyframes failed if the target folder resource is a root folder that does not have a path defined for it. Issue fixed by adding logic to ensure makePath is not called for an undefined path if the path is the root path.
FSP: Fixed an issue where Create Proxy jobs with chunks were failing with this error `Error: Job Manager:chunk sub-job failed with error: Cannot read properties of undefined`. Issue fixed by changing the logic for assigning config info between sub jobs and parent jobs for chunk jobs.
Revert the changes blocking master account entities being seen within the tenant account.
Fixed Issues FlexMAM
Fixed an issue where search filtering on Technical Metadata for Interlace Format is Top Field First/Bottom Field First was not returning the correct results.
Fixed an issue where reloading FlexMAM lost the focus on the selected UDO asset.
Fixed an issue where updating bulk metadata was also updating default metadata values on other select box fields in the metadata definition. Issue fixed by not using default values when editing multiple assets.
FlexADMIN: Fixed an issue where after updating the Expires On field for the user in Admin page and saving, 5:30 hours are added to the configured time.
Fixed an issue Manage page where the TC In and TC Out in the ClipBin view table were displayed incorrectly because the system identified the asset as NDF when it is DF.
Fixed an issue where the incorrect UDO type name (udo name) was displayed in the instance creation pop up in FlexMAM.
Fixed an issue where a user can manually update and save invalid TC In and TC Out for a custom marker. If invalid values are added an `Invalid timecode` error message is displayed and the Save button is disabled.
Fixed an issue where the Child assets url and child asset Id in the Details tab of the Manage were not identical.
Fixed an issue where audio stream info (Name/Language) updated from the listing page Technical Metadata tab in the Summary panel is not visible in the Technical Metadata tab on the Manage page.
FlexREVIEW: Fixed an issue where the subtitle switcher is not available on the listing page and task manage page.
Fixed an issue where child taxon fields are not displaying the correct label in FlexMAM.
FlexREVIEW: Fixed an issue where the Player is not visible in the Manage page for an audio asset which has a master keyframe set for it.
Fixed an issue where audio tracks were out of sync when pausing and jumping through a video.
Fixed an issue in Player full screen mode is not working as expected. When expanding the Clip Name input box, the player icons move above the player progress bar.
Fixed an issue where search lookup in metadata fields in FlexMAM is not working when a field is non editable.
FlexMAM search filter: Fixed an issue where the From and To fields in the calendar UI are not aligned.
FlexMAM: Fixed an issue where initials are not displayed on the user avatar when no login profile image has been uploaded.
Fixed an issue where the Notification panel opens unexpectedly when clicking a UDO referenced from metadata.
Fixed an issue where audio tracks unsynched
Fixed an issue where Taxonomy Field is not displaying the correct name in FlexMAM.
Fixed an issue where the Clip Bin view when opening a video asset in the Manage page shows the wrong TC values.
Fixed an issue where the calendar UI in the MAM search filter is not consistent.
Fixed an issue where Notifications panel opens unexpectedly.
FlexMAM: The search "magnifying glass" on metadata fields does not appear if the field is not editable from the UI even though the field is searchable.
FlexMAM: Fixed an issue where the "user" avatar doesn't have its initials anymore.
List of Services upgraded between 2023.6.0 and 2023.6.1
flex_fileprocessor_service
flex_filereplication_service
flex_imageproxy_service
flex_indexelastic_service
flex_job
flex_jobasyncexecutor_service
flex_master
flex_metadata_service
flex_searchelastic_service
flex_sequencemanifest_service
flex_streamprocessor_service
flex_videoproxy_service
flex_cut_app
flex_fmpadmin_app
flex_fmpreviewer_app
flex_globalheader_app
flex_search_app
2023.6.0
Enhancements DaletFlex
Use OAuth2 to communicate with enterprise in all services (Java)
MFA for Flex internal users
Fuzzy Search & Did You Mean... Suggestions
Mobile: Reviewer Manage page - images
Summary of BFF schema changes to be made before release
Added Recognition of XAVC video standard with the following technical metadata video standards (different variations of the definition apply based on the video resolution): XAVC HD Intra, XAVC HD, XAVC 4k Intra, XAVC 4K. A new Format Variant technical metadata field is populated with: QuickTime, MP4 v2, MP4 v1, ISO Base Media, BRAW, Quicktime (old).
Add eventData on marker update - timecode before and after.
JEF Export Edit: Support selecting referenced source assets to Export using AssetOrigin input field so that child assets can be exported instead of the parent asset. Possible options for export are ., ./transcode, ./proxy.
MFA: Persist "don't ask me again" status set for MFA on login in a client-side cookie, instead of as an explicit "false" in the DB, so that the MFA setup is not shown for every login in a particular browser. To use MFA setup after it has been hidden, users must clear cookies in the browser.
Searchelastic service: Implement GraphQL query for 'Did You Mean' suggestions.
STL Subtitle: Add support for Russian and Arabic char set standards for STL subtitles.
[FEATURE TOGGLE] Remove metadataVfsEnabled Consul KV value. This feature toggle was introduced in release 2020.7.0 and enabled as default in 2021.1.0. Account Storage + Account Folder Resource should be configured and used, if this is not your case please contact your Dalet Flex representative for more information.
To ensure that the workflow quota counters in Redis are synched correctly with the Database and do not get stuck, the time interval between each instance of the SyncJobLimitTimerTask has been reduced so it runs every 5 minutes.
[Mobile BFF] Add possibility to download assets to FlexMOBILE.
Timed Action: Send a notification message that reports the JEF job id associated to TimedAction + instructs creating a new job when there is an outage/disconnection between Timed Action and JEF Timed Action.
JEF Grafana and Metrics revision: Grafana Dashboards for Flex - Services / JEF Plugin Executions created. Dashboard displays: Mean time to complete jobs without execution step, Mean time to complete jobs with execution step, Running execution step jobs in execution step, Not completed execution step jobs within execution step, Duration of execution step iterations.
Amberfin: New configuration option (default true) to support/skip Extract Technical Metadata added in the LaunchAmberfinWorkflowConfiguration.
Added new allowed file types to uploader: .m2t, .mpeg, .m4a.
Export Edit: Add an input parameter to define final target FILE PATH: basepath and/or list (json) of target location to the Export Edit plugin configuration.
Add support for Extract Technical Metadata with masteringDisplay color option.
[Mobile BFF] Add referenceName field for all assets and fileSize and displayfileSize for image assets to metadata retrieved by Flex Mobile Service.
Add full metadata field path to event data returned by Rest API.
Flex Cut: Add configuration to set the Flex Edit Cut Folder resource at the Account level.
[iOS] Display editable fields in app. Implement editable metadata logic/architecture.
Add Aspera as an option for Transfer Accelerators in the Inbox config. Display all Aspera Connect parameters when Aspera is selected as the Transfer Accelerator.
Display eventData when updating timecode values on timeline comments/markers annotations.
Increase request body field size for HTTP message actions using a Script field instead of a String field.
Add ability to get workflow variables via the SDK.
Allow LDAP user lookup to match on email address, as an alternative to username to support LDAP login with the same user if IdP login is not available.
Mobile Login - Set autocapitalize=none for the username field.
Throw exception if JWT OAuth2 access token isn't available.
Improve logging when OAuth2 client-credentials token refresh fails (in @Recover method).
Set default pixel format for MPEG2 video to be YUV422.
Fix metadata JSON so metadata is stored in ArangoDB without the null key field.
Improvement to ffmpeg options and create a new forceVfsProxy Consul KV to force media access via VFS proxy to create pre-signed URLs on new connections to prevent pre-signed URLS expiring on long running jobs.
Updated the definition structure for the xdcam preset so that sequences using the xdcam preset do not fail.
Login App: Added E2E coverage for SAML scenario where multiple IdPs are configured in a single account.
Implement technical metadata extraction for Red files using redline in Flex Stream Processor.
Ensure METADATA_DEFINITION_SET events are raised when a metadata instance is created via REST API regardless of whether or not Enterprise uses the metadata service.
Multiple fixes and specific MioCM retry mechanism. Fixed message reporting inconsistencies in CM.
Fixed Issues DaletFlex
UDOT: Fixed an issue where the wrong Status code is displayed when you create and update the UDOT via Postman.
Fixed an issue where JEF-copy/move was unable to copy/move file to root location (to storage having path as /). As part of the fix, an option was added in the move/copy action configuration to set whether or not to overwrite files if they exist in the target location.
Fixed an issue where Workflow group id is null in event history because of a name mismatch: Workflow Group Id changed to Workflow Group ID.
JEF Grafana: Improve Graphs for Lock Facts: Current Lock Acquired Count, Current Lock Listener Count, Total Acquired vs Release Count, Total Duration Acquired by Locks.
Fixed an issue where Flex Master was unable to connect to Redis following outage. Redis connectivity is now included as part of the readiness check. Readiness and Liveness check added to Job Scheduler. If Readiness and/or Liveness check fails then Job Scheduler will not process new jobs until both these checks Okay.
Fixed an issue where images cached by Nginx are public and can be viewed by users without a valid login session.
[Mobile BFF] Fixed an issue where the Technical Metadata field is not displayed in FlexMOBILE for large assets (many Gb) because the Long data type for GraphQL schema fields was mapped incorrectly.
Fixed an issue in Web Uploader where the checkbox status was not displayed correctly in a metadata form. This issue is due to the color of the default theme.
Fixed an issue where it was not possible to add comments to a metadata field in UDO eventhough the field is specified as commentable.
[Android] Fixed an issue in the FlexMOBILE UI where the Copy option displayed from the File Information an asset was displayed in the wrong place and clicking it closed the application.
[iOS] Fixed an issue where incorrect bitrate in audio stream information and video stream information was displayed in FlexMAM on iOS emulator.
Fixed an issue where JEF TIMED_OUT jobs were being marked as Failed instead of as Cancelled. After the fix, timed out jobs are all marked as CANCELLED.
Fixed an issue where the Package Export action was failing because of the presence of variables with duplicate names in the config definition. The issue was solved by adding the prefix keyframe- to all child metadata variables to resolve clashes with other variables with same name.
'Follow' buttons should be hidden for Account and Sub-Account objects in Enterprise UI.
Fixed an issue where when parentUDOId is configured in a UDO browser wizard the child instances are not displayed.
HotFolder: Fixed an issue where the folderPath variable was wrongly set when the ingested asset name contained the same substring as the path name defined in the Storage Resource path.
Fixed behavior so that Jobs that run and complete after TIME_OUT and complete successfully in JEF, do not send a Job not found -xxx error to Flex Core.
Fixed an issue where performing Extract Technical Metadata for Image Sequence in root folder with an additional path threw an NPE. In job configuration, Package Root field has been renamed Image Sequence folder and its description has been updated.
Fixed an issue where released locks on jobs were not displayed in Grafana. The name of the relevant graph was changed to Locks released when job status is Failed or Cancelled or Completed.
[Mobile BFF] Fixed an issue where an Internal server error was thrown when retrieving fileInformation.
Fixed an issue where JEF actions were overwriting all existing workflow variables.
Event handler service: Add custom map merge handler for when account properties that duplicate system properties are retrieved. Improve the error message generated.
Fixed an issue where Login App is not setting the flex.request.id field properly.
Added missing EXTRACTED events to the `ExtractKeyframeResponseHandler`, `ExtractTiledKeyframeResponseHandler`, and `ExtractTechnicalMetadataResponseHandler` response handlers.
Upgrade log statements in Flex Stream Processor.
[Login App]: Fixed an issue where the wrong type of code text input field was used for typing in the MFA authentication code.
Fixed an issue when the copy action on an MXF file was failing when this was set: ColorTransferCharacteristics.getName(\"UNKNOWN\").
Collections: A COLLECTION_ITEMS_REMOVED event should be generated when automatically deleting Collection items as a result of assets being purged from Flex. This ensures that the same number of items are displayed in collections in FlexMAM and in Enterprise.
Fixed an issue where it was not possible to save a metadata annotation with a date field.
Fixed an issue where creating a proxy with dash-dar-passthrough profile fails.
Fixed an issue where Collection Deleted events erroneously appear in event type dropdown for event handler configuration. Issue fixed by hiding these events.
Fixed an issue where a system error was displayed when trying to view the event details for metadata modified event type.
Authorisation Service updated to perform pagination when requesting data (e.g. groups) from Enterprise or FastObject APIs
Fixed an issue in the GraphQL schema regarding unrecognized fields for type “double”.
Fixed an issue where extract audio waveform FSP jobs were getting stuck because of an endless loop in the ffmpeg http connection caused because timeout is not applied.
Allowed the disabling of server-side prepared statements for Spring microservices via Consul KV (default: enabled).
Fixed an issue with audio stream mapping issues when performing chunked transcode to package formats.
Fixed an issue with the Facebook Publish action where the title and description of an asset were not published as these parameters were not passed in the final Facebook publish call.
Fixed an issue where Get collections type parameter endpoint is case-sensitive instead of being case insensitive.
Fixed an issue in Vantage/AmberFin : Extract technical metadata is failing when asset is in root directory but the action Job status is marked as complete.
Fixed an issue with AmberFin jobs where the job failed as the action did not extract the subpath from the action if the AmberFin S3 Storage Resource was configured on the root level.
Fixed an error in reset password so that a valid error message is displayed when New password and Confirm password is different: `The password provided does not match with the confirmation password.
Fixed an “Invalid Parameter Data” issue by enabling support for <video> tags in the API Parameter Validation List.
Fixed an issue with Audio stream sync when performing chunked transcodes. A new default chunk mode, MIXED, has been introduced.
Fixed an issue where users could not update metadata if it contained object variables with a combination of workspace-supported and workspace-not-supported objects.
Fixed an issue in Event handler service where metadata expressions do not work for collection events. Issue fixed by allowing metadata expressions in event filters for object types where `contentMetadataSupported` is to true.
Fixed an issue with associated variable naming in Launch jobs.
Fixed an issue where metadata MERGE_STARTED events log the same ID for both "Old Metadata Definition Id" and "New Metadata Definition Id" in eventData
Fixed an issue with a JEF Timed Action script by normalizing JSon (e.g removing isExpression in the process).
Due to an issue where transcode jobs display this error Video codec pixelFormat must be specified for stitch and sequence jobs a pixelFormat field has been added to Flex Media Transcode Profile configuration.
Fixed an issue with the IndexElastic which originated from the Tag service.
Fixed an issue where deleted annotations (usually in bulk delete) would sometimes leave orphaned entries in Elasticsearch.
Fixed an issue where users were unable to search assets using drill-down metadata fields using Enterprise REST API.
Fixed an issue with the JEF Move action on Spanned media objects where the condition to check if the asset is spanned media or a package prevented the filename from being set, causing consequential issues.
Fixed a casting issue in the Elemental transcoding integration.
Fixed an issue where filtering assets in a workspace displayed different results when using a search filter and when selecting a workspace in the Left hand asset navigation panel.
Fixed an issue where the Custom review status in the Finish Review dialog are returned in a random and inconsistent order. After the fix, they always appear in the same position.
Fixed an issue with acceptance of JAR file names in JEF scripting actions by relaxing naming validation.
Fixed an issue with the Flex Tag REST service where a missing check for Edit permissions resulted in unauthorized users assigning tags to Flex objects.
Fixed an issue where the failure of cancelling a single workflow prevented the cancellation of all other workflows being cancelled in bulk.
Fixed an issue where it was not possible to extract Keyframe from FlexMAM.
Fixed an issue where timecode markers had different values in the timeline marker panel and in the Markers view in the summary panel. Issue caused because FormatContext in indexelastic is missing the `preferredStartTimecode` field, impacting how timecodes are rendered in the Markers view of FlexMAM.
Fixed an issue where assets are moved to UNMANAGED when its associated Storage Resource is disabled.
Improve Error Handling for VFS Package Export Command.
Fixed an issue where a JEF SDK metadata command caused the time field to update with incorrect times as the different time zone was not respected.
Fixed an issue where a Null pointer exception is thrown whenconverting searched udo to json.
Fix discrepancy between fetching and setting of metadata date formats. Fixed by updating the `fromJson` method to accept which ever date format is specified in the metadata definition.
Reverted the changes that Fixed an issue with setting visibility on accounts. Updated behavior is that visibilty can be added and removed to groups, accounts and sub-accounts. No visibility is set by default and there are no restrictions on adding visibility.
Fixed an issue where unknown asset type is considered as a Media Asset instead of falling back to import action configuration.
Fixed an issue where the Jobs summary panel displayed wrong values.
ACL shared asset don't show up in FQL output.
Resolved an issue where it was not possible to migrate Actions with passwords in Flex CM because of issues with password encryption.
Tar creation failing for few files.
Fixed an issue where extract technical metadata fails on opatom mxf file
Fixed an issue where incorrect Technical Metadata was extracted due to an incorrect version of MediaInfo in Flex Stream Processor.
Solved an issue where image transcode plugin fails to re-import child proxy because it is in a different resource. Issue solved by making Output storage selection mandatory in the action configuration.
Fixed an issue where proxy preview only shows thumbnail for media with frame rate 25 fps.
Fixed an issue where extract waveform fails for massive files (>100GB).
Fixed an issue where Flex SP failed to trim a 16 track proxy for Sequence Editor preview.
Fixed an issue where sequence transcode with presets complains that audioStreamTemplate is not present even though it is.
Provided a workaround for an issue where an Import action was not working with an unmanaged VFS location.
Enhancements FlexMAM
FlexREVIEW - List View
FlexREVIEW - Media asset review
More than 25 collections in FlexMAM - activate collection
FlexREVIEW - Images
Manage Image – image functionality aligned with legacy functionality (Pan, Scale, Annotations). Add a circular annotation and improve annotation deletion management.
Finish Review Session implemented for: No review status, Single select status, Multi select status including metadata.
Improved API call behavior when users use the playhead to move across the timeline. API debouncing was implemented to ensure only necessary calls are fired.
Added the ability to show audio waveform for media with a single audio stream.
FQL: Change made in the behavior for the search filter conditions: IS/IS NOT. If the IS/IS NOT condition is used in the filter, if there is a space in the query, the string is not split into separate tokens in FQL, for example fql = > name=“hello world” instead of fql = > name=hello name=world.
Remove Spanned Media type from column filter options. Selecting Video type displays video assets, segmented assets and spanned media assets.
Add does not contain to the search chip operators.
Pagination control – Display, Set number of items, Navigate between pages
Align manage video with FlexREVIEW manage.
Make task list sort and filter on the server side to display tasks correctly in Flex MAM Task panel. NOTE: Refresh FlexMAM manually to see new Tasks in the Task panel.
Update FlexMAM default help URL to reference the new Knowledge Base.
Fixed Issues FlexMAM
Fixed an issue where the membership name was not displayed in the Relationship
table.
Fixed an issue where `?` on a French AZERTY keyboard on Windows did not
open the keyboard shortcut screen for [?]. Shift + < updated
to shortcut for Previous 10 minutes and Shift + > updated to Next
10 Minutes.
FlexMAM: Fixed an issue where Player UI is not good when a user takes
a second task from the available task list.
FlexREVIEW: Fixed an issue where playable assets were not previewing
and the `No preview available message` was displayed.
Fixed an issue where Column filter for technical metadata was not working
correctly. Filter values updated to match the technical metadata values.
Fixed an issue where selecting a standalone wizard does not open the
dialog window with the panel to trigger the wizard.
Fixed an issue where it was not possible to see the Collection Type field
when creating a collection from Clip Bin. The type field has been added
in the Save ClipBin as dialog. It is also possible to edit the Type of
a Collection from its Details tab in the Summary panel.
Fixed an issue in FlexMAM GUI where Thesaurus suggestions at the bottom
of the screen are cut and displayed incorrectly.
Fixed an issue where the Language metadata was not displayed in technical
metadata tab in FlexMAM even though it was displayed in Core and can
be retrieved via API. Flex now supports 3 letter language code mappings
in addition to 2 letter language code mappings.
Fixed and issue in the Run Action execution page where clicking Run now
remained on Saving and the action was not executed.
Fixed an intermittent where the user profile avatar is not displayed after a user clicks on it.
Fixed an issue where it was setting or updated a user role failed. From
the Details page in User Management, disable the user and then update
the role from Role dropdown list.
Fixed Issues in FlexMAM Japanese translation.
FlexMAM: Fixed an issue where the Clear sequence popup window was not
displayed correctly.
Fixed an issue where the vertical and horizontal scroll bar on the sequence
page overlap on the pagination area.
Fixed an issue where while saving a created sequence the "save as sequence" popup window the loader icon is displayed, and the save does not seem to complete successfully even though it has.
Fixed an issue where Open details in the Keyframe tab in FlexMAM
is not is not working as expected.
Add entity info to the elastic search model for suggestions so that the
correct icon is displayed next to assets displayed in the Suggested Assets
list.
FlexMAM: Fixed an issue where image assets are not loading properly in
the Search Results listing page and in the Manage page.
FlexMAM: Fixed an issue where the Collection page was not displayed properly
in the UI and the pagination area was not fully visible.
Fixed an issue where the Reviewer icon in the App switcher pointed to
the legacy reviewer app.
FlexMAM: Fixed an issue here "Share with people and groups" does not
work for groups.
Fixed an issue where when starting a wizard on a clip or marker time
range, the IN time would be set to 00:00:00:00 instead of the correct
In time.
Fixed an issue with the Jump 10 Minute Forward command in the Player, where if the remaining media duration was shorter than 10 minutes, the playhead would not jump to the end of the timeline, as expected.
Fixed an issue where no duration was displayed for Spanned media assets in the search result.
Fixed an issue where the Export search results of current page to CSV
was not working correctly the first page of results was always exported.
Issue fixed by ensuring that the current page number is retrieved dynamically.
FlexMAM: Add timezone support to the history tab.
Fixed an issue where the asset type variant did not correctly redirect
to an asset.
FlexMAM: Fixed an issue where the subtitle switcher is not displayed.
Fixed an issue where a Workspace shared members tab was stuck on loading due to an issue with the sortBy parameter.
Fixed an issue where many Japanese translations were missing in the Search
Results listing and Manage page.
Fixed an issue where it was not possible to create a UDO instance using
the FlexMAM Create UDO icon.
Fixed an issue where when editing an existing marker, the metadata instance
was not retrieved.
Clip preview - player offset to clip in time.
Fixed an issue where save/retrieve metadata field of type object in a
multicardinality complex failed.
Fixed an issue where audio streams of video are played in wrong order
on MPEG-Dash proxy.
List of Services upgraded between 2023.4.0 and 2023.6.0 (LTS)
For the new 2023.6.0 release, most services have changed.
Comments
0 comments
Please sign in to leave a comment.