Dalet Flex 2022.12.X (LTS) Release Notes

Dalet is excited to present the release of Dalet Flex 2022.12.0 (LTS)

This release of Dalet Flex provides the new features, quality and security enhancements, bug fixes, and other changes listed below.

Flex 2022.12.0 is an LTS (Long Term Supported) release track and will receive both critical bug fix updates and security updates until it reaches end-of-life.

Dalet Flex

New Features

Updates to the Dalet Flex Configuration Manager (flex-cm) (new from 2022.12.4)

From this version of 2022.12.x, customers will be able to use flex-cm in specific scenarios to migrate configuration between Flex environments.

flex-cm can be used to pull configurations from one environment, the source, store in flex-cm file repository and deploy those configurations on a new target environment. Configuration management in Flex could lead to complex dependency graphs, relations between configurations (e.g. Actions, Resources...) and user/account references. Also, different environments might need different configuration setups, (for example, a different Storage Resource can be referenced via Tags instead of a direct setting in configuration params). flex-cm can help you to manage the promotion of configurations but users need to understand and control the specific relation among configurations.

Recent updates on this release for flex-cm are:

• Improved flexibility on configuration dependency on flex-cm commit (e.g. Account Storage, Storage Resource, Actions and their dependent configuration objects)
• Improved messages
• Support of Tag Collections

AmberFin plugin supports importing files from a subpath (new from 2022.12.1)

The Launch Job Amberfin plugin now supports importing files with subpath from the AmberFin output result. AmberFin output files with a subpath under the basepath as configured in the Output Storage Resource field in the plugin will be imported in Dalet Flex as Managed asset. This is supported both for S3 and FILE protocol.

Move Workspace supports UDOs (new from 2022.12.1)

The Move Workspace plugin now supports UDOs in addition to assets.

Allow MariaDB port to be configured

Flex can now connect to MariaDB on a configurable port (default: 3306). All Flex services have been updated to work with the new port configuration.  Port configuration is set using a Consul KV that is set by Ansible at install time.

Decouple start timecode from timeline objects – further developments 

Flex Timeline Annotations (FlexMAM and FlexREVIEW comments, and markers) timecodes in/out are managed (persisted, read/write from API) as relative values to the startTime, specifically to the preferredStartTimecode. Before 2022.12.0, Timeline Annotations (Comments, Metadata) were absolute timecode values. This means that startTimecode value was “baked in” to the timecode in/out values.

Flex can read/write previous absolute timecode values, for those assets/annotations created before this release, as well as read/write new relative values for the new assets/annotations created from this release onward. Notice there is no migration in place as Flex can deal with pre/post asset/timeline versions transparently. If you manage timeline annotations from the Groovy SDK or the B2B REST API then you should contact your Dalet technical representative as these scripts will require updating to support relative timecodes.

New state added to Flex Job Cycle (Submitted)

A new state has been added to Flex Job life cycle: SUBMITTED. Jobs running in JEF will set the job as SUBMITTED when the plugin delegates the execution to other processors (e.g. Flex Stream Processor, Flex File Processor) or to external services (e.g. Vantage, Amberfin Launch plugins) that have been updated to support the new SUBMITTED state. When the job in SUBMITTED state starts processing on the delegated service, the job will move to RUNNING and the progress will start updating as usual. The SUBMITTED to RUNNING transition can happen immediately after delegation or it might take some time, depending on the processor queue. This flag provides an immediate and quick view of the job specific execution phase. The new state is supported for Enterprise and JEF actions.

Create Proxy and Transcode actions now accept expressions in JSON format in FSP profiles 

Recently the Create Proxy and Transcode actions were enhanced to accept FSP profiles as JSON. From this release, the Flex Transcode Media Profile now accepts expressions in JSON format in the "Flex Stream Processor Profile (JSON)" field. This provides the ability to script a dynamic Flex Media Transcode Profile, which can cover a range of jobs using the same expression.

Multi-factor authentication for internal Dalet Flex users

Multi-factor authentication (MFA) has been implemented for authentication of internal users and can be enabled from the login page. MFA can be enforced at the account level.

Dalet FlexMAM

New Features

Support setting account preferences for format of video duration in FlexADMIN

Option added in FlexADMIN > Application Settings > Global Settings to set the preferred display format for video durations: frames or milliseconds (default setting). The duration format is applied in: 

• Asset table view 
• Tile view 
• Asset technical metadata tab 

Quick action to remove clips from Collections/Clip Bin

When bulk assets are selected in a Collection/Clip Bin, a quick action box to remove the clips from the current Collection/Clip Bin is displayed. When the Sequence window is open and bulk assets are selected, an option to remove the selected items from the Collection is available in the menu. Some additional small improvements were made to the Quick Actions UI.

Changelog

2022.12.7

Enhancements DaletFlex

• Added validations to ensure that assets ingested incorrectly to the wrong storage location do not to cause all assets in the folder to be removed on Purge.
• Added PixelFormat and thus bit per sample as listed enum field strings.
• Gave a common prefix to all name identifiers of entries in the `apps` section of Permissions, add FlexXTEND.
• Amberfin: Added a control polling cadence for Amberfin launch actions in JEF configuration. To improve performance, default polling value is 10s.
• Added validation in the Purge plugin to fail a purge job if it tries to delete any directory which is configured as a storage resource root location.
• When using the feature toggle `flex/shared/flex-enterprise/featureToggles/queueJobOnCreation`, set execution token when job is directly set to queued at the time of creation.
• Added Consul KV `flex/enterprise/workflow/ignoreTimedOutState`. When set to true the status of a workflow is displayed as Running and not move to Timed Out even if jobs associated to the workflow are moved to Timed Out. Default value is true; and validated the Consul KVflex/enterprise/workflow/enableSyncJobLimitCheck for Enterprise jobs that have flex-enterprise/featureToggles/queueJobOnCreation = true and flex/enterprise/scheduler/job/maxSyncJobsInProgress >1.
• Updated Consul KV: `flex/shared/flex-enterprise/featureToggles/queueJobOnCreation` set to true by default.

Fixed Issues FlexMAM

• Fixed an issue so that DateTime Fields (Start Date, End Date, Start Time, End Time and Created Date in metadata and marker display template use the timezone setting for the user.
• Segmented Asset – Fuxed an issue where asset preloading is not working in Video manage page when kv "playerEnablePreloading" is set to true.
• Fixed an issue where Subtitle Switcher icon is not visible in both Manage page and Summary page of the asset in FlexMAM and FlexREVIEW.
• Flex REVIEW: Fixed an issue where the current selected asset shows the timecode of the previously selected asset in summary page of FlexREVIEW.
• Fixed an issue with the Operational Dashboard where the asset names were displayed as Undefined.
• Fixed an issue where the "Add to Collection" and "Edit Metadata" option under Quick Actions for bulk assets are not working correctly.

List of Services upgraded between 2022.12.6 and 2022.12.7 

2022.12.6

Enhancements DaletFlex

• Removed INFO logs to reduce noise and added HotFolder metrics and respective grafana dashboards. New metrics: Workflow Requested per Hour; Currrent Scanned Files; Current Internally Processed as Candiate Files; Total Discovered Files; Total Updated Files; Current Deleted Files; Time Taken from Scan to Processed Candidate Files; Total Waiting for Activity TimeOut or Throttled before Launching; Total Launched Workflows; Total Workflows Requested Fail; Total Launched Workflow messages waiting to be consumed by Enterprise; Flex Enterprise API Calls; and Log Events.
• Added a gauge for running jobs and a respective view and the Grafana Job dashboard.
• Fixed an issue where the Fractional framerate (29.97f|59.94f) failed to add the dropFrameMultiplier when the framerateValue was not exact (29.97f|59.94f), leading to the wrong TC-millisec calculations
• Disabled ETM update for asset version lower then 4 and has asset having annotations by default. To force ETM update set {{flex-enterprise.featureToggles.allowTechnicalMetadataChanges}} to true.
• Removed the workflow age from scheduling computation of the Job Scheduler to achieve a steady number of jobs on the job queue when there are many PENDING jobs.
• Additional improvements to Job Scheduler to exclude jobs for which job quota for action configuration has been exceeded. Excluded jobs main in a Pending state.
• Added support to signal workflow manually if it stuck and not moving to next node using new API endpoint.

Fixed Issues DaletFlex

• Fixed an issue where the metadata instance type ahead UI is broken for fields with multiplicity supported variables.
• Fixed an issue so the concurrent workflow limit is removed from Redis when the limit is removed from Workflow Definition.
• Fixed an issue with the WorkflowScheduler where moving workflows from pending to running resulted in error. Updated job scheduler NOT to check workflow quota but move eligible jobs to RUNNING if the respective workflow is in running state. Updated workflow scheduler to set the workflow back to PENDING state if there is an error to help avoid workflows with an inconsistent state, as a running workflow with no job.
• Fixed an issue where Event Handler service does not paginate through the Enterprise /api/users/<userId>/accessibleWorkspaces API, so if the user is a member of >100 workspaces, then permission may denied incorrectly. Issue fixed by increasing the default limit of available workspaces to 1000.
• Fixed an issue where Workflows could get stuck in Pending status due to an issue with checking the workflow limit when a workflow was launched from a Hot Folder.
• Fixed an issue where Workflows with timed-out jobs which were eventually completed did not change their status from Timed out back to Running
• Fixed an issue where metadata in Cast / Director / Writer fields is not loading / is nor displayed in Flex Core for new Season UDO.
• Added missing fields in the format and video stream information for R3D file: Format: Bitrate; Video Stream: Codec, Width, Height, Display Aspect Ratio, Pixel Aspect Ratio.
• Set the event correlation_id to the job Id for Event type PUBLISHED to fully enable usage tracking.

Enhancements FlexMAM

• Player now supports playing assets regardless of the file name extension case (lower or upper).

Fixed Issues FlexMAM

• Fixed an issue where metadata value is not displayed for Timecode Field and key value fields in FlexMAM although it is displayed in Flex Core.

• FMP Reviewer: Fixed these issues with the display of audio tracks and player speed in FlexReview: Audio tracks and player speed were hidden in full screen mode and audio tracks and player speed were listed below the player when clicking audio switcher icon instead of above.

• Fixed an issue so default values are not displayed while doing bulk edit metadata and all values are updated correctly.

• Fixed an issue so clips are added to timeline in Sequence page based on the selected frame rate.

List of Services upgraded between 2022.12.5 and 2022.12.6

2022.12.5

Enhancements DaletFlex

• Added the configurable option for Amberfin jobs to succeed the JEF job in case of Amberfin job failure.

• Fixed an issue with the marker timecodes not respecting the correct start timecode

• Resilience: Executor not progressing - stops trying to re-QUEUE, deleteExecutionStepDataWhenTerminated, retry on missing and/or executionStepData Redis records, explore FAILED housekeeping, default Cancelled Jobs

• For the Adobe Premiere Pro integration, added support for Sequences with audio only

• Removed the Key field from the JSON when creating metadata instances via the metadata service

• Metadata Service migration is non-performant on clustered environments with large datasets

• The Image Transcode plugin now to uses the configured resource

• Added flag to disable the return of purged proxies by the API by default. By default, the flag “deleted=false” will only return active proxies; “deleted=true” will return only purged and deleted proxies; and “deleted=all” will return all the proxies, deleted and active (the old behavior of backward compatibility.

Fixed Issues DaletFlex

• Fixed an issue with the Workspace plugin backward compatibility

• Fixed an issue with AS02 assets where the stream count value was not correctly displayed in the format context field under Technical Metadata.

• Fixed an issue where custom markers post upgrade received an absolute timecode, but new markers are created with relative timecode.

• Fixed an issue where the Metadata Service added the "key" value in the metadata Json even when the "withKey" parameter was set to false. Fixed by using the value specified by the user in REST call instead of the “withKey” parameter.

• Following the addition of KV disableConnectionReuseForEnterpriseRestCalls, Updated KV disableConnectionRevisionForEnterpriseRestCalls with disableConnectionReuseForEnterpriseRestCalls and set to false by default.

• Fixed an issue with Invalid timecode in the post response (not using KV decoupleStartTimecode to pair with GET response).

• Job Async Executor: Spring Scheduling thread is getting blocked, causing '401 Unauthorized' errors for scripts which use Enterprise APIs. Fixed by setting the Consul KV to increase the number of threads available to Spring @Scheduled methods from the default (of 1) to 3.

• Fixed an issue in the Job Async Executor where numerous "Invalid cookie header" warnings were listed. Fixed by switching to a standard cookie spec.

• Changed the JAE executionStep thread pool (size 1) as the default pool for executing different schedulers of the plugin and JAE core. This change created a common/default thread pool size based on the number of available @schedule methods. Also added KV (flex/flex-jobasyncexecutor-service/job/bufferThreadSize) to add a buffer thread only if needed, default 0.

• Fixed an issue where the Job listing api failed data conversions if the Timedout Job was available in the system.

• Fixed an issue with the Login App where SAML authentication stopped working. Fixed by setting the decryption private key to decrypt any encrypted assertions received in SAML response.

• Fixed an issue where an Import action failed in web transfer using same paths for different buckets. Fixed by modifying the VFS location/bucket details based on the provider.

• Fixed an issue where it was impossible to unlock locked user accounts from Enterprise, because the query was returning duplicate user records when the logged in user was a member of a group. Fixed by updating the query to return distinct results.

• Fixed an issue where metadata values with the single quotation mark character did not appear in FMP.

• Fixed an issue with JEF where a RedisTimeoutException: Unable to acquire subscription lock after 9500ms error appeared.
• Fixed an issue where an error appeared after generating an Adobe Premiere sequence from a collection with only an audio asset. As Premiere requires a frame rate, even for Audio only, the issue was fixed by providing a default frame rate for those clips in the export xml.
• Fixed an issue where users were unable to create a timed action using Execute Action on the Metadata Condition Plugin.

• Fixed a global header issue were updating a metadata field using a task as part of a workflow failed.

• Fixed an issue where Enterprise API returns an invalid framerate for IMP Asset proxy.

Fixed Issues FlexMAM

• Fixed an issue with default values when bulk editing metadata.

• Fixed an issue where the Date filter would become unusable if a taxonomy filter was selected.

• Fixed an issue where preloading was disabled for AS02 and package assets.

• Fixed an issue where the Progressive Interlace format was not listed in the technical search filter and search does not return results due to a naming error.

• Fixed an issue where the time range for a marker annotation in the Listing page did not match the time range in custom marker tab due to an absolute/relative TC issue.

• Fixed an issue with default values when bulk editing metadata.

• Fixed an issue where save/retrieve metadata field of type object in a multicardinality complex failed.

List of Services upgraded between 2022.12.4 and 2022.12.5 

2022.12.4

Enhancements DaletFlex

• Allow LDAP user lookup to match on email address, as an alternative to username to support LDAP login with the same user if IdP login is not available.
• Add support for drill-down metadata fields to run rules using the syntax #{"@@new-drill-down-option-field@@"!=("???")}
• Add SDK method to return disabled taxons.
• Add ability to associate variantId without metadataDefinitionEntityId to a collection.
• Set default pixel format for MPEG2 video to be YUV422.
• Updated the definition structure for the xdcam preset so that sequences using the xdcam preset do not fail.
• Add source stream count check to conform job validation
• Disabled MP3 source file output truncation detection as the source duration is estimated from the file size.
• Provided a Consul KV, flex/flex-streamprocessor-service/enableLegacyImageOverlayLocation, to enable the legacy image overlay which bases location on the source instead of target frame size. As this is an unwanted behavior, only use this where reconfiguring image overlays is impossible.
• Support Consul KV /flex/flex-jobasyncexecutor-acceptance-tests/featureToggles/disableConnectionReuseForSdkEnterpriseRestCalls to improve performance of scripts. Default value is false.

Fixed Issues DaletFlex

• Fixed an issue where Flex Master was unable to connect to Redis following outage. Redis connectivity is now included as part of the readiness check. Readiness and Liveness check added to Job Scheduler. If Readiness and/or Liveness check fails then Job Scheduler will not process new jobs until both these checks Okay.
• Fixed an issue in the Hazelcast connectivity check where flex-master and flex-job services were unable to reconnect to Hazelcast following outage without doing a restart.
• Add retry on Search operations if Elasticsearch returns a 429 error and return 429 if retry still fails instead of immediately failing the search.
• Fixed an issue where it was not possible to clear (set to null) non-editable metadata fields via a script.
• Fixed an issue with audio stream mapping issues when performing chunked transcode to package formats.
• Fixed an error in reset password so that a valid error message is displayed when New password and Confirm password is different: `The password provided does not match with the confirmation password.
• Fixed an issue with Audio stream sync when performing chunked transcodes. A new default chunk mode, MIXED, has been introduced.
• Fixed an issue where actions were failing by skipping setting WorkflowContextVariables (jobContextVariables?) with null options.
• Fixed an issue where filtering assets in a workspace displayed different results when using a search filter and when selecting a workspace in the Left hand asset navigation panel.
• Fixed an issue where resources ignored the group visibility when the owner account visibility was added by default. Issue resolved by not adding visibility for the owner account by default.
• Fixed an issue where the failure of cancelling a single workflow prevented the cancellation of all other workflows being cancelled in bulk.
•  Fixed an issue where an Null pointer exception was throw when performing a composition proxy on a CPL Asset.
• Fixed an issue where assets are moved to UNMANAGED when its associated Storage Resource is disabled + BACKPORT.
• Fixed an issue where a Null pointer exception is thrown when converting searched udo to json.
• Fixed an issue where Metadata entity mappings are not generated by default when Metadata Service starts.
• Improve Metadata Service resilience to data loss in the metadata entity mapping.
• Fixed an issue where Enterprise delegating to SearchElastic erroneously sets the workspaceId when none has been specified causing ACL shared assets not to be shared in FQL output.
• Fixed issue in Enterprise API where time fields return UTC when includeMetadata parameter is included.
• Fixed an issue where unknown asset type is considered as a Media Asset instead of falling back to import action configuration.
• Fixed an issue where old instances of UDOs are no longer editable and throw an error in Flex CORE UI if their UDOT has been updated after they were created and subsequently had a metadata definition assigned to it. Issue fixed by assigning a default metadata instance to the old UDOs when they are loaded instead of throwing an error.
• Fixed a file size caching issue where package assets did not have unique names for media files. Fixed by based cache on the full path.
• Fixed an issue where system metadata was updated on a restart of JAE and possibly causing a reindex, for no apparent reason. Issue fixed by synching the revision numbers of system metadata definitions in Json files with those generated by Enterprise.
• Fixed an issue where AS02 proxy creation was failing for a because of a non-integer sample aspect ratio for specific J2K in MXF files.
• Fixed an issue where extract keyframes failed if the target folder resource is a root folder that does not have a path defined for it. Issue fixed by adding logic to ensure makePath is not called for an undefined path if the path is the root path.
• Fixed the efficiency for extracting keyfames on long files depending on whether keyframes are extracted at small or large time intervals.
• Pre-signed URLs are not recreated when concurrently executing spawned processes.
• Fixed an issue in FlexMAM where a user only sees tasks in the default workspace. Issue fixed by searching all workspaces available to the user for the specified object type.
• Added a retry loop before failing Fex Stream Processor jobs to improve issue where transcode jobs were hanging.
• Fixed an issue where PSD & AI wrongly inferred as media asset in import action.
• Fixed an issue where JEF Script actions and Move (JEF) actions were failing with this error Could not initialize class com.amazonaws.services.s3.S3CredentialsProviderChain.

Enhancements FlexMAM

• Add the ts format to the uploader.
• Pagination control – Display, Set number of items, Navigate between pages

Fixed Issues FlexMAM

• Fixed an issue where automatic logout was not forced after specified inacticvity interval had been reached.
• Fixed an issue where search filtering on Technical Metadata for Interlace Format is Top Field First/Bottom Field First was not returning the correct results.
• Fixed an issue where Timecode value were not persisted properly when saving asset metadata and incorrect values were saved.
• Fixed an issue where FlexMAM suggests search results when the query is empty.
• Fixed an issue where reloading FlexMAM lost the focus on the selected UDO asset.
• Fixed an issue where user is unable to set a new variant for a collection from the Details tab. The Save button remains disabled.
• Fixed an issue where child taxon fields are not displaying the correct label in FlexMAM.

List of Services upgraded between 2022.12.3 and 2022.12.4 

2022.12.3

Enhancements DaletFlex

• [Experimental Option] Configurable MultipartCopyPartSize/MultipartMinimumUploadPartSize: VFSPackageExportCommand Enterprise.
• Fixed Issues DaletFlex
• Fixed an issue in the GraphQL schema regarding unrecognized fields for type “double”.
• Fixed an issue with the Facebook Publish action where the title and description of an asset were not published as these parameters were not passed in the final Facebook publish call.
• Fixed an issue with AmberFin jobs where the job failed as the action did not extract the subpath from the action if the AmberFin S3 Storage Resource was configured on the root level.
• Fixed an issue with a JEF Timed Action script by normalizing JSon (e.g removing isExpression in the process).
• Fixed an issue with the IndexElastic which originated from the Tag service.
• Fixed an issue where users were unable to search assets using drill-down metadata fields using Enterprise REST API.
• Fixed an issue with the JEF Move action on Spanned media objects where the condition to check if the asset is spanned media or a package prevented the filename from being set, causing consequential issues.
• Fixed a casting issue in the Elemental transcoding integration.
• Fixed an issue with acceptance of JAR file names in JEF scripting actions by relaxing naming validation.
• Fixed an issue with the Flex Tag REST service where a missing check for Edit permissions resulted in unauthorized users assigning tags to Flex objects. 
• Fixed an issue where timecode markers had different values in the timeline marker panel and in the Markers view in the summary panel due to missing fields in the index.
• Fixed an issue where a JEF SDK metadata command caused the time field to update with incorrect times as the different time zone was not respected.

Enhancements FlexMAM

• Added the ability to show audio waveform for media with a single audio stream.

Fixed Issues FlexMAM

• Fixed an issue with the Jump 10 Minute Forward command in the Player, where if the remaining media duration was shorter than 10 minutes, the playhead would not jump to the end of the timeline, as expected.
• Fixed an issue in the Flex Admin app, where the duration format set under Application Settings > Global Settings was not applied to the Duration metadata fields.
• Fixed an issue where no duration was displayed for Spanned media assets in the search result.

List of Services upgraded between 2022.12.2 and 2022.12.3  

2022.12.2

Enhancements DaletFlex

• Added Recognition of XAVC video standard with the following technical metadata video standards (different variations of the definition apply based on the video resolution): XAVC HD Intra, XAVC HD, XAVC 4k Intra, XAVC 4K
•  A new Format Variant technical metadata field is be populated with: QuickTime, MP4 v2, MP4 v1, ISO Base Media, BRAW, Quicktime (old)
• JEF Plugin timeout resilience: Multiple tickets implemented to improve JEF performance for jobs running in ExecutionStep or Executor state and timing out.
• Added new allowed file types to uploader: .m2t, .mpeg, .m4a
• Add support to fetch Job and Workflow dashboard summary counts from SQL (by default) in Data Aggregation. Use a feature toggle Consul KV flex/flex-dataaggregation-service/aggregationDataSource to fallback to REDIS.
• Added Consul KV, flex-enterprise/featureToggles/returnOriginalKeyframeImage, to support downloading original keyframe images instead of converting the images to a .png file before download.

Fixed Issues DaletFlex

• Fixed an issue in Web Uploader where the checkbox status was not displayed correctly in a metadata form. This issue is due to the color of the default theme. 
• Fixed an issue where the Package Export action was failing because of the presence of variables with duplicate names in the config definition. The issue was solved by adding the prefix keyframe- to all child metadata variables to resolve clashes with other variables with same name
• Fixed an issue where the Enterprise UDO endpoint returns objects not of the specified type when sending a query with a list of object IDs as opposed to when sending a single ID which respected the Object type.
• SearchElastic: Fixed an issue where GraphQLSuggestions API was displaying this error Expected type 'Int' but was 'Long' by correctly mapping Elasticsearch mapping fields having long data type with Long type in GraphQL schema fields.
• Fixed an issue where actions requiring authentication were failing because the variable instance stored in the action configurations did not match the variable name stored in the secret service.
• Fixed an issue where JEF actions were overwriting all existing workflow variables.
• Upgrade log statements in Flex Stream Processor.
• [Login App]: Fixed an issue where the wrong type of code text input field was used for typing in the MFA authentication code.
• Collections: A COLLECTION_ITEMS_REMOVED event should be generated when automatically deleting Collection items as a result of assets being purged from Flex. This ensures that the same number of items are displayed in collections in FlexMAM and in Enterprise.
• Fixed an issue where it was not possible to save a metadata annotation with a date field.
• Authorisation Service updated to perform pagination when requesting data (e.g. groups) from Enterprise or FastObject APIs.
• Fixed an issue where extract audio waveform FSP jobs were getting stuck because of an endless loop in the ffmpeg http connection caused because timeout is not applied.
• Allowed the disabling of server-side prepared statements for Spring microservices via Consul KV (default: enabled).
• Allowed the disabling of server-side prepared statements for Enterprise via Consul KV (default: enabled).
• Fixed an “Invalid Parameter Data” issue by enabling support for <video> tags in the API Parameter Validation List.
• Fixed an XSS injection vulnerability.
• Fixed an issue where users could not update metadata if it contained object variables with a combination of workspace-supported and workspace-not-supported objects.
• Fixed an issue with associated variable naming in Launch jobs.
• Fixed an issue where deleted annotations (usually in bulk delete) would sometimes leave orphaned entries in Elasticsearch.
• Fixed an issue where the Jobs summary panel displayed wrong values.
• Fixed an issue where taxonomy fields did not show in Flex Move.
• Fixed an issue where the authentication details were found invalid when trying to get an asset by id, although the operation was done by an admin user who is part of the workspace.
• Fixed an issue where the variable context.job.workflow.name was null, fixed by using the displayName property instead.

Enhancements FlexMAM

• Clip duration in ClipBin in FlexMAM respects the Video Duration Format set in FlexADMIN> Application Management > Global Settings.
• Improved API call behavior when users use the playhead to move across the timeline. API debouncing was implemented to ensure only necessary calls are fired.
• FQL: Change made in the behavior for the search filter conditions: IS/IS NOT. If the IS/IS NOT condition is used in the filter, if there is a space in the query, the string is not split into separate tokens in FQL, for example fql = > name=“hello world” instead of fql = > name=hello name=world.

Fixed Issues FlexMAM

• Fixed an issue where it was not possible to see the Collection Type field when creating a collection from Clip Bin. The type field has been added in the Save ClipBin as dialog. It is also possible to edit the Type of a Collection from its Details tab in the Summary panel.
• Disabling the warning Your search has been limited to the first 10,000 results... is now saved across login sessions by saving the flag in the local storage instead of in the session.
• Fixed an issue where the Language metadata was not displayed in technical metadata tab in FlexMAM even though it was displayed in Core and can be retrieved via API. Flex now supports 3 letter language code mappings in addition to 2 letter language code mappings.
• Fixed an issue where the backslash character ('\') caused suggestions to fail in FlexMAM. Fixed by appending an additional backslash to escape the character.
• Fixed an issue where User Defined Object received incorrect icons.
• Fixed an issue where it was setting or updated a user role failed. From the Details page in User Management, disable the user and then update the role from Role dropdown list.
• Fixed an issue where an update to the ‘Expires On’ field of a user in User Management failed to save.
• Fixed Issues in FlexMAM Japanese translation.
• Fixed an issue where users were unable to view a Sequence preview in the sequence page.
• Add entity info to the elastic search model for suggestions so that the correct icon is displayed next to assets displayed in the Suggested Assets list.
• Fixed an issue where the Reviewer icon in the App switcher pointed to the legacy reviewer app.
• Fixed an issue where when starting a wizard on a clip or marker time range, the IN time would be set to 00:00:00:00 instead of the correct In time.
• Fixed an issue where the subtitle selection and the playback speed dropdown were not displayed properly when using the Player in full screen mode.
• Fixed an issue where the Export search results of current page to CSV was not working correctly the first page of results was always exported. Issue fixed by ensuring that the current page number is retrieved dynamically.
• Fixed an issue where the asset type variant did not correctly redirect to an asset.
• Fixed an issue where a Workspace shared members tab was stuck on loading due to an issue with the sortBy parameter.
• Fixed an issue where the Save button remain disabled even after changes were made toa Variant in a collection in the Details tab.
• Fixed an issue where the button and text of the Clear Sequence confirmation popup were not displayed correctly.
• Fixed an issue where while saving a created sequence the "save as sequence" popup window the loader icon is displayed, and the save does not seem to complete successfully even though it has.

List of Services upgraded between 2022.12.1 and 2022.12.2  

2022.12.1

Enhancements DaletFlex

• Video Codec support for DVVIDEO, H264 and H265 added to Dalet Flex. These codecs are extracted by the Extract Metadata plugin and displayed in the UI. 
• FastObject: Improve retrieving annotation metadata tag fields by caching tag names retrieved from Tag service.
• Added support for profiles to the Groovy SDK: createProfile, getProfile, getProfiles methods added.
• AmberFin - Change error message when output storage is not selected under AmberFin stencil and make the Output Storage mandatory when AmberFin stencil is added
• New Login App: Add IP Address in event data.

Fixed Issues DaletFlex

• Fixed an issue where UDO object metadata field does not respect workspaces. Switch Account & Workspace permissions must be disabled to support this fix, otherwise all UDOs in all workspaces are visible.
• Support renaming spanned media assets with multiple files.
• Fixed an issue where an `IllegalArgumentException` was thrown when doing a Composition Proxy and Publish (Asset Publish V2) action for an AS02 Version Asset.
• Fixed an issue where assets results were not returned in Enterprise API when createdFrom/createdTo criteria are set in the search query. Issue fixed by ensuring that these fields are considered when generating FQL for the query.
• Fixed an issue where the YouTube publish action stopped working. Issue fixed by upgrading the Google api client version and the YouTube api version so they are compatible. Also fixed an issue where YouTube was not working after the YouTube publish action failed because an incorrect token was generated.
• Fixed an issue where SDK calls were pausing between invocations and scripts were taking a long time to complete. To enable the fix set the Consul KV `/flex/flex-jobasyncexecutor-acceptance-tests/featureToggles/disableConnectionReuseForSdkEnterpriseRestCalls` to true.
• Fixed an issue where any update to a workflow definition reset the concurrent workflow limit to zero for that workflow definition.
• Fixed an issue where requests are rejected when account names contain dashes. Updated User Settings Service to use same special character rules for account names as Enterprise.
• Collection service: Collection UUID incorrectly used as account ID in collection updated events.
• Fixed an issue where UDO metadata is not indexed.
• Fixed an issue where for a Timed Action, the action is launched back to back and then timing out after some hours.
• Fixed an issue where there was a long queue wait time for Plugin jobs.

List of Services upgraded between 2022.12.0 and 2022.12.1  

2022.12.0

Enhancements DaletFlex

• Decouple start tc from timeline objects
• [FEATURE TOGGLE] The Consul KV directFspTimecodeMappingAndNewStartTimecodeDefinition used as a Feature Toggle has been removed. By default this value is true.
• [FEATURE TOGGLE] Support for Output AAF parse tmp file moved from the Consul KV value kv/flex/flex-jobasyncexecutor-service/useAafParseOutputFile to a configuration option in an Import Edit action.
• [FEATURE TOGGLE] Support for storage alias mapping moved from the Consul KV flex-enterprise.featureToggles.aliasMappingEnabled to a configuration option in a Storage resurce.
• Add bulk GET endpoint on collection service to retrieve information for multiple collections. Information collected by supporting adding an array of collection UUIDs separated by commas as a query parameter.
• Eliminated the I/O operation for asset PUT calls to improve reply time.
• Enabled expression support for relevant JEF plugin configuration parameters.
• Vantage: All input/output storage scenarios + improvements to messages for Vantage workflows reviewed and validated.
• Add a check to prevent duplicating external IDs within a Thesaurus. Allow updating an external ID and retrieving its value.
• Move from SUBMITTED_TO_RESOURCE to RUNNING on first progress >0
• Metadata service now has a “formatted” parameter to the create/update/get metadata endpoints (both public and private) and any date or date/time fields will be formatted as defined in the metadata definition.
• The Workflow designer will now list any number of existing action (previously limited to 1000), will not display disabled actions, and the list of displayed actions is now sorted alphabetically.  
• PKCE post-MVP: revisit & downgrade OAuth2 PKCE info logs to reduce verbosity and increase usefulness.
• When updating Asset Technical metadata, for example with an Extract Technical Metadata job, if the asset does not have any timeline annotations, Dalet Flex will update the Asset Format Version to the latest version (in this release this is Version = 5). In all other cases the Asset Version remains unchanged. 
• Dozer Mappers have been replaced with Mapstruct Mappers for these API services: timeline, theme, quota, profile, player, messagetemplate, wizard, task, taskdefinition, entityupdate, variant, resource, group.
• Support subtitle burning for transcode, stitch and sequence jobs using Flex Stream Processor media profile API.
• Support Extract Technical Metadata from pure subtitle files
• Add support for extracting keyframes using AVIF as the output format. Specify this Consul KV flex/flex-streamprocessor-service/imageProfileFormatDefaultAvif to use AVIF, otherwise JPEG output is used by default.
• In order to reduce call load from the Collection service and new Login App, the object Owner ID is added to all published events, when possible.
• In order to reduce message load from Flex Enterprise, JAE now sends logs directly to Flex Events. This feature does not include non-JAE opearation.
• Added support for chunk-based parallel processing for stitch jobs
• Added an Unmanaged Asset warning message in cases where an asset Storage Resource has no associated Folder Resource.
• Add caching headers for images downloaded by Flex Enterprise to /images/icons endpoints in Enterprise.
• Improve media profile API to support subtitle, timecode and image overlays by Flex Stream Processor.
• Fixed an issue with the Indexelastic service not being able to index assets due to nested_objects limit in ElasticSearch, and reporting the error Request execution cancelled. A new Consul KV has been added, flex/flex-indexelastic-service/elasticsearch/nestedObjectsLimit, to configure the maximum number of nested objects (default of 10000).
• Support stitching AVC codecs with same profile and level but different constraints by adding a logic to use the least constrained set of constraints for AVC1 codec specifications if only the constraint values are different.
• Cancel requests on a completed workflow will be ignored and no longer throw an exception.
• To improve backwards compatibility following HLS and DASH support, which changed video file naming to include additional information, if there is only one output video stream in a package, the old video file naming (e.g., XYZ.mp4, XYZ.m3u8) is used.
• S3 schemes can now be used in metadata URL fields.
•  Update default message templates so that links in password reset emails (and others) work if the user email addresses contain a +. Update default messages to Dalet Flex instead of Ooyala Flex.
• Simplified the launching of workflows regarding account workspace membership for improved behavior.

Fixed Issues DaletFlex

• Account creation is restricted when the proposed account name will create a role with the same name as an existing role. This error is displayed Role with name XXXXX already exists. Please try with different name.
• Fixed an issue in Flex-Enterprise where context.getMioObject() method returned a wrong object type (returned a MetadataDefinition object instead of an Asset object).
• Fixed an issue in Flex Core so that “workflow is written with a capital “W”.
• Fixed an issue in Flex Metadata Designer, where Drill-down, Multi-option and Tag variables were added as child variables and the schema was saved without a validation message for variable values.
• Fixed an issue where jobs on a segmented proxy was not working when the specified output folder is sharded.
• Fixed an issue where a Restore action on an already resorted object did not update the expiry date.
• Fixed an issue where there was an error when trying to generate the Checksum and Extract Technical Info on a file that has space in its path. Issue fixed by preventing the trimming of path and name fields when submitting jobs to Flex Stream Processor and Flex File Processor.
• Fixed an issue when it was not possible to select a metadata definition when creating a  variant.
• Fixed an issue where a spinning icon is displayed when opening the UDO summary tab
• SAML login retry logic improved to prevent errors causing SAML initialization to abort.
• Fixed an issue where DIVArchive was failing to start scheduler.
• Timed Action: Fixed an issue where it was not possible to delete a timed action that had been cancelled/completed. Issue fixed by checking that the job status is completed/cancelled and if it is not performing a cancel Job process before performing the delete.
• Fixed an issue in the Flex Stream Processor where there was an endless loop in ffmpeg transcode when using source clipping and outputting subtitles to DASH. The problem was caused because ffmpeg does not correctly decode EIA_608/708 captions and was solved by filtering these captions from the source.
• Fixed an issue where errors were sometimes logged twice in Flex Enterprise.
• Improved the resilience of the DB Pruner in cases where KVs are blank. The GetKV() function now treats a blank value as an unset KV, i.e., fall back to using the default value rather than the blank value.
• STL Fixed an issue where subtitle parsing was failing for accented characters. Support added for diacritical characters in Latin-based languages. Accents on non-Latin alphabets are not supported and this error is displayed CCT (language code) not supported in current version. Only supported Latin.
• Fixed an issue where the list of metadata definitions available for a Type in Metadata Designer was limited to 100 and not all the available definitions were displayed.
• Fixed an issue where a Pre-populated “From” value for Created Date in an Advanced Asset search could not be cleared without first manually specifying a value in the date picker. A Clear button, X , has been added to the Date picker field.
• Revised FQL queries to remove unnecessary nesting boolean operators nesting generated Elasticsearch queries
• Fixed an issue where audio packets were not being sized correctly within audio channel splitter and this was causing transcodes to fail because Flex Stream Processor was reporting the wrong duration.
• Fixed an issue to ensure that this error message is displayed when a password that is too long is set The password is too long, the maximum length is X.
• Fixed an issue where stitching source assets with differing color ranges was failing with the error differing color_range on streamconsolidate inputs. The issue was fixed by specifying default colorspace values for stitch/sequence inputs and safer handling of undefined values.
• Fixed an STL parsing error where input strings were not being trimmed and this error was thrown. Error with job: SubtitleException: Error during parsing STL file: java.lang.NumberFormatException: For input string: "17" .The problem was caused by whitespace in the header and was solved by trimming any strings being converted to integers.
• Fixed an issue where users were unable to set empty values for metadata instances.
• Fixed an issue where using the format defined in the metadata definition to set a date/time metadata field using the Set Metadata plugin was causing a validation error. To ensure backwards compatibility, the fix converts the date to ISO8601 format if the supplied format is incorrect.
• Improved the Metadata Modified event messages.
• FQL: Fixed an issue where queries containing the field=NULL operator do not work correctly if a metadata field with the same name exists in more then one metadata definition. Issue fixed by updating the FQL query generated  for a NULL query to use AND instead of OR if there is multi-field-mapping.
• Fixed an issue where for Enterprise search generating FQL: "No Variant" in UI or `includeNoVariant` in API is not handled properly. Issue fixed by sending `variant Id = NULL` instead of `variantID = 0` in the generated FQL.
• Enterprise Search API: Fixed issues with application of metadataDefinitionId and definitionId filters which were returning incorrect results when searching for assets while filtering with a metadata definition without specifying values for fields in the definition. Issue fixed by always sending the definitionId in the FQL query.
• Added missing Mappers to various objects.
• Fixed an issue where the sorting order was not always preserved when multiple Sort criteria were imposed. The order of multiple sort builders should now take place only within a single Sort criterion.
• Fixed issues with SDK calls to getTerms and getThesauri.
• Fixed an issue where FSP failed when Graphic Overlay was used on XDCAM Codec Profile.
• [Wizard Panel]: Fixed an issue where prepopulateMetadataValues option is broken after an upgrade to 2022.11.0.

Enhancements FlexMAM

• Improved the UX when loading a keyframe image in the Details page so that while the keyframe loads the screen is displayed in 100% resolution and a loading state is displayed.
• Added a drag and drop quick action to remove clip range from active clip bins and collections and a menu option to remove them from the sequence editor. Users must approve a confirmation message to complete the operation. 
• Refactor Wizard component to better calculate positions. Users can now view the Marker ID, timestampIn, and timestampOut.
• Configured format for Date fields in the metadata form is respected in FlexMAM.
• Support for wizards on clip-range added.
• Archive status and Most recent review status displayed in the Details tab in the Summary panel in Search and Manage pages.
• Timecode type metadata fields inside a complex field with no multiplicity are persisted correctly.
• Add confirmation dialog for "Remove from UDO" on relationship tab
• Video duration format, i.e., milliseconds or frames, is displayed according to the account preference. DF and NDF formatting is preserved.

Fixed Issues FlexMAM

• Fixed an issue with the player where the time displayed on the bar did match the actual player timecode for NDF files.
• Fixed an issue where when playing audio assets time markers, the playhead would jump immediately to the OUT timecode thus skipping the actual play.
• Fixed an issue were an external wizard launched from a clip bin did not show the startTimeCode and endTimeCode in the variable tab of the workflow. Fixed by passing the clip as input to the wizard to calculate the selection range.
• Fixed an issue where the hovering tooltip text on Collections concealed sub collections.
• Fixed an issue where the waveform would disappear from the audio tracks upon preview.
• Tooltip for remove collection icon in the collection and clip bin list added.
• Fixed an issue where loading saved search does not display the value saved in the global header search bar even though the search results are correct and reflect this value. Issue fixed by adding communication between search and the global header app.
• Fixed an issue where the “clip created” notification was not displayed when creating a clip from the Player in the Manage page.
• Fixed an issue where playing a video again after pausing it behaved inconsistently. After resuming playout, the asset always plays in the same direction (forwards/backwards) as it was playing before it was paused.
• Fixed an issue where the end timecode of a video was an unplayable frame, and unreachable via “jump to end” or “next frame” functions.
• Fixed an issue where the login page background image would not update
• Fixed an issue where the GOP Start timecode field in FlexMAM technical information tab was presented incorrectly.
• Fixed an issue where a pinned collection was removed from the Working Collection list after a page refresh.
• Fixed GUI issues in the Keyframe details modal display.
• Fixed an issue where the Subtitle icon is not visible in summary panel player.
• FlexMAM Metadata : Fixed an issue where it was not possible to save metadata for an asset from FlexMAM when basic variables were added (no complex fields and no multiplicity).
• FlexMAM: Metadata : Fixed an issue where alues are not persisted in FlexMAM for VFS Location, File and Image, timecode, objects, Key/value
• Fixed an issue where the Hotkey `a` for opening a Comment box under the video player was not working properly.
•  Fixed an issue where metadata values are not persisted in FlexMAM when a complex field has multiplicity 1 and a timecode field has multiplicity none.
• Fixed an issue where metadata values are not persisted in FlexMAM when a complex field and timecode field have multiplicity set as 1.
• Fixed an issue where metadata values are not persisted in FlexMAM when a complex field has multiplicity none and timecode has multiplicity set as 1.
• Fixed an issue where filtering on a Date metadata field in advanced search in FlexMAM was not working.
• Fixed an issue where the date format was displayed differently in the Summary panel and in the Manage page in FlexMAM. The date format should be the same throughout FlexMAM. The format should be taken from the configuration in FlexADMIN if this is available otherwise the default format should be used.

List of Services upgraded between 2022.11.0 and 2022.12.0 (LTS)

For the new 2022.12.0 release, most services have changed.