Dalet Flex 2021.7.0 Release Notes

Dalet is excited to present the July 2021 release of Dalet Flex 2021.7.0.
This release of Dalet Flex provides the new features, quality and security enhancements, bug fixes, and other changes listed below.

Dalet Flex

New Features

Resource Storage Mapping and Aliases

Storage mapping is used to allow different resources or applications to access a storage location from a mount point that is different from the one used by Dalet Flex to access the storage. To improve flexibility when configuring Flex Adobe panel, storage mapping has been generalized.
Storage resources have been extended to allow mappings as part of the storage resource configuration. You can configure an array of named alternative VFS locations for a storage resource. The mapping name for each resource should be unique.
Folder resources have been extended to allow 3rd party apps, such as Flex Adobe panel, to access shared storage from a local mount point. To support this:

• A Storage resource can be associated to multiple Folder resources.

• A REST API endpoint on the folder resource gives the full list of storage resource locations visible to the folder resource.

When configuring the Flex Adobe panel, a drop down list indicates all available storage locations. The storage locations are retrieved by a Flex API call to get a list of configured Folder resources.

Dalet FlexMAM

New Features

Changelog

2021.7.0

Enhancements DaletFlex

• Added JEF SDK method to perform a partial asset update
• Performance improvements to the indexelastic service clustering
• Fixed an issue where resource polling can stop after server restart
• Updated the stream processor to not assert truncated output if codec Add missing "Collection Delete" event type to Event searching & Event Handler configuration menus; remove duplicate legacy "Collection" entry from Object Type menus
• Update Replication Gateway to populate the 'flex-site-uuid' header instead of the 'siteUuid' header
• Add new field in get metadata call to support hide/show comment in UI
• Allow removing workflow drafts
• Add flex object and collection object authorisation support for read/write/delete comment in metadata service.
• Remove deprecated "q" and "fields" parameters (and related code) from SearchElastic service
• Fixed an issue where imageSequence and As02 assets didn’t show technical info in publish API requests
• Updated Flex SDK dependencies in accordance with Spring-Cloud
• Improved the accuracy of JEF metrics reporting
• Add metadata comments to asset and udo metadata migrator
• Add reorder function to Collections in the SDK
• Display all Udo children irrespective of workspace
• Flatten the metadataFullText response for tag / taxon variables
• Added a dedicated Event Handler for Set Master Keyframe
• Fallback to video stream interlacing and pixel aspect ratio values if not available in container format
• Fix / update events generated by Tag Service for tag rename / enabled / disabled.
• Removed confusing sub field options when creating customer column templates
• Improve error message when invalid tag is passed for fetching the FSP resource
• Power more of core UI Advanced Search / API search through FQL, so post-processing filters out fewer results
• Media Processing Engine improvements to support presets and image sequences
• Improve error message when account doesn't have account storage defined
• Add quotas to limit concurrency at the workflow level
• Resource Storage Mapping and aliases
• Improve backward compatibility of FPS and FSP actions (created without selecting FSP and FPS resources)
• Support of Flex Sequence has been added to Flex Enterprise UI: Asset Summary View, Advanced Search, Add Keyframes from API, Non I/O actions supported
• Added JEF example plugins: assetContext, groupExecutionSupported/groupMemberExecutionSupported
• Resource Tag to select dynamically resource at Flex/plugin level (no service consul tag selection)
• Resource Datacenter selection as single option (now multi-selection)
• Error reading assetmap file during IMF import
• In Flex Enterprise, use a drop down list of datacenters retrieved from consul KV to annotate Flex Stream Processor and Flex File Processor resources.
• Added validations for RioBroker Archive/Restore plugin when using partial file restore
• Encode STL JEF plugin: support STL as input and all output SRT, WebVTT, TTML (no style)
• BlackPearl: archive/restore BP and CloudArchive
• Update Dynamic Technical Metadata fields: complete document + patch
• Support has been added for additional image sequences formats: CR2, CNG, NEF, TIFF. Support for ingest, representation in Flex, Move, Copy and the ability to trigger a workflow on an asset
• Created a new Flex File Processor Resource with DataCenter support
• Additional validations on aliasName and aliasVfsLocation when saving Resource configuration
• Added new videostreamcontext property: dropFrame
• Update Revision of UDO when metadata is updated
• Resource changes should be saved when tag service is not available
• Handle drop-frame duration -> timecode representation in Flex UI
• Support RioBroker Restore after Purge & Purge File Only jobs are run
• Add method to JEF groovy SDK getCapacityItemRaw() to read resource files
• Add capability to search for tag metadata fields with backing store type of Thesaurus
• As part of the developments in Metadata Service, assets and UDO comments documents are migrated to metadata_comments in ArangoDB. Older comments are migrated to metadata_comments-lost collection.
• Metadata Merge should clean up comments associated with deleted fields

Fixed Issues DaletFlex

• Publish to Facebook jobs were failing due to a token error
• Asset REST API endpoint was returning an error when currentLocation was NULL
• Collections type was not available while creating a variant
• Large, gzipped file based result was not being created before source was deleted
• Support NBSP UTF-8 character in VFS storage
• FSP - FPS based jobs are not executing on selected datacenter instances
• Error on Import action with HLS asset
• Set Metadata not working for Key/Value variable
• Asset Context actions missing in FlexMAM after upgrade
• Mediainfo incorrectly parsing DPX as AVC video due to buffer based sync
• Default chunk processing in Flex Stream Processor service defaults to true when it is not specified
• Flex Jobs API: Error while fetching job variables when an object variable is present in job
• Error while fetching workflow variables via API when an object variable is present in workflow
• UDO objects added to Wizard Metadata shows duplicate entries
• Update message text "VFS folder resource not defined in the account <account name>" in Report Definition, while account folder is not defined
• Enterprise UI error on creating placeholder assets when running import asset or default ingest jobs
• Stream processor support for FFV1 codec and fix de-interlacing and interlace passthrough
• Groovy script SDK method updateAsset() failing for Image Sequences
• Wrong Flex Enterprise UI view of startTime in dropframe video
• User in master account with 'Administrator' role cannot modify object
• Transaction marked as rollback exception while execcuting groovy script - which then fail to schedule auto retry
• Sort function on the ASSET column on My Tasks not properly sorting the tasks in Enterprise
• JEF Copy action fails on image asset with colorMode parameter.
• Correct the calculation of Timecode when frameRate has dropFrame as true
• Transaction timeout error on long-running jobs
• Some wait for signal jobs were not completing
• All plugins are sometimes listed on Summary page while editing an Event Handler
• Incorrect records returned for wildcard searching
• Deleted UDOs were sometimes showing an error in the Enterprise UI
• FSP in job mode can consume more than one job and will not exit if no jobs
• Reinstate support for naming output streams in transcode profile
• Incorrect records returned for =NULL condition on nested fields
• Collection items not listed in search when shared with 'Modify' permission
• FFP supported action does not pick correct datacenter when tag expression is used to fetch FFP
• Migration script failing for collection with more than 1000 items
• Extracted technical metadata is not available on attachment tab of segmented asset
• Storage resource is not failing when we rename or delete the folder from the location
• Import media asset action was failing with error org/apache/commons/lang3/time/DurationUtils
• FlexCM was failing to replicate if no uuid defined (masteraccount+old message template)
• Default and HLS profiles specify webvtt text stream templating but it is not supported.
• MOV files with EIA 708 captions were not recognized as supported by the stream processor service
• Asset context format field was not returning the correct format name
• FLEX-60458 FLEX-60475 Event Handler Filter settings were lost while updating configuration
• Default start timecode to 00:00:00:00 when startTime 0
• Pair Enterprise with FMP startTime/duration conversion in UI for dropFrame
• Use correct landing page after login page set/reset password
• Search for Single option variable using OR option was not working
• Clicking on copy files in configuration of import action was removing the asset description config
• Out of memory error when extracting image technical metadata from large tif files
• Unable to access Metadata definitions and variant tab after assigning permission via group role
• Java heap space error when importing large files
• JEF copy job was failing when source and target were both file protocol
• Old MySQL metadata instances weren’t cleaned up after migration
• Comment creation times were all displaying the same value in the Enterprise UI
• Enterprise UI throwing error logs "MioObject of type Workspace is not enableSupported."
• Some jobs were failing while starting the job services
• Publish job for asset in GCP fails with google-api-client IllegalStateException
• Business Intelligence plugin was creating too many elasticsearch shards per index
• Handle authorisation of Variants in the authorisation service
• Service management endpoints were registering in Consul with incorrect IP address
• Need to restrict user to add item (asset) in a collection from a workspace without membership
• User should not be able to set variant and metadata-definition of sibling account on a collection
• Can't run more than 80 "JEF Delay Workflow" jobs at the same time
• Metadata Designer: Type: Add timeline icon is coming for Master Account Types in Account's Types listing
• ImageSequence: In formatcontext value of "tags" is not in proper format for image sequence asset if we comapre with arango db
• Flex Metadata Designer: Timeline: Group name(with space in it) is not coming on list page for Timeline
• Found errors in flex-publishindexer-service while publishing or republishing asset with metadata = true
• “Default workspace” and “Member workspace” were not assigned to externally authenticated users (i.e. SAML)
• Vantage jobs are set to Pending when the Vantage hard quota is reached

Enhancements FlexMAM

• Add “created by” user to marker template
• Reset column sorting when existing sort column is not showing on screen
• Ability to sort the notification task lists
• Task listing - Improve handling for long asset names
• Keep the table column header filter open until the user clicks away
• Add a default sort column to the custom table templates
• Upload icon should not be available in FMP when user doesn’t have Upload permission
• Sync filter chips with new search criteria
• When default template is marked as not shared, it remains selected in the FMP Admin App
• Multiple column sorting
• Added a manage page for image assets
• Update FMP tab styling

Fixed Issues FlexMAM

• Unable to create a workspace from FMP Admin App
• Unable to delete collection and saved searches in FMP
• Improved the performance of FQL OR queries
• Drill down fields were showing a blank option in addition to other options