Fusion 5.0.2
Release date: December 18, 2019
Component versions:
Component | Version |
---|---|
Solr |
8.3.1 |
ZooKeeper |
3.5.6 |
Spark |
2.4.3 |
Kubernetes |
GKE, AKS, EKS 1.18 Rancher (RKE) and OpenShift 4 compatible with Kubernetes 1.18 OpenStack and customized Kubernetes installs not supported. See Kubernetes support for end of support dates. |
Ingress Controllers |
Nginx, Ambassador (Envoy), GKE Ingress Controller Istio not supported. |
More information about support dates can be found at Lucidworks Fusion Product Lifecycle.
Looking to upgrade?
Check out the Fusion 5 Upgrades topic for details. |
New features
Predictive Merchandiser
Fusion 5.0.2 integrates Predictive Merchandiser as a component of Fusion.
If you have a Fusion license, you can access Predictive Merchandiser by navigating to Relevance > Rules and selecting Merchandiser.
To learn more, see Predictive Merchandiser.
Jupyter Integration
Starting with Fusion 5.0.2, we now provide a Jupyter service that can be run from the Fusion Helm chart. Jupyter is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations, and narrative text.
-
Run/Debug Spark code in Scala/Python (replacement for spark-shell)
-
Run SQL queries via Fusion SQL
-
Debug Scala and SQL transforms in PBL jobs
-
Everything else for which Jupyter is designed
To learn more, see Jupyter Support in Fusion.
Improvements
-
The HTML parser now parses the
application/xhtml+xml
media type by default.
-
The HTML parser can filter HTML content using jsoup. New HTML parser configuration options include:
Configuration option
Default value
Description
excludeFilters
N/A
Jsoup-formatted selectors for elements to exclude from the HTML
filterBeforeMapping
False
Apply exclude filters before performing HTML field mapping
filterBeforeExtractingLinks
False
Apply exclude filters before performing link extraction
-
Index pipelines can now receive nested JSON documents through the Parallel Bulk Loader.
-
The Fusion UI now supports undo for deleted rules.
-
A new boolean property,
shareState
, is introduced for Javascript Query Stages. When set totrue
, a single JavaScript engine will be used for all queries on a Javascript query stage. Previously, a unique engine was used for each thread.Under certain conditions, this can improve performance significantly.
-
If a rule creation API is incorrectly formatted in JSON, Fusion now produces a detailed error message.
-
Improved the output from phrase extraction jobs. It is now more useful for non-signals datasets.
-
Improvement made in error propagation between services.
-
The Windows Share SMB 2/3 Connector now parses data into individual Solr fields instead of a large JSON document.
-
The Custom Spark job has been replaced by a Custom Python job.
-
Various UI improvements and fixes.
Bug Fixes
-
Fixed a bug that sometimes resulted in the
APP_NAME_recommender_models
collection to delete theAPP_NAME_recommender_models
collection.
-
The
collection_alias
field is now required for time-based partitioning in the Fusion SQL service.
-
The roles selector in the New User panel now correctly displays the available role types.
-
Fixed a bug that prevented the Box Connector from correctly indexing PowerPoint files.
-
Fixed a bug that prevented the Box Connector from indexing Japanese text with UTF-8 character encoding.
-
Fixed a bug that prevented V2 connector jobs from succeeding if a fetcher was defined without a phase name.
-
Fixed a bug that produced an Out of Memory (OOM) error when indexing large JSON files with a V2 connector.
-
V1 connector stateful jobs are no longer dependent on server IPs. recrawling after restarting V1 connectors now works as expected.
-
Fixed a bug that removed CJK characters from file names when uploading a file.
-
Fixed a bug the prevented the Jobs API from scheduling a recently created job.
-
Fixed a bug that sometimes caused
DefaultHostInfoMetricReporter
to fail on Java 11.
-
Fixed a bug that caused head/tail analysis jobs to overwrite published rules.
-
Boost lists will now utilize the correct term,
orig_score
, when rewriting a query.
-
Corrections made to the default synonym detection job settings.
-
Fixed a bug that sometimes caused pytests to fail when using the
fusion
user.
-
Logstash is now enabled by default.
Known issues
Fusion
-
The Query Workbench rejects multiple parameters with the same name. This issue is fixed in Fusion 5.3.
-
If High performance mode is selected on the Web connector configuration, the crawl does not start. This issue is fixed in Fusion 5.1.0.
-
Deploying an application into the Webapps service requires a non-empty, non-root context path. This issue is fixed in Fusion 5.1.0.
-
Exported apps are created without
solrParams
, causing an error when importing. This issue is fixed in Fusion 5.2.
-
Failed requests to the Azure Kubernetes Service fall into an endless loop, causing rate limit violations in Azure. This issue is fixed in Fusion 5.3.
-
App Studio apps fail to run when deployed on a Fusion 5 cluster. This issue is fixed in Fusion 5.2.
-
The Solr exporter uses the same affinity rules as the Solr server. This issue is fixed in Fusion 5.1.
-
Publishing a rule on a deployed cluster is unusually slow. This issue is fixed in Fusion 5.1.2 and 5.2.
-
The default
rows
parameter only allows 10 rules to be triggered, even if a greater number of rules meet the triggering condition. This issue is fixed in Fusion 5.1.
-
No error is displayed if a sub-action fails while creating an app. This issue is fixed in Fusion 5.2.
-
The API gateway displays a "Some Services Unavailable" or "Force-closing" error. This issue is fixed in Fusion 5.0.3 and 5.1.
-
Importing an app displays a 502 error, intermittently. This issue is fixed in Fusion 5.0.3.
-
The Webapps service does not work with Twigkit apps. This issue is fixed in Fusion 5.0.3.
-
The Index Workbench shows a blank screen or "No Results" message. This issue is fixed in Fusion 5.1.
-
JavaScript evaluation does not start when initiated. This issue is fixed in Fusion 5.1.
Predictive Merchandiser
-
Items in the global bury list still show in search results. This issue is fixed in Fusion 5.1.2 and 5.2.
-
The Rules menu in Predictive Merchandiser redirects to the Fusion App Launcher. This issue is fixed in Fusion 5.1.
-
Publishing rules does not produce a request payload or publish the correct number of items. This issue is fixed in Fusion 5.1.