LQERelationalStoreLQERS < Deployment

r7 - 2025-04-11 - 14:20:46 - KotTontranakwongYou are here: TWiki >

Deployment Web > DeploymentInstallingUpgradingAndMigrating > LQERelationalStoreLQERS

<div id="header-title" style="padding: 10px 15px; border-width:1px; border-style:solid; border-color:#FFD28C; background-image: url(<nop>https://jazz.net/wiki/pub/Deployment/WebPreferences/TLASE.jpg); background-size: cover; font-size:120%">
---+!! Lifecycle Query Engine - Relational Store (LQE RS) <img src="https://jazz.net/wiki/pub/Deployment/WebPreferences/new.png" alt="new.png" width="50" height="50" align="right"> <img src="https://jazz.net/wiki/pub/Deployment/WebPreferences/uc.png" alt="uc.png" width="50" height="50" align="right"> <img src="https://jazz.net/wiki/pub/Deployment/WebPreferences/uc.png" alt="uc.png" width="50" height="50" align="right"> <img src="https://jazz.net/wiki/pub/Deployment/WebPreferences/uc.png" alt="uc.png" width="50" height="50" align="right"> <img src="https://jazz.net/wiki/pub/Deployment/WebPreferences/new.png" alt="new.png" width="50" height="50" align="right">
%DKGRAY% Authors: Chao Wang, Kot Tontranakwong <br>
Build basis: Lifecycle Query Engine 7.0.3+, 7.x
%ENDCOLOR%</div></sticky>

<!-- Page contents top of page on right hand side in box -->
<sticky><div style="float:right; border-width:1px; border-style:solid; border-color:#DFDFDF; background-color:#F6F6F6; margin:0 0 15px 15px; padding: 0 15px 0 15px;">
%TOC{title="Page contents"}%
</div></sticky>

<sticky><div style="margin:15px;"></sticky>

This page provides information for those who are looking to install or migrate to Lifecycle Query Engine - Relational store (LQE RS) application. LQE rs is an implementation of the Lifecycle Query Engine that replaces Jena with a relational database. The information in this page can help you determine the topology that fits your requirements.
%BR%%BR%
---++ Setup LQE RS on an Existing LQE server
*When to use:*
   * The LQE Jena server does not have much data and is not under heavy load. 
*Pros:*
   * No need to setup a separate LQE instances on a new server. 
   * Less JRS data sources to manage. 
   * Less risk when transitioning to LQE RS. 
   * LQE Jena can be decommissioned after transitioning to LQE RS. (Need to find documentation for decommissioning) 
*Cons:*
   * There could be a need to move the server off the powerful machine in the future (after LQE Jena is completely decommissioned). This raises a need for a server rename. 
%BR%
---++ Setup LQE RS on a New/Separate LQE server
*When to use:*
   * The current LQE has a large index and is under heavy load. 
   * You do not have LQE in the ELM environment and want to add LQE RS to the environment. 
*Pros:*
   * LQE RS does not require as much resources as LQE Jena; therefore, can be installed on a smaller machine. 
   * LQE RS will not be impacted by the LQE Jena’s performance. 
   * There could be a need to move the server off the powerful machine in the future (after LQE Jena is completely decommissioned). This can avoid the need for a server rename. 
*Cons:*
   * More data sources in JRS to manage 
%BR%
---++ Use a New or Existing data warehouse database for LQE RS?
Use the following links to help in determining whether to use the existing DW database or create a new DW database for LQE RS. 
   * https://jazz.net/wiki/bin/view/Deployment/LQERSDatabaseSizing 
When setting LQE RS with a new DW database, ensure the DW database is not empty. 
   * You will need to temporarily change DW connection in JTS to point to the new database, use JTS setup to populate the new DW database, then, switch the DW connection in JTS back to the original DW. 
When using the same DW, if you need to disable access control, it will be done by unchecking the checkbox in the “Data Warehouse” data source in the Report Builder. This will disable access control for both data warehouse and LQE RS. 
%BR%%BR%
---++ Steps to setup LQE RS
   1. __(NEW LQE only)__ Install LQE – follow the steps to install and setup LQE 
   1. Ensure LQE RS connect to the desired DW database: 
      i. Go to LQE > Administration > Relational Store > Settings at =https://server:port/lqe/web/pgs/settings=
      i. Ensure the database connection information under the “Data Warehouse Connection” section is correct and that the connection is successful.%BR%
      <img src="%ATTACHURLPATH%/DWConnectionPage.png" alt="DWConnectionPage.png" width="900" height="450" /> %BR% %BR%
   1. Disable/Enable Relational Store:
      i. Go to LQE > Administration > Relational Store > Settings at =https://server:port/lqe/web/pgs/settings=
      i. Under the “Relational Store Settings” section, check or uncheck the “Enabled” setting%BR%
       <img src="%ATTACHURLPATH%/rsEnable.png" alt="rsEnable.png" width="900" height="90" /> %BR% %BR%     
      When switching from LQE Jena to LQE RS, make sure to reindex the vocabularies.%BR%%BR%
   1. Disable/Enable TRS processing for an LQE node:
      i. Go to LQE > Administration > Nodes at =https://server:port/lqe/web/admin/nodes=
      i. Select a node you want to configure by clicking the Node name in the column header
      i. Check/Uncheck the TRS Processing setting as needed.%BR%
       <img src="%ATTACHURLPATH%/TRSprocessing.png" alt="TRSprocessing.png" width="900" height="100" /> %BR% %BR%
   1. Allow/Disallow SPARQL Service on LQE:
      i. Go to LQE > Administration > SPARQL Service at =https://server:port/lqe/web/admin/query=
      i. Check/Uncheck the “Query Service Enabled” setting%BR%
       <img src="%ATTACHURLPATH%/QuerySrvEnable.png" alt="QuerySrvEnable.png" width="350" height="100" /> %BR% %BR%

---++ Data Sources in Report Builder (JRS)
In JRS, when you discover and connect data sources, it looks for LQE that’s registered with the JTS and create the following data sources for each LQE: 
   * Lifecycle Query Engine (/sparql) 
   * Lifecycle Query Engine scoped by a configuration (/sparql-variable-config) 
   * Data Warehouse 
Assuming you have 2 LQEs and 1 DW database, JRS will detect 5 data sources
   * 2 Lifecycle Query Engine ==> one for each LQE
   * 2 Lifecycle Query Engine scoped by a configuration ==> one for each LQE
   * Data Warehouse%BR%
    <img src="%ATTACHURLPATH%/dataSources.png" alt="dataSources.png" width="1000" height="420" /> %BR% %BR%
And if you have 2 LQEs with 2 DW databases, JRS will detect 6 data sources; one additional Data Warehouse data source that LQE RS is connected to.%BR% %BR%

---+++ *What to consider when managing data sources in Report Builder?*
   * Existing reports are tied to the data source by data source ID.
      * For existing SPARQL reports to use LQE RS (SQL), the data source that is used by the reports must be configured to connect to LQE RS’s data warehouse.  
      * __Benefits:__
         * This allows you to switch between SPARQL and SQL in the existing reports. 
         * You can compare the reports’ results between SPARQL and SQL and ensure the results are expected. 
         * This is used to migrate existing reports to LQE RS (SQL) 
      * A data source cannot be deleted if there is one or more reports using it. 
   * Archive un-use data sources so that they are not visible to the users when creating or editing a report.
      * Archive is a better option than Delete as it ensures the data source is available for any back-end usage and that no new data source is detected if there is a need to reload the data sources in JRS again. %BR% %BR%

---+++ *Configuring data sources in Report Builder*
*Before you begin*
   * Review the “What to consider when managing data sources in Report Builder” section and determine which data sources to use.
   * Archive the data sources that you do not want users to create reports against. 
*Steps to enable Relational Store in JRS data sources:*
   1. In JRS > Administration > Data sources page, select the “Lifecycle Query Engine” data source by clicking the data source name
   1. Under Additional Properties section, select ‘Data Warehouse’ from the dropdown%BR%
   <img src="%ATTACHURLPATH%/DSadditionalProp.png" alt="DSadditionalProp.png" width="650" height="110" />%BR%
   1. Repeat step #1 and #2 for “Lifecycle Query Engine scoped by a configuration” data source. Select “Data Warehouse (indexed by: Lifecycle Query Engine)” as Lifecycle Query Engine relational store instead of “Data Warehouse” in step #2. 
*Converting existing reports from SPARQL to SQL:*
   * The query is automatically changed when switching from SPARQL to SQL
   * The only exception is reports with custom expressions. Manual modifications are required. 
 %BR%%BR%

---++ Q&A
Is it possible to flip all existing reports from SPARQL to SQL? 
   * Yes, you can add the following property to app.properties
      <verbatim>lqe.dw.trs.override = true</verbatim>
   * A report is converted at run-time (same as before) and does not impose any additional burden on the Report Builder server. The setting can be removed at anytime and it does not impact any existing reports.
_????? Does it mean that if I switch from SPARQL to SQL that the application will try to convert those custom reports? or is it going to skip them completely?_
   * _It will not try to convert them. Reports will not run and there will be an error message._
How to configure Report Builder to use LQE RS (SQL) by default?
   * https://www.ibm.com/docs/en/engineering-lifecycle-management-suite/lifecycle-management/7.1?topic=experience-advanced-properties
   * The following setting can be set
      <verbatim>lqe.dw.trs.default</verbatim>
%BR%
---++ Limitations
   * https://www.ibm.com/docs/en/engineering-lifecycle-management-suite/lifecycle-management/7.1?topic=builder-limitations-lifecycle-query-engine-relational-store
   * Server rename not supported in 703, but is in 7.1
%BR%%BR%


---+++++!! Related topics: [[DeploymentWebHome][Deployment web home]], [[DeploymentWebHome][Deployment web home]]

---+++++!! External links:          

   * [[https://www.ibm.com][IBM]]

---+++++!! Additional contributors: Main.TWikiUser, Main.TWikiUser

<sticky></div></sticky>

Attachments

Topic attachments
I	Attachment	Action	Size	Date	Who
png	DSadditionalProp.png	manage	30.7 K	2025-03-28 - 18:33	KotTontranakwong
png	DWConnectionPage.png	manage	217.6 K	2025-03-28 - 18:33	KotTontranakwong
png	QuerySrvEnable.png	manage	21.9 K	2025-03-28 - 18:33	KotTontranakwong
png	TRSprocessing.png	manage	54.7 K	2025-03-28 - 18:32	KotTontranakwong
png	dataSources.png	manage	285.1 K	2025-03-28 - 18:33	KotTontranakwong
png	rsEnable.png	manage	45.2 K	2025-03-28 - 18:32	KotTontranakwong

Deployment

Community information and contribution guidelines

Status icon key:

To do
Under construction
New
Updated
Constant change
None - stable page

Smaller versions of status icons for inline text:

Copyright © by IBM and non-IBM contributing authors. All material on this collaboration platform is the property of the contributing authors.
Contributions are governed by our Terms of Use. Please read the following disclaimer.
Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more here.