Encompass Data Connect Replication - Frequently Asked Questions (FAQs)
With Encompass Data Connect Replication, you can quickly access large amounts of near-real time loan data that's stored in the cloud, thus enabling you to leverage your existing technology to build your own intelligence on top.
These are the answers to Encompass Data Connect Replication's most frequently asked questions.
Looking for FAQs for Encompass Data Connect Hosted? Please click here.
Getting Started
What is the difference between Encompass Data Connect Standard and Encompass Data Connect Lite?
The following table describes the differences between Encompass Data Connect Standard and Encompass Data Connect Lite.
Access to all fields (standard, customer, virtual) | Yes | Yes |
5-minute SLA | Yes | Yes |
Handles schema changes | Yes | Yes |
Sample SSIS package (provided by ICE Mortgage Technology Professional Services) | Yes | Yes |
Audit capability | Yes (scheduled for release in 2019) | No |
PGP encryption | Yes, optional | No |
Supported number of seats | Unlimited | 300 maximum |
Supported databases | MS SQL, Postgres SQL | Postgres SQL only |
What is the provisioning request process?
To host your Encompass instance on an Encompass Data Connect instance, contact your account representative to initiate a provisioning request.
The provisioning process takes up to a week to complete and is as follows:
Provisioning Request - Two to four days after your account representative initiates a provisioning request, ICE Mortgage Technology will send a welcome email to the address you provided during initiation. This welcome email contains your instance ID and a link to the Encompass Data Connect website.
Log into Encompass Data Connect - Click the link in your welcome email to log in to Encompass Data Connect. From the log in screen, enter the instance ID (provided in the welcome email), your Encompass user ID, and your Encompass password.
In order to access Encompass Data Connect, you must have permission to log in to Encompass with the admin user ID, or be assigned the Super Administrator or Administrator persona.
Provisioning Request Form - Upon logging in, if you haven't yet been provisioned, you will be shown the Provisioning Request form to fill out and submit.
In the Provisioning Request Form, enter the following:
Email – Use commas to separate multiple email addresses.
Database User Name - Your desired Encompass Data Connect user name.
Database Password - Your desired Encompass Data Connect password.
IP Address Range - The IP address range allowed to access the Encompass Data Connect instance. Use commas to separate multiple IP addresses. Use the subnet mask of "/32" for an individual IP address.
Public Key – For how to manage keys, view Encompass Data Connect Replication - Best Practices.
This feature is available in Encompass Data Connect Standard only.
Connection Details - After receiving your completed Provisioning Request Form, ICE Mortgage Technology will create an Encompass Data Connect instance. It can take up to seven days to complete creation. Once complete, ICE Mortgage Technology will email you the connection details for your Encompass Data Connect instance.
For more information, view Getting Started with Encompass Data Connect Replication.
How do I generate a PGP key?
What are the best practices to use Encompass Data Connect Schema effectively?
How is the relationship between tables defined? (Examples)
Getting Connected
How do I connect to Encompass Data Connect? Where can I find connection details?
After receiving the Provisioning Request Form, ICE Mortgage Technology will create an Encompass Data Connect instance. It can take up to seven days for the creation to complete. Once complete, ICE Mortgage Technology will email you the following connection details for your Encompass Data Connect instance:
-
Server
-
User
-
Password
-
Port
Using the provided information, you can use SQL Workbench to connect to your Postgres or MS SQL Server database and view their records.
For details, view Connecting to Encompass Data Connect Replication.
How do I get Encompass Data Connect for additional Encompass instances?
Each Encompass Data Connect instance can only host a single Encompass instance. To host additional Encompass instances on additional Encompass Data Connect instances, contact your account manager to initiate a new provisioning request.
How can more than one user access Encompass Data Connect?
Encompass Data Connect only allows one user.
What if I lose or want to change my database password?
To request a password reset, contact ICE Mortgage Technology Technical Support. An email notification will be sent with the new password.
How do I enable access to Encompass Data Connect from additional IP addresses or ranges or additional machines?
During your provisioning request, you can enable access by identifying up to 40 individual IP addresses or ranges. To add more later, go to the IP Management tab under Administration Settings on the Data Connect portal. You can add new IP addresses and delete ones that are not needed. At all times at least one IP address must be whitelisted.
Database
Do you have example queries to explore loan data?
Yes. You can use the following queries:
-
To explore loan data (replace xxxxxxx with your loan number):
select loan_id,loan_number ,modified_utc from elliedb.loan where loan_number='xxxxxxx';
-
To see how many total loans you have in the database:
select count(*) from elliedb.loan;
Can I have virtual field?
Yes, Encompass Data Connect supports virtual fields as of the July 2018 Service Pack release.
Can I create my own database objects?
The database is for read-only purposes and does not permit new object creation.
How can I add historical data to my Encompass Data Connect instance?
Once provisioned, Encompass Data Connect adds three years of historical data. If you would like to access to additional historical data, contact ICE Mortgage Technology Technical Support with the exact dates.
During the processing of historical data, the system may run slower than usual. It can still be accessed, replicated, or queried.
Where can I view schema and table descriptions?
The schema file can be downloaded from the following knowledge base article in the Resource Center: Encompass Data Connect Help & Documentation.
Is there any document for the mapping of Encompass Data Connect fields to the corresponding fields in the Encompass Loan Schema for current Encompass Data Connect Schema?
The file detailing the mapping can be downloaded from the following knowledge base article in the Resource Center: Encompass Data Connect - Loan Schema Mapping.
The Field Schema HTML file for Postgres can be downloaded from the following knowledge base articles in the Resource Center: Encompass Data Connect - Field Schema HTML (Postgres).
The Field Schema HTML file for SQL can be downloaded from the following knowledge base articles in the Resource Center: Encompass Data Connect - Field Schema HTML (MS SQL).
How do I replicate data on Encompass Data Connect?
For the suggested replication process from Postgres and MS SQL Server, view Replicating Encompass Data Connect Data with SSIS.
Can I create reports or connect Encompass Data Connect with reporting tools?
Encompass Data Connect schema is not designed for reporting purposes. You can use Encompass Data Connect for querying purposes, or connect it to your reporting tool.
How often is data updated in Encompass Data Connect?
Encompass Data Connect updates in near real-time. At times, depending on traffic, delays up to a few minutes may occur.
Where can I view Encompass Data Connect ER diagram?
Encompass Data Connect tables have no relationships maintained at the database level, which means there are no integrity constraints associated between the tables. We do not produce ER Data Model as there are no relationships to show. The customer can refer to HTML Schema File to view different tables, or the PDF to understand relationships.
Data Fields
Where can I find Encompass custom fields in Encompass Data Connect?
Encompass Data Connect saves all custom fields in a table called "customfields". The "customfields" table is related to the loan table by the loan number (there can be multiple per loan table).
Are there primary keys in each table?
There is a field "loan_id" and field "table_name_id" in all tables. Together, they form a unique combination. We are not maintaining any primary keys for performance reasons. Inserts may be slow when we have primary keys. There is an index on "loan_id" for all tables. Once, data is replicated at your end, you may create indices depending on type of queries you are running. Exception: Loan table has a unique key index on "encompass_id" field.
How can I use the “customfields” table to query and access data from custom fields?
Custom fields are stored in the table "customfields". Each field is stored as values in a row. To query values in "customfield", the table must be filtered by that custom field and loan_number.
Example: "California_id" is a custom field of type "String".
To get value of this custom field, the query can be:
select string_value from customfield where custom_field_id = ‘California_id' where loan_number="SMPLLOAN123";
Troubleshooting
Why can't I access Encompass Data Connect?
Ensure the following is true:
If you are still encountering access issues, contact ICE Mortgage Technology Technical Support.
Why isn't my data updating in Encompass Data Connect?
Typically, it takes a few seconds for data to update in Encompass Data Connect. At times, due to high volumes or optimization, delays can occur.
If after 30 minutes the data still hasn't updated, or if you experience frequent delays, contact ICE Mortgage Technology Technical Support.
Why doesn't the Encompass Data Connect data match the Encompass data?
Possible reasons may include logics applied in Encompass (application layer) or synchronization. If it's been over 30 minutes since the update in Encompass the the data still does not match, contact ICE Mortgage Technology Technical Support with the loan ID, SQL query, and any other relevant information.
Why does my Loan ModifiedUTC not match DC_Modified?
There are multiple reasons for this but it does not necessarily mean that your data is not getting synced in near real-time:
-
Loan folder: Since Loan Folder is the metadata and is not part of the Loan file, Data Connect gets the updates for Loan Folder using a parallel process that is not related to the Loan File. This is like moving a file to a different folder on your computer, which does not update the timestamp on the file but only moves the file. Similarly, when a loan is moved there is no update to the ModifiedUTC but DC_Modified is updated since it is an update in the database, Example: user makes changes to the loan on 11/11/2019, now ModifiedUTC and DC_Modified are same but when user moves it to a new folder on 11/13/2019 the ModifiedUTC remains old value of 11/11/2019 but DC_Modified.
-
Miscellaneous: At times Encompass will treat certain tasks after a loan has been opened but closed without any changes or save. These could include printing out forms for example. In this case, Data Connect DC_Modified is updated but since the loan hasn’t changed, the Modifiedutc is not updated so you can see a gap of days or weeks or even longer.
-
Latency: In some cases the system may be running slowly and have issues. This is usually identified when the latency is considerably long but it usually catches up and impacts all loans, not selectively. If your loans are taking more than an hour, then please check Status Center and if there is no existing issue then contact Technical Support to open a case.
How Does Data Connect Calculate Time Zones?
Data Connect holds data for all Encompass customers in a common infrastructure. When a loan is created in any time zone, it will be converted into UTC.
- Data Connect does not store customer-specific time zones. The same customer may have branches across 50 states and Data Connect does not store a separate time zone for each one.
- Data Connect cannot assign a time zone based on the parent company location.
Data Connect uses PST and UTC only. Customers can convert to the target time zone as needed.
- CreatedUTC is the loan created time in Encompass.
- DCModifiedUTC is every time when this is updated in Data Connect.
Why is my query so slow?
For optimal performance, be sure that you are querying without joining tables. It is recommended that you do not perform any join queries. If you find a particular query taking more time, contact ICE Mortgage Technology Technical Support with the query details.
How do I contact ICE Mortgage Technology Technical Support?
You can contact ICE Mortgage Technology Technical Support through the Resource Center.
In order to access Technical Support features, you must be a named Support contact.
To Contact Technical Support:
-
On the Resource Center Home Page, under Popular Topics, expand Technical Support.
-
Click Contact Tech Support to be taken to the Technical Support page.
-
Under Support Cases, click Submit a Case.
-
In the Submit a Case form, enter your first name, last name, email address, and phone number.
-
It is recommended to select General Technical for the topic area.
-
It is recommended to include "Encompass Data Connect" in the subject.
-
Enter a description, include any attachments, and set a severity.
Tips
How to Keep Data Connect Running with Seamless Replication
In order to keep your Data Connect instance running with seamless replication, minimum latency and no data loss, we highly suggest you follow the below best practices.
- Do not run join queries on Data Connect database
- Do not run aggregate queries on Data Connect database.
- On SQL Server, use the WITH NOLOCK construct to avoid deadlock issues on database tables.
Query Table like the following.
- Postgres:
Create table public.lookup_encompassid as ( select encompassid from elliedb.loan (NOLOCK) where DcModifiedutc >= (FLOOR(EXTRACT(epoch FROM NOW())*1000) - 8640000000)
- SQL Server:
SELECT encompassid INTO dbo.lookup_encompassid FROM elliedb.loan (NOLOCK) where DcModifiedutc >= <TimeStamp1> and DcModifiedutc <= <TimeStamp2>
select * from elliedb.Asset (NOLOCK) where encompassid in (select encompassid from dbo.lookup_encompassid (NOLOCK))
Query all the other tables like described above.