Encompass Data Connect Replication - Frequently Asked Questions (FAQs)

With Encompass Data Connect Replication, you can quickly access large amounts of near-real time loan data that's stored in the cloud, thus enabling you to leverage your existing technology to build your own intelligence on top.

These are the answers to Encompass Data Connect Replication's most frequently asked questions.

Looking for FAQs for Encompass Data Connect Hosted? Please click here.

Getting Started

ClosedWhat is the difference between Encompass Data Connect Standard and Encompass Data Connect Lite?

The following table describes the differences between Encompass Data Connect Standard and Encompass Data Connect Lite.

Key FeaturesEncompass Data Connect StandardEncompass Data Connect Lite
Access to all fields (standard, customer, virtual)YesYes
5-minute SLAYesYes
Handles schema changesYesYes

Sample SSIS package (provided by ICE Mortgage Technology Professional Services)

YesYes
Audit capability

Yes (scheduled for release in 2019)

No
PGP encryptionYes, optionalNo
Supported number of seatsUnlimited300 maximum
Supported databasesMS SQL, Postgres SQLPostgres SQL only

ClosedWhat is the provisioning request process?

To host your Encompass instance on an Encompass Data Connect instance, contact your account representative to initiate a provisioning request.

The provisioning process takes up to a week to complete and is as follows:

  • Provisioning Request - Two to four days after your account representative initiates a provisioning request, ICE Mortgage Technology will send a welcome email to the address you provided during initiation. This welcome email contains your instance ID and a link to the Encompass Data Connect website.

  • Log into Encompass Data Connect - Click the link in your welcome email to log in to Encompass Data Connect. From the log in screen, enter the instance ID (provided in the welcome email), your Encompass user ID, and your Encompass password.

    In order to access Encompass Data Connect, you must have permission to log in to Encompass with the admin user ID, or be assigned the Super Administrator or Administrator persona.

  • Provisioning Request Form - Upon logging in, if you haven't yet been provisioned, you will be shown the Provisioning Request form to fill out and submit.

    In the Provisioning Request Form, enter the following:

    • Email – Use commas to separate multiple email addresses.

    • Database User Name - Your desired Encompass Data Connect user name.

    • Database Password - Your desired Encompass Data Connect password.

    • IP Address Range - The IP address range allowed to access the Encompass Data Connect instance. Use commas to separate multiple IP addresses. Use the subnet mask of "/32" for an individual IP address.

    • Public Key – For how to manage keys, view Encompass Data Connect Replication - Best Practices.

      This feature is available in Encompass Data Connect Standard only.

  • Connection Details - After receiving your completed Provisioning Request Form, ICE Mortgage Technology will create an Encompass Data Connect instance. It can take up to seven days to complete creation. Once complete, ICE Mortgage Technology will email you the connection details for your Encompass Data Connect instance.

For more information, view Getting Started with Encompass Data Connect Replication.

ClosedHow do I generate a PGP key?

To generate a PGP key using one of the verified methods for Mac/Linux or Windows, visit https://help.github.com/articles/generating-a-new-gpg-key/.

ClosedWhat are the best practices to use Encompass Data Connect Schema effectively?

​A guide detailing the best practices to use Encompass Data Connect Schema can be downloaded from the following knowledge base article in the Resource Center: Encompass Data Connect - Schema Best Practices.

ClosedHow is the relationship between tables defined? (Examples)

​A file explaining the schema relationships can be downloaded from the following knowledge base article in the Resource Center: Encompass Data Connect - Schema Relationships.

Getting Connected

ClosedHow do I connect to Encompass Data Connect? Where can I find connection details?

After receiving the Provisioning Request Form, ICE Mortgage Technology will create an Encompass Data Connect instance. It can take up to seven days for the creation to complete. Once complete, ICE Mortgage Technology will email you the following connection details for your Encompass Data Connect instance:

  • Server

  • User

  • Password

  • Port

Using the provided information, you can use SQL Workbench to connect to your Postgres or MS SQL Server database and view their records.

For details, view Connecting to Encompass Data Connect Replication.

ClosedHow do I get Encompass Data Connect for additional Encompass instances?

Each Encompass Data Connect instance can only host a single Encompass instance. To host additional Encompass instances on additional Encompass Data Connect instances, contact your account manager to initiate a new provisioning request.

ClosedHow can more than one user access Encompass Data Connect?

Encompass Data Connect only allows one user.

ClosedWhat if I lose or want to change my database password?

To request a password reset, contact ICE Mortgage Technology Technical Support. An email notification will be sent with the new password.

ClosedHow do I enable access to Encompass Data Connect from additional IP addresses or ranges or additional machines?

During your provisioning request, you can enable access by identifying up to 40 individual IP addresses or ranges. To add more later, go to the IP Management tab under Administration Settings on the Data Connect portal. You can add new IP addresses and delete ones that are not needed. At all times at least one IP address must be whitelisted.

Database

ClosedDo you have example queries to explore loan data?

Yes. You can use the following queries:

  • To explore loan data (replace xxxxxxx with your loan number):

    select loan_id,loan_number ,modified_utc from elliedb.loan where loan_number='xxxxxxx';

  • To see how many total loans you have in the database:

    select count(*) from elliedb.loan;

ClosedCan I have virtual field?

Yes, Encompass Data Connect supports virtual fields as of the July 2018 Service Pack release.

ClosedCan I create my own database objects?

The database is for read-only purposes and does not permit new object creation.

ClosedHow can I add historical data to my Encompass Data Connect instance?

Once provisioned, Encompass Data Connect adds three years of historical data. If you would like to access to additional historical data, contact ICE Mortgage Technology Technical Support with the exact dates.

During the processing of historical data, the system may run slower than usual. It can still be accessed, replicated, or queried.

ClosedWhere can I view schema and table descriptions?

The schema file can be downloaded from the following knowledge base article in the Resource Center: Encompass Data Connect Help & Documentation.

ClosedIs there any document for the mapping of Encompass Data Connect fields to the corresponding fields in the Encompass Loan Schema for current Encompass Data Connect Schema?

The file detailing the mapping can be downloaded from the following knowledge base article in the Resource Center: Encompass Data Connect - Loan Schema Mapping.

The Field Schema HTML file for Postgres can be downloaded from the following knowledge base articles in the Resource Center: Encompass Data Connect - Field Schema HTML (Postgres).

The Field Schema HTML file for SQL can be downloaded from the following knowledge base articles in the Resource Center: Encompass Data Connect - Field Schema HTML (MS SQL).

ClosedHow do I replicate data on Encompass Data Connect?

For the suggested replication process from Postgres and MS SQL Server, view Replicating Encompass Data Connect Data with SSIS.

ClosedCan I create reports or connect Encompass Data Connect with reporting tools?

Encompass Data Connect schema is not designed for reporting purposes. You can use Encompass Data Connect for querying purposes, or connect it to your reporting tool.

ClosedHow often is data updated in Encompass Data Connect?

Encompass Data Connect updates in near real-time. At times, depending on traffic, delays up to a few minutes may occur.

ClosedWhere can I view Encompass Data Connect ER diagram?

Encompass Data Connect tables have no relationships maintained at the database level, which means there are no integrity constraints associated between the tables. We do not produce ER Data Model as there are no relationships to show. The customer can refer to HTML Schema File to view different tables, or the PDF to understand relationships.

Data Fields

ClosedWhere can I find Encompass custom fields in Encompass Data Connect?

Encompass Data Connect saves all custom fields in a table called "customfields". The "customfields" table is related to the loan table by the loan number (there can be multiple per loan table).

ClosedAre there primary keys in each table?

There is a field "loan_id" and field "table_name_id" in all tables. Together, they form a unique combination. We are not maintaining any primary keys for performance reasons. Inserts may be slow when we have primary keys. There is an index on "loan_id" for all tables. Once, data is replicated at your end, you may create indices depending on type of queries you are running. Exception: Loan table has a unique key index on "encompass_id" field.

ClosedHow can I use the “customfields” table to query and access data from custom fields?

Custom fields are stored in the table "customfields". Each field is stored as values in a row. To query values in "customfield", the table must be filtered by that custom field and loan_number.

Example: "California_id" is a custom field of type "String".

To get value of this custom field, the query can be:

select string_value from customfield where custom_field_id = ‘California_id' where loan_number="SMPLLOAN123";

Troubleshooting

ClosedWhy can't I access Encompass Data Connect?

Ensure the following is true:

  • Your IP address matches one of the IP addresses listed on the IP Management screen provided on the Administration Settings tab.

  • The provided Port number is not blocked in your network.

If you are still encountering access issues, contact ICE Mortgage Technology Technical Support.

ClosedWhy isn't my data updating in Encompass Data Connect?

Typically, it takes a few seconds for data to update in Encompass Data Connect. At times, due to high volumes or optimization, delays can occur.

If after 30 minutes the data still hasn't updated, or if you experience frequent delays, contact ICE Mortgage Technology Technical Support.

ClosedWhy doesn't the Encompass Data Connect data match the Encompass data?

Possible reasons may include logics applied in Encompass (application layer) or synchronization. If it's been over 30 minutes since the update in Encompass the the data still does not match, contact ICE Mortgage Technology Technical Support with the loan ID, SQL query, and any other relevant information.

ClosedWhy does my Loan ModifiedUTC not match DC_Modified?

There are multiple reasons for this but it does not necessarily mean that your data is not getting synced in near real-time:

  • Loan folder: Since Loan Folder is the metadata and is not part of the Loan file, Data Connect gets the updates for Loan Folder using a parallel process that is not related to the Loan File. This is like moving a file to a different folder on your computer, which does not update the timestamp on the file but only moves the file. Similarly, when a loan is moved there is no update to the ModifiedUTC but DC_Modified is updated since it is an update in the database, Example: user makes changes to the loan on 11/11/2019, now ModifiedUTC and DC_Modified are same but when user moves it to a new folder on 11/13/2019 the ModifiedUTC remains old value of 11/11/2019 but DC_Modified.

  • Miscellaneous: At times Encompass will treat certain tasks after a loan has been opened but closed without any changes or save. These could include printing out forms for example. In this case, Data Connect DC_Modified is updated but since the loan hasn’t changed, the Modifiedutc is not updated so you can see a gap of days or weeks or even longer.

  • Latency: In some cases the system may be running slowly and have issues. This is usually identified when the latency is considerably long but it usually catches up and impacts all loans, not selectively. If your loans are taking more than an hour, then please check Status Center and if there is no existing issue then contact Technical Support to open a case.

ClosedHow Does Data Connect Calculate Time Zones?

Data Connect holds data for all Encompass customers in a common infrastructure. When a loan is created in any time zone, it will be converted into UTC.

  • Data Connect does not store customer-specific time zones. The same customer may have branches across 50 states and Data Connect does not store a separate time zone for each one.
  • Data Connect cannot assign a time zone based on the parent company location.

Data Connect uses PST and UTC only. Customers can convert to the target time zone as needed.

  • CreatedUTC is the loan created time in Encompass.
  • DCModifiedUTC is every time when this is updated in Data Connect.

ClosedWhy is my query so slow?

For optimal performance, be sure that you are querying without joining tables. It is recommended that you do not perform any join queries. If you find a particular query taking more time, contact ICE Mortgage Technology Technical Support with the query details.

ClosedHow do I contact ICE Mortgage Technology Technical Support?

You can contact ICE Mortgage Technology Technical Support through the Resource Center.

In order to access Technical Support features, you must be a named Support contact.

To Contact Technical Support:

  1. On the Resource Center Home Page, under Popular Topics, expand Technical Support.

  2. Click Contact Tech Support to be taken to the Technical Support page.

  3. Under Support Cases, click Submit a Case.

  4. In the Submit a Case form, enter your first name, last name, email address, and phone number.

  5. It is recommended to select General Technical for the topic area.

  6. It is recommended to include "Encompass Data Connect" in the subject.

  7. Enter a description, include any attachments, and set a severity.

Tips

ClosedHow to Keep Data Connect Running with Seamless Replication

In order to keep your Data Connect instance running with seamless replication, minimum latency and no data loss, we highly suggest you follow the below best practices.

  • Do not run join queries on Data Connect database
  • Do not run aggregate queries on Data Connect database.
  • On SQL Server, use the WITH NOLOCK construct to avoid deadlock issues on database tables.

Query Table like the following.

  1. Postgres:

Create table public.lookup_encompassid as ( select encompassid from elliedb.loan (NOLOCK) where DcModifiedutc >= (FLOOR(EXTRACT(epoch FROM NOW())*1000) - 8640000000)

  1. SQL Server:

SELECT encompassid INTO dbo.lookup_encompassid FROM elliedb.loan (NOLOCK) where DcModifiedutc >= <TimeStamp1> and DcModifiedutc <= <TimeStamp2>

select * from elliedb.Asset (NOLOCK) where encompassid in (select encompassid from dbo.lookup_encompassid (NOLOCK))

Query all the other tables like described above.