hayden-yu / forcegres

Data synchronization from Salesforce to PostgreSQL db.

Forcegres

Data synchronization from Salesforce to PostgreSQL db.

Usage

• Checkout the project

git clone [email protected]:Hayden-Yu/Forcegres.git

• Install dependencies

cd Forcegres
npm i

• Edit environment settings

cp .env.example .env && vim ./env

• After saving your environment, compile typescript source

npm run build

• Initialize postgres database

npm run init

• Start a daemon with npm run exec.

---

Update enableSync on internal_sobjects table to enable synchronization of sobjects

forcegres's Issues

field change in sobject results into sync failure

socket hang up

{"message":"read ECONNRESET","level":"error"}

salesforce request can get bursty with lots of table sync enabled. How do we handle the retry and/or coordinate traffic?

/updated and /deleted API stopped working?

ERROR_HTTP_414

saw 10 instance of this error over last 3 days.

// TODO: investigate what request cause this error;
properly control length of individual soql instead of limiting # of id?

sObject is not replicable

If object does not have this access you cant use calls like getupdated(),getdeleted() methods .Example will be Accountshare,OpportunityShare etc.

How does this impact our sync?

Address objects as [Object Object] string literal

how do we identify json type in describe sobject?
can hardcode Address field names for now

query locator getting stuck

with large queries queryLocator stops returning data and stuck until ECONNRESET

invalid query locator

getting INVALID_QUERY_LOCATOR. It looks like Salesforce limits up to 10 of these open at the same time

Bulk query 2.0

see if this new API release is helpful

http://releasenotes.docs.salesforce.com/en-us/winter20/release-notes/rn_api_bulk_2_query.htm?edition=&impact=