Replica Server / Oracle/Postgres to SQLITE

slide-show

The replica server compiles a SQLITE replica of the dataset prior to transfer.

Project description

Standard approaches for data transfers used commonly to support mobile applications (eg JSON/REST) were found inadequate for this project. This is due to the large size of the dataset to be transferred (128 Mb typical). After some trial and errors, AMVTEK engineers proposed to cut the intermediate serialization format and use SQLITE binary as a transfer format. This allowed to improve the performance and reliability of the mobile application meaningfully. The SQLITE/REST gateway was later transformed in a "real" replication server by allowing to reorder the changes coming from a large number of offline replica using a LAMPORT timestamp.

Skills : python, c-language, postgres