Skip to content

Data Storage Model

Jump to bottom
admin-hashedtokens edited this page Sep 29, 2026 · 9 revisions

Data is primarily stored in SQLite Db and folders on-disk. The model we adopted is that of an aggregated, flattened storage which in turn are organized into collections. EQP data is stored in EID folders in two directories

  • History : all data one gets to Test is maintained here in corresponding per EQP folder (retention period of 30 days on a rolling basis)
  • Saved : which the user wants to save are kept in the central storage (permanently stored unless user decides to delete)

Storage Limits

No limit on how much one would like to have in their EDMS application. It's limited to user's file system capacity.

Collections

A set of SQLite Dbs where the EID information is indexed, but not stored. The actual data is stored on disk in globalEQPData. This implies, we keep only one copy of EQP on the disk. One should however remember that duplicate EQP data is always a possibility. The following example illustrates the idea

E123: /some/random/endpoint, QP,header:5
E345: /some/random/endpoint, QP,headers:3

E123,and E345 have same endpoint string, but different QP, headers or both. This is necessary because in organizations one can have different servers need the same endpoint string routed for different purposes. For eg, hitting the endpoints through different subdomains, like E123: auth.company.com and E345, data.company.com. This kind of flattened storage model enables one to repurpose the endpoints for a variety of use cases.

Directory Structure

Data Backup (EDMS Application)

It's always possible that user may run into situations where it's important to copy the entire data to a different instance of EDMS application. For eg,

  • OS reinstall or corrupted disk is partially accessible, recovered EDMS data has to be moved
  • insufficient storage, where user has to move the data to a different location
  • copy the data to EDMS application on a different device
  • synchronize the data on multiple devices

Solution: user can simply copy the data and move to a different location using their portable storage devices or even network mount and copy the details or use the synchronization feature offered by the application.

Clone this wiki locally