Imp(limiter): fetch workspaces with cursor

[e11sy]

Problem:

hawk.workspaces query has issues with retrieving of all documents at the same time, also it does not have projection and returns whole workspace, that leads to top total execution time and enormous response len

Solution:

• use projection
• use cursor based retrieving, yield each workspace and store only 1 workspace at a time

[Copilot]

Pull request overview

This PR improves the limiter worker’s workspace-fetch path to reduce MongoDB query cost and response size by switching from loading all workspaces into memory to streaming them via an aggregation cursor, while also adding a workspace field projection.

Changes:

• Refactored DbHelper.getWorkspacesWithTariffPlans() to stream workspaces via an async generator and added a $project stage.
• Updated the limiter’s regular check to iterate workspaces with for await ... of instead of Promise.all(...map(...)).
• Adjusted unit tests to consume the async generator.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

File	Description
workers/limiter/src/dbHelper.ts	Reworks workspace+plan fetch into cursor-backed streaming with projection and a shared lookup pipeline.
workers/limiter/src/index.ts	Consumes streamed workspaces in the regular check loop; awaits DB bulk update.
workers/limiter/tests/dbHelper.test.ts	Updates tests to collect results from the async generator.

Comments suppressed due to low confidence (1)

workers/limiter/src/index.ts:209

• The PR description mentions “store only 1 workspace at a time”, but updatedWorkspaces still accumulates an entry per workspace, so memory use remains O(n). Consider updating per-workspace (or storing only minimal update payloads like _id + updated fields) instead of pushing full workspace objects for every iteration.

    const workspaces = this.dbHelper.getWorkspacesWithTariffPlans();

    const updatedWorkspaces: WorkspaceWithTariffPlan[] = [];

    for await (const workspace of workspaces) {
      /**
       * If workspace is already blocked - do nothing
       */
      if (workspace.isBlocked) {
        continue;
      }

      const workspaceProjects = await this.dbHelper.getProjects(workspace._id.toString());

      const { shouldBeBlockedByQuota, updatedWorkspace, projectsToUpdate } = await this.prepareWorkspaceUsageUpdate(workspace, workspaceProjects);

      updatedWorkspaces.push(updatedWorkspace);

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.