feat: add SINDI query-mass pruning and FP16 candidate refinement

[alexanderguzhva]

adds a candidate code for SINDI IP refinement
Basically, it keeps only largest weights that contributed to the given % of the total sum of terms.

sample_id	refine_k	sindi_query_mass	mean_recall	mean_qps
baseline	1	1	0.99907	1035
3	12.37	0.758	0.99907	1706
48	11.39	0.741	0.99900	1830
16	6.78	0.767	0.99880	1855
64	6.34	0.764	0.99877	1895
69	19.75	0.654	0.99860	2019
51	15.73	0.670	0.99857	2066
19	6.53	0.715	0.99850	2184
70	15.67	0.637	0.99827	2270
35	16.36	0.631	0.99823	2275
20	12.63	0.640	0.99803	2382
7	17.46	0.600	0.99757	2425
89	9.97	0.630	0.99690	2610
94	15.65	0.554	0.99543	2847
87	13.11	0.565	0.99483	2917
38	14.00	0.545	0.99417	3026
65	11.31	0.566	0.99397	3050
73	16.49	0.519	0.99330	3060
93	11.66	0.542	0.99257	3240
47	10.88	0.525	0.99007	3450
23	7.96	0.540	0.98750	3613
8	12.42	0.486	0.98717	3680
97	9.12	0.467	0.97743	4279
24	9.67	0.454	0.97600	4323
95	10.38	0.424	0.96827	4570
82	7.29	0.457	0.96730	4692
17	10.97	0.404	0.96140	4695
18	9.21	0.414	0.95987	4880
36	6.79	0.410	0.94213	5447
49	4.51	0.419	0.92407	5900
13	5.03	0.400	0.91833	6050
21	3.65	0.428	0.91313	6050
68	2.42	0.409	0.85407	6963
32	2.24	0.408	0.84087	7096
10	1.39	0.434	0.77117	7102
72	1.10	0.408	0.70413	7952

generated using Codex.

/kind improvement

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: alexanderguzhva

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

• OWNERS [alexanderguzhva]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment