Currently, TsFile uses a fixed encoding algorithm for each data type. For example, floating-point data may use Gorilla encoding.
However, data characteristics vary across datasets, and a fixed encoding algorithm may not always perform well. In some cases, it may even increase the encoded data size. We propose introducing an adaptive encoding mechanism that dynamically selects a more suitable encoding algorithm based on the actual data characteristics or encoding effectiveness.
Falling back to PLAIN when the current encoding is unsuitable can be one adaptive option, but it should not be the only one. The selection strategy, evaluation criteria, and switching granularity can be discussed separately.
Currently, TsFile uses a fixed encoding algorithm for each data type. For example, floating-point data may use Gorilla encoding.
However, data characteristics vary across datasets, and a fixed encoding algorithm may not always perform well. In some cases, it may even increase the encoded data size. We propose introducing an adaptive encoding mechanism that dynamically selects a more suitable encoding algorithm based on the actual data characteristics or encoding effectiveness.
Falling back to PLAIN when the current encoding is unsuitable can be one adaptive option, but it should not be the only one. The selection strategy, evaluation criteria, and switching granularity can be discussed separately.