Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
78067ce
mp: allow directly built CFL log chunks
edsiper Oct 28, 2026
7444e33
processor: support worker-safe CFL log processing
edsiper Oct 28, 2026
bc4c2cf
input_log: ingest processed CFL log chunks
edsiper Oct 28, 2026
ae86e33
input_ingest: route preprocessed log events
edsiper Oct 28, 2026
dc401f5
processor_content_modifier: mark log callbacks worker safe
edsiper Oct 28, 2026
efc9622
processor_sql: mark log callbacks worker safe
edsiper Oct 28, 2026
a61d0b6
opentelemetry: share protobuf log decoding
edsiper Oct 28, 2026
33a12fe
tests: internal: use shared protobuf validator
edsiper Oct 28, 2026
2d504ad
in_opentelemetry: use shared protobuf log decoding
edsiper Oct 28, 2026
279c31d
tests: internal: cover CFL processor execution
edsiper Oct 28, 2026
ef661ae
tests: integration: cover OTLP worker processing
edsiper Oct 28, 2026
a3b1196
opentelemetry: reuse protobuf arena for direct logs
edsiper Oct 28, 2026
12a1ace
processor: restrict direct CFL to native chains
edsiper Oct 28, 2026
396f314
processor_content_modifier: preserve OTLP container arenas
edsiper Oct 28, 2026
2923d12
processor_content_modifier: preserve log value arenas
edsiper Oct 28, 2026
bcbdabb
opentelemetry: decode JSON logs directly to CFL
edsiper Oct 28, 2026
6d230fd
in_opentelemetry: enable direct CFL for JSON logs
edsiper Oct 28, 2026
aea7fd7
tests: integration: cover direct OTLP JSON logs
edsiper Oct 28, 2026
31ae77c
tests: internal: compare OTLP logs CFL and msgpack decoding
edsiper Oct 29, 2026
8423e9d
downstream: allow adopting an accepted connection
edsiper Oct 29, 2026
a60c2f3
http_server: balance accepted connections across workers
edsiper Oct 29, 2026
65c52ca
tests: integration: cover balanced HTTP worker connections
edsiper Oct 29, 2026
a21ceff
benchmarks: compare OTLP log ingestion with the Collector
edsiper Oct 29, 2026
b457d8d
tests: internal: fuzzers: add OTLP logs decoder fuzzer
edsiper Oct 29, 2026
9ed77ea
in_opentelemetry: answer busy when processed logs hit a full queue
edsiper Oct 30, 2026
28c0110
tests: integration: cover busy answers with worker processors
edsiper Oct 30, 2026
b028307
benchmarks: add filesystem storage to the OTLP Collector comparison
edsiper Oct 30, 2026
61eea27
tests: internal: read the protobuf parity corpus length portably
edsiper Oct 31, 2026
58b33fa
json: add an inline read-only tree for hot path traversal
edsiper Oct 31, 2026
d249bad
opentelemetry: read JSON logs through the flb_json tree
edsiper Oct 31, 2026
fdbebef
tests: internal: cover the JSON tree accessors
edsiper Oct 31, 2026
a52fcf3
tests: internal: cover lenient OTLP JSON logs payloads
edsiper Oct 31, 2026
5f1151b
tests: integration: cover OTLP JSON logs with invalid Unicode
edsiper Oct 31, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
745 changes: 745 additions & 0 deletions benchmarks/compare_fluent_bit_otelcol.py

Large diffs are not rendered by default.

12 changes: 12 additions & 0 deletions include/fluent-bit/flb_downstream.h
Original file line number Diff line number Diff line change
Expand Up @@ -98,6 +98,18 @@ int flb_downstream_conn_event_accept(
void *accept_callback_data,
flb_connection_event_callback event_callback,
int mask);

/*
* Same as flb_downstream_conn_event_accept() for a socket that was already
* accepted, for example by another worker. The socket is always consumed.
*/
int flb_downstream_conn_event_adopt(
struct flb_downstream *stream,
flb_sockfd_t fd,
flb_connection_accept_callback accept_callback,
void *accept_callback_data,
flb_connection_event_callback event_callback,
int mask);
int flb_downstream_conn_event_register(struct flb_connection *connection,
int (*callback)(void *data),
int mask);
Expand Down
6 changes: 6 additions & 0 deletions include/fluent-bit/flb_input.h
Original file line number Diff line number Diff line change
Expand Up @@ -957,6 +957,12 @@ int flb_input_ingress_queue_log_take_records(struct flb_input_instance *ins,
const char *tag, size_t tag_len,
void *buf, size_t buf_size,
size_t allocation_size);
int flb_input_ingress_queue_log_processed_take_records(
struct flb_input_instance *ins,
size_t records,
const char *tag, size_t tag_len,
void *buf, size_t buf_size,
size_t allocation_size);
int flb_input_ingress_queue_metrics(struct flb_input_instance *ins,
const char *tag, size_t tag_len,
struct cmt *cmt, size_t payload_size);
Expand Down
14 changes: 14 additions & 0 deletions include/fluent-bit/flb_input_log.h
Original file line number Diff line number Diff line change
Expand Up @@ -45,4 +45,18 @@ int flb_input_log_append_processed(struct flb_input_instance *ins,
size_t tag_len,
const void *buf,
size_t buf_size);
int flb_input_log_append_processed_routed(struct flb_input_instance *ins,
size_t records,
const char *tag,
size_t tag_len,
const void *buf,
size_t buf_size);

struct flb_mp_chunk_cobj;
int flb_input_log_chunk_supported(struct flb_input_instance *ins,
int worker_thread);
int flb_input_log_append_chunk(struct flb_input_instance *ins,
const char *tag, size_t tag_len,
struct flb_mp_chunk_cobj *chunk,
int worker_thread);
#endif
Loading
Loading