Skip to content

Flaky tests in quickwit-indexing crate #6049

@congx4

Description

@congx4

Summary

Multiple tests in the quickwit-indexing crate are showing flaky behavior and consistent failures across test runs.

Flaky Tests

  • source::kafka_source::kafka_broker_tests::test_kafka_source_suggest_truncate - Shows flaky behavior (passed some runs, failed others)

Consistently Failing Tests (TRY 6 FAIL in all 4 test runs)

Pulsar Source Tests:

  • source::pulsar_source::pulsar_broker_tests::test_partitioned_topic_multi_consumer_ingestion
  • source::pulsar_source::pulsar_broker_tests::test_partitioned_topic_multi_consumer_ingestion_with_failover
  • source::pulsar_source::pulsar_broker_tests::test_partitioned_topic_single_consumer_ingestion
  • source::pulsar_source::pulsar_broker_tests::test_topic_ingestion
  • source::pulsar_source::pulsar_broker_tests::test_doc_batching_logic
  • source::pulsar_source::pulsar_broker_tests::test_multi_topic_ingestion

Kafka Source Tests:

  • source::kafka_source::kafka_broker_tests::test_kafka_source

Test Environment

All tests were run with make test-all and failed consistently across 4 separate runs.

Impact

These failures are blocking the test suite completion and may indicate issues with:

  • Pulsar broker connectivity/setup
  • Kafka broker connectivity/setup
  • Test environment reliability
  • Race conditions in source implementations

Next Steps

  1. Investigate Pulsar broker test setup and dependencies
  2. Review Kafka broker test configuration
  3. Check for timing/race condition issues
  4. Consider if tests need better isolation or cleanup

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions