close
Skip to content

RANGER-5680: Restructure audit services in docker compose and use OpenSearch as default Index Store - #1167

Merged
kumaab merged 11 commits into
apache:masterfrom
kumaab:ranger_5680
Aug 21, 2026
Merged

RANGER-5680: Restructure audit services in docker compose and use OpenSearch as default Index Store#1167
kumaab merged 11 commits into
apache:masterfrom
kumaab:ranger_5680

Conversation

@kumaab

@kumaab kumaab commented Aug 20, 2026

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

  • Use official Opensearch image from opensearchproject/opensearch version 3.7
  • Configure Ranger with Opensearch Index Store as default in docker via audit services with an option to have index store Solr alternatively.
  • Restructure all audit related services in docker-compose.ranger-audit-service.yml
  • Add healthchecks for Kafka, kafka needs to be healthy before audit-ingestor and audit-dispatcher
  • Updates the CI to bring up audit services with Opensearch as default Index Store.
  • audit-dispatcher must depend on audit-ingestor to be healthy, until RANGER-5752 is resolved.

How was this patch tested?

  • CI passing

  • Additionally tested the following scenarios (from README.md):

# 1
export RANGER_DB_TYPE=postgres
export AUDIT_INDEX_STORE=opensearch
docker compose -f docker-compose.ranger.yml -f docker-compose.ranger-kafka.yml -f docker-compose.ranger-audit-service.yml -f docker-compose.ranger-usersync.yml -f docker-compose.ranger-tagsync.yml -f docker-compose.ranger-pdp.yml -f docker-compose.ranger-kms.yml up -d

# 2
export RANGER_DB_TYPE=postgres
export AUDIT_INDEX_STORE=solr
# manually update ranger-admin-install-postres.properties - one liner update
docker compose -f docker-compose.ranger.yml -f docker-compose.ranger-kafka.yml -f docker-compose.ranger-audit-service.yml -f docker-compose.ranger-usersync.yml -f docker-compose.ranger-tagsync.yml -f docker-compose.ranger-pdp.yml -f docker-compose.ranger-kms.yml up -d

# 3
export RANGER_DB_TYPE=postgres
export AUDIT_INDEX_STORE=solr
# manually update ranger-admin-install-postres.properties - one liner update
export COMPOSE_PROFILES=$AUDIT_INDEX_STORE,hdfs
docker compose -f docker-compose.ranger.yml \  
  -f docker-compose.ranger-kafka.yml \
  -f docker-compose.ranger-hadoop.yml \
  -f docker-compose.ranger-audit-service.yml up -d
  • Verified Audits are flowing to Opensearch/Solr/HDFS.
  • No denies are seen in Audits.

@kumaab
kumaab marked this pull request as draft August 20, 2026 01:05
@kumaab kumaab self-assigned this Aug 20, 2026
@kumaab
kumaab requested a review from mneethiraj August 20, 2026 15:22
@kumaab
kumaab marked this pull request as ready for review August 20, 2026 15:22
@kumaab
kumaab requested review from ramackri and rameeshm August 20, 2026 15:27
Comment thread .github/workflows/ci.yml Outdated
Comment thread dev-support/ranger-docker/.env Outdated
@kumaab
kumaab merged commit d4a0759 into apache:master Aug 21, 2026
4 checks passed
@kumaab
kumaab deleted the ranger_5680 branch August 21, 2026 04:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants