Skip to content

ATLAS-5059: add support for rdbms backend and audit repository #389

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 6 commits into
base: master
Choose a base branch
from

Conversation

mneethiraj
Copy link
Contributor

What changes were proposed in this pull request?

enhancements to support using Postgres as the backend store for JanusGraph and entity-audit, replacing HBase.

How was this patch tested?

Verified that Atlas:

  • startups successfully with configuration set to use Postgres as the backend storage\
  • successfully processes notifications, which stores the data in Postgres
  • successfully serve search APIs

Copy link

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This pull request adds support for a new RDBMS backend using PostgreSQL for JanusGraph and the entity-audit repository, replacing the existing HBase configuration.

  • Introduces new modules (e.g. DaoManager, RdbmsStoreManager, RdbmsStore, etc.) for RDBMS support.
  • Integrates changes in AtlasJanusGraphDatabase via reflection to inject the new store manager and updates docker configuration and scripts to enable Postgres backend.

Reviewed Changes

Copilot reviewed 20 out of 44 changed files in this pull request and generated 3 comments.

File Description
graphdb/janusgraph-rdbms/src/main/java/org/janusgraph/diskstorage/rdbms/dao/DaoManager.java Initializes the JPA layer for RDBMS; iterates persistence providers.
graphdb/janusgraph-rdbms/src/main/java/org/janusgraph/diskstorage/rdbms/RdbmsStore.java Implements the RDBMS-backed KeyColumnValue store with store creation and key mapping logic.
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusGraphDatabase.java Injects RDBMS support into graphdb via reflection.
Docker and configuration files Update docker-compose and shell scripts to support Postgres as backend.

@@ -50,9 +50,13 @@ Docker files in this folder create docker images and run them to build Apache At

Time taken to complete the build might vary (upto an hour), depending on status of ${HOME}/.m2 directory cache.

6.2. Execute following command to install and start Atlas and dependent services (Solr, HBase, Kafka) in containers:
6.2. To install and start Atlas using Postgres as backend store, execute following commands:
export ATLAS_BACKEND=postgres
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes to .github/workflows/ci.yml would be required to incorporate the docker changes for CI.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants