<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Datahub :: Ay Docs</title><link>https://aaronyang0628.github.io/docs/installation/database/datahub/index.html</link><description>Preliminary Kubernetes is installed; if not, check 🔗link ArgoCD is installed; if not, check 🔗link Elasticsearch is installed; if not, check 🔗link MariaDB is installed; if not, check 🔗link Kafka is installed; if not, check 🔗link Steps 1. prepare datahub credentials secret ​ plain sasl kubectl -n application \ create secret generic datahub-credentials \ --from-literal=mysql-root-password="$(kubectl get secret mariadb-credentials --namespace database -o jsonpath='{.data.mariadb-root-password}' | base64 -d)" kubectl -n application \ create secret generic datahub-credentials \ --from-literal=mysql-root-password="$(kubectl get secret mariadb-credentials --namespace database -o jsonpath='{.data.mariadb-root-password}' | base64 -d)" \ --from-literal=security.protocol="SASL_PLAINTEXT" \ --from-literal=sasl.mechanism="SCRAM-SHA-256" \ --from-literal=sasl.jaas.config="org.apache.kafka.common.security.scram.ScramLoginModule required username=\"user1\" password=\"$(kubectl get secret kafka-user-passwords --namespace database -o jsonpath='{.data.client-passwords}' | base64 -d | cut -d , -f 1)\";" 5. prepare deploy-datahub.yaml ​ plain sasl apiVersion: argoproj.io/v1alpha1 kind: Application metadata: name: datahub spec: syncPolicy: syncOptions: - CreateNamespace=true project: default source: repoURL: https://helm.datahubproject.io chart: datahub targetRevision: 0.4.8 helm: releaseName: datahub values: | global: elasticsearch: host: elastic-search-elasticsearch.application.svc.cluster.local port: 9200 skipcheck: "false" insecure: "false" useSSL: "false" kafka: bootstrap: server: kafka.database.svc.cluster.local:9092 zookeeper: server: kafka-zookeeper.database.svc.cluster.local:2181 sql: datasource: host: mariadb.database.svc.cluster.local:3306 hostForMysqlClient: mariadb.database.svc.cluster.local port: 3306 url: jdbc:mysql://mariadb.database.svc.cluster.local:3306/datahub?verifyServerCertificate=false&amp;useSSL=true&amp;useUnicode=yes&amp;characterEncoding=UTF-8&amp;enabledTLSProtocols=TLSv1.2 driver: com.mysql.cj.jdbc.Driver username: root password: secretRef: datahub-credentials secretKey: mysql-root-password datahub-gms: enabled: true replicaCount: 1 image: repository: m.daocloud.io/docker.io/acryldata/datahub-gms service: type: ClusterIP ingress: enabled: false datahub-frontend: enabled: true replicaCount: 1 image: repository: m.daocloud.io/docker.io/acryldata/datahub-frontend-react defaultUserCredentials: randomAdminPassword: true service: type: ClusterIP ingress: enabled: true className: nginx annotations: cert-manager.io/cluster-issuer: self-signed-ca-issuer hosts: - host: datahub.dev.72602.online paths: - / tls: - secretName: "datahub.dev.72602.online-tls" hosts: - datahub.dev.72602.online acryl-datahub-actions: enabled: true replicaCount: 1 image: repository: m.daocloud.io/docker.io/acryldata/datahub-actions datahub-mae-consumer: replicaCount: 1 image: repository: m.daocloud.io/docker.io/acryldata/datahub-mae-consumer ingress: enabled: false datahub-mce-consumer: replicaCount: 1 image: repository: m.daocloud.io/docker.io/acryldata/datahub-mce-consumer ingress: enabled: false datahub-ingestion-cron: enabled: false image: repository: m.daocloud.io/docker.io/acryldata/datahub-ingestion elasticsearchSetupJob: enabled: true image: repository: m.daocloud.io/docker.io/acryldata/datahub-elasticsearch-setup kafkaSetupJob: enabled: true image: repository: m.daocloud.io/docker.io/acryldata/datahub-kafka-setup mysqlSetupJob: enabled: true image: repository: m.daocloud.io/docker.io/acryldata/datahub-mysql-setup postgresqlSetupJob: enabled: false image: repository: m.daocloud.io/docker.io/acryldata/datahub-postgres-setup datahubUpgrade: enabled: true image: repository: m.daocloud.io/docker.io/acryldata/datahub-upgrade datahubSystemUpdate: image: repository: m.daocloud.io/docker.io/acryldata/datahub-upgrade destination: server: https://kubernetes.default.svc namespace: application apiVersion: argoproj.io/v1alpha1 kind: Application metadata: name: datahub spec: syncPolicy: syncOptions: - CreateNamespace=true project: default source: repoURL: https://helm.datahubproject.io chart: datahub targetRevision: 0.4.8 helm: releaseName: datahub values: | global: springKafkaConfigurationOverrides: security.protocol: SASL_PLAINTEXT sasl.mechanism: SCRAM-SHA-256 credentialsAndCertsSecrets: name: datahub-credentials secureEnv: sasl.jaas.config: sasl.jaas.config elasticsearch: host: elastic-search-elasticsearch.application.svc.cluster.local port: 9200 skipcheck: "false" insecure: "false" useSSL: "false" kafka: bootstrap: server: kafka.database.svc.cluster.local:9092 zookeeper: server: kafka-zookeeper.database.svc.cluster.local:2181 neo4j: host: neo4j.database.svc.cluster.local:7474 uri: bolt://neo4j.database.svc.cluster.local username: neo4j password: secretRef: datahub-credentials secretKey: neo4j-password sql: datasource: host: mariadb.database.svc.cluster.local:3306 hostForMysqlClient: mariadb.database.svc.cluster.local port: 3306 url: jdbc:mysql://mariadb.database.svc.cluster.local:3306/datahub?verifyServerCertificate=false&amp;useSSL=true&amp;useUnicode=yes&amp;characterEncoding=UTF-8&amp;enabledTLSProtocols=TLSv1.2 driver: com.mysql.cj.jdbc.Driver username: root password: secretRef: datahub-credentials secretKey: mysql-root-password datahub-gms: enabled: true replicaCount: 1 image: repository: m.daocloud.io/docker.io/acryldata/datahub-gms service: type: ClusterIP ingress: enabled: false datahub-frontend: enabled: true replicaCount: 1 image: repository: m.daocloud.io/docker.io/acryldata/datahub-frontend-react defaultUserCredentials: randomAdminPassword: true service: type: ClusterIP ingress: enabled: true className: nginx annotations: cert-manager.io/cluster-issuer: self-signed-ca-issuer hosts: - host: datahub.dev.72602.online paths: - / tls: - secretName: "datahub.dev.72602.online-tls" hosts: - datahub.dev.72602.online acryl-datahub-actions: enabled: true replicaCount: 1 image: repository: m.daocloud.io/docker.io/acryldata/datahub-actions datahub-mae-consumer: replicaCount: 1 image: repository: m.daocloud.io/docker.io/acryldata/datahub-mae-consumer ingress: enabled: false datahub-mce-consumer: replicaCount: 1 image: repository: m.daocloud.io/docker.io/acryldata/datahub-mce-consumer ingress: enabled: false datahub-ingestion-cron: enabled: false image: repository: m.daocloud.io/docker.io/acryldata/datahub-ingestion elasticsearchSetupJob: enabled: true image: repository: m.daocloud.io/docker.io/acryldata/datahub-elasticsearch-setup kafkaSetupJob: enabled: true image: repository: m.daocloud.io/docker.io/acryldata/datahub-kafka-setup mysqlSetupJob: enabled: true image: repository: m.daocloud.io/docker.io/acryldata/datahub-mysql-setup postgresqlSetupJob: enabled: false image: repository: m.daocloud.io/docker.io/acryldata/datahub-postgres-setup datahubUpgrade: enabled: true image: repository: m.daocloud.io/docker.io/acryldata/datahub-upgrade datahubSystemUpdate: image: repository: m.daocloud.io/docker.io/acryldata/datahub-upgrade destination: server: https://kubernetes.default.svc namespace: application if you wannna start one more gms add this under global, if you wanna start one more gms</description><generator>Hugo</generator><language>en</language><lastBuildDate/><atom:link href="https://aaronyang0628.github.io/docs/installation/database/datahub/index.xml" rel="self" type="application/rss+xml"/></channel></rss>