Oxia

[eaba]

I want to replace the #zookeeper with #oxia, which is not working, how can I do it? I want to try Pulsar Oxia!

version: '3.8'

networks:
  pulsar-oxia:
    driver: bridge
    #ipam:
      #driver: default
      #config:
        #- subnet: 192.168.0.1/24

services:

  ox1:
    container_name: ox1
    hostname: ox1
    ports:
     - "192.168.0.131:6649:6649"
     - "192.168.0.131:6648:6648"
     - "192.168.0.131:8080:8080"
    image: streamnative/oxia:main
    command: >
      bash -c "oxia server --log-json --data-dir=/data/db --wal-dir=/data/wal --db-cache-size-mb=512 --profile && \
               oxia coordinator --log-json --metadata=configmap --profile"
    environment:
      oxia_cluster: test           
    volumes:
      - /data
    networks:
      pulsar-oxia:
        #ipv4_address: 192.168.0.131
      
  
  bk1:
    hostname: bk1
    ports:
      - "192.168.0.131:3181:3181"
      - "192.168.0.131:8003:8000"
    container_name: bk1
    image: apachepulsar/pulsar-all:3.0.0
    command: >
      bash -c "export dbStorage_writeCacheMaxSizeMb="$${dbStorage_writeCacheMaxSizeMb:-16}" && \
               export dbStorage_readAheadCacheMaxSizeMb="$${dbStorage_readAheadCacheMaxSizeMb:-16}" && \
               bin/apply-config-from-env.py conf/bookkeeper.conf && \
               bin/apply-config-from-env.py conf/pulsar_env.sh && \
               # bin/watch-znode.py -z $$zkServers -p /initialized-$$clusterName -w && \
               exec bin/pulsar bookie"
    environment:
      PULSAR_MEM: >
        -Xms128m
        -Xmx256m
        -XX:MaxDirectMemorySize=256m
      PULSAR_GC: >
        -XX:+UseG1GC
        -XX:MaxGCPauseMillis=10
        -XX:+ParallelRefProcEnabled
        -XX:+UnlockExperimentalVMOptions
        -XX:+DoEscapeAnalysis
        -XX:ParallelGCThreads=4
        -XX:ConcGCThreads=4
        -XX:G1NewSizePercent=50
        -XX:+DisableExplicitGC
        -XX:-ResizePLAB
        -XX:+ExitOnOutOfMemoryError
        -XX:+PerfDisableSharedMem
      # configure the memory settings based on jvm memory settings
      dbStorage_writeCacheMaxSizeMb: "32"
      dbStorage_readAheadCacheMaxSizeMb: "32"
      dbStorage_rocksDB_writeBufferSizeMB: "8"
      dbStorage_rocksDB_blockCacheSize: "8388608"
      PULSAR_PREFIX_journalDirectories: "/pulsar/data/bookkeeper/journal"
      extraServerComponents: "org.apache.bookkeeper.stream.server.StreamStorageLifecycleComponent"
      clusterName: test
      configurationStore: ox1:6649
      numAddWorkerThreads: 8
      useHostNameAsBookieID: "true"
    volumes:
      - ./scripts/apply-config-from-env.py:/pulsar/bin/apply-config-from-env.py:z
    depends_on:
      - ox1
      #- pulsar-init    
    networks:
      pulsar-oxia:
        #ipv4_address: 192.168.0.134

 

[hpvd]

a short official doc for this would be super helpful and would possibly help people discovering oxia... (even those who does not read the blog or do not attend summit or its videos)

[hpvd]

@eaba did make any progress using oxia for pulsar?
if not, maybe one may look/ask/discuss in the oxia repository https://github.com/streamnative/oxia

[hpvd]

We invite everyone to try Oxia and reach out with any questions, feedback, or ideas for improvement. As an open-source project, we rely on community contributions to continue advancing the technology, and your involvement will help make Oxia more widely beneficial.
source https://streamnative.io/blog/introducing-oxia-scalable-metadata-and-coordination

[eaba]

@hpvd I found this:

Configuration file path for metadata store. It's supported by RocksdbMetadataStore and EtcdMetadataStore FOR NOW

metadataStoreConfigPath=

[hpvd]

ok, so maybe oxia is still to fresh ;-)
on the otherhand...maybe one could simply open an issue for adding oxia support..

[tisonkun]

FYI @merlimat

[hpvd]

some news on this topic: streamnative/oxia#346 (comment)

[merlimat]

We're preparing to add support in Pulsar 3.3

[hpvd]

wow great news! Many thanks for all your work on this stunning project!

[lhotari]

PR in apache/pulsar is #22007