How to force the execution happening in 1 pod/container in Openshift/Kubernetes

[chanlevan]

Hi everyone,

I have a backend node application using 1 queue. Every REST request comes, I create 200 jobs and do some processing on each job. After the execution is done, the result of all jobs are logged into an excel file.

I deployed this application to Openshift(Kubernetes in the backend). It works perfectly with 1 pod. However, if I increase the number of pod more than 1, Kubernetes starts distribute the jobs to not only the first pod but also to different pods. I am wondering if anyone faces the same issue and knows the way how to force all of the jobs to be executed only in 1 pod using bull? Or if it the execution runs in multiple pods, what should be the proper way to catch the complete event after the execution of all jobs are done from multiple pods?
I attached my sample code as below.

Looking forward for some helps.
Chan.

import * as Queue from "bull";
import { myjob} from "./myjob.job";
const { NX_REDIS, NX_REDIS_PASSWORD, REDIS_PORT } = process.env;
let myQueue: Queue.Queue<any>;
const redisOptions = {
  port: REDIS_PORT ,
  host: NX_REDIS,
  password: NX_REDIS_PASSWORD 
};

const createQueueMQ = (name) => new Queue(name, { redis: redisOptions });
const activateQueue = async (queueName: string) => {
  myQueue.process((job) => {
    return Promise.resolve(myjob(job));
  });
  myQueue.on("error", (error) => {
    console.log(error);
  });
};
if (NX_REDIS) {
  myQueue= createQueueMQ("myqueue");
  activateQueue(myQueue.name);
}
export { myQueue };

export const addJobs = async (queryType: string, username: string) => {
  const filteredQueries: Array<any> = await getSQLqueries(
    queryType
  );
  const totalQueries: number = filteredQueries.length;
  let results: Array<any> = [];
  try {
    filteredQueries.forEach((query) => {
      myQueue.add(query);
    });
    myQueue.on("completed", (job, result) => {
      results.push(job.returnvalue);
      if (results.length === totalQueries) {
        generateExcelfile(results);
      }
    });
  } catch (error) {
    throw error;
  }
};