Multithreaded Priority Queue in Python

Last Updated : 31 Dec, 2020

The Queue module is primarily used to manage to process large amounts of data on multiple threads. It supports the creation of a new queue object that can take a distinct number of items.
The get() and put() methods are used to add or remove items from a queue respectively. Below is the list of operations that are used to manage Queue:

get(): It is used to add an item to a queue.
put(): It is used to remove an item from a queue.
qsize(): It is used to find the number of items in a queue.
empty(): It returns a boolean value depending upon whether the queue is empty or not.
full(): It returns a boolean value depending upon whether the queue is full or not.

A Priority Queue is an extension of the queue with the following properties:

An element with high priority is dequeued before an element with low priority.
If two elements have the same priority, they are served according to their order in the queue.

Below is a code example explaining the process of creating multi-threaded priority queue:

Example:

import queue 
import threading 
import time 
  
thread_exit_Flag = 0
  
class sample_Thread (threading.Thread): 
   def __init__(self, threadID, name, q): 
      threading.Thread.__init__(self) 
      self.threadID = threadID 
      self.name = name 
      self.q = q 
   def run(self): 
      print ("initializing " + self.name) 
      process_data(self.name, self.q) 
      print ("Exiting " + self.name) 
  
# helper function to process data         
def process_data(threadName, q): 
   while not thread_exit_Flag: 
      queueLock.acquire() 
      if not workQueue.empty(): 
         data = q.get() 
         queueLock.release() 
         print ("% s processing % s" % (threadName, data)) 
      else: 
         queueLock.release() 
         time.sleep(1) 
  
thread_list = ["Thread-1", "Thread-2", "Thread-3"] 
name_list = ["A", "B", "C", "D", "E"] 
queueLock = threading.Lock() 
workQueue = queue.Queue(10) 
threads = [] 
threadID = 1
  
# Create new threads 
for thread_name in thread_list: 
   thread = sample_Thread(threadID, thread_name, workQueue) 
   thread.start() 
   threads.append(thread) 
   threadID += 1
  
# Fill the queue 
queueLock.acquire() 
for items in name_list: 
   workQueue.put(items) 
  
queueLock.release() 
  
# Wait for the queue to empty 
while not workQueue.empty(): 
   pass
  
# Notify threads it's time to exit 
thread_exit_Flag = 1
  
# Wait for all threads to complete 
for t in threads: 
   t.join() 
print ("Exit Main Thread") 

Output:

initializing Thread-1
initializing Thread-2initializing Thread-3

Thread-2 processing AThread-3 processing B

Thread-3 processing C
Thread-3 processing D
Thread-2 processing E
Exiting Thread-2
Exiting Thread-1
Exiting Thread-3
Exit Main Thread

Note: The output may differ depending upon the device specifications and processing power.

RajuKumar19

Improve

Python - Stack and StackSwitcher in GTK+ 3

Python Program to Reverse the Content of a File using Stack

Python Matrix Exercises

Python Functions Exercises

Python Lambda Exercises

Python Pattern printing Exercises

Python DateTime Exercises

Python OOPS Exercises

Python Regex Exercises

Python LinkedList Exercises

Python Searching Exercises

Python Sorting Exercises

Python DSA Exercises

Python File Handling Exercises

Python CSV Exercises

Python JSON Exercises

Python OS Module Exercises

Python Tkinter Exercises

Python Web Scraping Exercises

Python Selenium Exercises

Multithreaded Priority Queue in Python

Please Login to comment...

Similar Reads

What kind of Experience do you want to share?