Concurrent and Parallel Programming in Python

1. Threading, Multiprocessing, Async Introduction

In this video, we will be introduced to threading, multiprocessing, and asynchronous programs and the different considerations of choosing Python for coding.

2. Threading in Python

This lecture demonstrates how to write our first concurrent program. The author also explains the benefits of choosing the Python coding portal instead of the other code-writing portals.

3. Creating a Threading Class

After learning how to write our first threading program, you will learn how to use classes as our threading tools.

4. Creating a Wikipedia Reader

After comprehensively practicing our basic threading creation, we will look at the project we will create to implement threading more effectively.

5. Creating a Yahoo Finance Reader

After learning how to create the Wikipedia reader, you will learn how to write a threaded class to extract the price from a Yahoo Finance portal.

6. Queues and Master Scheduler

In the previous lessons, you learned how to set up our Wikipedia reader and the Yahoo Finance worker; we will now systemize the process and create separate process entities. You will learn to create queues, take elements, and place them in a queue.

7. Creating a Postgres Worker

In this lesson, we will create our instruction worker using a Postgres database.

8. Integrating the Postgres Worker

After creating our Postgres database insertion worker, we will integrate this worker into our main function and make changes to ensure that everything is working properly.

9. Yaml File Introduction

After creating a working program, you will learn how to clean up the appearance and make it nicer to have an overview and be able to expand its features in the future.

10. Creating a Yaml Reader

Now that we have the Yaml pipeline defined, we will implement something to read this file or any other file that has a queue worker structure to create our pipeline for us.

11. Improving Our Wiki Worker

After successfully creating and defining our Yaml reader, we will implement this into our main class.

12. Improving All Workers and Adding Monitoring

In this lecture, you will learn to clean up the Yaml pipeline executor, load the pipeline, initialize it, and join it to your main class.

13. Final Program Cleanup

Apart from a final cleanup to make our project more functional, you will learn to create local environment variables for actual testing.

14. Locking

This lecture will cover the locking process and things we need to vary when threading.

1. Multiprocessing Introduction

Here, we will understand multiprocessing and monitor how our CPU functions during multiprocessing.

2. Multiprocessing Queues

Now that we have understood multiprocessing, you will learn how to split our segments over multiple processes in the form of queues to speed up processing and take a load off the process execution.

3. Multiprocessing Pool

After learning how to distribute the work by multiprocessing over different CPUs, you will learn to replicate the process over a multiprocessing program surrounding multiprocessing classes.

4. Multiprocessing Pool Map Multiple Arguments

Let's learn how to pass multiple arguments, passing lists instead of elements in a list or class while executing a code.

5. Multiprocessing Multiple Varying Arguments

In the previous video, we have seen how to provide additional arguments using a partial library in the functools built-in tool; you will now learn to add different elements such as a power list instead.

6. Multiprocessing Checking Elements in List in Certain Ranges

In this video, we will finally revisit the initially more CPU-intensive functions we were using, which will be checking how many values in our comparison list are in a specific range.

1. Introduction to Writing Asynchronous Programs

In this video, we will understand what asynchronous programming is and the fundamental differences between synchronous and asynchronous programming. We will also write our first asynchronous program.

2. Asynchronous Tasks

Here, you will learn to assign asynchronous functions to tasks to execute on the asynchronous syntax.

3. Async Gather Method

Let's understand how to combine two APIs using the gather method with the await function. Here, the function waits for all tasks to complete before executing the next task assigned.

4. Using Async Timeouts

This video will explain what a timeout does in asynchronous programming and how to place timeouts in our syntax.

5. Creating Asynchronous For Loops

This lesson elaborates on what a for loop does and does not do in an asynchronous program code.

6. Using Asynchronous Libraries

Here, you will learn how some libraries support asynchronous libraries, and others do not. You will also learn to look for those libraries and compare them.

7. The Async Wait Statement

In this video, we will look at how we can wait for specific tasks to complete before we execute the code we want to run. Unlike the gather function that waits for all tasks to complete before running a code, this statement waits for specific tasks to complete.

8. Combining Async and Multiprocessing