FTP Upload failed of media manager (October 4.x)

Reproduce:

  1. Clean installation of octobercms 4.x, and use the media in the backend.
  2. Need to install the composer packages manually, mentioned in this link, for using FTP & SFTP media driver. Octobercms 3 update ftp problem - #4 by mkinternet

Symptom:

  1. SFTP works fine, but FTP is not.
  2. Try upload a single file using FTP driver will end with an error as below.
ftp_fput(): php_connect_nonb() failed: Operation now in progress (36)
  1. Try upload two files using FTP driver, the first one uploaded successfully, not for the second file.

Any idea?