Comments on: Python – How to Receive Full Data with the recv() Socket function

By: Anibal

Anibal — Mon, 23 May 2022 16:06:50 +0000

In Python 3.8 this line doesn’t work:

return ”.join(total_data)

It throws:

return ”.join(total_data)
TypeError: sequence item 0: expected str instance, bytes found

My data is a bunch of characters (not binary data), but I have control characters in the stream.

And if I replace it with:

return ”.join(str(total_data))

I’m basically changing the control character \x0b to a literal string with a backslash, followed by x, followed by 0 and then b. That’s not what I want. Not sure how to address this.

By: cyberthereaper

cyberthereaper — Tue, 17 Nov 2020 17:56:16 +0000

I solved the problem with a simple method. i am using python3.8

After extracting the data with s.recv (4096), do the following.

results = s.recv(4096)

while (len(results) > 0):
print(results)
results = s.recv(4096)

the above command will give you all the data

By: Silver Moon

Silver Moon — Mon, 28 Sep 2020 16:54:49 +0000

In reply to Eduardo.

yes you are correct.
the code is not fully compatible with python 3.
it needs to be edited.

By: Eduardo

Eduardo — Sun, 27 Sep 2020 01:10:30 +0000

SADLY. This doesn’t work in python 3. You have to decode I you will get errors by doing all at once

By: supra

supra — Tue, 28 Jul 2020 11:19:24 +0000

In reply to Andres A. How do you called recv_timeout function to socket?

By: Rufus V. Smith

Rufus V. Smith — Wed, 06 Sep 2017 19:58:45 +0000

I’m not sure the comment on the time.sleep(0.1) between read requests is really appropriate. I don’t believe it is to “indicate a gap”, it is probably to reduce load on the CPU caused by spinning for new data (I’ve written a lot of code like this). If you remove that time, you’ll see the CPU load on your computer skyrocket, perhaps to 100% for no reason. The code is quite good however. The only other comment I have is the “Wait for any data” and “wait for end of data” should probably each have their own values, not for one to be twice the other. Usually the “Wait for any data” can be quite long, and the “wait for end of data” is quite short.

By: James

James — Thu, 13 Apr 2017 02:13:25 +0000

This is better than any answer on Stackoverflow by a long shot.

By: James

James — Thu, 13 Apr 2017 02:10:36 +0000

This works great! Totally solved my problem.

By: Ben

Ben — Tue, 28 Feb 2017 02:20:29 +0000

Hello, i have a question. Is there a reason 8192 is used as the number in recv? What’s its advantage to putting any other number there?

By: Shuvo

Shuvo — Sat, 25 Feb 2017 01:27:13 +0000

What modification can be done in this code in order to download a webpage pointed by a URL and all the image objects associated with the base html?

By: ab1

ab1 — Tue, 21 Feb 2017 07:57:22 +0000

Thank you, the only complete example that works!

By: Andres A

Andres A — Thu, 02 Feb 2017 17:25:42 +0000

I just added your recv_timeout function to mine and works perfect! Thanks!

By: Ryan

Ryan — Sat, 10 Sep 2016 01:27:31 +0000

Thank you.
Thank you so much.

By: Ibrah

Ibrah — Sun, 10 Jul 2016 08:58:58 +0000

fell in love with you code

By: Hurin

Hurin — Wed, 23 Jul 2014 10:23:00 +0000

I love you. You just perfectly solved the problem I had with this explanation. Thanks!

By: VectorEQ

VectorEQ — Thu, 19 Jun 2014 13:05:00 +0000

if you get a 302 redirect just make another request. the redirect will contain the url you need to be redirected too. run the same thing ,but have it point to the redirect url.

By: berebere

berebere — Sun, 27 Apr 2014 09:11:00 +0000

This is very interesting…How do I get a full data like that to be displayed on a broswer..??

By: Vishal

Vishal — Wed, 19 Feb 2014 03:36:00 +0000

First of all a lot of Thanks for this beautiful and lucid post. Helps in clarifying lot of stuff so quickly! Great Job!

I have one question on the response returned from the server:

If you see the response returned is a 302:
…………………………………………
302 Moved
The document has moved
…………………………………………

Now browsers will do an auto forward and urllib2 library also has classes to handle the redirects, but I want to know how can this be natively handled via Sockets. I am getting 302 for almost all the sites.

Any help is much appreciated!

By: Anton

Anton — Thu, 23 Jan 2014 14:30:00 +0000

have no idea why, but it works. Thanks.