Urllib3 download file and write to drive

Nguyen Vu Ngoc Tung. No Comments. Table of Contents. Downloading Files in Python Using wget Module. Leave a Reply Cancel reply Your email address will not be published. Related Posts. Python Web Engineering Web Scraping. Scraping and downloading multiple files from web with Python 1 year ago. Python Software Testing. An introduction to Selenium with Python 1 year ago. Improve this question. Add a comment. Active Oldest Votes. Both are fine and the difference is subtle.

Imho, example 2 uses less memory, especially when downloading big files. Improve this answer. Jeroen Vankelecom Jeroen Vankelecom 6 6 bronze badges.

This is exactly what I wanted to hear. Thank you so much. I searched a lot but there were no answer for this. Add a comment. Active Oldest Votes. Your code snippet is close. Two things worth noting: If you're using resp. This would look something like Improve this answer. And one more question.

You're right, the method should go first, and your snippet will work. Updated my answer. I tried the above code today using urllib3 1. Second, if data is None should be if not data to take into account that data being an empty string, not None.

Otherwise, it works perfectly. Thank you. I also want to thank Alecz below for providing more clues. Good question. To restrict download by file size, we can get the filesize from the Content-Length header and then do suitable comparisons. We can parse the url to get the filename.

This will be give the filename in some cases correctly. However, there are times when the filename information is not present in the url. In that case, the Content-Disposition header will contain the filename information.

Here is how to fetch it. The url-parsing code in conjuction with the above method to get filename from Content-Disposition header will work for most of the cases. Use them and test the results. These are my 2 cents on downloading files using requests in Python.

Let me know of other tricks I might have overlooked. This article was first posted on my personal blog.