Skip to content
  • twitter
  • linkedin
  • github

Focusing illusion

My place to talk about developing, pandas and life

Tag: queue

Using asyncio to download hackernews (at 1300 requests/sec)!

January 21, 2017March 25, 2017 Itiel shwartzasyncio

tl;dr super-fast and easy hn client, based on python 3.6+ As this is my first blog post, I’ll focus on downloading a set of Hackernews posts and user data to use as the data set for the machine learning exercises we’ll look at in future posts.  We’ll start by exploring the different options to create a […]

Itiel Shwartz

Late bloomer in the software world and in the blog community.
The blog is a documentation of my journey to fill knowledge gaps, learn new things and explore what the (software) world have to offer.

Recent Posts

  • Scraping Planet Python – Getting the history of python blogs and projects

     September 4, 2017
  • Using asyncio to download hackernews (at 1300 requests/sec)!

     January 21, 2017
  • Hello world

     January 11, 2017

Recent Comments

itiel
itiel - 24/08/17
Using asyncio to download hackernews (at 1300 requests/sec)!
Hi @royheh:disqus , Each consumer await for only...
Roy Heh
Roy Heh - 21/08/17
Using asyncio to download hackernews (at 1300 requests/sec)!
why use an array for response collection....

Tags

aiohttp asyncio beautifulsoup hacker-news hello-wrold Intro ipython planet-python praw python queue reddit requests scraping
Proudly powered by WordPress | Theme: Amadeus by Themeisle.