local client = require'http_client'

HTTP 1.1 coroutine-based async client in Lua.

Features https, gzip compression, persistent connections, pipelining, multiple client IPs, resource limits, auto-redirects, auto-retries, cookie jars, multi-level debugging, caching, cdata-buffer-based I/O. In short, your dream library for web scraping.

Status

Alpha

Configuration

API

client:new(opt) -> client

Create a client object. The opt table can contain:

Note: A target is a combination of (vhost, port, client_ip) on which one or more HTTP connections can be created subject to per-target limits.

Pipelined requests

A pipelined request is a request that is sent in advance of receiving the response for the previous request. Most HTTP servers accept these but in a limited number.

Spawning a new connection for a new request has a lot more initial latency than pipelining the request on an existing connection. On the other hand, pipelined responses come serialized and also the server might decide not to start processing pipelined requests as soon as they arrive because it would have to buffer the results before it can start sending them.

client:request(opt) -> req, res

Make a HTTP request. This must be called from a scheduled socket thread.

The opt table can contain:

client:close_all()

Close all connections. This must be called after the socket loop finishes.

Last updated: 20 months ago | Edit on GitHub