Skip to content

Use curl multi interface#60

Open
abellgithub wants to merge 6 commits intoconnormanning:masterfrom
abellgithub:multi
Open

Use curl multi interface#60
abellgithub wants to merge 6 commits intoconnormanning:masterfrom
abellgithub:multi

Conversation

@abellgithub
Copy link
Copy Markdown
Contributor

@abellgithub abellgithub commented Mar 13, 2026

This replaces arbiter's use of the curl "easy" interface with the curl "multi" interface. This was recommended by the author of curl in order to reduce file descriptor use. Each easy "handle" would use at least three file descriptors to facilitate an http transfer. The multi interface uses a single descriptor for each transfer in addition to a couple of descriptors to facilitate asynchronous I/O. This should allow more transfers to occur without running out of file descriptors on system where they are a limited resource.

This change also does modifies the interface internally so that fetched data is moved rather than copied where possible.

@abellgithub
Copy link
Copy Markdown
Contributor Author

See PDAL/PDAL#4985

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant