Skip to content

ZMQ Frontend + Caching Improvements#7

Merged
Corey-Zumar merged 216 commits intodcrankshaw:high-perf-clipperfrom
Corey-Zumar:zmq_frontend
Sep 12, 2017
Merged

ZMQ Frontend + Caching Improvements#7
Corey-Zumar merged 216 commits intodcrankshaw:high-perf-clipperfrom
Corey-Zumar:zmq_frontend

Conversation

@Corey-Zumar
Copy link
Collaborator

@Corey-Zumar Corey-Zumar commented Sep 12, 2017

To build and run the ZMQ frontend:

./configure --release && cd release && make clipper_zmq_frontend
./src/zmq_frontend/clipper_zmq_frontend --rpc_send_max <max number of rpc requests sent at once> --rpc_recv_max <max number of rpc requests received at once>

To run the benchmark:

python zmq_client_py/zmq_client.py <number of child request processes to create>

Note: This PR leaves noop_container.py untouched. For best scaleout results, add a sleep to the container that is proportional to the number of inputs.

This PR introduces an additional dependency: Facebook's Wangle Library. Installation should be fairly straightforward.

* replace boost futures with folly

* Remove unused futures code

* some code formatting

* Update query frontend dockerfile to support Folly

* fix cache move issue

* remove unused import

* format code

* remove version check

* remove boost thread dependency

* remove boost thread as required component

* format code

* Create base dockerfile for installing clipper deps, query and mgmt inherit from this base

* rename lib-base >> lib_base

* makes FindFolly.cmake search in FOLLY_ROOT

* format code

* Pin library versions in base dockerfile

* Fix FindFolly cmake

* Add additional link flags for folly cmake

* Add missing threadpool imports

* fix boost thread import

* Add more cmake link flags

* Revert "Add more cmake link flags"

This reverts commit 5604672.

* Update QueryFrontendDockerfile

* Update ManagementFrontendDockerfile
* format code

* Update clipper mgr register external output
* Recalculate mean on insertion, improve histogram data precision and value capacity

* Format code
@Corey-Zumar Corey-Zumar merged commit d8b03ae into dcrankshaw:high-perf-clipper Sep 12, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant