Hi, how should I run and test this project?

[Joe0826]

Hi,
I have been read your paper recently, and I would like to run this project on my servers, the current server version is Ubuntu 16.04.6.
Could you please tell me how to run and test this project memec detail? Thank you very much

Best

[helenchw]

Thanks for your interest in MemEC. You may try the following steps on a Ubuntu 16.04 server.

1. Install project dependencies

   sudo apt install adduser automake yasm libtool make g++

2. Download and install spread library

   • http://old-releases.ubuntu.com/ubuntu/pool/universe/s/spread/libspread1_3.17.4-4_amd64.deb
   • http://old-releases.ubuntu.com/ubuntu/pool/universe/s/spread/libspread1-dev_3.17.4-4_amd64.deb
   • http://old-releases.ubuntu.com/ubuntu/pool/universe/s/spread/spread_3.17.4-4_amd64.deb

   sudo dpkg -i *spread*.deb

3. Compile ISA-L library

   cd lib/isa-l-2.14.0
   ./autogen.sh
   ./configure --prefix=$(pwd)
   make install

4. Go back to MemEC root folder and compile MemEC

   make

5. Start a standalone Spread server in a separate terminal

   sudo spread -n localhost

6. Use the following modified script to start a local MemEC cluster with 1 proxy, 1 coordinator and 10 servers, in a separate terminal (see the original script in scripts/local/run_screens.h)

   #!/bin/bash
   
   SLEEP_TIME=0.4
   
   # coordinator
   tmux new -d -s coordinator 'bin/coordinator'
   
   sleep ${SLEEP_TIME}
   
   # servers
   for i in {1..10}; do
           rm -rf /tmp/memec/server${i}
           mkdir -p /tmp/memec/server${i} 2> /dev/null
           tmux new -d -s server${i} \
                   "bin/server -v -o server server${i} tcp://127.0.0.1:911${i} -o storage path /tmp/memec/server${i}"
           sleep ${SLEEP_TIME}
   done
   
   # proxy
   tmux new -d -s client "bin/client"
   
   
   read -p "Press Enter to terminate all instances..."
   killall coordinator server client

7. Download YCSB v0.7.0 from https://github.com/brianfrankcooper/YCSB/tree/0.7.0 and install the dependency

   sudo apt install -y maven openjdk-8-jdk

8. Copy all files under benchmark/ycsb-0.7.0-patch/ into the YCSB root folder

9. Go to YCSB root folder and build the MemEC YCSB client

   mvn -pl memec -am clean package

10. Test using the YCSB client

    bin/ycsb load memec -P workloads/workloada -p fieldcount=1 -p readallfields=false -p memec.host=127.0.0.1 -p memec.port=10091 -p memec.key_size=255 -p memec.chunk_size=4096

    bin/ycsb run memec -P workloads/workloada -p fieldcount=1 -p readallfields=false -p memec.host=127.0.0.1 -p memec.port=10091 -p memec.key_size=255 -p memec.chunk_size=4096

For more testing setup and details, you may refer to the benchmarking scripts under scripts/.

[Joe0826]

Thank you very much~