Skip to content

Latest commit

 

History

History
32 lines (25 loc) · 1.07 KB

File metadata and controls

32 lines (25 loc) · 1.07 KB

SWDevProj

Memory/Ownership Notes

  • Array, Map, Queue all steal ownership of what's passed into them

  • Test files without memory leaks:

    • array, queue, map
    • serialization
    • message, cache, blocks, distributed array
    • schema
    • store, storeIntegration
    • trivial test (all 4 trials)
    • demo test
    • Sorer
    • Linus
  • Tests with memory leaks/unchecked

    • Wordcount (1 leak - 10 bytes)

ReceiverThread Info

Receives WaitAndGet message it can't currently respond to -> add to KVStore's msgsCache_ (map). When new data is added to a KVStore (RT calls kv_->put()), KVStore adds it locally, then checks the msgCache_ map to see if anyone else was looking for the data that just came in. It sends the responses if available

Additional notes

  • Don't use args unless it's specifically for network; pseudo doesn't use all of them
  • Key stored for each block (DF is DataFrame's key): Key('DF-colIdx-blockIdx', blockIdx % numNodes)
  • Real Network sends a Message as the serialized msg type prepended to the serialized message.

Notes for things to improve from before: