☑️ try update BOW matrix to TF-IDF weighted matrix. See if non-integer matrix could work.
☑️ pick more comments for each subreddit, say, 10000.
☑️ use > 10% for topic cutoff, and combine those topic vectors with their weights.
- use subreddit comment frequency to weight the similarity.
- find the most voted comments, and find that if they are written by generalist or specialist. find the distribution for each subreddit community. How to measure the "success" from the perspective of generalist and specialist.
- plots of "fraction of specialist" to the "average comment score", size by the number of comments.
☑️ try update BOW matrix to TF-IDF weighted matrix. See if non-integer matrix could work.
☑️ pick more comments for each subreddit, say, 10000.
☑️ use > 10% for topic cutoff, and combine those topic vectors with their weights.