Skip to content

Move out process_result_queue from cycle in LdaMulticore#2358

Merged
menshikh-iv merged 4 commits into
piskvorky:developfrom
horpto:move_result_queue
Jan 29, 2019
Merged

Move out process_result_queue from cycle in LdaMulticore#2358
menshikh-iv merged 4 commits into
piskvorky:developfrom
horpto:move_result_queue

Conversation

@horpto
Copy link
Copy Markdown
Contributor

@horpto horpto commented Jan 28, 2019

  • simplify inner check
  • add heuristic for case with large number of workers

+ simplify inner check
+ add heuristic for case with large number of workers
@horpto
Copy link
Copy Markdown
Contributor Author

horpto commented Jan 28, 2019

It's the light version of my try to refactor LdaMulticore horpto@16fa8fa
I'm not sure should I to continue work on that branch. I've tried to extract work with the queues and pool in the separate entity and then use it as a base for others *Multicore.

Comment thread gensim/models/ldamulticore.py
Comment thread gensim/models/ldamulticore.py
@menshikh-iv menshikh-iv changed the title Move out process_result_queue from cycle in LdaMulticore Move out process_result_queue from cycle in LdaMulticore Jan 29, 2019
@menshikh-iv
Copy link
Copy Markdown
Contributor

awesome @horpto

@menshikh-iv menshikh-iv merged commit 59cf775 into piskvorky:develop Jan 29, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants