-
Notifications
You must be signed in to change notification settings - Fork 243
Try to make lupin working with threads #4333
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Try to make lupin working with threads #4333
Conversation
…thread_an_no_nogil
for more information, see https://pre-commit.ci
|
I have a problem with the branch @samuelgarcia , this is crashing for your dev notebooks with the compute_analyzer() case... |
…erface into thread_an_no_nogil
| if preferred_mp_context is not None and preferred_mp_context != mp_context: | ||
| warnings.warn( | ||
| f"You processing chain using pool_engine='process' and mp_context='{mp_context}' is not possible." | ||
| f"So use mp_context='{preferred_mp_context}' instead") | ||
| mp_context = preferred_mp_context |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What if a preprocessor wants to use spawn on linux (maybe because it uses GPUs)?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Then this is handle because mp_context = preferred_mp_context
This is the same logic as before ?
|
@sam you should merge my optimizations for the waveforms/templates estimations. And do not forget your patch for shallow_copies. |
This is useless and buggy
|
Ready on my side |
for more information, see https://pre-commit.ci
This try to make lupin working with thread.
This will be usefull because on windows the spwan and process parrallel is using too much memory
this replace:
#4331
#4309