如何在并发.futures ProcessPoolExecutor 映射中导入类模块？

Question

我尝试使用consturrent中的ProcessPooleExecutor获得序列对齐得分。Futures模块。但是我有一个错误。

from concurrent.futures import ProcessPoolExecutor
from Bio import Align

def main():
    aligner = Align.PairwiseAligner()

    with ProcessPoolExecutor(max_workers=3) as executor:
        result = list(executor.map(aligner.align, ['fasd', 'fdas'], ['gdfs', 'fdsa']))
    print(result)

if __name__ == '__main__':
    main()

我有一个typeserror。 错误是

concurrent.futures.process._RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/home/bion/.conda/envs/project_env/lib/python3.9/concurrent/futures/process.py", line 208, in _sendback_result
    result_queue.put(_ResultItem(work_id, result=result,
  File "/home/bion/.conda/envs/project_env/lib/python3.9/multiprocessing/queues.py", line 372, in put
    obj = _ForkingPickler.dumps(obj)
  File "/home/bion/.conda/envs/project_env/lib/python3.9/multiprocessing/reduction.py", line 51, in dumps
    cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'Path generator' object
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/bion/playground/notebooks/multiprocessing_test.py", line 12, in <module>
    main()
  File "/home/bion/playground/notebooks/multiprocessing_test.py", line 8, in main
    result = list(executor.map(aligner.align, ['fasd', 'fdas'], ['gdfs', 'fdsa']))
  File "/home/bion/.conda/envs/project_env/lib/python3.9/concurrent/futures/process.py", line 559, in _chain_from_iterable_of_lists
    for element in iterable:
  File "/home/bion/.conda/envs/project_env/lib/python3.9/concurrent/futures/_base.py", line 609, in result_iterator
    yield fs.pop().result()
  File "/home/bion/.conda/envs/project_env/lib/python3.9/concurrent/futures/_base.py", line 446, in result
    return self.__get_result()
  File "/home/bion/.conda/envs/project_env/lib/python3.9/concurrent/futures/_base.py", line 391, in __get_result
    raise self._exception
TypeError: cannot pickle 'Path generator' object

我认为此问题是导入类而不是功能。你有什么想法吗？

我导入功能。它起作用的

def foo(a, b):
    return a+b


with ProcessPoolExecutor() as executor:
    result = list(executor.map(foo, [1, 2, 3], [4, 5, 6]))
print(result)

是我的代码流

seqA = 'asdf'
seqB = 'asgf'

seq_length = min(len(seqA), len(seqB))
alignments = aligner.align(seqA, seqB)
similarity_score = alignments[0].score / (seq_length * aligner.match_score)

，我想运行许多SEQA和SEQB sequences_a = ['adf'，'agsdaf'，...] sequences_b = ['gafs，'，'asgdasdf'，'afasdf'，...]