Python子进程从houdini运行miniconda3 / etc / profile.d / conda.sh

编程问答 2022-06-12

问题描述

我被一种奇怪的行为困住了。我想从Houdini（https://www.sidefx.com/）创建一个流程，该流程应初始化conda并激活环境。 如果我使用python 2.7在终端上运行代码，则一切正常。

import os
import sys
import subprocess
conda_path = "/home/alelidis/miniconda3"

print("============================ Python version ============================")
print (sys.version)

my_env = {}
my_env["PYTHONHOME"] = conda_path + ":" + conda_path + "/envs/tflow1.15.0-cuda10-python3"
my_env["PATH"] = '/home/alelidis/miniconda3/bin:/opt/hfs18.0.566/bin:/opt/hfs18.0.566/houdini/sbin:/usr/bin'

script_cmd = 'source ' + os.path.join(conda_path,'etc/profile.d/conda.sh')  + ' && ' 
script_cmd += 'conda activate tflow1.15.0-cuda10-python3' + ' && '
script_cmd += 'python --version' + ' && '
script_cmd += 'conda deactivate'


#print script_cmd
print("---------------------")
print ("PATH:")
# If shell=True,the command string is interpreted as a raw shell command.
print subprocess.check_output('echo $PATH',shell=True,env=my_env,executable='/bin/bash')
print ("PYTHONHOME:")
print subprocess.check_output('echo $PYTHONHOME',executable='/bin/bash')
print ("python version:")
print subprocess.check_output('python --version',executable='/bin/bash')
print ("python should be: 3.8.3")

print("++++++++++++++++++++++++++")
print subprocess.check_output(script_cmd,executable='/bin/bash')

返回以下输出：

============================ Python version ============================
2.7.15 |Anaconda,Inc.| (default,Dec 14 2018,19:04:19) 
[GCC 7.3.0]
---------------------
PATH:
/home/alelidis/miniconda3/bin:/opt/hfs18.0.566/bin:/opt/hfs18.0.566/houdini/sbin:/usr/bin

PYTHONHOME:
/home/alelidis/miniconda3:/home/alelidis/miniconda3/envs/tflow1.15.0-cuda10-python3

python version:
Python 3.8.3

python should be: 3.8.3
++++++++++++++++++++++++++
source /home/alelidis/miniconda3/etc/profile.d/conda.sh && conda activate tflow1.15.0-cuda10-python3 && python --version && conda deactivate
++++++++++++++++++++++++++
Python 3.7.9

但是，当我尝试从Houdini运行相同的代码时，出现以下错误：

============================ Python version ============================
2.7.15 (default,Mar 11 2020,10:04:04) 
[GCC 6.3.1 20170216 (Red Hat 6.3.1-3)]
---------------------
PATH:
/home/alelidis/miniconda3/bin:/opt/hfs18.0.566/bin:/opt/hfs18.0.566/houdini/sbin:/usr/bin

PYTHONHOME:
/home/alelidis/miniconda3/bin:/home/alelidis/miniconda3/envs/tflow1.15.0-cuda10-python3

python version:
Python 3.8.3

python should be: 3.8.3
++++++++++++++++++++++++++
source /home/alelidis/miniconda3/etc/profile.d/conda.sh && conda activate tflow1.15.0-cuda10-python3 && python --version && conda deactivate
++++++++++++++++++++++++++
Traceback (most recent call last):
  File "/home/alelidis/miniconda3/bin/conda",line 12,in <module>
    from conda.cli import main
  File "/home/alelidis/miniconda3/lib/python3.8/site-packages/conda/__init__.py",line 22,in <module>
    from .common.compat import text_type,iteritems
  File "/home/alelidis/miniconda3/lib/python3.8/site-packages/conda/common/compat.py",line 14,in <module>
    from tempfile import mkdtemp
  File "/home/alelidis/miniconda3/lib/python3.8/tempfile.py",line 45,in <module>
    from random import Random as _Random
  File "/home/alelidis/miniconda3/lib/python3.8/random.py",line 41,in <module>
    from math import log as _log,exp as _exp,pi as _pi,e as _e,ceil as _ceil
ModuleNotFoundError: No module named 'math'

我不知道为什么会这样！任何帮助或指针将不胜感激！

解决方法

这仍然可能是环境问题。尝试继承当前环境，然后对其进行编辑，而不要创建空白环境。您还将完全重写PATH env var，而不是添加/编辑可能导致问题的条目。另一尝试是设置working directory for the subprocess command。但是仍然不确定为什么会收到该错误。

my_env = os.environ.copy()
my_env["PYTHONHOME"] = conda_path + ":" + conda_path + "/envs/tflow1.15.0-cuda10-python3"
my_env["PATH"] = '/home/alelidis/miniconda3/bin:/opt/hfs18.0.566/bin:/opt/hfs18.0.566/houdini/sbin:/usr/bin'

您也可以尝试执行python脚本，而不使用标准I / O。我没有尝试过Anaconda，但我已经从Houdini成功启动了MayaPy，如下所示：

cmdArgs = [mayaPyPath,pyScriptPath]
output = subprocess.call(cmdArgs,cwd=mayaPyWorkDir,shell=False,env=curEnv)
,

我发现Houdini正在覆盖我使用python设置的环境变量。因此，在通过内部GUI删除PYTHONHOME变量后，它按预期工作。老实说，我仍然不确定为什么会这样。

anacondabashhoudinilinuxlinuxpython