Sys.Path (still) missing some directories in latest 3.0.17 version

[vinsworldcom]

          @chcg it's better, but now not finding the PythonScript site directory:

'C:\\usr\\bin\\npp64\\plugins\\PythonScript\\lib'
 'C:\\usr\\bin\\npp64\\plugins\\Config\\PythonScript\\lib'
 'C:\\usr\\bin\\npp64\\plugins\\PythonScript\\scripts'
 'C:\\usr\\bin\\npp64\\plugins\\Config\\PythonScript\\scripts'
 'C:\\usr\\bin\\npp64\\plugins\\PythonScript\\lib\\lib-tk'
 'C:\\usr\\bin\\npp64\\plugins\\PythonScript\\python312.zip'
 'C:\\usr\\bin\\npp64\\plugins\\PythonScript'
 'C:\\usr\\bin\\npp64\\plugins\\PythonScript\\Lib'
 'C:\\usr\\bin\\npp64']

Notice :

'C:\usr\bin\npp64\plugins\PythonScript\lib\site-packages

is missing and it was there before (see previous posts).

Also, now it's not finding any of the local system Python paths. Note I do not have the "Prefer installed Python libraries ..." checked, but the previous versions always found the local system Python paths:

'C:\Users\VinsWorldcom\AppData\Roaming\Python\Python3xx\site-packages\**'

This new commit is no longer finding them, and as you can see from above, the "original" 3.0.17 did find the local system Python paths.

At the very least, if it imports the local PythonScript site packages:

plugins\PythonScript\lib\site-packages

Then I can put a .pth file in that directory with the paths of my system Python installation site files and get the functionality I want.

Cheers.

Originally posted by @vinsworldcom in #321 (comment)

[dinkumoil]

I'm facing an issue that could be related to the one here. I use a portable version of Notepad++ v8.6.4 and PythonScript plugin. Until plugin version 3.0.16 everything is fine. Starting with v3.0.17 I get an error message in plugin's console when starting up Notepad++.

Under <Npp-BasePath>\plugins\config\PythonScript\scripts\startup.py I have a user startup script that contains the following lines:

from Utils.PreProcessorLexer import PreProcessorLexer
pre_processor_lexer_interface = PreProcessorLexer()

The module I want to import is <Npp-BasePath>\plugins\config\PythonScript\scripts\Utils\PreProcessorLexer.py. However, the error message mentioned above tells me ModuleNotFoundError: No module named 'Utils', thus PreProcessorLexer.py is not loaded. As already said, this misbehavior started with PythonScript plugin v3.0.17, with v3.0.16 everything works.

Since my knowledge of Python is very limited, I'm not sure if this is related to the issue at hand. Maybe someone more knowledgeable could share their thoughts.

Additional info: <Npp-BasePath>\plugins\config\PythonScript\scripts\Utils does not contain a file named __init__py, in case that would be relevant.

[vinsworldcom]

@dinkumoil almost certainly the same issue I describe. No fix yet.

[mpheath]

@vinsworldcom I have tried this artifact .

Looks like site config changed from enabled to disabled
f4b6f02#diff-9270932fd4a7a300cabd17a1f0462588f5111832df6302c3009a56fdccc5f7eb

PythonScript/PythonScript/src/PythonHandler.cpp

Lines 97 to 102 in 6851859

	// Don't import site - if Python 2.7 doesn't find it as part of Py_Initialize,
	// it does an exit(1) - AGH!
	// unclear if this is still the case with python 3.12
	config.site_import = 0;
	config.use_environment = 0;
	config.user_site_directory = 0;

Check value in PythonScipt sys.flags.no_site which v3.0.17 displays 0 and the artifact displays 1. In C++ source code Py_NoSiteFlag = 1; and config.site_import = 0; are not equivalent including the other 2 config lines.

Output from print() in workaround code with the initial work around commented out.

v3.0.17:

sys.flags.no_site: 0
sys.flags.ignore_environment: 0
sys.flags.no_user_site: 0
site.ENABLE_USER_SITE: True
site.USER_BASE: C:\Users\Michael\AppData\Roaming\Python
site.USER_SITE: C:\Users\Michael\AppData\Roaming\Python\Python312\site-packages

Artifact:

sys.flags.no_site: 1
sys.flags.ignore_environment: 1
sys.flags.no_user_site: 1
site.ENABLE_USER_SITE: None
site.USER_BASE: None
site.USER_SITE: None

For AppData user paths, you could try to add to start.py as a workaround with the artifact

import site
site.ENABLE_USER_SITE = True
site.main()
print('sys.flags.no_site:', sys.flags.no_site)
print('sys.flags.ignore_environment:', sys.flags.ignore_environment)
print('sys.flags.no_user_site:', sys.flags.no_user_site)
print('site.ENABLE_USER_SITE:', site.ENABLE_USER_SITE)
print('site.USER_BASE:', site.USER_BASE)
print('site.USER_SITE:', site.USER_SITE)

to force user site paths to be added to sys.path.

I created a test path in AppData to site-packages and added a foo folder with __init.py__ file inside. import foo causes no error.

List from sys.path:

C:\\Programs\\Notepad++\\8.6.5\\plugins\\PythonScript\\lib
C:\\Programs\\Notepad++\\8.6.5\\plugins\\Config\\PythonScript\\lib
C:\\Programs\\Notepad++\\8.6.5\\plugins\\PythonScript\\scripts
C:\\Programs\\Notepad++\\8.6.5\\plugins\\Config\\PythonScript\\scripts
C:\\Programs\\Notepad++\\8.6.5\\plugins\\PythonScript\\lib\\lib-tk
C:\\Programs\\Notepad++\\8.6.5\\plugins\\PythonScript\\python312.zip
C:\\Programs\\Notepad++\\8.6.5\\plugins\\PythonScript
C:\\Programs\\Notepad++\\8.6.5
C:\\Users\\Michael\\AppData\\Roaming\\Python\\Python312\\site-packages
C:\\Programs\\Notepad++\\8.6.5\\plugins\\PythonScript\\Lib\\site-packages

Still 1 for sys.flags ... though site sets user paths. Weather the sys.flags still at 1 messes up the running, IDK.

sys.flags.no_site: 1
sys.flags.ignore_environment: 1
sys.flags.no_user_site: 1
site.ENABLE_USER_SITE: True
site.USER_BASE: C:\Users\Michael\AppData\Roaming\Python
site.USER_SITE: C:\Users\Michael\AppData\Roaming\Python\Python312\site-packages

Quite a bad hack though at the moment, might be better then the released v3.0.17 (no guarantee). If not worth it, use what ever version that works for you. I have not checked win32gui to know if that works.

@dinkumoil No scripts dir in sys.path of released v3.0.17 so Utils not found by import statement. The artifact might be better else probably go back to v3.0.16 if worked for you.

[vinsworldcom]

For AppData user paths, you could try to add to start.py as a workaround with the artifact

YES! I can and it works fine with my win32gui issue mentioned here.

Currently using:

### START: Deal with 3.0.17 sys.path/site bug: https://github.com/bruderstein/PythonScript/issues/322
import site
site.ENABLE_USER_SITE = True
site.main()
paths = [
    'C:\\Users\\VinsWorldcom\\AppData\\Roaming\\Python\\Python312\\site-packages',
    'C:\\Users\\VinsWorldcom\\AppData\\Roaming\\Python\\Python312\\site-packages\\win32',
    'C:\\Users\\VinsWorldcom\\AppData\\Roaming\\Python\\Python312\\site-packages\\win32\\lib',
    'C:\\Users\\VinsWorldcom\\AppData\\Roaming\\Python\\Python312\\site-packages\\Pythonwin',
    'C:\\usr\\bin\\npp64\\plugins\\PythonScript\\Lib\\site-packages',
]
for path in paths:
    if path not in sys.path:
        sys.path.append(path)
### END: Deal with 3.0.17 sys.path/site bug

Cheers.

[chcg]

@vinsworldcom @dinkumoil Could you please test with artifacts from https://ci.appveyor.com/project/bruderstein/pythonscript/builds/49581044 if with the change 0fc150c behaviour is working again as with 3.0.16.

[vinsworldcom]

@chcg The artifact at 0fc150c seems to have fixed it for me! Using my original 'startup.py' without the fix I mentioned above works as previously with 3.0.16.

Thank you!!

[dinkumoil]

@chcg I can confirm that the artifact fixed the issue. Thank you!

[chcg]

Fixed with https://github.com/bruderstein/PythonScript/releases/tag/v3.0.18