Mailman 3 - Python.NET

Roslyn from python import errors
by Charles Medcoff 05 Sep '24

05 Sep '24

My goal is to write a python script for analyzing C# code by way of the Roslyn API. I'm running into a lot of issues with imports. I'm installing nuget packages then using python code to find the path to the relevant DLL using AddRef but subsequent imports throw. Does anyone have any examples of using Roslyn?

1 0

Request for help with Pythonnet Integration Error in Unity Project
by 河野晟生 18 Aug '24

18 Aug '24

Dear Pythonnet Support Team, I am currently working on a Unity project where I am using the Pythonnet library to integrate Python scripts with C# code. Specifically, I am attempting to utilize the HugChat library from within my Unity project. However, I have encountered the following error: PythonException: SystemError : initialization of md__mypyc did not return an extension module [' File "C://Users//HOME/u3000anyone//AppData//Local//Programs//Python//Python38//lib//site-packages//hugchat//hugchat.py", line 1, in <module>/n import requests/n', ' File "C://Users//HOME/u3000anyone//AppData//Local//Programs//Python//Python38//lib//site-packages//requests//__init__.py", line 48, in <module>/n from charset_normalizer import __version__ as charset_normalizer_version/n', ' File "C://Users//HOME/u3000anyone//AppData//Local//Programs//Python//Python38//lib//site-packages//charset_normalizer//__init__.py", line 24, in <module>/n from .api import from_bytes, from_fp, from_path, is_binary/n', ' File "C://Users//HOME/u3000anyone//AppData//Local//Programs//Python//Python38//lib//site-packages//charset_normalizer//api.py", line 5, in <module>/n from .cd import (/n', ' File "C://Users//HOME/u3000anyone//AppData//Local//Programs//Python//Python38//lib//site-packages//charset_normalizer//cd.py", line 14, in <module>/n from .md import is_suspiciously_successive_range/n'] at Python.Runtime.Runtime.CheckExceptionOccurred () (at <7702cb0f55bd42e3a72a1a6382f5edbc>:0) Python.Runtime.PythonEngine.ImportModule (System.String name) (at <7702cb0f55bd42e3a72a1a6382f5edbc>:0) Python.Runtime.Py.Import (System.String name) (at <7702cb0f55bd42e3a72a1a6382f5edbc>:0) AIVtuberProject.get_response () (at Assets/Scripts/AIVtuberProject.cs:31) AIVtuberProject.main_func () (at Assets/Scripts/AIVtuberProject.cs:75) AIVtuberProject.OnSendButtonClicked () (at Assets/Scripts/AIVtuberProject.cs:82) System.Runtime.CompilerServices.AsyncMethodBuilderCore+<>c.<ThrowAsync>b__7_0 (System.Object state) (at <b89873cb176e44a995a4781c7487d410>:0) UnityEngine.UnitySynchronizationContext+WorkRequest.Invoke () (at <10871f9e312b442cb78b9b97db88fdcb>:0) UnityEngine.UnitySynchronizationContext.Exec () (at <10871f9e312b442cb78b9b97db88fdcb>:0) UnityEngine.UnitySynchronizationContext.ExecuteTasks () (at <10871f9e312b442cb78b9b97db88fdcb>:0) This error occurs when trying to import the requests module within HugChat. I have confirmed that all necessary Python packages are installed and accessible. I am using Python 3.8 with Pythonnet version 2.5.2. I would greatly appreciate your assistance in resolving this issue. If you need any additional information, please let me know. Thank you in advance for your help. Best regards, Kouno Teruki

1 0

Debugging python code embedded in C# in Visual Studio 2022
by ikargm＠gmail.com 22 Nov '23

22 Nov '23

Hi, I have a project in C# and visual studio 2022. The project uses a few scripts in python that are embedded in C# code using the Python.Net interface. I have used the application with several several different versions of python and wotkd perfectly. I am looking a descrptive and usable way to be able to debug my python code while I am in C# code and debugging it. In other words to be able to break in python code from C# code. With IronPython this was doable in Visual studio but I am not using IronPython anymore. Thanks in advance. IK

1 0

Help with an ObservableCollection
by hopkins.jesse＠gmail.com 09 May '23

09 May '23

Hi, I'm newly trying to use python .NET to embed some C# dlls into my python program. I'm very new to anything .NET, so I apologize if this is a simple question. In order to execute part of the program I need to submit some information back to an object in one of the dlls. This class is expecting an ObservableCollection of objects. I tried submitting a python list, but got an error that it couldn't be converted to the correct type. Unfortunately I can't share the API I'm using for licensing reasons, but here's a short pseudo code of the C# (using 'vegetable' to stand in for some proprietary object types): private ObservableCollection<VegetableRecord> vegetableRecords private VegetableSequence VegetableSequence .... newVegetableRecord1 = new VegetableRecord('Potato') newVegetableRecord2 = new VegetableRecord('Carrot') vegetableRecords.Add(newVegetableRecord1) vegetableRecords.Add(newVegetableRecord2) ... VegetableSequence.SequenceRecordSet = vegetableRecords I'm trying to recreate this in python, essentially, using the VegetableRecord and VegetableSequence imported from the dll : vegetableRecords = [] VegetableSequence = VegetableSequence() .... newVegetableRecord1 = VegetableRecord('Potato') newVegetableRecord2 = VegetableRecord('Carrot') vegetableRecords.append(newVegetableRecord1) vegetableRecords.append(newVegetableRecord2) ... VegetableSequence.SequenceRecordSet = vegetableRecords That fails with an error that is essentially: TypeError: 'list' value cannot be converted to System.Collections.Generic.ICollection`1[VegetableRecord] Any advice? Thanks! - Jesse

1 1

Doubt about compatibility between Python version and Pythonnet
by Alvaro Castro, Fernando 26 Apr '23

26 Apr '23

Hello, I contact you because we are doing some tests using Python 3.10 and Python 3.8. We have seen that using Python 3.8 we can install pythonnet 2.5.2, but using Python 3.10 pythonnet 2.5.2 installation failed. In the information of Pythonnet it seems that 2.5.2 can be installed with Python versions between 3.7 and 3.11. Can you help me with this please? Is there any manner or procedure to install this specific pythonnet version with Python 3.10? Thank you in advance. Fernando. This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.

2 1

import failing help needed
by Mark A Gregory 12 Feb '23

12 Feb '23

Windows 11. Visual Studio 2022. Python311 install and working using VSCode. Pythonnet installed using VS 2022 nuget and pip3 in command prompt I have this code and it is failing at import pyproj - error is no _socket Help appreciated public AzimuthBoundingBoxCalculator() { string? GetPythonLib() { if (RuntimeInformation.IsOSPlatform(OSPlatform.OSX)) { return "/Library/Frameworks/Python.framework/Versions/3.11/lib/libpython3.11.dylib"; } if (RuntimeInformation.IsOSPlatform(OSPlatform.Windows)) { return @"C:\Users\basic\AppData\Local\Programs\Python\Python311\python311.dll"; } if (RuntimeInformation.IsOSPlatform(OSPlatform.Linux) || RuntimeInformation.IsOSPlatform(OSPlatform.FreeBSD)) { return "libpython3.11.so"; } return null; } string pythonDll = GetPythonLib(); Runtime.PythonDLL = pythonDll; Environment.SetEnvironmentVariable("PYTHONNET_PYDLL", pythonDll); PythonEngine.Initialize(); _gilState = Py.GIL(); using (Py.GIL()) { dynamic pyproj = Py.Import("pyproj"); _geod = pyproj.Geod(ellps: "WGS84"); } } Regards Mark Gregory

1 0

python3-pythonnet in Yocto project
by egyszeregy＠freemail.hu 04 Dec '22

04 Dec '22

In Yocto project python3-pythonnet module is available from now, feel free to use for any embedded Linux image build. https://layers.openembedded.org/layerindex/recipe/327446/

1 0

Release 3.0.0
by Benedikt Reinartz 30 Sep '22

30 Sep '22

Hi all, I'm proud to finally release the first new major version of Python.NET in 7 years. This is the culmination of over 2 years of work from many contributors to modernise the code base and support modern .NET and Python versions. Highlights: - Support for Python 3.9 and 3.10 - Support for .NET 6 - Codec system to control conversions between .NET and Python objects - Single assembly for all Python versions and operation systems (and thus also just a single wheel) - Significantly simplified the build system, only requires a modern .NET SDK to build the Python package The new package is available from PyPI and Nuget, respectively. Updated documentation is available here: https://pythonnet.github.io/pythonnet/ In particular, there is an updated Getting Started section that documents using .NET 6 (coreclr) from Python: https://pythonnet.github.io/pythonnet/python.html#getting-started While we tried to keep this release as backwards-compatible as possible, there are still some breaking changes. The changelog is available here: https://github.com/pythonnet/pythonnet/blob/master/CHANGELOG.md#300---2022-… Best Regards Benedikt

1 0

Pythonnet causes Exception has occurred: "TypeLoadException" when running .net dll on linux
by Hossam Alzomor 27 Sep '22

27 Sep '22

Hello, I have a dotnet dll build using dotnet6.0 on Ubuntu 20.04. I could use the dll using C# application. but when I try to test it using python script with pythonnet on Ubuntu 20.04 , I get the following error " Exception has occurred: TypeLoadException Could not load type of field 'ElmosLCC.ElmosLidarController:_updateWatchdog' (37) due to: Could not resolve type with token 0100004a from typeref (expected class 'System.Timers.Timer' in assembly 'System.ComponentModel.TypeConverter, Version=6.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a') assembly:System.ComponentModel.TypeConverter, Version=6.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a type:System.Timers.Timer member:(null) at (wrapper managed-to-native) System.RuntimeType.GetFields_native(System.RuntimeType,intptr,System.Reflection.BindingFlags,System.RuntimeType/MemberListType) at System.RuntimeType.GetFields_internal (System.String name, System.Reflection.BindingFlags bindingAttr, System.RuntimeType+MemberListType listType, System.RuntimeType reflectedType) [0x0001b] in <de882a77e7c14f8ba5d298093dde82b2>:0 at System.RuntimeType.GetField (System.String name, System.Reflection.BindingFlags bindingAttr) [0x00015] in <de882a77e7c14f8ba5d298093dde82b2>:0 at System.Type.GetField (System.String name) [0x00000] in <de882a77e7c14f8ba5d298093dde82b2>:0 at Python.Runtime.ClassManager.CreateClass (System.Type type) [0x00079] in <3972e4befd8f45a1b7c0e96a8f1f659a>:0 at Python.Runtime.ClassManager.GetClass (System.Type type) [0x00015] in <3972e4befd8f45a1b7c0e96a8f1f659a>:0 at Python.Runtime.ModuleObject.GetAttribute (System.String name, System.Boolean guess) [0x0008e] in <3972e4befd8f45a1b7c0e96a8f1f659a>:0 at Python.Runtime.ModuleObject.tp_getattro (System.IntPtr ob, System.IntPtr key) [0x00073] in <3972e4befd8f45a1b7c0e96a8f1f659a>:0 " I tested the dll on windows machine with pythonnet and it's working fine. Best Regards Hossam Alzomor [IZB Wolfsburg 2022 | Hall 2 | Booth 2405 | 11 - 13 Oct, 2022 | Wolfsburg]

1 0

Problem with importing twice (PythonNet)
by Bodurov Daniel (RBBG/ENG23) 30 Aug '22

30 Aug '22

Hello PythonNet Developers, I have a problem with running scripts in sequence in my C# Unit Tests. When I run my test alone it works perfectly, but when I run all my tests, one specific test fails with Memory Access Violation Error. This specific test is a test with 2 script imports or 2 scripts compilations. string Script1 = "plain_tests.py"; string Script2 = "fitting_tests.py"; PythonEngine.Initialize(); var script1 = new Script(Script1); script1.Execute(); var script2 = new Script(Script2); script2.Execute(); Where: public class Script { public string Filename { get; private set; } private PyObject Compiled; public PyScope Scope; public Script(string filename) { Filename = filename; var content = File.ReadAllText(filename); var py_lock = PythonEngine.AcquireLock(); Compiled = PythonEngine.Compile(content, filename, RunFlagType.File); PythonEngine.ReleaseLock(py_lock); Reset(); } public void Execute() { var py_lock = PythonEngine.AcquireLock(); Scope.Execute(Compiled); PythonEngine.ReleaseLock(py_lock); } public void Reset() { var py_lock = PythonEngine.AcquireLock(); Scope = Py.CreateScope(); PythonEngine.ReleaseLock(py_lock); } } The place it fails is on script2.Execute(); Scope.Execute(Compiled) fails on the seconds script. But this only happens when running all 10 unit tests. When running only this one specific test alone - there is no problem. The issue occurs both from direct python function calling from Imported script and from this way I presented - compiling and executing script. Do you have any idea how to solve this issue with sequential testing? I really need your help.. I have been trying to solve this for 3 weeks now. I am really really stuck. Thanks in advance! Best regards, Daniel Bodurov

1 0

convert python.runtime.pyobject to .net datatype
by anilshrirao＠gmail.com 23 Jul '22

23 Jul '22

Hi, Does anyone know how to convert the pyobject dataype to .net datatype? I need to send the image from python to .net code. Thanks,

1 0

TypeError: No method matches given arguments for SetContext: (<class 'int'>)
by Steven Manross 15 Jul '22

15 Jul '22

I got my initial code working on the C DLL and it's creating snapshot sets as I want. I am now having a problem with a function to query ALL the snapshots. This value can be sent to SetContext() In [39]: alphavsslib.VssSnapshotContext.All Out[39]: 4294967295 4294967295 = 0xFFFFFFFF A sample of the call is here: https://github.com/alphaleonis/AlphaVSS-Samples/blob/8482e83dd13cb8467860e8… # this is the declaration of SetContext virtual void SetContext(VssSnapshotContext context); This is the declaration for All: VssSnapshotContext.All = 0xFFFFFFFF https://github.com/alphaleonis/AlphaVSS/blob/13462e657f7993da5c80f835d219bb… However, this line results in a Type error In [40]: ctx = cmp.SetContext(alphavsslib.VssSnapshotContext.All) --------------------------------------------------------------------------- TypeError Traceback (most recent call last) Input In [40], in <cell line: 1>() ----> 1 ctx = cmp.SetContext(alphavsslib.VssSnapshotContext.All) TypeError: No method matches given arguments for SetContext: (<class 'int'>) I've tried converting the value using: ctx = cmp.SetContext(System.Convert.ToUInt32(alphavsslib.VssSnapshotContext.All)) *And* ctx = cmp.SetContext(ctypes.c_uint32(alphavsslib.VssSnapshotContext.All).value) but the same error occurs I can get the function to succeed (albeit it doesn't show me what I want) with this: cmp.SetContext(ctypes.c_int32(alphavsslib.VssSnapshotContext.All).value) ... because ctypes.c_int32(alphavsslib.VssSnapshotContext.All).value = -1 I believe it's possible that this could be related to the link below but I can't be sure because I am not a C developer and I can't determine how this was fix from the notes in the link. Granted, the author is on CentOS, and I'm on Windows... but the backstory behind the issue sounds like it's related. https://github.com/pythonnet/pythonnet/issues/950 I'm currently running on pythonnet 2.5.2 and Python 3.9.13 (tags/v3.9.13:6de2ca5, May 17 2022, 16:36:42) [MSC v.1929 64 bit (AMD64)] on win32 Any thoughts or suggestions would be greatly appreciated. Steven

2 2

pythonnet crashes python 39
by Florin Atasiei 12 Jul '22

12 Jul '22

Hello gutlys, thanks for the good work I encountered a problem on all 3.0.0 versions. I have a small exe written in C# that opens up a python process and then puts it to execute python modules. On one od the modules I have import clr. When it imports that module I get Fatal Python error:take_gil: NULL tstate and then python crashes and also the main thread from my program. This is not happening on 2.5.2 release but with that i have other problems since is not for py39 If I open python 39 and do the import clr it works. Is only happening when the import is done from a subprocess. I just thought this can be a good info for you guys. Keep in touch.

2 1

How to run Python in Visual Studio Code? Demo Sample
by hemendra＠theninehertz.com 12 Jul '22

12 Jul '22

Hi, I need your assistance how to run Python in Visual Studio Code demo samples. Best Regards, Hemendra Singh | CEO and Co-founder The NineHertz Website: https://theninehertz.com/

1 0

BadImageFormatException or FileNotFoundException- pythonnet and AlphaVSS
by Steven Manross 11 Jul '22

11 Jul '22

Howdy all, I am somewhat new to pythonnet and .NET programming, and just joined the mailing list. You have my apologies if I am missing something simple. I am aware that BadImageFormatException suggests that I'm trying to open an x64 DLL on a 32-bit OS or python installation (or vice versa), but neither seem to be the case (that I can tell). Depending on exactly how I call the code, I get a File Not Found or Bad Image Exception. The File Not Found is interesting since the files live in the same directory as a working DLL (AlphaVSS.Common works - built to run on any architecture, AlphaVSS.x64 doesn't). Specifics: * Python 3.9.13 (tags/v3.9.13:6de2ca5, May 17 2022, 16:36:42) [MSC v.1929 64 bit (AMD64)] on win32 * uninstalled Python 3.10 temporarily so I cant get you that detail (sorry) * And the Windows version clearly states it's Windows Server 2016 x64 I'm doing my testing from ipython. The code below was tested with Python 3.9 x64 (pythonnet 2.5.2 via wheel file) and Python 3.10 x64 (installed pythonnet 3.0.0-dev1 from git master a few days ago) on Windows Server 2016 x64 Evaluation patched for current .NET Frameworks 2022-06 and both produce an error on the following code. AlphaVSS DLLs were generated via powershell/nuget, and I just copied the DLLs from my powershellmodules dir to the "clr_dir" below for testing (documentation suggests you copy the files to the same directory for use). This DLL was created for .NET Framework 4.5 and I've installed Framework 4.8 and this Cumulative update: * 2022-06 Cumulative Update for .NET Framework 4.8 for Windows Server 2016 for x64 (KB5014630) This code is eventually intended to manipulate the Volume Shadow Copy Service on Windows. I am aware that there is limited functionality for ShadowCopies from DISKSHADOW and WMI, but wanted to get more functionality from this VSS .NET Library (specifically Shadow Copy Sets), and pythonnet seemed like a great way to implement this code in my favorite scripting language. Here is the documentation for the DLLs (version 2.0.0) if anyone wants that: https://alphavss.alphaleonis.com/api/Alphaleonis.Win32.Vss.html git source: https://github.com/alphaleonis/AlphaVSS I double checked permissions on the DLLs and I have full control as the administrator. UAC is completely turned off on this machine (if it matters). Any suggestions would be appreciated. This is a test system, so I can do just about anything to it including rebuilding it from scratch as it was built specifically for testing this. This is a VM on Hyper-V 2016 (I doubt that matters). Thank you for your time! Steven # ipython dir output In [16]: ! dir "c:\users\administrator\desktop\alphavss" Volume in drive C has no label. Volume Serial Number is 8C70-F8A3 Directory of c:\users\administrator\desktop\alphavss 07/09/2022 03:10 AM <DIR> . 07/09/2022 03:10 AM <DIR> .. 12/03/2019 08:37 PM 69,632 AlphaVSS.Common.dll 12/03/2019 08:37 PM 21,408 AlphaVSS.Common.pdb 12/03/2019 08:37 PM 618,522 AlphaVSS.Common.xml 12/03/2019 08:37 PM 325,120 AlphaVSS.x64.dll 12/03/2019 08:37 PM 271,872 AlphaVSS.x86.dll 12/03/2019 08:29 PM 342,392 Ijwhost.dll 07/09/2022 03:09 AM <DIR> runtimes 07/09/2022 03:10 AM <DIR> win-x64 07/09/2022 03:10 AM <DIR> win-x86 # code import sys import clr import System # from System import Reflection clr_dir = "C:\\Users\\Administrator\\Desktop\\AlphaVSS" if clr_dir not in sys.path: sys.path.append(clr_dir) # common_vss = Reflection.Assembly.LoadFile(f'{clr_dir}\\AlphaVSS.Common.dll') clr.AddReference("AlphaVSS.Common") #pylint:disable=I1101 import Alphaleonis.Win32.Vss as alphavss # clr.AddReference("AlphaVSS.x64") #pylint:disable=I1101 vss = alphavss.VssFactoryProvider.Default # x64_vss = Reflection.Assembly.LoadFile(f'{clr_dir}\\AlphaVSS.x64.dll') # BadImageFormatException: An attempt was made to load a program with an incorrect format. (Exception from HRESULT: 0x8007000B) try: factory = vss.GetVssFactory() except System.BadImageFormatException as e: print(f'Bad Image Format: {e}') except OSError as e: # FileNotFoundException: Could not load file or assembly 'AlphaVSS.x64, Version=2.0.0.0, Culture=neutral, PublicKeyToken=959d3993561034e3' or one of its dependencies. The system cannot find the file specified. print(f'File Not Found: {e}')

4 5

[Pythonnet] Python to c# long conversion time
by Jordan GUILLOT 29 Jun '22

29 Jun '22

Hi, I'm using Pythonnet to import proprietary python package from Windows Application. When my python package return a large byte array in C# world, the type conversion takes lot of time. To illustrate this long conversion time, I made a simple example: 1. A Python package with a method which return a byte array: class MyClass: @staticmethod def get_bytes_from_py(): array = np.arange(0, 720000, dtype=np.uint8) return bytes(array) 1. An application console to call my Python package and which convert 'bytes' type into 'byte[]' type static void Main(string[] args) { Runtime.PythonDLL = "c:\\Python38\\python38.dll"; PythonEngine.Initialize(); Stopwatch st = new Stopwatch(); st.Start(); using (Py.GIL()) { dynamic myPackage = Py.Import("mypackage"); dynamic myClass = myPackage.MyClass(); dynamic myPyByteArray = myClass.get_bytes_from_py(); long t0 = st.ElapsedMilliseconds; byte[] myCsharpByteArray = myPyByteArray; long t1 = st.ElapsedMilliseconds; Console.WriteLine("Conversion takes {0}ms", t1-t0); } st.Stop(); } 1. The console output: "Conversion takes 303ms" Is this the right way for this conversion? Environment: Python: v3.8.10 Pythonnet: * Pypi: v2.5.2 * Nuget : 3.0.0-preview2022-06-03 Windows 10 Pro .NET framework 4.7.2 Regards, Jordan GUILLOT

3 2

pythonnet with .Net6 demo
by Emmanuel Rutovic 10 Jun '22

10 Jun '22

Hi there, I feel that there is a lot of interest in using pythonnet with modern flavors of .Net and without .Net Framework/Mono. In fact, it's already possible using the latest preview packages, even if the documentation isn't updated. I made this very simple minimal demo: https://github.com/aesim-tech/pythonnet_minimal. It demonstrates how to use pythonnet with .Net6 and how to use encoders. Note: I am not involved in the development of Pythonnet, so It might not be the best approach. It is what I understood looking at the source code. I hope this helps. Cheers, -- *Emmanuel Rutovic* Founder, AESIM.tech Book a meeting with me <https://meetings.hubspot.com/manu27> +1 (438) 926-6458

1 0

Next release version of pythonnet
by Alon Liberman 25 May '22

25 May '22

Hi, Is there an ETA for a release version of pythonnet that supports Python 3.10? Due to a security vulnerability in Python versions 3.10.3 and lower, my company needs to upgrade to Python 3.10.4. See https://github.com/advisories/GHSA-3f7p-x3g9-9grh. Thanks, Alon Liberman ________________________________ This email and any attachments thereto may contain private, confidential, and privileged material for the sole use of the intended recipient. Any review, copying, or distribution of this email (or any attachments thereto) by others is strictly prohibited. If you are not the intended recipient, please contact the sender immediately and permanently delete the original and any copies of this email and any attachments thereto.

1 0

WPF or other GUI with PythonNet & Clingo
by David Epstein 04 May '22

04 May '22

Hi folks! This is my first post. In short, I'd like to know whether it is a good idea to use PythonNet within a MVVM framework to glue the models (that rely on a Python package) to the user interface's view models and views (that rely on C# and WPF controls). If it is a good idea, I'd welcome advice (e.g. working with PythonNet within a Visual Studio C# project). If it is not a good idea, I'd welcome alternatives (e.g. Python GUIs with desktop functionality like docking). Here are the details. I'm creating a graphical, desktop, turn-based game/simulation based on the logic programming system, Clingo<https://potassco.org/>, which is accessible from Python (via import clingo<https://pypi.org/project/clingo/>). While other language bindings exist for Clingo (including a nascent C# one<https://github.com/NEKERAFA/clingo-cs>), the Python binding appears to be the most complete and most popular. However, I've only created GUI's using C# frameworks (WPF & Xamarin.Forms). Since I'd like this application to include docking, data grid, rich-text editor, tooltips, and other Windows desktop staples, I'm inclined to use WPF. I may have access to DevExpress' WPF controls<https://www.devexpress.com/products/net/controls/wpf/> and technical support, the latter of which might require me to use C# (not sure). What do you think? Thank you, -david

2 3

Problem installing pythonnet 2.5.2 on Debian 11
by Muhammed-Talha Özmen 27 Apr '22

27 Apr '22

Hello , I am developing with Python 3.7.9 on Debian 11 and I have to import C# Libraries. For that I’ve tried to install pythonnet 2.5.2 via pip, but I get error messages. I’ve installed clang, libglib2.0-dev, nuget, dotnet runtime 2.0 (the C# Libs were developed with .NET Core 2.0, but I tried also 6.0 without success). So, how I have to install pythonnet 2.5.2? Thanks for your help! Best Regards, Muhammed-Talha Özmen

3 2

Binding to a DynamicObject
by Taylor, Guy 23 Feb '22

23 Feb '22

Hi there, I'm new to the list, and fairly new to python integration with C#, so I was hoping someone could help me. I am trying to bind a c# class (which is derived DynamicObject) to Pythonnet but can't get the dynamic aspect working. In the following Code, the line : AppBind.Description("layout") works fine and calls the C# method: public void Description(string str) But AppBind.DynMethod(123) throws an error stating the method doesn't exist (I was hoping this would be called: public override bool TryInvokeMember(InvokeMemberBinder binder, object[] args, out object result) And AppBind.Fred = 123 Assigns 123 to a python variable Fred, when I was hoping it would call: public override bool TrySetMember(SetMemberBinder binder, object value) Is there a way to make this work? The closest I've found is this page, but I couldn't work it out: https://github.com/pythonnet/pythonnet/issues/72 Thank you Guy Here is the python snippet: AppBind = PythonSpace.PythonCallbacks() def DoStuff(): AppBind.Description("layout") AppBind.DynMethod(123) AppBind.Fred = 123 Here is the C# code: (This is derived from the the DynamicDictionary example ) public class PythonCallbacks : System.Dynamic.DynamicObject { // The inner dictionary. Dictionary<string, object> dictionary = new Dictionary<string, object>(); public void Description(string str) { } public override bool TryInvokeMember(InvokeMemberBinder binder, object[] args, out object result) { return base.TryInvokeMember(binder, args, out result); } // If you try to get a value of a property // not defined in the class, this method is called. public override bool TryGetMember(GetMemberBinder binder, out object result) { // Converting the property name to lowercase // so that property names become case-insensitive. string name = binder.Name.ToLower(); // If the property name is found in a dictionary, // set the result parameter to the property value and return true. // Otherwise, return false. return dictionary.TryGetValue(name, out result); } // If you try to set a value of a property that is // not defined in the class, this method is called. public override bool TrySetMember(SetMemberBinder binder, object value) { // Converting the property name to lowercase // so that property names become case-insensitive. dictionary[binder.Name.ToLower()] = value; // You can always add a value to a dictionary, // so this method always returns true. return true; } } }

1 0

Stricter types in 3.0
by Felix Bourbonnais 03 Feb '22

03 Feb '22

Hello, as was discussed in the bi-weekly meeting, the newest version seems to introduce stricter type checking. Here's a snippet that exhibits two issues. using (Py.GIL()) { dynamic sysmod = Py.Import("sys"); dynamic syspath = sysmod.path; bool found = false; foreach (var path in syspath) { if (path == Path.GetFullPath("some/test/path/").Replace("\\", "/")) { found = true; break; } } } The first is a runtime exception with syspath: Microsoft.CSharp.RuntimeBinder.RuntimeBinderException : Cannot implicitly convert type 'Python.Runtime.PyObject' to 'System.Collections.IEnumerable'. An explicit conversion exists (are you missing a cast?) The second is maybe a non-issue, but I think it used to work. If syspath is made to be of type PyList there is now a compiler error: error CS0019: Operator '==' cannot be applied to operands of type 'PyObject' and 'string' Thanks

2 2

Working group notes for January 20, 2022
by Mark Visser 20 Jan '22

20 Jan '22

Attendees: Victor, Mark Agenda: Review previous action items: Benedikt will review References PR <https://github.com/pythonnet/pythonnet/pull/1603> over weekend If no comments Victor will merge References PR <https://github.com/pythonnet/pythonnet/pull/1603> Benedikt will release alpha 2 after References PR <https://github.com/pythonnet/pythonnet/pull/1603> is merged Walk through open issues for 3.0.0 milestone Notes Unity update: current Python is 3.7, and they are migrating to 3.9 will take a look at https://github.com/pythonnet/pythonnet/pull/1402 <https://github.com/pythonnet/pythonnet/pull/1402> will move to master / 3.0.0 "soon" if you don't hear from us in the next 2 weeks, go ahead with the release no quorum The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, February 3 at 2pm EST (click for your time zone) <https://www.google.com/search?q=2%3A00+pm+EST>. Mark Visser Senior Dev Manager, M&E Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Sending and receiving objects.
by marko.beleuca＠clarivate.com 07 Oct '21

07 Oct '21

Hi, We have several Python scripts and we used IronPython so far. Now, we are trying to migrate to Python.NET. Unfortunately, there aren’t adequate examples Python.NET GitHub wiki page. Are there any examples of how to use Python.NET? For example, we have a Python script and we want to send an object as a parameter to a certain Python method in that script and we expect another object as a returning result which will be converted on the .NET side. Thanks!

1 0

Working group notes for September 2, 2021
by Mark Visser 02 Sep '21

02 Sep '21

Attendees: Victor, Benedikt, Mark Agenda: Review previous action items: Victor will continue working on PRs for breaking changes that could land for 3.0 Amos will continue working on porting performance improvements to master "We'll try to come up with a concrete roadmap for the 3.0 release in one of the next biweekly meetings." Python 3.9 on the mailing list Github Discussions feature https://github.com/pythonnet/pythonnet/pull/1402 <https://github.com/pythonnet/pythonnet/pull/1402> blocked by issue #1412 <https://github.com/pythonnet/pythonnet/issues/1412> Notes Release candidate for 3.0 next step is a preview build need to groom 3.0 milestone need to decide on breaking API changes for 3.0 - last chance to break API python wheel build needs to be fixed can't run 32-bit in CI because dotnet clr doesn't support 32-bit Unity does not support 32 bit would be nice if we can run ARM in CI Python 3.9 is not supported on 2.5 branch if anyone wants to work on this they are welcome to do so (on 2.5 branch) but we have no plans to support on 2.5 we know it crashes, non-trivial to debug support will come in 3.0 (master branch) Github Discussions let's wait and see Action Items: Victor will go through issues to select ones for 3.0 Victor will work on memory leaks Benedikt will look into running 32 bit builds in CI Mention we do not officially support 32 bit yet The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, September 30 at 2pm EST (click for your time zone) <https://www.google.com/search?q=2%3A00+pm+EST>.

1 0

Parameter marshalling question
by Slide 20 Aug '21

20 Aug '21

I have the following method defined in my application that I am trying to call from Python using PythonNET Snippet public IEnumerable<byte> ReadBuffer(ulong address, int size, out int readCount) The address can be anything in the range of 0x0_0000_0000 - 0x1_XXXX_XXXX, when I call this using a value that is less than 0x1_0000_0000 (e.g., 0x0_01d00_0000) I get an error that the value an Int32 when a UInt64 is expected, so I created an override that takes an Int32 as the first parameter and the function works when using values less than 0x1_0000_0000, so far so good. However, when I try and call the function with an address >= 0x1_0000_0000 I get the following exception. System.AggregateException: One or more errors occurred. ---> System.ArgumentException: Expected UInt64, got Int32 in method System.Collections.Generic.IEnumerab le`1[System.Byte] ReadBuffer(UInt64, Int32, Int32 ByRef) ---> Python.Runtime.PythonException: Expected UInt64, got Int32 --- End of inner exception stack trace --- --- End of inner exception stack trace --- ---> (Inner Exception #0) System.ArgumentException: Expected UInt64, got Int32 in method System.Collections.Generic.IEnumerable`1[System.Byte] ReadBuffer(UInt64 , Int32, Int32 ByRef) ---> Python.Runtime.PythonException: Expected UInt64, got Int32 --- End of inner exception stack trace ---<--- ---> (Inner Exception #1) System.ArgumentException: value too large to convert in method System.Collections.Generic.IEnumerable`1[System.Byte] ReadBuffer(Int32, Int32, Int32 ByRef) ---> Python.Runtime.PythonException: value too large to convert --- End of inner exception stack trace ---<--- It seems like the checks in converter.cs will choose Int32 even if the value is longer that 32-bits (since PyInt is also true for larger than 32-bit values). Snippet if (value == Runtime.PyIntType){ result = int32Type; return true;} if (value == Runtime.PyLongType){ result = int64Type; return true;} So, I am confused how I can get the correct method resolution and the correct type. Can anyone shed any light on this? Regards, Alex -- Website: http://earl-of-code.com

1 0

"TypeError: No method matches given arguments" Error - please help!
by mysfeir＠gmail.com 16 Aug '21

16 Aug '21

This seems to come up semi-regularly from a web search, but I have been unable to converge on a solution. I am using Python 3.8 and pythonnet to try to control a Newport ESP301 motion controller. The supplied .NET assembly contains this command: public int SR_Get(int axisNumber, out double limit, out string errstring) { errstring = string.Empty; limit = double.MinValue; string text = string.Format("{0}{1}", axisNumber.ToString(), "SR"); string text2 = text + "?"; string empty = string.Empty; StringBuilder sbBuffer = new StringBuilder(); int num = m_COM.Query(text2, ref sbBuffer); empty = sbBuffer.ToString(); empty = empty.Trim(); errstring = checkReturnCodeAndResponse(text2, num, empty); if (num == 0 && string.IsNullOrEmpty(errstring)) { decodeDoubleFromResponse(text, empty, out limit); } if (!string.IsNullOrEmpty(errstring)) { return -1; } return 0; } I am unable to get this command to run successfully using Pythonnet. Here is my code: import sys print("Adding location of Newport.ESP301.CommandInterface.dll to sys.path") sys.path.append(r'C:\Windows\Microsoft.NET\assembly\GAC_64\Newport.ESP301.CommandInterface\v4.0_2.0.0.3__9f994642f5b48132') import clr clr.AddReference("Newport.ESP301.CommandInterface") from CommandInterfaceESP301 import * import System #===================================================================== # Instrument Initialization instrument="COM3" BAUDRATE = 921600 print('Instrument Key=>', instrument) # create an ESP301 instance ESP301Device = ESP301() # Open communication ret = ESP301Device.OpenInstrument(instrument, BAUDRATE); if ret == 0: print("Instrument successfully opened!") else: print("Error!") # Get positive software limit result, response, errString = ESP301Device.SR_Get(1) if result == 0: print('positive software limit=>', response) else: print('Error=>', errString) If I try to execute this code, I get the following error: ====== RESTART: C:\Users\Laser\Documents\Python Programs\esp301_python.py ====== Adding location of Newport.ESP301.CommandInterface.dll to sys.path Instrument Key=> COM3 Instrument successfully opened! Traceback (most recent call last): File "C:\Users\Laser\Documents\Python Programs\esp301_python.py", line 57, in <module> result, response, errString = ESP301Device.SR_Get(1) TypeError: No method matches given arguments for SR_Get: (<class 'int'>) I thought this was originally a problem with int64 vs. int32 but I have tried several methods for converting between these and all give the same error. FWIW, I have no trouble getting this to work in Matlab: clear % Add Assembly NET.addAssembly('C:\Windows\Microsoft.NET\assembly\GAC_64\Newport.ESP301.CommandInterface\v4.0_2.0.0.3__9f994642f5b48132\Newport.ESP301.CommandInterface.dll'); % load modules import CommandInterfaceESP301.*; cport = "COM3"; BAUDRATE = 921600; ESP301Device = ESP301(); % open communication ret = ESP301Device.OpenInstrument(cport, BAUDRATE); if ret == 0 disp("Intrument open!") else disp("Error!") end % Get negative software limit [result, response, errString] = ESP301Device.SR_Get(1); I'm completely stumped and frustrated at this point. Any constructive feedback would be very appreciated! Matt

3 4

Working group notes for July 22, 2021 - no meeting
by Mark Visser 22 Jul '21

22 Jul '21

Quorum not met, meeting cancelled. The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, August 5 at 2pm EST (click for your time zone) <https://www.google.com/search?q=2%3A00+pm+EST>. Mark Visser Senior Dev Manager, M&E Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Support for Python v3.9
by Douglas Wyant (Aptly Technology Corporation) 22 Jul '21

22 Jul '21

PythonNet, Hi folks, I have no idea if this is the correct way to engage support / ask questions, so please redirect me. We need to deploy Python v3.9 to resolve a known Security issue in older versions. I'm told we're blocked on deploying until PythonNet is updated to support v3.9. So the question is when might that be? https://bugs.python.org/issue41944 CVE-2020-27619: WIndows Python versions 3.0.0 through 3.9.0 are susceptible to a vulnerability which when successfully exploited could lead to disclosure of sensitive information, addition or modification of data, or Denial of Service (DoS). Affected Versions Python versions 3.0.0 through 3.9.0 Thanks, Doug Wyant (Aptly Technology Corporation), GSEC, GCIH Service Engineer 2 Microsoft

5 8

Working group notes for July 8, 2021
by Mark Visser 08 Jul '21

08 Jul '21

Attendees: Amos, Mark, Victor Agenda: Review last week's action items: Victor to make a list of breaking changes in his branch that could land for 3.0 and discuss with Benedikt Victor to update https://github.com/pythonnet/pythonnet/pull/1133 <https://github.com/pythonnet/pythonnet/pull/1133> and check with Benedikt that it's still good to land for 3.0 Amos to create a PR to master with bindings performance improvements Benedikt to review https://github.com/pythonnet/pythonnet/pull/1369 Modernize import hook <https://github.com/pythonnet/pythonnet/pull/1369> Notes Victor opened PRs for breaking changes that could land for 3.0, already in review will continue working on these #1133 __name__ and __signature__ for .NET methods <https://github.com/pythonnet/pythonnet/pull/1133> will stay as is for now, not important #1369 Modernize import hook <https://github.com/pythonnet/pythonnet/pull/1369> has been merged PR with bindings performance improvements has a lot of conflicts, taking longer than expected Victor suggested porting changes to master one at a time rather than trying to resolve conflicts Action Items: Victor will continue working on PRs for breaking changes that could land for 3.0 Amos will continue working on porting performance improvements to master The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, July 22 at 2pm EST (click for your time zone) <https://www.google.com/search?q=2%3A00+pm+EST>. Mark Visser Senior Dev Manager, M&E Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

PythonNet installed manually on windows enterprise
by jupal1998＠gmail.com 28 Jun '21

28 Jun '21

Dear PythonNet Team, I am an empolyee at a company using windows entersprise 1909, and We are currently working on a python project for to help automate some things that needs a few .NET functions to be able to push items into an SQL database. That is why we are chose pythonnet. My problem is the following: I think The IDEEs (VS code and Pycharm) We are using cannot „see” the imported pythonnet libraries. I think the installation of the pythonnet module is the main source of this inconvinience. We cannot install python modules automatically with pip because of the company firewall proxy settings, we have to use a manual method: downloading the pythonnet.whl, and install it with the following command in cmd.exe: pip install python_module.whl -f ./ --no-index --no-deps. For example we import clr module and use the following lines: clr.AddReference('System') clr.AddReference('System.Data') from System.Data.SqlClient import * But the enviroment shows error on this: Unresolved reference System, and i cannot run the program. I tried to use a different method by using cmd.exe to run it, but the result is the same. How can i import System module manually with .whl, or .gz? I could not find it on pypi website. I hope You can help us! I see forward to Your answer! Yours sincerely, Pál Juhász

1 0

Working group notes for June 17, 2021
by Mark Visser 21 Jun '21

21 Jun '21

Attendees: Amos, Mark, Felix, Victor Agenda: Review last week's action items: Victor to make a list of breaking changes in his branch that could land for 3.0 and discuss with Benedikt Felix to review #1426 <https://github.com/pythonnet/pythonnet/pull/1426> & #1441 <https://github.com/pythonnet/pythonnet/pull/1441> Victor to update https://github.com/pythonnet/pythonnet/pull/1133 <https://github.com/pythonnet/pythonnet/pull/1133> and check with Benedikt that it's still good to land for 3.0 Amos concerned about performance Notes #1426 <https://github.com/pythonnet/pythonnet/pull/1426> & #1441 <https://github.com/pythonnet/pythonnet/pull/1441> merged possibility of performance improvements in bindings https://github.com/topameng/tolua <https://github.com/topameng/tolua> bindings perform much better than Python for .NET Victor: please add any missing coverage to performance tests so we can catch regressions Amos: there is room for improvement in Python .NET performance code gen to improve performance? will likely introduce breaking changes I have a branch already that improves performance Victor: if it's not risky and can be ported to current master it could go into 3.0 (no sooner than September) Victor: make a PR against master branch and describe the breaking changes import refactor almost done, waiting for Benedikt to review Action Items: Victor to make a list of breaking changes in his branch that could land for 3.0 and discuss with Benedikt Victor to update https://github.com/pythonnet/pythonnet/pull/1133 <https://github.com/pythonnet/pythonnet/pull/1133> and check with Benedikt that it's still good to land for 3.0 Amos to create a PR to master with bindings performance improvements Benedikt to review https://github.com/pythonnet/pythonnet/pull/1369 Modernize import hook <https://github.com/pythonnet/pythonnet/pull/1369> The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, July 8 at 2pm EST (click for your time zone) <https://www.google.com/search?q=2%3A00+pm+EST>. Mark Visser Senior Dev Manager, M&E Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Mapped DataTypes of Python to .NET
by Satya Prasad 09 Jun '21

09 Jun '21

I have a 32 bit .NET DLL - so I made use of PythonNet Module <http://pythonnet.github.io/> and msl.loadlib.server32 module <https://msl-loadlib.readthedocs.io/en/latest/_api/msl.loadlib.server32.html> as I am using Python 64 bit version. I am a just a beginner in this domain - and below is my query. Thru ILSpy I can see the below signature: [DllImport("DISCOM.DLL", CharSet = CharSet.Unicode)] public static extern uint CancelRequests(IntPtr data); I tried opening DISCOM.DLL via ILSpy and Pythonnet but could not do so - how can we call the above API and create a Python datatype of IntPtr. Please let me know how to Convert Python data types to .NET format and vice versa Regards, Prakash

1 0

Working group notes for April 22, 2021
by Mark Visser 22 Apr '21

22 Apr '21

Attendees: Victor, Mark, Felix, Benoit Agenda: Review last week's action items: Victor to make a list of breaking changes in his branch that could land for 3.0 and discuss with Benedikt Felix to review #1426 <https://github.com/pythonnet/pythonnet/pull/1426> Victor to update Improve Python <-> .NET exception integration <https://github.com/pythonnet/pythonnet/pull/1134> Victor to update https://github.com/pythonnet/pythonnet/pull/1133 <https://github.com/pythonnet/pythonnet/pull/1133> and check with Benedikt that it's still good to land for 3.0 Benoit to test on Apple Silicon & derisk Notes: Improve Python <-> .NET exception integration <https://github.com/pythonnet/pythonnet/pull/1134> blocked: waiting for #1426 & #1441 to land Python 3.7 doesn't build on Apple Silicon fixes won't be backported to 3.7 3.9 is earliest version that will support Apple Silicon Action Items: Victor to make a list of breaking changes in his branch that could land for 3.0 and discuss with Benedikt Felix to review #1426 <https://github.com/pythonnet/pythonnet/pull/1426> & #1441 <https://github.com/pythonnet/pythonnet/pull/1441> Victor to update https://github.com/pythonnet/pythonnet/pull/1133 <https://github.com/pythonnet/pythonnet/pull/1133> and check with Benedikt that it's still good to land for 3.0 The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, May 6 at 12pm EST (click for your time zone) <https://www.google.com/search?q=12:00+pm+EST>. Mark Visser Senior Dev Manager, M&E Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Working group notes for April 8, 2021
by Mark Visser 08 Apr '21

08 Apr '21

Attendees: Victor, Mark, Felix, Benoit Agenda: Review last week's action items: everyone should look into the finalizer issues if they can PythonException finalizer update Notes: finalizer issues? not sure what this is referencing, Victor will talk to Benedikt PythonException finalizer update blocked due to failure on 3.6 Benedikt gave Felix pointers he needed to get unblocked Victor posted a pull that potentially fixes - this PR #1426 <https://github.com/pythonnet/pythonnet/pull/1426> Victor has a bunch of breaking changes he wants to potentially land for 3.0 feature: ability to add mix-ins to .NET types with Python solves multiple issues with dictionary conversions avoids having to create a proxy class in C# that doesn't behave like a C# dictionary allows you to create a class that works as a dictionary in both Python and C# fairly mature, possibly can land before 3.0 feature: change overload resolution to whatever dynamic does in C# solves problem where overloads behave in a surprising way barely a proof-of-concept (not even tested/validated/etc) feature: ability to change base class others Victor has many open PRs https://github.com/pythonnet/pythonnet/pulls/lostmsu <https://github.com/pythonnet/pythonnet/pulls/lostmsu> please review Have we tested on Apple Silicon no Benoit can test Travis? do we have automated testing on Mac? we do, AMD64 only we don't have a good debugger for 64-bit ARM Unity will need Apple Silicon support by November to make our Python package officially supported potentially lots of work Native code page still there? no, got removed Action Items: Victor to make a list of breaking changes in his branch that could land for 3.0 and discuss with Benedikt Felix to review #1426 <https://github.com/pythonnet/pythonnet/pull/1426> Victor to update Improve Python <-> .NET exception integration <https://github.com/pythonnet/pythonnet/pull/1134> Victor to update https://github.com/pythonnet/pythonnet/pull/1133 <https://github.com/pythonnet/pythonnet/pull/1133> and check with Benedikt that it's still good to land for 3.0 Benoit to test on Apple Silicon & derisk The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, April 22 at 12pm EST (click for your time zone) <https://www.google.com/search?q=12:00+pm+EST>. Mark Visser Senior Dev Manager, M&E Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Python for Unity 4.0.0-exp.5 now available!
by Mark Visser 06 Apr '21

06 Apr '21

Hi everyone, I'm thrilled to announce that Python for Unity has been updated to support the latest Python for .NET! This update brings Python 3.7 support and the ability to use native Python modules. Well, technically you could use them before; the difference is that now Unity won't crash on domain reload if you do. :-) You can find more details in the official announcement <https://forum.unity.com/threads/python-for-unity-release-announcements.1084…>. I'm cross-posting here because this release would not have been possible without the joint efforts of Unity, Imaginary Spaces and the Python for .NET developers. Thank you Amos, Felix, Victor, Benedikt, and Benoit! cheers, -Mark Mark Visser Senior Dev Manager, M&E Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Working group notes for March 25, 2021
by Mark Visser 25 Mar '21

25 Mar '21

Attendees: Benedikt, Mark Agenda: Review last week's action items: everyone should look into the finalizer issues if they can PythonException finalizer update Notes: No quorum, meeting canceled Action Items: Mark will check if dev work on existing Unity PRs is still in progress (if not, please comment on the PR when we expect work to resume) The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, April 8 at 12pm EST (click for your time zone) <https://www.google.com/search?q=12:00+pm+EST>. Mark Visser Senior Dev Manager, M&E Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Working group notes for March 11, 2021
by Mark Visser 11 Mar '21

11 Mar '21

Attendees: Felix, Benoit, Mark Agenda: Review last week's action items: Amos will check if _GC_Calloc can be replaced with public function Felix will continue working on PythonException finalizer Notes: Benedikt agrees it's a good idea to get rid of _GC_Calloc, need to be mindful that allocation works with domain reload Technical discussion on debugging Current state of tests is that we have pytest and NUnit tests can run pytest through NUnit but not the inverse should we keep both? domain reload tests are separate (Re-enable the domain reload tests <https://github.com/pythonnet/pythonnet/pull/1404>) could trip up devs if they don't know to run the reload tests same situation right now with pytests & NUnit tests - need to run both locally document? make available via a single front-end? ideally running either pytest or NUnit tests runs all interesting tests most code is in C#, maybe dotnet test should run all tests, not pytest still nice to run pytest, allows us to write pytests in a meaningful way pytests are a bit hacky as they need to build the Python tests DLL ideal to run all tests through dotnet test - big project though create a bridge to run pytests via NUnit? Benedikt needs to think more on how to solve this current setup is fine for now (keep as separate steps) Modernize import hook <https://github.com/pythonnet/pythonnet/pull/1369> import hook as python code has implications can we embed it instead of having it as a .py file? Benedikt has no major changes planned going through PRs to get pythonnet into a stable state dealing with finalizer issues once main performance issues, finalizer fixes & import hook is merged we'll be ready for 3.0 the work Victor has started on reworking older components is good look at obsoleting unsafe interfaces before major release What does Unity need? import hook is the last thing we'd like to ship with an official 3.0 (currently shipping a git hash build) timeline for that is fall 2021 Action items: everyone should look into the finalizer issues if they can The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, March 25 at 12pm EST (click for your time zone) <https://www.google.com/search?q=12:00+pm+EST>. Mark Visser Senior Dev Manager, M&E Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Working group notes for February 11
by Mark Visser 11 Feb '21

11 Feb '21

Attendees: Victor, Benedikt, Mark, Felix, Amos Agenda: Review last week's action items: Victor: fix merge conflict and merge PythonDLL PR Victor: create issue for domain reload when .NET objects point to PythonException and/or PyObject Benedikt will check if he can restore perf tests using wheel of 2.5.1 Notes: PythonDLL PR was merged domain reload when .NET objects point to PythonException and/or PyObject Felix found a problem, will create PR to fix PyValue wasn't reference counted PythonDLL work Python usually requires setting PYTHON_HOME - maybe we should try to discover DLL location from PYTHON_HOME instead of starting from the DLL location? PYTHON_HOME doesn't work very well for system environment maybe should try to discover PYTHON_HOME from DLL path instead? need to have both Benedikt will take a look at different OSes and see what could work CLR Loader PR The failures are due to Finalize call from Python on process shutdown, which previously was not there Calling Finalize is correct, but exposes preexisting bugs that now cause CI to fail can we ignore the CI failures and fix them as a separate issue? yes Benedikt will move code fixing reference counting (and other changes unrelated to Finalize) and enabling Finalize to a new branch and land CLR loader we'll treat the surfaced Finalize issues separately Felix will need to rebase his PR CI will continue to non-deterministically fail in the interim weakref support PR need to fix some bugs to pass CI Action items: Felix will create PR to likely fix Domain reload crashes when .NET object points to PythonException <https://github.com/pythonnet/pythonnet/issues/1371> Benedikt will look into automatically setting PYTHON_HOME and/or inferring location of Python DLL Benedikt will comment on the CLR Loader regarding Finalize call from Python on process shutdown and merge the PR The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, February 25 at 12pm EST (click for your time zone) <https://www.google.com/search?q=12:00+pm+EST>. Mark Visser Senior Dev Manager, M&E Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Visual Studio extension to convert [DllImport] into new unmanaged function pointers
by Victor Milovanov 11 Feb '21

11 Feb '21

OneDrive link: https://1drv.ms/u/s!AioR7aFFo_FKzuwi_AkxqtZj7JnXhw?e=uriiwU This is a custom build of Roslynator You write something like [DllImport(PythonDLL, CallingConvention = CDecl)] public extern void PyProc(); Then VS should offer a refactoring, that converts this to unmanaged pointers. // Victor

1 0

Wrap in interface (#1240)
by Mohamed Koubaa 08 Feb '21

08 Feb '21

Hello, This PR<https://github.com/pythonnet/pythonnet/pull/1240> changed behavior of pythonnet to use stricter typing when a method returns an interface. I'd like a way to opt-out of this behavior, and I'll share a representative use-case below. The tl;dr is that python is a dynamic language and I expect the C# objects which pythonnet wraps to behave more like "dynamic" and less like the static types on the interface. **** C# code **** namespace Example1 { public enum ShapeType { Square, Circle } public interface IShape { void Draw(); double Area { get; } ShapeType Type { get; } } public class Square : IShape { public double Length { get; } public Square(double length) { Length = length; } public void Draw() {} public double Area { get { return Length * Length; } } public ShapeType Type { get { return ShapeType.Square; } } } public class Circle : IShape { public double Radius { get; } public Circle(double radius) { Radius = radius; } public void Draw() {} public double Area { get { return Math.PI * Radius * Radius; } } public ShapeType Type { get { return ShapeType.Circle; } } } public class ShapeDataModel { private Dictionary<int, IShape> _shapes = new Dictionary<int, IShape>(); private int _nextId = 1; public int AddShape(IShape shape) { int id = _nextId; _shapes[id] = shape; _nextId++; return id; } public IShape GetShape(int id) { return _shapes[id]; } } } **** Python code **** >>> import clr >>> clr.AddReference("Example1") >>> import Example1 >>> sq1 = Example1.Square(2.) >>> ci1 = Example1.Circle(1.3) >>> sq2 = Example1.Square(2.5) >>> m = Example1.ShapeDataModel() >>> m.AddShape(sq1) 1 >>> m.AddShape(sq2) 2 >>> m.AddShape(ci1) 3 >>> m.GetShape(2) <Example1.IShape object at 0x000002A3448A09A0> >>> m.GetShape(2).Area 6.25 >>> m.GetShape(2).Length Traceback (most recent call last): File "<stdin>", line 1, in <module> AttributeError: 'IShape' object has no attribute 'Length' **** summary **** This factory and/or datamodel pattern is very common in my codebase and probably also lots of object oriented systems. The mentioned PR breaks this common design pattern in C# objects wrapped by pythonnet, and I would like a way to opt-out of it. Maybe an attribute on the method which returns an interface can be used, or maybe something global to switch this behavior. I think perhaps the original bug might also have been fixed in a different way. Thanks! Mohamed

2 5

Binary file passed to .Net object
by Alexander Masis 28 Jan '21

28 Jan '21

Hello, guys here is a prototype code: exAsseblyRef = clr.AddReference("C:\ExamRecordHelper") from ExamRecordHelper import * loaderObj = ExamRecordLoader( 'MyBinaryFile.bin') <<<<<< Exception here. On the 3d line the C# constructor ExamRecordLoader(String) is called - it can't create the object. The actual exception is: "Column requires a valid DataType." However, the same binary file used with native C# code: ExamRecordLoader( 'MyBinaryFile.bin') works with no errors. Obviously something is happening when the binary file is being used by the C# class... Any suggestions? Thanks, Alex.

4 6

Working group notes for January 14, 2021
by Mark Visser 14 Jan '21

14 Jan '21

(I think I forgot to send out the previous meeting notes - you can find them in the Google doc linked at the bottom of this message) Attendees: Benedikt, Mark, Victor, Benoit, Felix, Amos Agenda Review last week's action items: Benedikt will fix 32-bit issues Benedikt to add test that loads unicode function names Felix will submit PR for #1333 (function delegates) Felix will submit PR that rewrites import hook to use pure Python (see #1096 & #727) Notes: 32-bit issues nothing done yet, Benedikt will look into this test that loads unicode function names merged! PR #1329 problem was that we need to make sure we always use our own UTF-8 marshaller we can't use the .NET one because it doesn't exist in all .NET frameworks PR fixes the issue where Benedikt saw it, but there are possibly other places where the same issue exists follow-up issue is #1354 let's link all encoding problems to this issue in Python 3 it's all UTF-8 this particular issue (unicode function names) is fixed function delegates merged! PR #1333 rewrite of import hook to use pure Python (see #1096 & #727) in progress (Felix) rewrite avoids entering C# unless we absolutely need to, because there's no way to prevent C# from "owning" a thread that calls C#, and once C# owns it domain reload hangs waiting for the thread to exit fixes a common pattern "try import PySide; except: import PySide2" - previous implementation hits C# on the first import call, even if PySide doesn't exist internal compiler error (https://github.com/dotnet/roslyn/issues/49760) still present in latest .NET 5.0.2 might still be a Roslyn point release? doesn't help because Roslyn likely frozen until .NET 6 Victor will find out when they plan on releasing a fix required for replacing PInvoke delegates for reference types with using unmanaged function pointers (supposed to work in new C#, but triggers an internal compiler error) blocking our ability to do a multi-stage startup and dynamically bind to the right Python dll/dso/dylib anywhere but Mono (which supports __Internal as the DllImport string) helpful for embedding .NET in Python since want to use the statically linked symbols in the python executable - using a dynamic library, even if present, leads to weird problems we'll find out if a fix is forthcoming and if not, use a workaround Action items: Benedikt will fix 32-bit issues Felix will complete rewrite of import hook to avoid calling C# unless necessary Victor will find out if there will be a Roslyn release fixing the internal compiler error The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, January 28 at 12pm EST (click for your time zone) <https://www.google.com/search?q=12:00+pm+EST>. Mark Visser Senior Dev Manager, M&E Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

RANGE object access from Python
by AlexM 03 Dec '20

03 Dec '20

Hello, guys, I have a C# object, I need access to it's properties in Python 2.7. I got this type returned from a C# dll: <class 'Philips.CT.Host.ModelAbstraction.DataStructures.0, Culture=neutral, PublicKeyToken=b77a5c561934e089]]'> This should be a "Range" data type in C#. Thanks a lot for any suggestion! Alex.

2 2

How to Run Pythinon.net Demo Samples
by Vishal Patel 27 Nov '20

27 Nov '20

Hi, I need your help regarding how to run Pythinon.net Demo samples (C:\Program Files\PythonNet\demo) in c#. Best Regards, Vishal Patel | PROJECT LEADER Openxcell Email Id: seo4(a)openxcelltechnolabs.com Website: http://www.openxcell.com

1 0

Allowing Python.Net to run with latest Python version
by Vince Luff 26 Nov '20

26 Nov '20

Hello, I work on a commercial Python package which I am currently enhancing to use Python.Net in order to access some .Net libraries. Before using Python.Net we specified to end users that the requirement for running our package was "Python 3 installed". Now that we are using Python.Net we can't say that statement because Python.Net 2.5.1 supports Python 3.8 but not Python 3.9. Since our package is not a stand-alone application, but it instead provides a Python API for users Python scripts to call, it's not an option for us to convert the whole delivery into an exe using something like PyInstaller. So I'm looking for advice about the best option: 1. Specify that end users install a specific version of Python (3.8) in order to use our application. 2. Include Python 3.8 in our installer and install this if it's not already installed. Is this a good idea? 3. Any other ideas? Many thanks, DareDevilDenis

3 2

Working group notes for November 5, 2020
by Mark Visser 20 Nov '20

20 Nov '20

Attendees: Victor, Benedikt, Mark, Amos, Benoit, Felix Agenda Review last week's action items: Felix & Benoit to add tests to master in preparation for the soft reload fix PR - will be ignored for now (or expected to fail - ideal if that's possible) Victor to review these to understand the need for isolated testing environment for each test discuss soft init/reload/shutdown modes: what are the use cases for each? are they all necessary? need to document if so. (Benoit/Felix) Notes: PR for soft reload tests is failing, hasn't run on travis coverage reported is not accurate let's not worry too much about the coverage numbers and try to provide good tests for new features build times have gotten slower over time due to testing all shutdown modes do we need to run full tests for all modes? some of this is likely redundant let's remove unnecessary tests from travis additional run for every mode github actions? we should keep at least one version of python testing all shutdown modes drop everything except 3.7 from testing shutdown since that's the version we support in Unity? still want to catch regressions caused by new Python versions (e.g. API changes) long term we should look at moving from travis to github actions Unity shutdown/domain reload is using reload mode. do we need other two modes? (soft / none) we never use reloading when embedding C# in Python - just kill workers/instances and restart can we remove soft & none modes? what are the use cases for the other two modes? reload mode requires implementing a customer serializer for CLR objects Feilx is working on making the custom serializer optional so it still works without it with this update reload won't fail without a serializer does this make soft mode redundant? there are a lot of places where there are three code paths depending on the shutdown mode - can we simplify soft mode has no such requirement none - used for shutting down Python and not restarting it - makes no attempt to save state soft - does not maintain connections between CLR and Python objects, but saves state of Python interpreter reload - also maintains connections between CLR and Python objects all three modes are useful as they facilitate testing different parts of the system e.g. if something fails on only one of the modes, it's useful data currently all tests are run with all modes in all versions Travis problems jobs take forever to start job status not reporting at least partly connected to new free tier limitations https://blog.travis-ci.com/2020-11-02-travis-ci-new-billing <https://blog.travis-ci.com/2020-11-02-travis-ci-new-billing>  we will need to move things off travis-ci.org by the end of the year travis is shutting down free travis access due to abuse move to travis-ci.com, still potential for free use but will be potentially limited longer term move to github actions needs to be evaluated Benedikt's SDK-style build system branch working well, except for some unexpected crashes using poetry instead of setuptools - much simpler than current PRs to come Action items: Felix will reduce the test combinations for soft shutdown on appveyor and travis to reduce build times and make a PR Felix will look at extracting domain reload tests to reduce/simplify build times and report back Benedikt will fix 32-bit issues The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, December 3 at 12pm EST (click for your time zone) <https://www.google.com/search?q=12:00+pm+EST>. Mark Visser Senior Dev Manager, M&E Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

3 2

Working group notes for October 22, 2020
by Victor “LOST” Milovanov 22 Oct '20

22 Oct '20

1 0

Arrays float
by Gavin 25 Sep '20

25 Sep '20

Hello im trying to convert this line of code buffer = array.array("f", [0.0]) * (WIDTH * HEIGHT * bufferdepth) but have problems its an image buffer of floats but it does not like the [0,0] can anyone helpthanks in advance

2 1

Working group notes for September 10, 2020
by Victor “LOST” Milovanov 10 Sep '20

10 Sep '20

1 0

Working group notes for August 13, 2020
by Mark Visser 13 Aug '20

13 Aug '20

Attendees: Mark, Benoit, Felix, Mohamed, Victor, Amos Agenda Review action items from last meeting: Benedikt to confirm WITH_DEBUG builds need to be updated for 3.9 (low priority) and will create issue to document for later Benedikt - Add reference to backports-2.5 branch in README Benedikt - Switch to .NET Standard for everything but ClrModule Benedikt - will look at Amos's fix for #891 issue in PR #958 Benedikt - will look into Python Buffer branch again Benedikt to look into weirdness with pycparser in appveyor.yml (see PR #1175 <https://github.com/pythonnet/pythonnet/pull/1175>) Domain reload update Notes Felix has been testing domain reload branch mostly success with a few fixes needed issues if you register a Python function as a delegate directly into a C# event, it is not retained - currently throws an exception due to leaving the Python function in a bad state would be ideal to bring back the connection Acceptable to lose the connection, but must leave python.net in a good state otherwise if you maintain a proxy to a C# object in Python, on domain reload the proxy usually gives several different exceptions and sometimes crashes correct behaviour is to raise an exception, ideally the same one with no crashes if an assembly/type/class member/etc is missing after domain reload, causes problems on the Python side needs to be gracefully handled finalizers at exit fix done by Felix PR not yet made other than these issues reload mode works really well soft shutdown mode doesn't work well for domain reload it unloads all modules, which doesn't work for native modules (by design) intended for use in the game, not the editor Victor approved landing it to master once remaining issues raised in PR are fixed Felix/Benoit to fix the minor issues in the PR and land the patch If it can't land to master, Victor will create a branch for it in the repo Remaining issues found by Felix can land to master after the main PR lands to master. Process: Fixes: Felix submits a PR for the fix (ideally with test case) Issues: create an issue, Felix submits PR with test case, invites Amos to fix. Amos fixes it. Land PR with test case + fix to master. Documentation would be good Proposal: Unity/imaginary spaces writes an outline, amos fills in outline, Unity/imaginary spaces revises it Python 2 support for soft shutdown / reload is not necessary. Action Items Benedikt to confirm WITH_DEBUG builds need to be updated for 3.9 (low priority) and will create issue to document for later Benedikt - Add reference to backports-2.5 branch in README Benedikt - Switch to .NET Standard for everything but ClrModule Benedikt - will look at Amos's fix for #891 issue in PR #958 Benedikt - will look into Python Buffer branch again Benedikt to look into weirdness with pycparser in appveyor.yml (see PR #1175 <https://github.com/pythonnet/pythonnet/pull/1175>) Felix to create test case for Amos that demonstrates the "Python function as delegate fails on reload" (and others) and log issue - will create unit tests to land after main PR lands Benoit/Felix to create doc outline for reload & soft shutdown modes (developer docs) Felix will fix remaining domain reload issues raised by Victor Amos will fix new issues to land after main PR lands The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, August 27 at 12pm EST (click for your time zone) <https://www.google.com/search?q=12:00+pm+EST>. Mark Visser M&E Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Working group notes for July 30, 2020
by Mark Visser 30 Jul '20

30 Jul '20

Attendees: Amos, Victor, Mark, Benedikt, Mohamed Agenda Review action items from last meeting Benedikt - Check whether we need to change the `WITH_DEBUG` variant of PyObject_TYPE for newer versions of Python (> 3.8?) Benedikt - Add reference to backports-2.5 branch in README Benedikt - Switch to .NET Standard for everything but ClrModule Benedikt - Change project files to new format Victor - Consider adding a StolenReference type Benedikt - will look at Amos's fix for #891 issue in PR #958 Benedikt - will look into Python Buffer branch again Soft shutdown PR Notes Check whether we need to change the `WITH_DEBUG` variant of PyObject_TYPE for newer versions of Python (> 3.8?) in newer versions of Python WITH_DEBUG builds have the same layout we need to remove the special case not high priority right now since it's 3.9+ Switch to .NET Standard for everything but ClrModule Benedikt will complete today to unblock Mohamed Change project files to new format need to get rid of old project files and replace by new ones CLR module needs to stay on old format StolenReference type created issue for StolenReference type <https://github.com/pythonnet/pythonnet/issues/1193> Python Buffer branch again up for grabs if someone else wants to contribute is working fine - was held back until release because it's a Python 3-only branch should be ready to be merged once rebased Soft shutdown PR Unity will test before fall Python 3.9 multiphase initialization for modules used for subinterpreter support among other things every module is an object instead of a singleton can have multiple instances of a module thus there can be multiple instances of the clr module can be opted out of - see PEP 489 <https://www.python.org/dev/peps/pep-0489/> (other PEPs are based on it as well) may incur work on Python.NET side to support or disable PEP 554 <https://www.python.org/dev/peps/pep-0554/> also relevant (subinterpreters python API for 3.10) interesting for embedding use case of embedding Python into .NET nicer API seems like a good idea to leverage this for our own embedding API needs investigation Discussion on broken appveyor.yml fixed in PR #1175 <https://github.com/pythonnet/pythonnet/pull/1175> Action Items Benedikt to confirm WITH_DEBUG builds need to be updated for 3.9 (low priority) and will create issue to document for later Benedikt - Add reference to backports-2.5 branch in README Benedikt - Switch to .NET Standard for everything but ClrModule Benedikt - will look at Amos's fix for #891 issue in PR #958 Benedikt - will look into Python Buffer branch again Benedikt to look into weirdness with pycparser in appveyor.yml (see PR #1175 <https://github.com/pythonnet/pythonnet/pull/1175>) The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, August 13 at 12pm EST (click for your time zone) <https://www.google.com/search?q=12:00+pm+EST>. Mark Visser M&E Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

how to install in sles12
by Ramesh Ponnada 25 Jul '20

25 Jul '20

Hi, i see error while installing pythonnet module in sles12 OS machine. could you please share us the steps. ./pip3 install pythonnet Collecting pythonnet Using cached Collecting pycparser py2.py3-none-any.whl <https://devpi.qualcomm.com/root/pypi/%2Bf/758/2ad22678f0fcd/pycparser-2.20-…> (112 kB) Building wheels for collected packages: pythonnet Building wheel for pythonnet (setup.py) ... error ERROR: Command errored out with exit status 1: command: /software/python/3.7.6/bin/python3.7 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-0fnlx7pb/pythonnet/setup.py'"'"'; __file__='"'"'/tmp/pip-install-0fnlx7pb/pythonnet/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-e5dshd8e cwd: /tmp/pip-install-0fnlx7pb/pythonnet/ -- Ramesh

1 0

Working group notes for July 16, 2020
by Mark Visser 16 Jul '20

16 Jul '20

Attendees: Benedikt, Mark, Amos Agenda Review action items from last meeting Amos will try to fix soft shutdown 3.8 CI Victor will try to reproduce soft shutdown 3.8 CI failure Since the failure appears to be in codecs tests, Victor will try to check if any codecs fixes were not backported from Lost Tech branch Notes Soft shutdown - CI failure related to issue #891 <https://github.com/pythonnet/pythonnet/issues/891> see https://github.com/pythonnet/pythonnet/blob/master/src/runtime/runtime.cs#L… <https://github.com/pythonnet/pythonnet/blob/master/src/runtime/runtime.cs#L…> soft mode finished from Amos's side still need test cases for reload mode - may have stability issues Benedikt still reviewing hold off merging until we're sure it's stable Unity will do additional QA (use branch updated to master first) Still some polish to be done Some parts have already been merged to master via other PRs small PR #1175 - Remove unnecessary `CheckExceptionOccurred` calls <https://github.com/pythonnet/pythonnet/pull/1175> looks good comments from Victor to address quantconnect branches will close Action Items Benedikt - Check whether we need to change the `WITH_DEBUG` variant of PyObject_TYPE for newer versions of Python (> 3.8?) Benedikt - Add reference to backports-2.5 branch in README Benedikt - Switch to .NET Standard for everything but ClrModule Benedikt - Change project files to new format Victor - Consider adding a StolenReference type Benedikt - will look at Amos's fix for #891 issue in PR #958 Benedikt - will look into Python Buffer branch again The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, July 30 at 12pm EST (click for your time zone) <https://www.google.com/search?q=12:00+pm+EST>. Mark Visser M&E Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Working group notes for June 18, 2020
by Benedikt Reinartz 18 Jun '20

18 Jun '20

Working group notes for June 18, 2020 Attendees: Mohamed, Amos, Victor, Benedikt Agenda * Review action items from last meeting o Benedikt/Mohamed: extract “Moving files around” PR o Benedikt/Mohamed: extract “Support for dotnet SDK” PR * PR #958 https://github.com/pythonnet/pythonnet/pull/958 - what's left, how can we (Unity) help bring this to master? Notes * No new NuGet for 2.x releases due to many packages needed * We will start releasings NuGet for 3.x dev builds as soon as they are available * PR opened to drop Python 2 support (1158) * CLR/CoreCLR loading is striving to be pure Python with no C code to simplify build and deployment * PR #958 https://github.com/pythonnet/pythonnet/pull/958 : Amos is syncing it to the latest master. Victor: still quite a few comments pending * On PyHandle (#1087): Integrate with the existing NewReference and BorrowedReference types, which should be used on the interface to Python Action Items * Check whether we need to change the `WITH_DEBUG` variant of PyObject_TYPE for newer versions of Python (> 3.8?) * Add reference to backports-2.5 branch in README * Switch to .NET Standard for everything but ClrModule * Change project files to new format * Consider adding a StolenReference type

1 0

Python.NET 2.5.0 released
by Benedikt Reinartz 14 Jun '20

14 Jun '20

Hi all, We have just released v2.5.0 of Python.NET: - https://github.com/pythonnet/pythonnet/releases/tag/v2.5.0 - https://pypi.org/project/pythonnet/ This will be the last release to support Python 2 and non-.NET-Standard builds. Thanks a lot to the contributors to this release: @alexhelms @amos402 @andreydani @benoithudson @chrisjbremner @Cronan @filmor @ftreurni @henon @inna-w @Jeff17Robbins @jmlidbetter @koubaa @m-rossi @matham @mjmvisser @NickSavin @s4v4g3 @slide Regards Benedikt

1 0

the most popular 50 jobs on ideras.com since 2020-06-04
by ideras.com job search engine 05 Jun '20

05 Jun '20

1 0

Working group notes for June 4, 2020
by Mark Visser 04 Jun '20

04 Jun '20

Attendees: Benedikt, Victor, Mark Agenda Review action items from last meeting Benedikt/Mohamed: extract “Moving files around” PR Benedikt/Mohamed: extract “Support for dotnet SDK” PR Notes PR 1094 reviewed by Amos (thanks!) 2.5 release in progress PR 824 will go into 2.5 RC will be released this week - taking a while due to combination of platforms & python versions github master branch will be 2.5 release and only land bug fixes will only publish 2.5 to PyPI - not Nuget Benedikt will start new develop branch after next meeting (June 18th) once that's done we'll start integrating big PRs that break things (including dropping Python 2.x) other PRs on hold until after 2.5 release Victor's branch (for after 2.5 release) worked on providing Python interfaces to existing .NET collections implemented and injected mixins for stuff from collections.abc into reflected classes implementing interfaces from System.Collections.Generic also implemented buffer interface for arrays depends on features that haven't yet landed upstream Python for .NET now part of the .NET foundation! no change to the license after the 2.5 release we can improve our appveyer setup Action Items Benedikt/Mohamed: extract “Moving files around” PR Benedikt/Mohamed: extract “Support for dotnet SDK” PR The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, June 18th at 12pm EST, 9am PST, 6pm CET, 1am China. Mark Visser M&E Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

2 1

Working group notes for Feb 27, 2020
by Mark Visser 21 May '20

21 May '20

Attendees: Victor, Mark, Benedikt, Benoit, Amos, Felix Agenda Review action items from last meeting: Benoit to finish wiki page for threading Victor will talk to Benedikt regarding creating a lib/separate repo for codecs (this also applies to QuantConnect) Quantconnect PR - Victor to ensure Amos commits are mirrored in master Amos should take over PR #1016 Victor will try to review #958 instead See if Benedikt needs better time or we can make decisions while he’s off Unity is settled on 2.4.0, and might reduce presence Create NuGet organization and transfer package ownership for NuGet package <https://www.nuget.org/packages/pythonnet/> At least 1 more person to admin NuGet org Mailing list for maintainers only A plan to replace IntPtr with the new reference types Upstreaming Lost Tech (Victor’s) fork Python 2 support? DllImport -> GetDelegateForFunctionPointer Notes Wiki page for threading is up in tutorials section Victor & Amos discussing failing multithreading test case in PR #1022 Looks like Amos's commits in the Quantconnect PR are already in master PR #1016 closed in favour of using PR #958 instead Slow going on PR #958 review needs some description to explain the changes - a few sentences that describe the intended effects of the changes: what actions are necessary to implement soft shutdown? hard to get overall picture of what the code is expected to do Regarding the time slot this is the best we can get that balances China, North America and Germany time zones it's OK for Victor make decisions in the meeting - unless Benedikt is completely against the decision, it will be OK NuGet org Victor has access problem is that registered e-mail is the mailing list e-mail, security hole A plan to replace IntPtr with the new reference types we should avoid using IntPtr in our own pull requests should use proper pointer types ourselves, once we've got good practices established can be documented belongs with Benedikt's work on loader PR Upstreaming Lost Tech (Victor’s) fork Python 2 support not handled, should we drop support from master (and move 2.x to branch)? DllImport -> GetDelegateForFunctionPointer change require dropping 2.x in general dropping 2.x helps with a lot of things not a problem for Unity, also moving to 3.x No arguments against dropping support for 2.x in master were raised is master in a good state for a last release of 2.x? have one last push to get any changes not specific to 3.x into master before branch-off / tag codecs other minor changes stability of current release? random CI failures we added more tests recently - e.g. domain reload tests unstable one of the domain reload tests often fails on Python 2.7 Amos' changes for normal mode shutdown should solve these failures - should we land them first? no, let's only backport them if there is demand master is currently green As soon as we have all PRs we want in, we will tag 2.4.1 (if no breaking changes, 2.5 otherwise) and branch if necessary will use a github milestone to track PRs for 2.4.1 Still failing tests on 3.8, but likely a dependency on 3.7 - next release should have 3.8 support Lost Tech branch has support for Python version independence (except for 3.8) complete version independence requires dynamic tp slot handling will need runtime logic for handling different versions of Python to handle differing slot locations also need to remove PInvoke usage solving for these two issues will allow any Python version to be used at runtime instead of requiring pre-build for specific versions Lost Tech branch doesn't handle embedding C# in Python, but CLR loader PR should take care of this - already working, and should work with Lost Tech branch changes Dynamic CLR loading won't support 2.4 Action Items Victor will create codecs repo on github Amos to create issue or PR to make implicit operator for reference types to convert reference to IntPtr Amos will create wiki page to explain soft shutdown Benedikt will look into creating a private mailing list for maintainers only Everyone - tag PRs you want to land in 2.4.1, we'll try to get merged before next release Benedikt to check that modernization branch will work with 3.8 The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, March 12th at 12pm EST, 9am PST, 6pm CET, 1am China. Mark Visser Tooling Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 3

Is it possible to check if a .NET class is a subclass of another .NET class
by robert.hoelzl＠posteo.de 20 May '20

20 May '20

In python I can check the inheritance via isinstance() (and issubclass()). These methods do not work on .NET classes. Are there alternative methods which are doing the job for .NET

2 2

How to run in STA without spawning an extra thread
by robert.hoelzl＠posteo.de 19 May '20

19 May '20

I want to create a WPF app, which requires a STA thread. Unfortunately the main-thread of python.exe runs in MTA and thus cannot be utilitized. I had to spwan an extra thread, But this makes my IDE's (PyCharm) debugger not work any more (does not stop on breakpoints). I downloaded the Python.NET sources to create a version that runs in STA, but I failed to find any piece of code, that activates MTA (and which I could change to STA). I expected it to be in "/src/monoclr/pynetinit.c", but here I only found the code to load Python.Runtime.dll. can anyone give me a hint? regards, Robert

1 3

How the clr module works with .NET imports
by adam.preble＠gmail.com 29 Apr '20

29 Apr '20

I'm curious about how the clr module and the subsequent imports work. I'm asking for a hand in understanding that since that's some pretty dense code for me to understand by myself. I'm doing this because I'm trying to have the same functions in my own pure .NET, async-await Python interpreter project. I have a fairly simple example I am using as a test that I got originally from IronPython--that also works with Python.NET: >>> import clr >>> clr.AddReference("System") <System.Reflection.RuntimeAssembly object at 0x0000022C20DA2438> >>> from System import Environment >>> Environment <class 'System.Environment'> Two questions: 1. Generally how does Python.NET track these references? I assumed there'd be a module loader for .NET DLLs but saw nothing in sys.meta_path. In my own project, I've been polluting the local context with a a __clr__ dunder. 2. How does Python.NET get Environment out of the System reference? Is it a misnomer? Environment's in mscorlib but the System namespace. I'm treating AddReference("System") as adding the System assembly, but I suppose it's more applicable to say it's adding the System namespace. I don't know how to represent that in .NET parlance. I found this, which seems rather tedious! https://stackoverflow.com/questions/79693/getting-all-types-in-a-namespace-… Presumably that would mean going through all references and finding matching namespaces.

1 0

Working group notes for April 23, 2020
by Victor “LOST” Milovanov 23 Apr '20

23 Apr '20

1 0

Working group notes for April 23, 2020
by Victor “LOST” Milovanov 23 Apr '20

23 Apr '20

1 0

Using Import method in C# Py.GIL
by murad.tulunay＠gmail.com 12 Apr '20

12 Apr '20

Hi, How can I write "from packet..messaging import MessagingClient" in Python.Runtime. I tried below code snipet "dynamic MessagingClient = Py.Import("packet.messaging");" Still heve exception:

1 0

TypeError for argument type IList <dynamic>
by gregor.hd＠gmx.de 11 Apr '20

11 Apr '20

Hi, I'm new to Python for .NET and to this mailing list. From the search results to my question I see I'm not the first person with my problem, yet the solution still evades me. When using the following function without AuxParameters everything works fine bool CalculateResult(string resultName, IntPtr resultArray, IList <dynamic> AuxParameters = null) but in cases where I do need a parameter I get a "TypeError: No method matches given arguments for CalculateResult". Any ideas how I can make this work? Here's what I tried: from System import Array, Int16 from System.Runtime.InteropServices import GCHandle, GCHandleType resultName = 'ABCD' result_index = 50 # set 0 if not needed! par = [result_index] a = [0] * 100 arr = Array[Int16](a) arr_hndl = GCHandle.Alloc(arr, GCHandleType.Pinned) ptr_arr = arr_hndl.AddrOfPinnedObject() if result_index: CalculateResult(resultName, ptr_arr, par) else: CalculateResult(resultName, arr) Thanks for any help, Greg

1 0

intermittent importerror unknown location, module imported as namespace, import from clr works
by Mark Mikofski 10 Apr '20

10 Apr '20

Sorry for starting a new thread if redundant. I have been a long time user of PythonNet and suddenly I am having an intermittent failure that I can't diagnose, PythonNet == 2.4.0.dev0 from pypi in Conda Python == 3.7.6 from conda main channel msvc 2019 I am using the following repository: https://github.com/mikofski/pv.net When I try to import pv.SolarPosition I get the following error: ImportError: cannot import name 'SolarPosition' from 'pv' (unknown location) I've tried it a couple of ways: 1. add reference to assembly name, doesn't work >>> import clr >>> assy_path = "C:\\Users\\mikofski\\source\\repos\\pv.net\\bin\\pv.dll" >>> assy = clr.AddReference(assy_path) >>> import pv >>> pv <module 'pv' (namespace)> >>> pv.SolarPosition AttributeError: module 'pv' has no attribute 'SolarPosition' >>> from pv import SolarPosition ImportError: cannot import name 'SolarPosition' from 'pv' (unknown location) 2. add assembly path to PYTHONPATH or sys.path, neither works >>> import sys >>> assy_path = "C:\\Users\\mikm\\source\\repos\\pv.net\\bin" >>> sys.path.append(assy_path) >>> import clr >>> assy = clr.AddReference("pv") >>> import pv >>> pv <module 'pv' (namespace)> >>> pv.SolarPosition AttributeError: module 'pv' has no attribute 'SolarPosition' >>> from pv import SolarPosition ImportError: cannot import name 'SolarPosition' from 'pv' (unknown location) 3. import from clr, always works >>> import clr >>> assy_path = "C:\\Users\\mikofski\\source\\repos\\pv.net\\bin\\pv.dll" >>> assy = clr.AddReference(assy_path) >>> from clr import pv >>> pv <module 'pv' (namespace)> >>> pv.SolarPosition pv.SolarPosition >>> dates = ["19900101T12:30:00", "19900102T12:30:00", "19900103T12:30:00", "19900104T12:30:00"] >>> pv.SolarPosition(dates, 32.1, -121.0) 19900101T12:30:00 --> 1/1/1990 12:30 PM 19900102T12:30:00 --> 1/2/1990 12:30 PM 19900103T12:30:00 --> 1/3/1990 12:30 PM 19900104T12:30:00 --> 1/4/1990 12:30 PM 01/01/1990 12:30:00 --> 1.00 02/01/1990 12:30:00 --> 2.00 03/01/1990 12:30:00 --> 3.00 04/01/1990 12:30:00 --> 4.00 1.00 --> 0 2.00 --> 0.01721421 3.00 --> 0.03442841 4.00 --> 0.05164262 Out[35]: <pv.SolarPosition at 0x173cdd71c88> Even though I still can't import SolarPosition from pv at least call pv.SolarPosition. Weirdly, somehow if I import some other assemblies, which sometimes works, or if I keep trying long enough, suddenly it works, and I can import SolarPosition from pv using method 1 or 2. I don't know why, it's not repeatable. I recently made changes to my visual studio configuration, I only have build tools for 2015, visual studio 2017, and visual studio 2019. I am building using the makefile with visual studio 2019. I have tried compiling with either 2015 or 2017, but it doesn't seem to matter. I am using the native x64 environment. Also, maybe this matters, I started this project in visual studio 2019 as a .net core 3.1 project, and I noticed that it doesn't have AssemblyInfo.cs or a very big csproj file, but since I'm compiling from the command line using csc in the Makefile (see repo) I didn't think that would matter. Also, I tried an older project that I started using .Net Framework-4.5 and it also seems to work intermittently, inconsistently. My suspicion is that I somehow screwed up my .NET configuration, but not sure how or what. Anyway, if anyone has ever encountered this, or has any ideas, please let me know. I'm going a little crazy. thanks, Mark

4 3

Working group notes for April 9, 2020
by Victor “LOST” Milovanov 09 Apr '20

09 Apr '20

1 0

Working group notes for March 26, 2020
by Mark Visser 27 Mar '20

27 Mar '20

Attendees: Victor, Benedikt, Amos, Mohamed, Mark Agenda Review action items from last meeting: [x] Mohamed will work on list and action codec PRs [x] Victor will ask Benedikt about older solution files/create an issue [x] Victor will look again at Mohamed’s issue with VS 2019 [ ] Continue PyHandle/References discussion on GitHub [x] Victor will start a discussion about serializing user objects - it might be highly misleading [ ] Amos will create a test for WrapperStorer demonstrating it release plan? Notes List & action codec PRs working through comments will put function codec into codec repo older solution files everything has not been converted to new project format old solution files still used by one of the appveyor builds Mono build uses xbuild? we should use .NET CLI for building what if users only have mono? building by yourself is painful older solutions should be removed Benedikt has removed it in a branch serializing user objects discussion will continue in PR private mailing list has been created contact Benedikt/Victor if you want to be on the mailing list use this for any future security issues / contacts joining .NET foundation got a new questionnaire, upcoming boarding meeting discussing new applications please review PR #1094 on finalize that Victor created what's going in the next release? finalizing Python 3.x support should go in memory dump can go in nested namespaces? Benedikt: deprecation warning about implicit loading is wrong and we should remove it codec groups? re: IronPython compatibility import system vs. import clr current system replaces __import__ and is overly invasive Action Items [ ] Viktor to create issue to track removing old solutions [ ] Continue PyHandle/References discussion on GitHub [ ] Amos will create a test for WrapperStorer demonstrating it [ ] Amos please review PR #1094 [ ] Benedikt will review codec groups PR The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, April 10 at 12pm EST, 9am PST, 6pm CET, 1am China. Mark Visser Tooling Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Re: Building with vs2019
by Victor “LOST” Milovanov 13 Mar '20

13 Mar '20

1 0

Working group notes for March 12, 2020
by Victor “LOST” Milovanov 12 Mar '20

12 Mar '20

1 0

Building with vs2019
by Mohamed Koubaa 09 Mar '20

09 Mar '20

Hello, At my organization we use a release of VS2017 that does not include the 7.3 version of the C# compiler and cannot update because we are fixed to a specific C++ ABI. I am trying to use VS2019 to build and deploy pythonnet using some tips I found here<https://github.com/dotnet/performance/blob/master/src/benchmarks/gc/docs/py…> but hit this issue when building clrmodule.15: Error MSB4062 The "RGiesecke.DllExport.MSBuild.DllExportAppDomainIsolatedTask" task could not be loaded from the assembly C:\Users\mkoubaa\.nuget\packages\unmanagedexports\1.2.7\tools\RGiesecke.DllExport.MSBuild.dll. Could not load file or assembly 'Microsoft.Build.Utilities, Version=2.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. The system cannot find the file specified. Confirm that the <UsingTask> declaration is correct, that the assembly and all its dependencies are available, and that the task contains a public class that implements Microsoft.Build.Framework.ITask. clrmodule.15 C:\Users\mkoubaa\.nuget\packages\unmanagedexports\1.2.7\tools\RGiesecke.DllExport.targets 58 Has anyone got this to work and if so what did you do? A better question might be how UnmanagedExports is making use of Microsoft.Build.Utilities. I know that there is a modernization project<https://github.com/pythonnet/pythonnet/projects/6> that may address this in the future. Thanks! Mohamed Koubaa Software Developer ANSYS, Inc

1 0

Re: DLL Processor compatibility
by Victor “LOST” Milovanov 05 Mar '20

05 Mar '20

1 0

Re: DLL Processor compatibility
by Victor “LOST” Milovanov 05 Mar '20

05 Mar '20

3 2

Re: DLL Processor compatibility
by Victor “LOST” Milovanov 04 Mar '20

04 Mar '20

2 2

[NuGet Gallery] Recent changes to your organization's email
by NuGet Gallery 04 Mar '20

04 Mar '20

The email address associated with your NuGet Gallery organization was recently changed from pythondotnet(a)python.org to pythonnet-dev(a)python.org. Thanks, The NuGet Gallery Team Privacy Statement (https://go.microsoft.com/fwlink/?LinkId=521839) Microsoft Corporation One Microsoft Way Redmond, WA 98052 USA

1 0

Re: Accessing a list that is a read-only property?
by Victor “LOST” Milovanov 04 Mar '20

04 Mar '20

2 1

DLL Processor compatibility
by Govil Nag 04 Mar '20

04 Mar '20

hallo, pythonnet dll work either x64 bit processor or x86 processor ..is it possible to run it in visual Studio with "Any CPU"

1 0

Accessing a list that is a read-only property?
by Mark Brighton 03 Mar '20

03 Mar '20

Hello, I think this is a really basic question, but despite searching I haven't found a solution. I've been asked to use a .NET assembly from python. I have programed in other languages, but not C#. In the brief time I've used it, PythonNet has been fantastic... with one little wrinkle. Here's a pared down version of the C# that I’m trying to access from Python: namespace Service.API { public class ServiceAPI { private static ServiceAPI m_Instance = new ServiceAPI(); public static ServiceAPI Instance { get { return m_Instance; } } public ServiceAPI() { } ~ServiceAPI() {} ServiceInformation m_ServiceInformation = new ServiceInformation(); public List<string> ServiceHosts { get { return m_ServiceInformation.ServiceHosts; } } } public class ServiceInformation { public List<string> ServiceHosts { get; set; } public ServiceInformation() { ServiceHosts = new List<string>(); } } } I need to add strings to the List “ServiceHosts”, accessing it via a ServiceAPI object. The author placed the List inside another class, "ServiceInformation" and did not provide a set accessor, so that the ServiceHosts could not be altered to another object, while allowing strings to be added and removed from it. I think adding a string to that list is trivial in C#: ServiceAPI.Instance.ServiceHosts.Add('1.1.1.1'); So I try it in Python: >>> import clr # Pyton.NET package >>> clr.AddReference("Service.API") >>> import Service.API >>> import System >>> Service.API.ServiceAPI.Instance.ServiceHosts.Add('1.1.1.1') Traceback (most recent call last): File "<interactive input>", line 1, in <module> AttributeError: 'ServiceAPI' object has no attribute 'Add' This is a List that PythonNet is mapping onto a python list: >>> Service.API.ServiceAPI.Instance.ServiceHosts [] So try using a python method: >>> Service.API.ServiceAPI.Instance.ServiceHosts.append('1.1.1.1') >>> Service.API.ServiceAPI.Instance.ServiceHosts [] Nope. And I start suspecting that I've added that string to a boxed version of the list. But because there's no set accessor, I can't do this: >>> hosts = Service.API.ServiceAPI.Instance.ServiceHosts >>> hosts.append('1.1.1.1') >>> Service.API.ServiceAPI.Instance.ServiceHosts = hosts Traceback (most recent call last): File "<interactive input>", line 1, in <module> TypeError: property is read-only So what about calling the unbound list method, passing in the list? >>> System.Collections.Generic.List[String].Add( Service.API.ServiceAPI.Instance.ServiceHosts, '1.1.1.1') Traceback (most recent call last): File "<interactive input>", line 1, in <module> AttributeError: 'ServiceAPI' object has no attribute 'Add' The author of this assembly has offered to create a specific method so that I can access the list, but he assures me that this is a common C# pattern that I will encounter frequently. I can't just create an instance of ServiceInformation and add the hosts to that, ServiceAPI has no method for getting or setting m_ServiceInformation. Any help in setting me in the right direction would be appreciated. Thanks, Mark Brighton

1 0

How do you add an element to a List in a read-only property?
by mark＠brightsoftwaredesign.com 02 Mar '20

02 Mar '20

Hello, I think this is a really basic question, but I haven't found a solution. I've been asked to use a .NET assembly from python. I have programed in other languages, but not C#. In the brief time I've used it, PythonNet has been fantastic... with one little wrinkle. Here's a pared down version of the C#: namespace Service.API { public class ServiceAPI { private static ServiceAPI m_Instance = new ServiceAPI(); public static ServiceAPI Instance { get { return m_Instance; } } public ServiceAPI() { } ~ServiceAPI() {} ServiceInformation m_ServiceInformation = new ServiceInformation(); public List<string> ServiceHosts { get { return m_ServiceInformation.ServiceHosts; } } } public class ServiceInformation { public List<string> ServiceHosts { get; set; } public ServiceInformation() { ServiceHosts = new List<string>(); } } } I need to add strings to the List "ServiceHosts" in ServiceAPI. The author placed the List inside another class, "ServiceInformation" and did not provide a set method, so that the ServiceHosts could not be altered to another object, while allowing strings to be added and removed from it. I think adding a string to that list is trivial in C#: (I've been assured by the assembly author that this works) ServiceAPI.Instance.ServiceHosts.Add('1.1.1.1'); So I try it in Python: >>> import clr # Pyton.NET package >>> clr.AddReference("Service.API") >>> import Service.API >>> import System # This is a .NET package. >>> Service.API.ServiceAPI.Instance.ServiceHosts.Add('1.1.1.1') Traceback (most recent call last): File "<interactive input>", line 1, in <module> AttributeError: 'ServiceAPI' object has no attribute 'Add' This is a List that PythonNet is mapping onto a python list: >>> Service.API.ServiceAPI.Instance.ServiceHosts [] So try using a python method: >>> Service.API.ServiceAPI.Instance.ServiceHosts.append('1.1.1.1') >>> Service.API.ServiceAPI.Instance.ServiceHosts [] Nope. And I start suspecting that I've added that string to a boxed version of the list. But because there's no set accessor, I can't do this: >>> hosts = Service.API.ServiceAPI.Instance.ServiceHosts >>> hosts.append('1.1.1.1') >>> Service.API.ServiceAPI.Instance.ServiceHosts = hosts Traceback (most recent call last): File "<interactive input>", line 1, in <module> TypeError: property is read-only So what about calling the unbound list method, passing in the list? >>> System.Collections.Generic.List[String].Add( Service.API.ServiceAPI.Instance.ServiceHosts, '1.1.1.1') Traceback (most recent call last): File "<interactive input>", line 1, in <module> AttributeError: 'ServiceAPI' object has no attribute 'Add' The author of this assembly has offered to create a specific method so that I can access the list, but he assures me that this is a common C# pattern that I will encounter frequently. I can't just create an instance of ServiceInformation and add the hosts to that, ServiceAPI has no method for getting or setting m_ServiceInformation. Any help in setting me in the right direction would be appreciated. Thanks, Mark Brighton

1 0

[NuGet Gallery] Membership update for organization 'pythonnet'
by NuGet Gallery 20 Feb '20

20 Feb '20

The user 'lost' is now an administrator of organization 'pythonnet'. Thanks, The NuGet Gallery Team Privacy Statement (https://go.microsoft.com/fwlink/?LinkId=521839) Microsoft Corporation One Microsoft Way Redmond, WA 98052 USA

1 0

Working group notes for Feb 13, 2020
by Mark Visser 20 Feb '20

20 Feb '20

Attendees: Victor, Benoit, Amos, Mohammed Agenda Review action items from last meeting: Benoit will write github issue documenting GIL best practices when running multithreaded code and possible solutions [in progress, wiki page + tests] Benedikt will look into splitting up CLR loader into multiple work items to speed up .NET Core support Victor will address comments on codec PR - ready to check in Victor - will work on breaking up Quantconnect PR Mohamed will rebase #974 on top of Victor's codec PR ? - github actions Victor will send Benoit & Felix build that failed on Linux 3.7 Benoit will continue working on PR #1016 Amos is having connection issues and will send an update email to the mailing list Create NuGet organization and transfer package ownership for NuGet package <https://www.nuget.org/packages/pythonnet/> Notes Benoit will work on wiki page + tests for GIL Quantconnect PR Converter-related stuff depends on codecs repository Performance in separate PR Mohamed will rebase #974 - handle generic parameters on action type, needs repo for codecs Victor made repo <https://github.com/losttech/PackagedTensorFlow> + NuGet <https://www.nuget.org/packages/LostTech.TensorFlow.Python> with packaged Python Action Items Benoit to finish wiki page for threading Victor will talk to Benedikt regarding creating a lib/separate repo for codecs Quantconnect PR - Victor to ensure Amos commits are mirrored in master Amos should take over PR #1016 Victor will try to review #958 instead See if Benedikt needs better time or we can make decisions while he’s off Unity is settled on 2.4.0, and might reduce presence The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, February 27th at 12pm EST, 9am PST, 6pm CET, 1am China. Mark Visser Tooling Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Notes for #958 & #1016
by Li Amos 30 Jan '20

30 Jan '20

For #958, I droped NativeCodePage dependency, it makes no need for writting the machine code to makes dummy slots at all. I was thinking is it possible to keep thouse clr moduel alive after domain reload. I may try to implement it if I could. Actually, it won't be easy to make #1016 pass all tests as an independency, since many pre conditions are not completed. Like some refcnt fixes it doesn't possess. For achieving the soft shutdown, I have to fixes some flaws and bugs whiches on master branch in #958. That making the PR become biger and biger(some are the optimizations I added passingly). Thouse bugs maybe insignificances(reference count error, memory leaks, etc.) on master branch, be they may be the criticals when you try to reset the python runtime, you have to wipe them out first. About those weird crashes in other branches, they're not the odd. since I fixed the bugs I found in my branch, I have great confidence that if you try to merge #958 into them, they may pass. So I still recommend merge #958 directly, split them just reduce efficiency, because I have to consider the merge order if I need all tests pass. But now the efficiency of merge progress is worse. #1016 may be the one very close the final one if it have to be split.

1 0

Working group notes for January 30, 2020
by Mark Visser 30 Jan '20

30 Jan '20

Attendees: Benedikt, Victor, Amos, Benoit, Mark Agenda Review action items from last meeting: Benedikt will continue working on .NET foundation application Victor - will continue review of CLR loader PR Benedikt - review codec PR please Benoit - multithreaded python code Victor - will work on breaking up Quantconnect PR Mohamed will rebase #974 on top of Victor's codec PR ? - github actions Amos - will take changes made to PR #958 and push to #1016, address comments Notes Benoit looked at releasing threads on initialization return for multithreaded python code use case is initializing Python.NET in Unity, on return GIL is held, workaround doesn't need Python.NET change (just release GIL from C#) should the solution be in user code or Python.NET? discussion around tradeoff between complexity for users and correct behaviour Could this be opt-in via e.g. attributes? So existing code continues to work without change. Currently PyGIL attribute doesn't do anything, purely documentation Current behaviour is somewhat surprising First step is to document behaviour Benedikt still working on .NET foundation application seems to be in some triage stage, not rejected but not progressing either will continue with personal membership and keep application moving CLR loader still WIP, can load any CLR into Python dynamic loading of Python.NET is messy, problems around PInvoke and content string, works in Mono and .NET framework should work in .NET core but first function call that hits Python function fails with missing DLL from the PInvoke call we want PInvoke to call into symbols in the existing namespace so can use current Python exe (without Python so/dll) very WIP could this be split into multiple work items? goal is to have a single deployment, but maybe this work can be split up there are a lot of people asking for .NET core support, splitting would help that Codec PR target a specific version or just merge into master once it passes CI? merge into new branch for next version? or make functions internal and use [InternalsVisibleTo] in master? just land in master tuple converter looks more like an example of how code should be done - maybe move out of main assembly to an example project? internal conversions should be rewritten using codec API PR #1016 Amos merged changes to the PR Some test failures need to be addressed Linux 3.7 crash not sure if errors are legitimate or test framework failure seems to be infrastructure instability? Victor saw same crash on other branch try again? Is there a release schedule? not really want to get Amos' big change into master before next release so we can update Python for Unity (sometime in 2020) needs input from Benedikt Action Items Benoit will write github issue documenting GIL best practices when running multithreaded code and possible solutions Benedikt will look into splitting up CLR loader into multiple work items to speed up .NET Core support Victor will address comments on codec PR Victor - will work on breaking up Quantconnect PR Mohamed will rebase #974 on top of Victor's codec PR ? - github actions Victor will send Benoit & Felix build that failed on Linux 3.7 Benoit will continue working on PR #1016 Amos is having connection issues and will send an update email to the mailing list The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, February 13th at 12pm EST, 9am PST, 6pm CET, 1am China. Mark Visser Tooling Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Re: [Python.NET] Working group meeting notes for December 5, 2019 - CANCELLED
by Victor “LOST” Milovanov 16 Jan '20

16 Jan '20

1 0

Working group notes for January 16, 2020
by Mark Visser 16 Jan '20

16 Jan '20

Attendees: Felix, Mark, Victor, Mohamed, Amos Agenda Review action items from last meeting: Benedikt will continue working on .NET foundation application Victor will take a look at the CLR loader PR, looks big though Victor will look into if we can generate perf stats through AppVeyor and Travis Victor will publish a PR for conversion config Mohamed will split PR #974 Benoit - multithreaded python code Victor - breaking up Quantconnect PR ? - github actions Benedikt - will try to reproduce PyBuffer crash locally Notes Victor took a look at CLR loader PR, review in progress Perf stats on hold as they aren't supported by Appveyor/Travis, would need an external server to record stats Codec PR published, needs review from Benedikt Mohamed will rebase #974 on top of Victor's codec PR PR #1016 - some bugs in this PR have been fixed in #958 by Amos Felix working through domain reload changes, updating to master and reviewing PR plan is to break up PR #958 General note: please participate in PR reviews and/or take a look at the PyBuffer crash. Action Items Victor - will continue review of CLR loader PR Benedikt - review codec PR please Benoit - multithreaded python code Victor - will work on breaking up Quantconnect PR ? - github actions Amos - will take changes made to PR #958 and push to #1016, address comments The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, January 30th at 12pm EST, 9am PST, 6pm CET, 1am China. Mark Visser Tooling Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Working group meeting notes for December 5, 2019 - CANCELLED
by Mark Visser 16 Jan '20

16 Jan '20

Attendees: Mohamed, Amos, Mark Agenda Review action items from last meeting: Benedikt - continue working on joining .NET foundation Benoit - multithreaded python code ? - breaking up Quantconnect PR ? - github actions Amos - continue breaking up pull 958 into smaller PRs to make it easier to review and merge. e.g. have a single PR that gets reference counts right and doesn't touch GC chains. See Benoit's example of the __import__ restore PR for best practices. Amos - same for other older PRs Benedikt - will try to reproduce PyBuffer crash locally Benedikt - will check if there are any breaking changes since 2.4.0 Benedikt - continue exploring CLR loader, splitting parts into separate Python interop DLLs, have main Python runtime implement layers on top Notes Quorum not reached, meeting cancelled The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next meeting will be held on Thursday, December 19th at 12pm EST, 9am PST, 6pm CET, 1am China. Mark Visser Tooling Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

3 2

Support for Python 3.8
by Anand Mohan 13 Jan '20

13 Jan '20

Hello - We are exploring Python 3.8 currently in our organization. I have used PythonNet in the past and I see it is supported until 3.7. Will support for Python 3.8 be available for PythonNet? Regards, Anand CONFIDENTIALITY NOTICE: This communication contains information intended for the use of the individuals to whom it is addressed and may contain information that is privileged, confidential or exempt from other disclosure under applicable law. If you are not the intended recipient, you are notified that any disclosure, printing, copying, distribution or use of the contents is prohibited. If you have received this in error, please notify the sender immediately by telephone or by returning it by return mail and then permanently delete the communication from your system. Thank you.

1 0

Will 2.4.0 be built for Python 3.8?
by Steven Rumbalski 02 Jan '20

02 Jan '20

Hi, Will 2.4.0 be built for Python 3.8 or is the plan to wait for 2.4.1? Is there a time frame in mind for Python 3.8 support? Thank you, Steven Rumbalski

1 0

Working group meeting notes for December 19, 2019
by Mark Visser 19 Dec '19

19 Dec '19

Attendees: Benedikt, Victor, Amos, Mohamed, Mark Agenda Review action items from last meeting: Benedikt - continue working on joining .NET foundation Benoit - multithreaded python code ? - breaking up Quantconnect PR ? - github actions Amos - continue breaking up pull 958 into smaller PRs to make it easier to review and merge. e.g. have a single PR that gets reference counts right and doesn't touch GC chains. See Benoit's example of the __import__ restore PR for best practices. Amos - same for other older PRs Benedikt - will try to reproduce PyBuffer crash locally Benedikt - will check if there are any breaking changes since 2.4.0 Benedikt - continue exploring CLR loader, splitting parts into separate Python interop DLLs, have main Python runtime implement layers on top Victor - Perf runs in CI Review PRs Mailing list currently moderated - @markv asked for ownership to be transferred to Benedikt Notes joining .NET process had changed, Benedikt working on it Pull 958 (domain reload handling) split PRs being approved and merged, thanks Amos! github actions if we join .NET we can stay on current setup would be nice to have Darwin CI working PyBuffer nothing done yet CLR loader modernization PR has a single build Python 2 should still work, but Benedikt won't spend a lot of time on Python 2, 3.5+ is current focus moved code and tests into separate directories removed old csproj file in favour of small project files generated using .NET CLI goal is a fully building project using .NET CLI that is operating system independent made a small pythonnet module that will be the future entry point still rough, testing currently with core CLR and Mono on Linux loading works, P/Invoke __internal breaks on .NET core Python functions have been split out into an interface using T4 templates ready for early review if you can take a look Performance tests and CI not very stable if we put in CI, fail depending on weather conditions no way to put in CI without random failures maybe makes sense to keep it as an ongoing statistic on master and not blocking PRs useful for running locally on branch vs. master to check for regressions still informative for detecting regressions - we can run it on every PR, but it shouldn't result in a hard error - can we report it on the PR? perf comparison is relative, so different machines shouldn't affect the result Mailing list keep it, but remove moderation, transfer ownership to Benedikt Improve method binding PR #974 discussion Meeting on January 2 is cancelled, next meeting will be in 4 weeks on Thursday, January 16, 2020 Action Items Benedikt will continue working on .NET foundation application Victor will take a look at the CLR loader PR, looks big though Victor will look into if we can generate perf stats through AppVeyor and Travis Victor will publish a PR for conversion config Mohamed will split PR #974 Benoit - multithreaded python code ? - breaking up Quantconnect PR Benedikt - will try to reproduce PyBuffer crash locally The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. Please note there will be no meeting on January 2nd. The next meeting will be held on Thursday, January 16th at 12pm EST, 9am PST, 6pm CET, 1am China. Happy holidays! Mark Visser Tooling Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

2 1

Fwd: 4 PythonDotNet moderator request(s) waiting
by Denis Akhiyarov 19 Dec '19

19 Dec '19

Since no one is moderating this pythondotnet mailing list, I would like to archive this mailing list unless someone is willing to take over? I will wait for one week. I’m no longer involved with the project. Thanks, Denis ---------- Forwarded message --------- From: <pythondotnet-bounces(a)python.org> Date: Wed, Dec 18, 2019 at 7:00 AM Subject: 4 PythonDotNet moderator request(s) waiting To: <pythondotnet-owner(a)python.org> The PythonDotNet(a)python.org mailing list has 4 request(s) waiting for your consideration at: https://mail.python.org/mailman/admindb/pythondotnet Please attend to this at your earliest convenience. This notice of pending requests, if any, will be sent out daily. Pending posts: From: kennywc.lin(a)gmail.com on Sun Nov 24 04:55:14 2019 Subject: C# assembly module importing error using pythonnet after .py to .pyd conversion. Cause: Post by non-member to a members-only list From: benoit.hudson(a)imaginary-spaces.com on Thu Dec 5 14:55:17 2019 Subject: Re: [Python.NET] Working group meeting notes for December 5, 2019 - CANCELLED Cause: Post to moderated list From: johanna01(a)worldchemforum.com on Fri Dec 6 11:20:07 2019 Subject: Confirmation for World Chemistry Forum, May 22-24, 2020 in Osaka Cause: Post by non-member to a members-only list From: info(a)comms.yahoo.net on Thu Dec 12 08:00:47 2019 Subject: Next Steps: The Evolution of Yahoo Groups (Final Notification) Cause: Post by non-member to a members-only list

4 5

C# assembly module importing error using pythonnet after .py to .pyd conversion.
by Weichen Lin 24 Nov '19

24 Nov '19

Dear Sir, Thank you for your effort in developing a wonderful module pythonnet so that I can easily interface the C# assembly (https://www.kgifutures.com.tw/content/images_D8/QuoteCom%20API-20170425.zip ) offered by my futures dealer. A working simple code is as follows, using the supplied assembly in bin\release\QuoteCom.dll: # File name: Test.py import clr clr.AddReference("QuoteCom") import Intelligence QC = Intelligence.QuoteCom("211.20.186.12", 8000, "API", "b6eb") However, it caused an error importing "Intelligence" module when I converted .py to .pyd. Conversion was done using: # setup.py from distutils.core import setup from distutils.extension import Extension from Cython.Distutils import build_ext ext_modules = [ Extension("Test", sources=["Test.py"]), ] setup( name = 'My Program', cmdclass = {'build_ext': build_ext}, ext_modules = ext_modules ) # DOS command: Python setup.py build_ext -inplace Is there any step I've done wrong? Any response is appreciated. Thank you very much! Best regards, Weichen Lin

1 0

Working group notes for November 21, 2019
by Mark Visser 21 Nov '19

21 Nov '19

Attendees: Victor, Benoit, Mark, Amos, Benedikt Agenda Review action items from last meeting: Mark - got in touch with .NET foundation Benoit - document how to use pythonnet when you expect to run multithreaded python code (BeginAllowThreads/EndAllowThreads) in an embedded interpreter Victor - will create Github issues for items in the Quantconnect PR and figure out plan for bringing more generic solutions to master. ? - can someone research how hard it would be to move the CI to Github Actions? Benoit - will break out SlotsHolder and __import__ restore into smaller PRs Amos - will continue to break https://github.com/pythonnet/pythonnet/pull/958 <https://github.com/pythonnet/pythonnet/pull/958> into smaller PRs following Benoit's example All - please discuss changing the meeting time on the list Notes .NET foundation - Benedikt working on it with contact & maintainer of IronPython Multithreaded python code - Benoit still working on it, has a deadlock issue that's probably unrelated. WPF has a similar issue? There are old tickets around where people tried this before. Possibility of making it automatic, but requires a major version bump. https://github.com/pythonnet/pythonnet/issues/990 <https://github.com/pythonnet/pythonnet/pull/958> for example. Quantconnect PR - perf PR was OK, but is a fairly small part of the larger PR. Need to get .NET standard / core stuff on the way so that they don't fork off. Github actions - currently have appveyer and travis CI implementations, but in theory github actions can do both and also work on mac. Could cover all platforms. One of the unit tests crashes on Mac - ongoing problem, would be good to have CI for that. Possible plan is to start with github actions on Mac, then extend to Linux, finally Windows. __import__ restore - merged (moved out of pull 958) SlotsHolder in progress - goal is to make it so that PyFinalize doesn't need to be called to disconnect C# from Python (moved out of pull 958) General note: please make PRs as small and targeted as possible - large PRs are very difficult to review and judge the impact and risk. Large PRs won't likely be merged. Discussion around time to accommodate Amos - we will move the meeting 3 hours earlier. Need to start planning for a point release (2.4.1) including Python 3.8 support. PyBuffer change - good addition but is crashing in a non-obvious way. Maybe not a candidate for the point release. If someone needs it for the next release, they could try to fix it in branch. We shouldn't have any breaking changes since 2.4.0, only bug fixes. Benedikt - Haven't been able to integrate CLR loader yet (ripping out old stuff). Will try to have the interface ready for the CLR loader. Python.NET exposes a clr module inside Python which exposes .NET VM startup functions. Mono vs. Core have different code paths currently. Current approach in latest .NET core seems to be stable. New CLR loader abstracts three different ways of loading .NET. Technical discussion. Proposal: pass parameters as JSON. Alternatives? Would also enable choosing runtime version of Python. Benchmarking - Still in progress. PR will be open today. Could CLR loader be completely separate from Python.NET? Benedikt - sure, it's useful on its own as a low-level mechanism to talk to .NET. On the other hand Python interop is interconnected with how Python.NET works and should stay in the project. No plans to have more libraries than CLR loader (which isn't actually needed if you're embedding Python within .NET) and pure interop + abstractions on top. Action Items Benedikt - continue working on joining .NET foundation Amos - continue breaking up pull 958 into smaller PRs to make it easier to review and merge. e.g. have a single PR that gets reference counts right and doesn't touch GC chains. See Benoit's example of the __import__ restore PR for best practices. Amos - same for other older PRs Mark - move meeting 3 hours earlier Benedikt - will try to reproduce PyBuffer crash locally Benedikt - will check if there are any breaking changes since 2.4.0 Benedikt - continue exploring CLR loader, splitting parts into separate Python interop DLLs, have main Python runtime implement layers on top The meeting notes google doc is here <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…>. Feel free to correct or add additional information. The next working group meeting will be held on December 5th at 12pm EST, 9am PST, 6pm CET, 1am China. Please note that this is three hours earlier than previous meetings. Mark Visser Tooling Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Working group meeting notes for November 7, 2019
by Mark Visser 19 Nov '19

19 Nov '19

Attendees: Benoit Hudson (ImgSpc), Amos Li, Mark Visser (Unity) Agenda Review action items from last meeting Notes Update from Victor: The only thing I’ve done though is reviewing PyBuffer request PR: https://github.com/pythonnet/pythonnet/pull/980 <https://github.com/pythonnet/pythonnet/pull/980>, for which, sadly, tests are still not passing. Update from Benedikt: I've been mostly working on clr_loader, will open a PR on pythonnet for this weekend. .NET foundation: Mark finally got a reply back from his contact at Unity He will loop Benedikt in on the e-mail as soon as he's introduced to someone on the .NET foundation Soft restart: PR is large and hard to review https://github.com/pythonnet/pythonnet/pull/958#issuecomment-551230878 <https://github.com/pythonnet/pythonnet/pull/958#issuecomment-551230878> documented here: https://docs.google.com/document/d/1a9OLsdKHXJ6MxHjo0WlVRcfjAiaP5hONNKUKKH6… <https://docs.google.com/document/d/1a9OLsdKHXJ6MxHjo0WlVRcfjAiaP5hONNKUKKH6…> Benoit will break out SlotsHolder and __import__ restore into smaller PRs Amos can you continue to break https://github.com/pythonnet/pythonnet/pull/958 <https://github.com/pythonnet/pythonnet/pull/958> into smaller PRs to land individually? discussion about system modules restoration - clarity found split removal of native code page into another PR after everything else has landed Regarding the meeting time: Amos pointed out that the meeting is at 4am his local time - could we move this meeting to a better time for him? possible times: 4 hours earlier (12pm EST, 8am PST, 12am China) 2 hours later (5pm EST, 11am PST, 6am China) 3 hours later (6pm EST, 12pm PST, 7am China) please discuss! Action Items Mark - still working on getting in touch with .NET foundation Benoit - document how to use pythonnet when you expect to run multithreaded python code (BeginAllowThreads/EndAllowThreads) in an embedded interpreter Victor - will create Github issues for items in the Quantconnect PR and figure out plan for bringing more generic solutions to master. ? - can someone research how hard it would be to move the CI to Github Actions? Benoit - will break out SlotsHolder and __import__ restore into smaller PRs Amos - will continue to break https://github.com/pythonnet/pythonnet/pull/958 <https://github.com/pythonnet/pythonnet/pull/958> into smaller PRs following Benoit's example All - please discuss changing the meeting time on the list

2 3

Working group minutes for October 22, 2019
by Mark Visser 22 Oct '19

22 Oct '19

Attendees: Benedikt Reinhartz (Project Lead), Benoit Hudson (ImgSpc), Felix Bourbonnais (ImgSpc), Mohamed Kouba (ANSYS Inc.), Victor Milovanov, Amos Li, Mark Visser (Unity) Agenda (Mark) I got a reply from Jared Broad (QuantConnect): His team is unable to devote resources to anything other than the PR they agreed to open (#895). He wanted to remind us that he proposed making a $500/month contribution, which combined with other sponsors could have a full-time person working on pythonnet. I took a look through their PR and the changes seem to roughly fit into one of these categories: stylistic (e.g. int vs. var) version change (1.0 vs. 2.4) correctness checks & better support for debugging (e.g. TRACE_ALLOC, FINALIZER_CHECK) code removal due to earlier branch point (domain reload work) additional type support (datetime, timespan) changes to support Python 3? unclear modifications (e.g. removal of initSigs parameter) Are any of these non-contentious? If so, could we cherry-pick those changes at least? Notes Benoit - Felix & Amos are talking on domain reload - next step - write up possible solutions. Working towards consensus, Amos is solving the problem more generally than we are. Likely will be two patches. Victor - If there will be multiple patches, can we split into two PRs? Benoit - that's the goal. Victor - Have two PRs that are ready for review, please review. New PR that introduces performance tests, not yet working with CI. Needs to be split into two PRs: test framework and actual tests. This will enable adding performance tests for any feature. Victor - re Quantconnect PR, can we make some of these changes more generic and bring them to master? Victor will create issues and the plan for PRs to bring them to master. Goal is for Quantconnect to not have to modify base source code. Mark - re Jared's suggestion of $500/month: Unity can't pay someone to maintain Python for .NET without a lot of legal overhead (master service agreement, statement of work, etc). Joining the .NET foundation may help with this. Mark - will move meeting to Thursday to assist Benedikt joining Benedikt- Still didn't hear anything from the .NET Foundation even though I filled their questionnaire now twice Mark - trying to contact .NET foundation from inside Unity, but my contact is on vacation. Will continue when he returns. Benedikt: - I started work on separating the CLR loading out into a separate Python package with implementations for Framework, Core and Mono. This should simplify our build-process a lot. - I started (again) to drop the old csproj files in favour of proper Sdk-style files, will try to finish that after the loader is done - I really like Victor's work on the benchmark, will look into the PR tomorrow. If this turns out well, I'd really like to see where we would get by replacing the P/Invoke style by explicit delegates, as this would finally open up a proper route towards a single Nuget package - After the build-system improvements I'll go forward on the IEnumerable changes started in PR 963. The idea is to drop (almost) all implicit conversions in favour of implementing the correct protocols for .NET objects (leveraging duck typing). - Since I don't use embedding very much, please implement your proposals for domain reload etc. as you please and I'll just have a final look on the respective PRs. I don't have an informed opinion on these cases. Discussion about performance. For good performance you’d need nice C# access to the Buffer protocol: https://docs.python.org/3/c-api/buffer.html <https://docs.python.org/3/c-api/buffer.html> (also available in Python 2.7: https://docs.python.org/2/c-api/buffer.html <https://docs.python.org/2/c-api/buffer.html>) Mohamed- C# method that takes IEnumerable can't be called with Python lists and tuples. Should that work? Worked this way in IronPython, but not ideal. Victor- Have been working on another approach with static list of conversion codecs. You can add your own codec to the list to handle arbitrary conversions. Still WIP, needs design discussion. Benedikt- What about filtering by assembly or class in registration? Victor- could achieve that by subclassing a codec and adding a filter for assembly/class. Discussion on corner cases around automatic conversion of parameters. Implicit conversion is tricky. Mohamed- is there a way to register at runtime? (with your conversion API) Victor- yes, registration is via singleton method. Worth some discussion. Benedikt- would it be better to always require function-based registration? i.e. argument & return type conversion? Discussion on parameter conversion between Python and C#. Non-trivial to do automatic conversion, too many corner cases. Amos- showed proposal for conversion API Victor- how to handle generic types? will send Amos example. Benedikt- if anyone has time to look into Github Actions, they are a potential way to have a single way to run CI on both Windows and *nix. Action Items Benoit - document how to use pythonnet when you expect to run multithreaded python code (BeginAllowThreads/EndAllowThreads) in an embedded interpreter Benoit - document my understanding of soft restart, work with Felix & Amos to get to a shared understanding. Goal is two PRs for domain reload. Victor - will create Github issues for items in the Quantconnect PR and figure out plan for bringing more generic solutions to master. Mark - move meeting to Thursday, same time to accommodate Benedikt's schedule ? - can someone research how hard it would be to move the CI to Github Actions? Victor- send complex type conversion example to Amos Google doc here: https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE… <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…> (please reply or comment in the google doc if I have made any mistakes or missed details) Unless otherwise noted, the next working group meeting will be held on Thursday, November 7, 2019 at 3pm EST. Zoom call link: https://unity3d.zoom.us/j/346931511 <https://unity3d.zoom.us/j/346931511> Please add agenda items in the google doc above.

1 0

Python for .NET working group meeting notes from Tuesday, September 24, 2019
by Mark Visser 18 Oct '19

18 Oct '19

Attendees: Mark Visser (Unity), Benoit Hudson & Felix Bourbonnais (ImgSpc), Victor Milovanov, Mohamed Koubaa (ANSYS Inc), Amos Li Agenda 1. (Mark) Suggest we use a "needs discussion" label on issues and PRs for next time. Then we can just go through them on the call. 2. (Mark) Can we get a status update on joining the .NET Foundation? Github issue: Joining the .NET Foundation <https://github.com/pythonnet/pythonnet/issues/956> 3. (Benoit) Python can't reliably re-initialize; new proposal for Unity's domain reload <https://github.com/pythonnet/pythonnet/issues/957> 4. (Benoit) What's the policy with the GIL? Main thread appears to be grabbing the lock and not releasing it. 5. (Mohamed) Can I get clarification on IWrapper vs. reflection for PR #808? Notes Welcome to new contributor Mohamed Koubaa (ANSYS), who is investigating moving his company's platform from IronPython to CPython. 1 & 2) need input from Benedikt, Mark will follow up with Benedikt. 4) Benoit: GIL - Should we expect the GIL to be held after initialization? Victor: I wouldn't expect it to be held. [PyGIL] attribute is informational. 3) Benoit: Python can't reliably re-initialize. last fall's work - force PyFinalize to be called unfortunately doesn't work for native extensions - can't reliably reinitialize proposal instead of calling PyFinalize, delete all links from Python to C# Felix prototyped a solution that tracks all links during proxy generation and cuts all links during domain shutdown to prevent dereference of dead pointers result is just AttributeError instead of crash Amos proposed a different solution which seems to be targeting memory leaks Victor: what about memory leaks? C# side deletes all of its memory If C# holds a reference to Python, it will still exist when C# shuts down - no problem Amos: has a branch that solves one of the problems Benoit & Felix will investigate his branch and see where it intersects with their solution the reason we're using pythonnet is to enable PySide/PyQt and numpy among others 5) Mohamed: Working on a small change to implement the wrapper function for console output via __repr__ https://github.com/pythonnet/pythonnet/pull/808 inheritance over reflection, IWrapper vs. method with a signature Pythonnet can reflect what are the pros and cons? should we go with a convention? Victor: you can take the reflection approach, but need to cache the delegates more of an implementation detail, not actually necessary (note: any errors in the above are mine, feel free to correct any gross misrepresentations I've inadvertently made!) Action Items Mark follow up with Benedikt about Python foundation and using issues to track discussion items Benoit & Felix investigate why GIL is held indefinitely test out Amos's branch and connect over gitter to discuss what parts of the problem each approach is solving Thank you all for attending! The next call will be held at 3pm EST on Tuesday, October 8th, 2019, see you then. Please e-mail me if you're not on the attendee list and I will add you. Mark Visser Tooling Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 1

Working group minutes for October 8, 2019
by Mark Visser 08 Oct '19

08 Oct '19

Attendees: Benoit Hudson (ImgSpc), Mohamed Kouba (ANSYS Inc.), Victor Milovanov, Amos Li, Mark Visser (Unity) Agenda (Mark) Suggest we use a "needs discussion" label on issues and PRs for next time. Then we can just go through them on the call. Who can tag issues? (Mark) Can we get a status update on joining the .NET Foundation? Github issue: Joining the .NET Foundation <https://github.com/pythonnet/pythonnet/issues/956> - Any response? (Mark) PR review (Mark) Issues review Notes Mark - no news on .NET foundation progress, Mark is investigating internally through Unity if there's some way to get the process moving. Benoit - Amos & Felix still need to connect and chat re: PR#957 Benoit - re: grabbing the GIL in issue#964 - this is by design and should stay that way. Need to document implications of multithreaded environment when Python is embedded in a C# application. GIL needs to be explicitly released and regrabbed via BeginAllowThreads/EndAllowThreads otherwise the process will crash. No change is proposed to this behaviour. Victor - will move PRs that aren't ready for merge to draft state so we have a clearer idea of what's actually in process. Mohamed - in IronPython you can have more than one instance running, i.e. more than one scope. Victor - Python 3.7 or 3.8 has/will/may have sub-interpreters working.. Mark/Benoit - RpyC + subprocesses can achieve the same effect but has marshalling/IPC overhead Mohamed - what's the process for supporting a feature like sub-interpreters in pythonnet Victor - basically propose it at a meeting, get alignment on design, write the code Amos - is there any plan for improving performance? Victor - need performance tests before we check in any PRs around performance, no time at the moment. Hopefully in time for the next meeting or shortly after. Action Items Mark - see if there's a path to the .NET foundation internally and get our application unblocked. Benoit - coordinate discussion between Amos & Felix on #957 Benoit - document how to use pythonnet when you expect to run multithreaded python code (BeginAllowThreads/EndAllowThreads) in an embedded interpreter Victor - move PRs that aren't ready for merging to draft status Mohamed - update #808 according to feedback, time permitting Google doc here: https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE… <https://docs.google.com/document/d/1rJVU84B_dgx58-_EopjRtOJVFAI2WfHJYV0n7uE…> (please reply or comment in the google doc if I have made any mistakes) Unless otherwise noted, the next working group meeting will be held on Tuesday, October 22 at 3pm EST. Zoom call link: https://unity3d.zoom.us/j/346931511 <https://unity3d.zoom.us/j/346931511> I have all-day meetings that week so I can't attend. Can someone else fill in as moderator for the call? Mark Visser Tooling Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Working group meeting today
by Mark Visser 08 Oct '19

08 Oct '19

Hi everyone, just a reminder that the working group meeting is today, Tuesday October 8th at 3pm EST. Here's the zoom link: https://unity3d.zoom.us/j/346931511 <https://unity3d.zoom.us/j/346931511> cheers, -Mark Mark Visser Tooling Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0

Call for discussion items for next week's working group meeting (September 24th)
by Mark Visser 24 Sep '19

24 Sep '19

Hi all, The next Python for .NET working group call will be held on Tuesday, September 24th, at 3pm EST / 12pm PST. Please reply to this e-mail with any discussion items you would like to add to the agenda, or if you would like to be added to the call. Mine: 1. I suggest we use a "needs discussion" label on issues and PRs for next time. Then we can just go through them on the call. 2. Benedikt (filmor(a)gmail.com <mailto:filmor@gmail.com>) can we get a status update on joining the .NET Foundation? Github issue: Joining the .NET Foundation <https://github.com/pythonnet/pythonnet/issues/956> cheers, -Mark Mark Visser Tooling Dev Manager Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

3 4

Working group meeting Tuesday September 10th
by Mark Visser 12 Sep '19

12 Sep '19

Hi everyone, Here are the minutes from Tuesday's meeting. Present: Victor Milovanov, Amos Li, Mark Visser Mark mentioned that his team has found a solution to C# domain reload that doesn't crash the Unity Editor. Benoit Hudson will join the next meeting to discuss with the group. Victor has been working on the ability to inherit C# classes from Python classes and override Python methods in C# using attributes. The next meeting will held on Tuesday, September 24th at 3pm EST. If you have not received an invite, please e-mail me directly and I'll add you to the event. Also please note that I went ahead and switched to Zoom for hosting meetings as Google Hangouts is blocked in the PRC. I'll ask the list for agenda items the week before the meeting. Hope to see you all online next time. cheers, -Mark Mark Visser DCC Team Lead Unity Technologies - www.unity3d.com <http://www.unity3d.com/>

1 0