IronPython

Commented Feature: Allow resources when compiling with pyc.py [32289]

slide_o_mix — Wed, 22 Feb 2012 14:10:06 GMT

pyc.py should be able to embed resources into its generated files, ideally using the same format and syntax as csc.
Comments: ** Comment from web user: slide_o_mix **

How would a normal script not compiled through pyc.py load resources? If the script has to change to load resources when in compiled form, it makes it less desirable to have this feature.

Commented Feature: Add option to pyc.py to embed IronPython assemblies [32288]

slide_o_mix — Wed, 22 Feb 2012 12:23:27 GMT

pyc.py should have an option to embed the IronPython assemblies inside a generated .exe as resources and then use the AppDomain.AssemblyResolve event to load them when they are needed.
Comments: ** Comment from web user: slide_o_mix **

Here's a version to play with, in your local sys.cs just add another catch for ArgumentException and set previx to String.Empty there too.

Commented Feature: Add option to pyc.py to embed IronPython assemblies [32288]

slide_o_mix — Wed, 22 Feb 2012 12:22:08 GMT

I implemented this, though it does require a change to the sys module as well (the GetPrefix method throws an exception because the .Location of the Assembly is empty when loading from a resource stream). I'll continue to test with some heftier examples to make sure nothing else is broken when doing this.

Commented Feature: Allow resources when compiling with pyc.py [32289]

slide_o_mix — Tue, 21 Feb 2012 02:37:48 GMT

pyc.py should be able to embed resources into its generated files, ideally using the same format and syntax as csc.
Comments: ** Comment from web user: slide_o_mix **

Are you looking for both managed resources and unmanaged resources? There are two different options to csc /win32res (unmanaged) and /res (managed).

Commented Feature: Allow resources when compiling with pyc.py [32289]

slide_o_mix — Mon, 20 Feb 2012 22:58:31 GMT

pyc.py should be able to embed resources into its generated files, ideally using the same format and syntax as csc.
Comments: ** Comment from web user: slide_o_mix **

This is pretty easy to do with the System.Resources namespace. The ModuleBuilder has a DefineResource method that returns an IResourceWriter that can be used to add resources.

Commented Feature: Add option to pyc.py to embed IronPython assemblies [32288]

slide_o_mix — Mon, 20 Feb 2012 17:01:42 GMT

I would recommend doing this using assemblyresolve and resources. I'll take a look.

Created Feature: Allow resources when compiling with pyc.py [32289]

jdhardy — Mon, 20 Feb 2012 16:47:04 GMT

pyc.py should be able to embed resources into its generated files, ideally using the same format and syntax as csc.

Created Feature: Add option to pyc.py to embed IronPython assemblies [32288]

jdhardy — Mon, 20 Feb 2012 16:45:29 GMT

pyc.py should have an option to embed the IronPython assemblies inside a generated .exe as resources and then use the AppDomain.AssemblyResolve event to load them when they are needed.

Closed Issue: Module loaded by clr.Use() is not added into sys.modules [23836]

slide_o_mix — Mon, 20 Feb 2012 15:55:30 GMT

<Test></Test>
<Creator>Qing Ye</Creator>
<CreatedDate>11/16/2007</CreatedDate>
<NewInternalID>409649</NewInternalID>
<OldInternalID>322099</OldInternalID>
<AreaPath>IronPython\Runtime</AreaPath>

<Description>
Not sure if this is by-design. But I had impression that clr.GetInstance().Use() should behave same as import.

Repro:
1. Copy both attached test.py and test1.py
2. Run test.py:
ipy test.py

Expected:
output by import statement and clr.GetInstance().Use() should match

Actual:
test1 is not in sys.modules when it is loaded via clr.GetInstance().Use("test1.py", "python")
</Description>

<Repro>

</Repro>

<History>
It gets published to sys.modules but not under the correct name.
</History>
Comments:

No files attached, no way to reproduce.

Commented Issue: version() shows only version number when running pyc-compiled .exe [30267]

slide_o_mix — Mon, 20 Feb 2012 15:13:49 GMT

the function sys.version() shows only a version number when running in an .exe-file built with pyc.py.

simple script pyVersion.py
import sys
def main():
print "version=", sys.version
return 0
if __name__ == "__main__":
sys.exit(main())

outputs:
d:\d\d0\lib\python\pdf\r01\ipy>ipy pyVersion.py
version= 2.7.0 (IronPython 2.7 RC 1 (2.7.0.30) on .NET 4.0.30319.1)

d:\d\d0\lib\python\pdf\r01\ipy>pyVersion.exe
version= 2.7.0 ()
Comments: ** Comment from web user: slide_o_mix **

Issue still exists in 2.7.2beta

Closed Issue: Desktop IronPython debugging failure - Error: Reading old stack frames, should match 3 [24046]

slide_o_mix — Mon, 20 Feb 2012 04:46:15 GMT

<Test>test_ip_debugging</Test>
<Creator>Dave Fugate</Creator>
<CreatedDate>5/1/2008</CreatedDate>
<NewInternalID>428090</NewInternalID>
<OldInternalID></OldInternalID>
<AreaPath>IronPython</AreaPath>

<Description>

</Description>

<Repro>
test_ip_debugging.GenericTest. Please ask Sri for details.
</Repro>

<History>
OS: x86 2K3
Flags: -X:Interpret
Binary type: debug

C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>SETLOCAL ENABLEEXTENSIONS
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>SET BVT_ROOT=C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>IF "C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\bin\Debug" == "" (SET CORE_ROOT=C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\bin\Release ) ELSE (SET CORE_ROOT=C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\bin\Debug )
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>SET CORE_RUN=C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\bin\Debug\ipy.exe
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>IF "x86" == "x86" (IF "" == "" (SET MDBG=C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Mdbg\i386\mdbg.exe ) ELSE IF "" == "AMD64" (SET MDBG=C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Mdbg\amd64\mdbg.exe ) ) ELSE IF "x86" == "AMD64" (SET MDBG=C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Mdbg\amd64\mdbg.exe )
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>IF "C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Mdbg\i386\mdbg.exe" == "" (ECHO "Unknown processor architecture" EXIT /b 1 )
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>SET PERLEXE=C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\perl\perl.exe
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>SET PERL5LIB=C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\perl\lib;C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\perl\site\lib
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\perl\perl.exe C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\dbgh.pl -debugger C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Mdbg\i386\mdbg.exe -script C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgNested.scr -baseline C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgNested.bsl -filter "" SUCCESS!
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>IF NOT "100" == "100" GOTO FAIL
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\perl\perl.exe C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\dbgh.pl -debugger C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Mdbg\i386\mdbg.exe -script C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgRecursive.scr -baseline C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgRecursive.bsl -filter "" SUCCESS!
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>IF NOT "100" == "100" GOTO FAIL
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\perl\perl.exe C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\dbgh.pl -debugger C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Mdbg\i386\mdbg.exe -script C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgClassMethod.scr -baseline C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgClassMethod.bsl -filter "" SUCCESS!
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>IF NOT "100" == "100" GOTO FAIL
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\perl\perl.exe C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\dbgh.pl -debugger C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Mdbg\i386\mdbg.exe -script C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgTryCatch.scr -baseline C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgTryCatch.bsl -filter "" SUCCESS!
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>IF NOT "100" == "100" GOTO FAIL
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\perl\perl.exe C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\dbgh.pl -debugger C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Mdbg\i386\mdbg.exe -script C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgImport.scr -baseline C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgImport.bsl -filter "" SUCCESS!
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>IF NOT "100" == "100" GOTO FAIL
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>REM C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\perl\perl.exe C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\dbgh.pl -debugger C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Mdbg\i386\mdbg.exe -script C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgInterop.scr -baseline C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgInterop.bsl -filter ""
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>IF NOT "100" == "100" GOTO FAIL
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\perl\perl.exe C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\dbgh.pl -debugger C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Mdbg\i386\mdbg.exe -script C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgStepThrough.scr -baseline C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgStepThrough.bsl -filter "" SUCCESS!
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>IF NOT "100" == "100" GOTO FAIL
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\perl\perl.exe C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\dbgh.pl -debugger C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Mdbg\i386\mdbg.exe -script C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgInheritance.scr -baseline C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop\Tests\MdbgInheritance.bsl -filter "" Error at line 20: was Error: Reading old stack frames, should match 3: self\.width = width.FAILED: there were 1 errors.
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>IF NOT "101" == "100" GOTO FAIL
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>ENDLOCAL
C:\MERLLA~1\MerlinSnap\Test\Merlin\Main\Test\Debugging\Desktop>EXIT /b 1The test failed with exit code 1.
</History>
Comments:

SNAP failure.

Commented Issue: Some path ops are not done through PlatformAdaptationLayer in IronPython.Runtime.Importer [31603]

slide_o_mix — Mon, 20 Feb 2012 04:44:17 GMT

Path name operations in IronPython.Runtime.Importer are supposed to be performed through the PlatformAdaptationLayer, enabling platform adaptations of path name structure. Some operations are still directly done to System.IO.Path, though, which breaks the adaptation layer. The commit https://github.com/rickardraysearch/main/commit/7cc9ed676c1ee6f6f0e770d9c8842d24b4e1c7d6 fixes (at least some of some of) the remaining items.
Comments: ** Comment from web user: slide_o_mix **

This looks to be fixed.

Commented Issue: compile('#foo\n', '', 'single') throws null ref exception [30940]

slide_o_mix — Mon, 20 Feb 2012 04:35:41 GMT

compile('#foo\n', '<stdin>', 'single')

IronPython:

>>> compile('#foo\n', '<stdin>', 'single')
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
SystemError: Object reference not set to an instance of an object.

CPython:

>>> compile('#foo\n', '<stdin>', 'single')
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "<stdin>", line 1
#foo
^
SyntaxError: unexpected EOF while parsing
Comments: ** Comment from web user: slide_o_mix **

NRE comes from here:

internal static FunctionCode FromSourceUnit(SourceUnit sourceUnit, PythonCompilerOptions options, bool register) {
var code = PythonContext.CompilePythonCode(sourceUnit, options, ThrowingErrorSink.Default);

return ((RunnableScriptCode)code).GetFunctionCode(register);
}

code is null for this statement after parsing because its an empty statement.

Commented Issue: sys.args[0] dissapears in ipy-script compiled with pyc.py [30263]

slide_o_mix — Mon, 20 Feb 2012 03:39:09 GMT

If I compile a script with pyc.py the program name disappears from sys.argv (it is usually sys.argv[0]).

the script:
# coding: latin-1
import sys
def main():
for i1, a1 in enumerate(sys.argv):
print "%2.2d: %s" % (i1, a1)
return 0
if __name__ == "__main__":
sys.exit(main())

output with ipy.exe:

d:\d\d0\lib\python\pdf\r01\ipy>ipy args.py 1 2 3
00: args.py
01: 1
02: 2
03: 3

compilation and compiled output:

d:\d\d0\lib\python\pdf\r01\ipy>ipy "C:\Program Files (x86)\IronPython 2.7\Tools\Scripts\pyc.py" /main:args.py /out:args args.py
Input Files:
args.py
Output:
args
Target:
ConsoleApplication
Platform:
ILOnly
Machine:
I386
Compiling...
Saved to args

d:\d\d0\lib\python\pdf\r01\ipy>args.exe 1 2 3
00: 1
01: 2
02: 3

d:\d\d0\lib\python\pdf\r01\ipy>
Comments: ** Comment from web user: slide_o_mix **

I'm fairly sure that InitializeModule (this override anyway) is not called by anything but the pyc generated stub executable, but I will make sure.

Commented Issue: Need a way to have a base class in an extension which is not exposed to Python [28891]

slide_o_mix — Mon, 20 Feb 2012 03:37:54 GMT

I have a base class for all of our classes that wrap numpy core objects. I'd like a way to hide this so it is not exposed to IronPython.
I have:

public class Wrapper : IDisposable {
...
}

public class ndarray : Wrapper {
...
}

I'd like ndarray to be visible to Python but Wrapper not be visible.
Comments: ** Comment from web user: slide_o_mix **

Does the PythonHiddenBaseClass not work?

[PythonHiddenBaseClass]
public class Wrapper : IDisposable {

}

/// <summary>
/// Marks a class as being hidden from the Python hierarchy. This is applied to the base class
/// and then all derived types will not see the base class in their hierarchy and will not be
/// able to access members declaredo on the base class.
/// </summary>
[AttributeUsage(AttributeTargets.Class)]
public sealed class PythonHiddenBaseClassAttribute : Attribute {
}

Commented Issue: _winreg doesn't support key names which are 256 chars long [28743]

slide_o_mix — Mon, 20 Feb 2012 03:31:50 GMT

.NET seems to limit this to 255 characters, Python supports 256. We'd need to move entirely to P/Invokes to make this work.
Comments: ** Comment from web user: slide_o_mix **

Please provide a test case if possible.

Closed Feature: Improve debugging experience [22035]

slide_o_mix — Mon, 20 Feb 2012 03:27:42 GMT

There's lots that can be done to improve the existing experience of debugging an IronPython app from VS. Some random thoughts on objects that could use debug visualizers:
Dictionaries
Lists
Tuples
new-style/old-style classes
type objects
Comments:

IronPython Tools deprecated in favor of Python Tools for Visual Studio

Commented Feature: implement clr.GetString and clr.GetBytes as helper to convert strings to and from bytes [7159]

slide_o_mix — Mon, 20 Feb 2012 03:25:38 GMT

<Thanks>Seo Sanghyeon</Thanks>

Let's say this way. clr.GetString would be equivalent to
StringOps.FromByteArray already in IronPython. clr.GetBytes would be
its reverse.
Comments: ** Comment from web user: slide_o_mix **

StringOps.FromByteArray no longer exists?

Commented Issue: sys.args[0] dissapears in ipy-script compiled with pyc.py [30263]

peterSchwalm — Mon, 20 Feb 2012 03:19:29 GMT

I figured that out too.
Perhaps I would suggest, to remove the "RemoveFirst", but I could not figure out if this code is also run if the code is not compiled (with pyc.py). I suppose it is, because if the script is run with ipy.exe the "ipy.exe" is the first command line argument and it makes sense to remove it, so that the script name becomes the first entry in sys.argv.

A "good" version should probably something like this:

if (runningInCompiledEnvironment ...)
options["Arguments"] = ArrayUtils.Environment.GetCommandLineArgs();
else
options["Arguments"] = ArrayUtils.RemoveFirst(Environment.GetCommandLineArgs()); // remove the EXE

But I do not have an idea how "runningInCompiledEnvironment" could be implemented in this startup environment.

Commented Issue: IRONPYTHONPATH not respected for pyc.py compiled assemblies [26706]

slide_o_mix — Sun, 19 Feb 2012 22:49:46 GMT

We need to initialize the runtime the same way as the command line does and respect all of the env vars.
Comments: ** Comment from web user: slide_o_mix **

What other environment variables would be useful?