[IronPython] Embedding & Charsets

[Michael Foord]

Igor Elyas wrote:
> Interesting info:
> 1. Calling unicode('russian symbols') throws "'ascii' codec can't 
> decode byte 0 in position 0: ordinal not in range"
In IronPython calling unicode is the same as calling str. Calling 
unicode on a bytestring with non-ascii characters in it would also blow 
up in CPython.

Michael

> 2.
> IronPython 2.0 (2.0.0.0) on .NET 2.0.50727.3082
> Type "help", "copyright", "credits" or "license" for more information.
>>>> str(u''russian symbols'.encode('cp1251'))
> Traceback (most recent call last):
>  File "<stdin>", line 1, in <module>
>  File "mscorlib", line unknown, in GetString
>  File "mscorlib", line unknown, in GetChars
>  File "mscorlib", line unknown, in Fallback
>  File "mscorlib", line unknown, in Throw
> UnicodeDecodeError: ('unknown', u'\xef', 0, 1, '')
>
> Python 2.5.4 (r254:67916, Dec 23 2008, 15:10:54) [MSC v.1310 32 bit 
> (Intel)] on win32
> Type "help", "copyright", "credits" or "license" for more information.
>>>> str(u''russian symbols'.encode('cp1251'))
> '\xef\xf0\xe8\xe2\xe5\xf2'
>
> --------------------------------------------------
> From: "Michael Foord" <fuzzyman at voidspace.org.uk>
> Sent: Wednesday, March 25, 2009 10:03 PM
> To: "Discussion of IronPython" <users at lists.ironpython.com>
> Subject: Re: [IronPython] Embedding & Charsets
>
>> Igor Elyas wrote:
>>> Ops
>>>  Deep in code on returned value  used Python str() function and 
>>> looks like:
>>>  str(self._reader.GetString(self._idx))
>>>
>>
>> You can't call str on a string if it contains non-ascii characters. :-)
>>
>> (and why would you need to...)
>>
>> Michael
>>
>>> That correct situation ?
>>>
>>> *From:* Igor Elyas <mailto:igor_elyas at hotmail.com>
>>> *Sent:* Wednesday, March 25, 2009 9:17 PM
>>> *To:* Users at lists.ironpython.com <mailto:Users at lists.ironpython.com>
>>> *Subject:* [IronPython] Embedding & Charsets
>>>
>>> Hello
>>>  I'm use IronPython 2.0.1 as embedded interpreter for read data from 
>>> database.
>>> Code for create Engine:
>>>  fEngine = Python.CreateEngine();
>>>             Ops = fEngine.CreateOperations();
>>>             // core libs
>>>             fEngine.Runtime.LoadAssembly(typeof(Decimal).Assembly);
>>>             fEngine.Runtime.LoadAssembly(typeof(IValue).Assembly); 
>>> // loading ADO.NET driver assemblies
>>>             LoadAssemblies(from v in 
>>> EtlBaseCfg.BaseCfg.Element("dlls").Elements("dll") select v.Value);
>>>  After that, I use generated Ipy class for read one value from 
>>> specific IDbDataReader:
>>>  from ETL.Common.pipes import IValuePipe
>>> class SelectExtractor(IValuePipe):
>>>     def __init__(self,adoreader,originId,storage):
>>>         self._name = originId
>>>         self._reader = adoreader
>>>         self._idx = adoreader.GetOrdinal(self._name)
>>>         self._transport = storage
>>>     def Do(self, pydict):
>>>         val = self._transport.Clone()
>>>         if not self._reader.IsDBNull(self._idx):
>>>             val.Data = self._reader.GetString(self._idx)
>>>         if pydict.ContainsKey(self._name):
>>>             pydict[self._name] = val
>>>         else:
>>>             pydict.Add(self._name,val)
>>>  This operation return string with Russian symbols and I get 
>>> Exception: "'ascii' codec can't decode byte 0 in position 0: ordinal 
>>> not in range"
>>> How I can enable unicode .NET strings ?
>>> Looks like I not initialize IronPython correctly, because this code 
>>> in Ipy console work fine with Russian charset (Russian Windows), but 
>>> not sure about other charsets. I need use .NET unicode strings.
>>>
>>> Best regards
>>>
>>> Igor Elyas
>>>
>>> ------------------------------------------------------------------------ 
>>>
>>> _______________________________________________
>>> Users mailing list
>>> Users at lists.ironpython.com
>>> http://lists.ironpython.com/listinfo.cgi/users-ironpython.com
>>> ------------------------------------------------------------------------ 
>>>
>>>
>>> _______________________________________________
>>> Users mailing list
>>> Users at lists.ironpython.com
>>> http://lists.ironpython.com/listinfo.cgi/users-ironpython.com
>>>
>>
>>
>> -- 
>> http://www.ironpythoninaction.com/
>>
>> _______________________________________________
>> Users mailing list
>> Users at lists.ironpython.com
>> http://lists.ironpython.com/listinfo.cgi/users-ironpython.com
>>
> _______________________________________________
> Users mailing list
> Users at lists.ironpython.com
> http://lists.ironpython.com/listinfo.cgi/users-ironpython.com


-- 
http://www.ironpythoninaction.com/