Extending the dict class

2006-08-29 Thread chosechu
Hello Pythoneers:

I need to pass a list of named arguments to a function in a given
order,
and make sure these named arguments are retrieved using keys() in the
same order they were given. Example:

keyargs={}
keyargs['one']=1
keyargs['two']=2
keyargs['three']=3

myfunc(**keyargs)
-> myfunc would retrieve key arguments with keys() in the same order
as they were set, i.e. keyargs.keys() == ['one', 'two', 'three']

To achieve that, I subclassed dict and added the required lines
in __init__(), __setitem__() and keys(). I then assigned dict to
my new class but only get the desired behaviour for dictionaries
created like:
d=dict()
but not for dictionaries created like:
d={}
or
myfunc(**keyargs)

Is it possible to force dictionary creation in these case to use
my own dict class instead of the default one?

I guess we can formulate this as a more generic question: if I
want to modify the behaviour of the dictionary class, is there
any way to do it interpreter-wide so that special dict constructors
like those mentioned above use the modified version?

Thanks for helping

-- 
http://mail.python.org/mailman/listinfo/python-list


Re: Extending the dict class

2006-08-29 Thread chosechu

Duncan Booth wrote:
> > Is it possible to force dictionary creation in these case to use
> > my own dict class instead of the default one?
>
> No

Ouch. I was expecting something like that, thanks for confirming it.

If I may: this seems inconsistent to me. I have created an augmented
version of the class with no possibility to extend 2 of the 3 legal
constructors: {} and func(**d). While I agree changing base class
behaviour is a bad idea, since we have the possibility to re-assign
dict to another class we should be able to do it consistently, i.e.
re-assing the two special constructors too.

Just my 2c on the topic... I have found workarounds anyway.

-- 
http://mail.python.org/mailman/listinfo/python-list


Re: Extending the dict class

2006-08-29 Thread chosechu

> I'm not sure to understand why you want to do so - perhaps you could
> tell more about your real use case ?

Without diving into too many details: I am calling SOAPpy to build
SOAP requests. When calling a proxy, named arguments are used
to build up the corresponding XML like:

proxy.call(alpha=1, beta=2, gamma=3)
would end up like:
1 2 3

Unfortunately, since the arguments as retrieved with **k
their order is lost in the call. The corresponding XML file
re-arranges the parameter order randomly and the final
XML request is unordered, which is not supported by a
number of braindead SOAP servers (including one produced
by a well-known software company I will not name here).

SOAPpy cannot know in advance the argument names since
they are server-dependent and SOAPpy is generic, so retrieving
named arguments with **k seems like the sensible thing to do.
Unfortunately this gets converted to a dict so looses all ordering
when being received. Extending the base dict class to support ordering
was one possible idea.

> Anyway, and since it's not directly possible, a possible workaround
> could be to pass a sequence of (key, value) tuples instead (possibly as
> *args). This of course requires that you can modify the implementation
> of myfunc().

Yes, if I could simply modify myfunc() I would have workarounds.
This would mean me modifying SOAPpy and specializing it for
my needs.

There are other ways to implement SOAP clients anyway so
no real need. Just wanted to try out some metaclass stuff.

-- 
http://mail.python.org/mailman/listinfo/python-list


Re: Extending the dict class

2006-08-29 Thread chosechu

Duncan Booth wrote:
> If the order of the argument names matters, then it seems to me that should
> be handled by the SOAP library, not pushed onto the end user whoch should
> just be calling the function with the named arguments in the most
> convenient order.
>
> Shouldn't SOAPpy be able to get this information out of the WSDL?

Yes, SOAPpy could extract this from the WSDL specs.
SOAPpy could also find another way to pass call parameters, but I kinda
like
the named parameters (seems really Python-like). Microsoft could also
build SOAP services that parse XML without making ordering mandatory
where
nobody said it was.

... but we are living in a different dimension, one where I can extend
the Python dict class but not touch 2 of its 3 constructors (of course
the most
useful ones).

If you really want to know, I ended up at the socket level pushing
templatized
strings. Wish me luck with future server changes.

-- 
http://mail.python.org/mailman/listinfo/python-list


Re: Extending the dict class

2006-08-29 Thread chosechu

> (the exact set of methods you need to override depends on how SOAPpy
> fetches the members).

[fakedict class]
This I did. And checking out the source it seems SOAPpy retrieves named
parameters through keys(), which is the method I tried to overload.
Trouble is:
something happens to my fakedict object when getting through this:
d = fakedict(...)
SOAPmethod(**d)
I have the impression **d acts like a dict constructor, taking over my
fakedict class. I know I could find the answer by scrutinizing the
source,
call me lazy.

-- 
http://mail.python.org/mailman/listinfo/python-list


Re: Extending the dict class

2006-08-29 Thread chosechu

Duncan Booth wrote:
> No, you weren't able to extend the builtin dict class nor touch any its
> constructor.

Yes, sorry. Forgot the negation.

> All you did was to create a subclass with its own constructor and hide the
> name for the builtin dictionary type. The original type was still unchanged
> as you can see since anything which constructed a dictionary without using
> the name you had overwritten still got the original type.
>
> If you had looked at type(dict()) and type({}) after your subclassing, you
> would see that they are different types.

... which prompted my question.

And prompts yet another one: seems like it
is not possible with Python to modify behaviour
for base classes without recompiling the
interpreter. Forgive me for asking what must
surely have been asked already, but are there
plans to implement something like that,
like Ruby?

I would not feel too safe navigating in a source
where base object behaviour might have been
re-defined, but it sure is a powerful way of
adding behaviour to third-party code which you
may not have possibility to modify.

-- 
http://mail.python.org/mailman/listinfo/python-list


Re: Extending the dict class

2006-08-29 Thread chosechu

Tim N. van der Leeuw wrote:
> Anyways, modifiying SOAPpy might not be a bad idea: submit your changes
> to the project, and you can write on your CV that you have contributed
> to open-source projects! ;-)

Been there, done that. Don't worry, my contributions
to open-source projects is largely positive (though under
different aliases).

About SOAPpy: the author mentions something about
ordering (or not) parameters in the XML request. Quoting:

  "There is an incompatibility with the way that Python and
  SOAP handle method arguments: SOAP requires that
  all arguments have names and that they are presented
  in the same order as the method signature. [...]"

See SOAPpy/docs/MethodParameterNaming.txt for more
details.

> I do hope for you that you will find something better to do than
> pushing template-instances down a socket-hole.

It is not the first time I end up implementing some kind of
support for ASCII-based protocols with templatized strings
You would be surprised how easy it is to maintain when
the emitter is required to be as stable as possible. Just
have to be aware that you have a potential maintenance
nightmare somewhere out there.

-- 
http://mail.python.org/mailman/listinfo/python-list


Re: Extending the dict class

2006-08-29 Thread chosechu

Bruno Desthuilliers wrote:
> It's usually possible to modify third-parts classes behaviour on the fly
> (googling for 'monkey-patching' should get you started). But true, this
> doesn't work with builtins.

I guess this stems from the fact that Python dictionaries
are C creatures and they are themselves used for internal
housekeeping, so no high-level modifications can be allowed
to disturb language internals. This all makes sense. It is sad
not to have the possibility to extend built-ins but on the other
hand it guarantees a constant (predictable) behaviour, which
I agree is something we should protect.

Thanks to all contributors for your nearly instantaneous
reaction times and help on the topic.

-- 
http://mail.python.org/mailman/listinfo/python-list