Using 'in' with a Dict

[cpmcdaniel]

I was wondering if the following two "if" statements compile down to
the same bytecode for a standard Dictionary type:

m = {"foo": 1, "blah": 2}

if "foo" in m:
print "sweet"

if m.has_key("foo"):
print "dude"

[kowboy]

I posted too quickly. A little performance testing told me that has_key
is somewhat slower than "in". I used a large number of string keys in
my test.

[Kartic]

This is what I did ....

import compiler
exec1 = compiler.compile('''if "foo" in m: print "sweet"''', '', 'exec') exec2 = compiler.compile('''if m.has_key("foo"): print "dude"''', '', 'exec') exec1.co_code 'd\x01\x00e\x00\x00j\x06\x00o\t\x00\x01d\x02\x00GH n\x01\x00\x01d\x00\x00S' exec2.co_code 'e\x00\x00i\x01\x00d\x01\x00\x83\x01\x00o\t\x00\x0 1d\x02\x00GHn\x01\x00\x01d\x00\x00S' exec2 = compiler.compile('''if m.has_key("foo"): print "sweet"''', '', 'exec') exec2.co_code 'e\x00\x00i\x01\x00d\x01\x00\x83\x01\x00o\t\x00\x0 1d\x02\x00GHn\x01\x00\x01d\x00\x00S' exec(exec2) sweet exec(exec1) sweet exec1.co_varnames ('m',) exec2.co_varnames ('m', 'has_key')

The code generated with the has_key() version is slightly large (3
bytes) than the one with the membership test. The co_varnames for the
two code objects vary, as the second one has the has_key method also,
which the other version does not.

Thanks,
-Kartic

[Steven Bethard]

cp********@gmail.com wrote:

I was wondering if the following two "if" statements compile down to
the same bytecode for a standard Dictionary type:

m = {"foo": 1, "blah": 2}

if "foo" in m:
print "sweet"

if m.has_key("foo"):
print "dude"

To answer the question you actually asked, you can use dis.dis:

py> def f1(s, m):
.... if s in m:
.... pass
....
py> def f2(s, m):
.... if m.has_key(s):
.... pass
....
py> import dis
py> dis.dis(f1)
2 0 LOAD_FAST 0 (s)
3 LOAD_FAST 1 (m)
6 COMPARE_OP 6 (in)
9 JUMP_IF_FALSE 4 (to 16)
12 POP_TOP

3 13 JUMP_FORWARD 1 (to 17)

16 POP_TOP
17 LOAD_CONST 0 (None) 20 RETURN_VALUE
py> dis.dis(f2)
2 0 LOAD_FAST 1 (m)
3 LOAD_ATTR 1 (has_key)
6 LOAD_FAST 0 (s)
9 CALL_FUNCTION 1
12 JUMP_IF_FALSE 4 (to 19)
15 POP_TOP

3 16 JUMP_FORWARD 1 (to 20) 19 POP_TOP
20 LOAD_CONST 0 (None)

23 RETURN_VALUE

Note that in the *bytecode*, f1 uses COMPARE_OP, while f2 uses LOAD_ATTR
and CALL_FUNCTION. So no, the bytecode is different.

If the question you meant to as was "Do Python's builtin dicts use the
same code for 'in' and 'has_key'?", you can check dictobject.c:

static PyMethodDef mapp_methods[] = {
{"__contains__",(PyCFunction)dict_has_key, METH_O | METH_COEXIST,
contains__doc__},
...
{"has_key", (PyCFunction)dict_has_key, METH_O,
has_key__doc__},
...
};

Note that both __contains__ and has_key are mapped to dict_has_key. So
yes, the same C code will be executed in both cases[1].

STeVe

[1] modulo the different lookup paths to find these methods

[Steven Bethard]

kowboy wrote:

I posted too quickly. A little performance testing told me that has_key
is somewhat slower than "in". I used a large number of string keys in
my test.

See my other post, but the reason has_key is slower is almost certainly
that it has to do a LOAD_ATTR:

$ python -m timeit -s "m = dict.fromkeys(xrange(100, 200))" "[i in m for
i in xrange(300)]"
10000 loops, best of 3: 102 usec per loop

$ python -m timeit -s "m = dict.fromkeys(xrange(100, 200));
has_key=m.has_key" "[has_key(i) for i in xrange(300)]"
10000 loops, best of 3: 107 usec per loop

For this data at least, the difference is negligible. (I actually found
has_key to be faster in some other datasets.)

STeVe

[Fredrik Lundh]

<cp********@gmail.com> wrote:

I was wondering if the following two "if" statements compile down to
the same bytecode for a standard Dictionary type:

m = {"foo": 1, "blah": 2}

if "foo" in m:
print "sweet"

if m.has_key("foo"):
print "dude"

nope.

import dis
dis.dis(compile("'foo' in dict", "", "exec")) 1 0 LOAD_CONST 0 ('foo')
3 LOAD_NAME 0 (dict)
6 COMPARE_OP 6 (in)
9 POP_TOP
10 LOAD_CONST 1 (None)
13 RETURN_VALUE dis.dis(compile("dict.has_key('foo')", "", "exec"))

1 0 LOAD_NAME 0 (dict)
3 LOAD_ATTR 1 (has_key)
6 LOAD_CONST 0 ('foo')
9 CALL_FUNCTION 1
12 POP_TOP
13 LOAD_CONST 1 (None)
16 RETURN_VALUE

"in" is a built-in operator, "has_key" is an ordinary method. both
paths end up in the same C function, but the method path is usually
a little bit slower.

</F>