Skip to main content

Python is SLOW - How to speed it up - 1

Python is slow. 

For most cases this doesn't really matter as the development time is more of a factor. However on low CPU power devices (phones) anything is significant.

First tip on how to speed up python, is to use Atom!  Just install with pip.  Atom speeds up object creation by about 50% per property (ex an object with 4 properties is about 2x faster, 8 properties 4x, etc...) . I've seen significant performance increases simply by switching in my testing. See the simple example below:
from atom.api import Atom, ForwardInstance, Callable, Unicode, Tuple, Bool, Int,  Instance, set_default, Property
class TestAtom(Atom):
    i = Int(1)
    a = Unicode("abc")
    b = Tuple(default=(1,2,3))
    c = Bool()
    f = Callable(default=lambda: "test")
class TestObj(object):
    def __init__(self):
        self.i = 1
        self.a = 'abc'
        self.b = (1,2,3)
        self.c = False
        self.f = lambda: "test"
%timeit TestAtom()
The slowest run took 27.35 times longer than the fastest. This could mean that an intermediate result is being cached.
1000000 loops, best of 3: 218 ns per loop
%timeit TestObj()
The slowest run took 11.07 times longer than the fastest. This could mean that an intermediate result is being cached.
1000000 loops, best of 3: 732 ns per loop

As you can see this simple example the atom object is created almost 4x faster than the python object. The speed increase scales linearly with the number of attributes in the object.  Also the atom object uses about 1/4 the memory (which probably explains the speed increase).

from pympler.asizeof import asizeof

a = TestAtom()
b = TestObj()
Out[20]: 176
Out[21]: 760


Popular posts from this blog

Kivy vs React-Native for building cross platform mobile apps

I've built three apps now using Kivy and one with React-Native, just wanted to share my thoughts on both. Just a warning, I am strongly biased towards python and this is all based on opinion and experience and is thus worth what you pay for it. I don't claim to be an expert in either of these, just have worked with each for several months.  If something is incorrect I'd love to hear advice. Kivy Demo of one of the apps Pros: Nice to be able to run natively on the desktop WITHOUT a simulator Python is easy to work with Use (almost) any python library Very easy to create custom widgets Kivy properties and data binding just work. Way nicer than React's "state" / flux / redux whatever you want to call it (stupid?).  Native interfaces (pyjnius) and (pyobjc) Runs and feels pretty smooth Cons: Default widget toolkit looks like Android 4.4. Requiring you use your own widgets or a theming kit like KivyMD  if styling bothers you Creating dy

Control Systems in Python - Part 1 - Bode and Step Response

I hate matlab with passion, yet sadly, nearly everyone uses it.  I'm a fan of Python and open source stuff so here's a simple article on how to do some common control systems stuff in Python. First we need to make sure the environment is setup. Install IPython (or you can use any other python shell, but a unicode supported shell is preferred) Install python-control (numpy, scipy) Install sympy These should do if your on Ubuntu/debian: sudo apt - get install python - sympy python-numpy python-scipy python-matplotlib ipython Then you need to install python control, see How to download and install python-control Intro to using Sympy Open ipython and run the following: import sympy from sympy import * sympy.init_printing() s = Symbol('s') Now we can do things like define transfer functions using the symbolic variable s. We can expand the bottom using the .simplify() method and we can do something more complex like... which is really nice because it

A look at Chaquopy the Python SDK for Android

I recently heard about chaquopy - A "Python SDK for Android" and was really excited. There's already a demo app on the Play store for python 2 and python 3. As the author of enaml-native , I had to take a look to see how others are trying to tackle the python on android challenge.  So here's a short review and discussion of my initial thoughts on chaquopy. Demo I encourage you to try out the demo yourself to get a feel for it, but here's a short demo of what it does. Initial thoughts. It starts reasonably fast (about 3-4 seconds on my phone).  There's a noticeable delay when starting the python activity on my phone (much smoother on the emulator), but other than that the widgets look great and interaction is smooth! The apk is 11.54 MB and the app is only 18 MB installed (21MB if you include the cache), which is very good for bundling python! Also, the build process was a piece of cake!  I cloned the repo, opened in android studio, pressed play,