That's why you need to learn Vim without plugins. Vim can "open files really quickly":

    :e *ba<Tab>
    :vs ../**/fo<Tab>

I love CtrlP but you can go a long way without any plugins. It just takes some time and effort.