Ido Michael
Ido Michael co-founded Ploomber to help data scientists build faster. He'd been working at AWS leading data engineering/science teams. Single-handedly he built 100’s of data pipelines during those customer engagements together with his team. He came to NY for his MS at Columbia University. He focused on building Ploomber after he constantly found that projects dedicated about 30% of their time just to refactoring the dev work (prototype) into a production pipeline.
Sessions
Most data practitioners use Jupyter notebooks for data modeling; however, iterating, testing, and collaborating on top if it can be quite complex. This talk will show how a few open-source tools, will allow you to run notebooks the right way, including concepts like debugging on production, profiling the memory consumption, and easily parallelizing them.
Data practitioners with experience analyzing data with Python and Jupyter are welcome to attend. Basic experience with at least one of the supported orchestration backends is helpful but not necessary.