Sanjay Siddhanti
Sanjay Siddhanti joined AKASA as an early engineer in 2019 and currently serves as director of engineering. He has a passion for working on software to help people have a better experience with healthcare. His teams focus on AKASA’s AI-driven automation platform and data engineering problems. He has a B.S. in computer science and M.S. in biomedical informatics from Stanford University.
Sessions
Workflow engines are widely used, but most people don’t know how they work under the hood. This talk will review how a team of engineers implemented a workflow engine from scratch in Python.
The talk will cover the motivation for building a new workflow engine and why existing solutions did not fit the use case. Next, it will talk about the architecture and implementation of the engine, including queuing, managing workers, asynchronous execution, task polling, deployment, and monitoring.
It will show code examples that use popular Python libraries such as Pydantic and FastAPI in the implementation of the engine.