paex
PaEx(Parallel Executor), / ˈpās / - a cloud native distributed process executor template.
RepositoryA process distributor, scheduler and executor template that builds on the concepts of distributed computing, with inspiration from the raft algorithm in forming consensus among nodes in a cluster.
We are interested in creating a cheap and efficient system that allows for running compute intensive tasks at scale on the cloud, providing affordable and cloud portable alternative to a single point of failure, expensive infrastructure model prevalent in highly specialised hardware investment models.
The modular nature of the executor allows for varying types of divisible tasks to be run on clusters parallelly with specialised code to handle process division, execution and result retrieval, all of them attachable as modules within paex.
We are a group of student developers trying to solve problems of the future :)
We call ourselves Project Vyuha and intend to build on this project with some really interesting and scalable use-cases!
So considering the inability to complete the project in time for submission, we have decided to move to a more relaxed time-frame for development and thanks to having started with FOSSHack we have also committed to building paex entirely in FOSS.
Thank you for providing us this awesome platform to showcase our ideas, and the various inspiring projects that are being built. We would like to humbly request people to take a look at our project and provide us guidance and help in moving ahead. We are a real rag-tag team, but this opportunity has helped us collaborate better.
Hope to participate again in 2021! 🚀
Congratulations to the community and the organisers on this real gem of an event, thank you for the starter fuel @mentors and most importantly, I would like to commend my fellow hackers on the real great work they have put in over the last 36 hours!
Keep safe. Keep Hacking!
Created issues to discuss and build: - consensus engine: https://github.com/de-sh/paex/issue/1 - cluster definition: https://github.com/de-sh/paex/issue/2 - example use-case: https://github.com/de-sh/paex/issue/3
Project created by Devdutt Shenoi