Hey Kirill, Thanks for sharing! I wasn't aware of this project. According to the blog post https://medium.com/yandex/ytsaurus-exabyte-scale-storage-and-processing-system-is-now-open-source-42e7f5fa5fc6 It was released in public earlier this year by Yandex.
It was inspired by Google's MapReduce, so it has the same root as Hadoop but I don't think they use the same code. Looks like a very mature project with more than 60 thousand commits in the repo. Maybe I'll put it this way, an entire Hadoop ecosystem in a parallel universe. (Hats off to YTsaurus developers). It's got its own scheduler similar to YARN, dynamic table support like HBase, query engine similar to Hive, consensus protocol similar to Raft (we have Apache Zookeeper and Ratis) On Thu, Sep 28, 2023 at 1:46 AM Kirill <[email protected]> wrote: > Hi everyone! > > Have you seen this platform https://ytsaurus.tech/platform-overview ? > What do you think? Has somebody tried it? > Is it based on Hadoop source code? It is claimed that there is also a > MapReduce in it. > Is it possible to run Hadoop programs and Hive queries on ytsaurus? > > > > Regards, > Kirill >
