siddharthteotia opened a new issue, #14817: URL: https://github.com/apache/pinot/issues/14817
Our work on a Multi SKU recommender / cost-to-serve optimizer recently got accepted in USENIX and we will be presenting the work in March '25. We have built the entire machinery in-house and have a ton of results / data to share. The reason we built in-house first is because this ran longer than usual with an elaborate POC first to demonstrate value followed by actually doing it in production. Also, we first wanted to nail the integrations within LinkedIn on a fast path to solve our problem. I feel the core algorithm that takes in production metrics, SKU profiles, processes high cardinality profiling data and recommends an optimal SKU can potentially be open-sourced. Starting this thread to see if there is sufficient interest in exploring such a tool by Pinot users for their respective prod environments on-prem or in cloud. If so, we can think about putting it in open source. Not sure of LOE / timelines etc. Right now just trying to gauge interest We had originally built this for Azure but then repurposed it to on-prem successfully without changing the core pieces of algorithm. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
