Discovering the Power of Large Language Models as a Solution