https://mlc.ai/mlc-llm/ has a TestFlight beta for running an LLM locally on a modern iPhone. Remarkable that it works.
While GPT4 is leaps and bounds ahead in terms of quality, those locally run model could catch up. LLMs likely follow an S-curve in terms of their quality. Makes me wonder if GPT4 is near the top or still near the start or middle.