Your observations on the "arhetorical" nature of the tool-and I would say LLM writing assistance in general-is the key for me because that rhetorical situation (message, audience, purpose) along with the underlying audience analysis (audience needs, attitudes, knowledge) is the underpinning of the thinking I do as I write something and the GG generation is absent any of those concerns, of course, because LLMs have no capacity for that kind of reasoning. It's always going to be a simulation. The simulation may be more or less convincing, but if I can discern between the good and bad stuff from the LLM, as you say, I probably already have a robust process where it isn't helpful. If I don't have that capacity, I'm just letting the tool throw stuff at the wall and hoping it sticks.
Your observations on the "arhetorical" nature of the tool-and I would say LLM writing assistance in general-is the key for me because that rhetorical situation (message, audience, purpose) along with the underlying audience analysis (audience needs, attitudes, knowledge) is the underpinning of the thinking I do as I write something and the GG generation is absent any of those concerns, of course, because LLMs have no capacity for that kind of reasoning. It's always going to be a simulation. The simulation may be more or less convincing, but if I can discern between the good and bad stuff from the LLM, as you say, I probably already have a robust process where it isn't helpful. If I don't have that capacity, I'm just letting the tool throw stuff at the wall and hoping it sticks.