Let’s go deep on this one.drumdude wrote: ↑Sun Mar 23, 2025 9:29 pmYeah, I mean at the end of the day it’s still a fancy auto-complete machine. It’s just generating the next best guess token/word based on a finite set of inputs. If I were a college professor asking for an essay on the dynamics between this forum and DCP, I wouldn’t be very impressed. It’s a lot of words and not much substance. Kish characterizes it as regurgitation, and I think that’s mostly correct.
It’s still missing that Je ne sais quoi of real human thinking. Similar to computer graphics, there’s an uncanny valley effect where as the A.I. improves, it stands out more in a less natural manner.
As some background, I created a GPT called “Debate Coach.” The idea is that it can look at conversations I have at MormonDialogue and suggest edits to my posts.
If wind of this gets over to the mods at MormonDialogue I’ll probably rightly be banned for this, but I’ll confess it now. I trained “Debate Coach” to mimic “Analytics” in thought and writing style. It took some refinement, but it got relatively good at it. A few weeks ago, I tested it out at MDB in a “Smacalytics” conversation. I’d copy into ChatGPT what Smac97 said, and would ask ChatGPT how I should respond. It would provide a response which I’d paste back into MDB under my own name. I did this with barely reading what Smac said. My A.I.-generated content ended up destroying Smac. He finally wore down and said, "I guess we'll just need to agree to disagree.” ChatGPT came back with “Agreeing to disagree would make sense if this were a matter of opinion. It isn’t.” Mic drop. Nobody suspected that the content ChatGPT generated wasn’t me.
Anyway, I decided to use “Debate coach” to respond to Kish’s question above, "So this is the A.I. that costs $200 per month?” The idea was that I’d give it background on this conversation, and would then ask it its opinion on a draft of what I wrote. Here is what I planned on saying:
I was expecting it to say this was a great response, but to offer a few suggestions to make it stronger. The conversation went wild. I’ll talk about it in my next post, but think about this question: is this really the behavior of "a fancy auto-complete machine.”?“Analytics Draft” wrote:I can’t tell if this is just a straight forward question about what produced the prose I’m pasting, or if it's meant to sarcastically say there is little economic value here. In any case, the answer is yes, I’m paying $200 a month for this. Is it worth it? It depends upon your situation and what you’re using it for, but for me, I’d honestly pay $1,000 a month for what I’m getting out of it, so $200 a month is a steal.
I’ve gotten real-world value out of it in two ways. First as a personal and marriage counselor. Would you pay $100 an hour for a good counselor--somebody who would really listen to you and offer you really good advice that you wouldn’t have figured out on your own? If so how much would you pay to retain that same counselor who was available up to 24 hours a day, every day of the month? $200 a month is a steal for something like that.
Second, in the real world I’ve been retained as an expert witness in a fairly large class action lawsuit. I wrote a 50-page expert report and was deposed. Then the other side hired three expert witnesses to respond to me. Each of them wrote a report that averaged 75 pages long. In very little time, I needed to help the attorneys prepare for depositions for all three of these experts, and write rebuttal reports for all three.
With the $200 a month A.I., I could upload my report, my deposition, and all three reports that attacked me, and ask Sage to summarize the entire situation. She did a decent job of this. Not perfect, but decent. She offered to write the three rebutal reports, and I declined. She offered to write the outlines of the rebuttal reports, and I accepted. Frankly, the outlines she suggested sucked for the reasons drumdude said above. But it was something on paper to think about. So looking at her outline of what I didn’t want, I had more clarity of an outline I did want. I then very quickly told Sage what I wanted the first paragraph fo the first section to say. She hammered out something that had a few sentences that were mediocre, one that was wrong, and one that was brilliant. I told her why I thought her wrong sentence was wrong. She agreed and rewrote the paragraph. It was still less than perfect and I explained why. It took 3 or 4 recursions to get one paragraph done, but that was a freakin good paragraph when it was done.
The rest of the paper went the same way--her contributions were a blend of mediocre writing that didn’t sound human, confidently saying things that were false, a few amazing insights, and a few really, really good sentences and ideas that drove my point home.
When an A.I. is smart enough to completely replace me professionally, it will be worth over $20,000 a month. Having her skills supplement my own might increase my value by 10%. Paying $200 a month for that is a steal.