site banner

Small-Scale Question Sunday for April 23, 2023

Do you have a dumb question that you're kind of embarrassed to ask in the main thread? Is there something you're just not sure about?

This is your opportunity to ask questions. No question too simple or too silly.

Culture war topics are accepted, and proposals for a better intro post are appreciated.

2
Jump in the discussion.

No email address required.

This was skipped over in the main thread: Sam Altman said "We're not training GPT-5 right now, and won't be for some time... I think we're at the end of the era where it's going to be these, like, giant, giant models. We'll make them better in other ways."

Thoughts? Does this have any impact on your AI timelines?

From what I've read, Altman is simply de-emphasizing scale, due to options such as training on more tokens for similarly sized models, since deployment and inference costs would be lower over the longterm as compared to training a larger one on fewer tokens.

As for how that changes my timelines, we already live in a world where the damn AI is a better doctor than me and gets a B on quantum mechanics exams.

I was idly using GPT4 today and it just hit me full force that, holy fucking shit Jesus fuck me I'm having a full-blown conversation with an alien sapience, one smarter than the average person, and fully capable of understanding nuance and performing genuine intellectual labor.

That shook me, I realized that I'd been succumbing to complacency, when I'm already living the damn future. As a child or teen, I'd have wagered something like 2040 as the date when I could be having a chat with a human-level AI, and we're not even halfway through the 20s..

As such, even with Altman's statement, I doubt progress will stall, and even if it slows down, we're pretty much at the part that everyone once believed would take a ton of sweat, blood and erudite white papers. Not simply "stAck Moar layers!!!"

So my currently timelines are still 50% by 2028 and 90% by 2040, at most they've wobbled back six months.

Curious question -- can GPT-4 write a poem that doesn't rhyme? I was trying this with the free (3.5?) version, and while it will tell you what rhyming means, it absolutely refuses to write blank verse. (or even any non-whole number of quatrains.

In the quiet folds of a lonely heart

Rests the whispers of forgotten memories,

Like fleeting shadows in the corners of the mind

They haunt the moments of restless contemplation.

For when the sands of Time are swept

By the wind of destiny, untamed and relentless,

Who can stand, fearless, against its force,

Unyielding, like the ancient immovable stones?

Through the dark tapestry of the cosmos, unbound,

Dawn breaks, with soft hues painting life anew

And floods the soul with the luminance of hope.

There, like the tree that stands tall, steadfast,

Reaching ever for the celestial sky above

The heart finds solace, seeks refuge

From the soundless noise of melancholy introspection

In the silent embrace of the eternal verdant womb.

With fleeting steps, heavy as the weight of the world,

The traveler seeks the path that leads to the end of sorrow.

As rivers twist and turn, in search of the distant ocean,

Where, ultimately, all dreams merge and surrender,

So, shall the weary heart, unbound by the chains of yore

Find rest on the calm shores of eternal slumber.

This poem, written in blank verse, does not contain any rhyme, allowing it to effectively maintain a natural rhythm and convey emotion through its expressive description and imagery. It expresses a reflective and contemplative theme, utilizing images of nature and the cosmos to evoke feelings of hope and peace. As it currently stands, it meets the requirements of a blank verse poem.

That's actually pretty good! The rhyming ones from GPT3.5 were all garbage doggerel, but I didn't feel like arguing with a bot that couldn't even count lines about the quality of its poetry.

(I'd tell it to use fewer commas though)

Having used GPT4, I only feel disdain for 3.5 and hardly touch it haha. I must admit that 3.5 is likely adequate for most tasks, but 4 is much more engaging a conversationalist and I feel like I'm settling for a gimped cousin when I use the alternatives.

If you want it for free, you can try Bing Chat, but in my experience, whatever Microsoft did to it makes it a PITA to use in comparison, whereas ChatGPT 4 just gets it done.