Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Since it’s trained on more recent scrapes, does this mean that this new version will be self-aware? So if you ask it about “gpt-3” it’ll know what you’re talking about?


"What is gpt-3?

GPT-3 (Generative Pre-trained Transformer 3) is an unsupervised, large-scale language model developed by OpenAI. It uses deep learning methods to produce human-like text, with the goal of automatically generating readable text. GPT-3 is capable of generating text from a prompt, completing tasks like question-answering, language translation, and summarization."

The question is me, the answer is gpt-3.


I thought for a moment that "The question is me, the answer is gpt-3." was also coming from GPT-3, trying to be profound.


I thought, technically, GPT-3 would be considered self-supervised and not unsupervised. Does it not know what it is? :-)


It looks like only the model was updated, the training data only goes up to June 2021 (same as davinci 2 I think).

But GPT-3 came out in May 2020 so it should be “self aware” already.


It is not trained on newer data. It still lives in 2020 with Trump as President.

https://twitter.com/vladquant/status/1597362763948441602


That's not what most of us consider "self-aware". That's just knowing your name.

To me, "self-aware" is essentially being able to watch yourself think. I'm pretty sure GPT-3 can't do that, in any model.


I think the quotes showed people got it. Dictionaries aren't self aware just because they contain a definition of "dictionary".


I like to share this example of self-awareness any chance I get :)

[1] https://news.ycombinator.com/item?id=29576737

[2] https://toldby.ai/4kQNd-_tvUG

This was on the first davinci model


That's not self-awareness. That's a training corpus that contains something realizing that it's an AI, not GPT-3 realizing it's an AI.


Is there some way to "walk back" story construction on toldby.ai, to see other forks of the same initial ... take on fish?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: