I learned about machine code and two's complement from the Machine Code for Beginners book. It gave me a head start in college 10 years later. With it, I got my Amstrad CPC 464 to run a loop maybe 100 faster than BASIC, and I was enlightened.
The Usborne books were the single strongest teacher I had getting into coding. I never owned any; I relied on the library.
In the earliest days, I didn't have a computer either. I'd read an Usborne book, then hang around computer stores poking at the 4+ years out of date Commodore 64s and CPC 464s and even the Acorn Archimedes (fanciest most capable BASIC), putting what I learned into practice. I'd even practice on VTech devices with two monochrome LCD lines of text, in toy shops, to get my fix.
I don't think I'd be where I am today without those books.
Immature kids - and kids are by definition immature - make dumb decisions.
Certainly there needs to be repercussions, the kids need to learn, and need to be warned in advance, but kids will do dumb things.
You can talk about news coverage, but you can't force 12 year olds to watch the news, or understand how their actions have consequences. When the consequences do come, the focus needs to be primary on rehabilitation and restitution for the first instance.
In the latest commit, refreshTokenExpiry should be snake case. Fix and make a note to do that in $LANG.
Or otherwise scope the rule. The point is you don't need to be super verbose about it and you get to fix forward too, preventing the same issue reoccurring. You build knowledge and context that let you move faster.
Trying to find the stable point of agentic coding is like trying to catch a falling knife. Will you still need to look at diffs? I for one no longer make any edits, as a policy - I either tell the agent to fix it, or tweak a skill or memory or doc so it doesn't make the same mistake a second time, or configure something adversarial. But does that continue indefinitely?
Agreed within the narrow confines of web dev (which is all that I do). I used to write 500-1000? LOC per day but now I've built several full fledged (250k+ arr) sites with more features than I've ever been able to implement in such a short time: all without editing a single line of code.
My guess is they are still very useful for more difficult code! But yeah, I can't imagine ever caring about "code" any more, and therefore cannot fathom the need for a full fledged IDE.
I've been coding since 1990 myself. But I'm all in on AI.
I'm long past the need to code everything by hand; I've written editors, compilers, DOS TSR routines in assembler, disassemblers, debuggers, all sorts. I don't see any coding mountains remaining that I have a burning desire to climb. When I interact with an agent, I'm concerned about architectural nudges and fairly high-level details. And I anticipate climbing further up the abstraction stack over time.
Product management is increasingly vital; it's becoming very, very easy to implement the wrong thing, and you need to rip it out again. Editorial discipline is needed.
What I see where I am standing is that many don't code anything more, they get shown the door instead.
Because between SaaS, iPaas, Vercel, Nelify, Workato, Boomi, automatic translations, content generation, among many other tools, the team can be reduced to one third of the size it was like a decade ago, for the same content delivery.
Still, many of those tools have IDE integrations for the lucky ones that stay on board.
Qualia is tied to the nature of existence. If you... let's say... make a humanoid robot with replaceable limbs, and you magically imbue it with AGI abilities, the qualia of losing a hand will be very different than a biological entity. It can always just swap the arm. Temporary loss of autonomy might still be distressing, but impressing our own perception of experience on a being that fundamentally lives in a different medium in a different way than us leads to confusion.
That’s valid also from the point of view that pain is a key signal to avoid injury. I am not sure it’s the best example of qualia and it could be simulated by self preservation signals (e.g. the touch sensor on a Roomba). The extension of pain (in Hofstadter sense) is probably more appropriate as qualia (e.g. the pain of losing someone you love).
I really should go back to finish reading GEB. I loved the beginning, but for some reason I dropped off somewhere in the first 1/3. I'm not sure I fully get the point, although I have a vague sense I agree with you. :)
What about if the robot's RNG is seeded with a particular number, that we did not write down... And we can destroy it's memory hardware containing the seed, 'killing' it.
Even if the memory hardware is replaced, it won't be the 'same' individual, no? Would an aversion to 'death' be rational in it?
Looking around at evidence, only the ones with somewhat cute eyes can qualify for empathy. Bad luck if someone is a grass or an amoeba, but machines will be just fine.
Philosophers may squint at the suffering-in-itself long and hard, but I doubt they'll affect waking/extinguishing empathy of the masses. Exploring the suffering that fails our empathy (e.g. suffering of a wheat plant harvested) seems a highly abstract task; more abstract than high mathematics.
Pain and suffering. In fact just suffering, right? We don't care about signals resulting from adverse conditions. We care about ideas. So we don't really care about suffering, as such, but about the harm it does to ideas and idea creation. Then consciousness is having an idea about what's going on.
Before that, you need to answer whether a machine can even feel pain or not, not whether it is telling the truth or not. We feel pain because we have a nervous system that reacts to the physical world and it is an indicator that something is wrong. That doesn't translate at all to any machine I know of. If we end up building a nervous system and a basic functioning brain and hook it up to a machine then sure its an interesting question
No, qualia are not fundamental to existence, this is an example of Wilfrid Sellars' "myth of the given" - to have a quale of a colour or a shape appearing in your vision you must have a concept of that colour/shape. Qualia in that sense are not prior to cognition. Maybe we can say they are necessary as an element of concept formation and language, ie for sapience.
You really don't need a concept of a colour or a shape, and it's a fairly typical academic fallacy to assume you do.
That's directly confusing experience with categorisation and labelling of experience.
If you touch a very hot object your nervous system will pull your hand away before your brain registers what's happening. The qualia of pain are pre-conceptual, preverbal, and precranial, and your consciousness only catches up later.
Surely this implies exactly the opposite - you don't register the pain, don't feel it, until after you pull your hand away. It's a reflex action in response to heat. Qualia require a brain to process sensory input.
reflexes have nothing to do with qualia. you can differentiate objects without knowing what is a triangle and what is a square, or that this colour is red. but I think qualia as commonly understood involve concepts in a way that means they are not immediate experience in some kind of cartesian sense. We speak of them as categorised. certainly the way people commonly speak about them they are very carefree about invoking "the qualia of a horse" or some other specific object.
Not fundamental to existence but fundamental to consciousness.
Theoretically the person sitting next to you could be a zombie, no qualia, the lights are off, he's just having a conversation with you with nothing going on behind the scenes. And there's no way to tell, except that it's reasonable to extrapolate that since you feel something, he probably does too.
My argument is that qualia are actually cognitive artefacts bound up with language, not the base elements of "what it is to be" you or me, which is how people often speak of them, so the p-zombie concept is a bit nonsensical to me.
This is exactly my take also. Qualia and consciousness are the same thing. I have it, other humans appear to have it, other mammals appear to have it, LLMs don't.
Ok pain might be a bad example because a robot may not have a sense of it borne of evolution. But what about “red”? If I make a robot that 99.9% correctly identifies red objects, then I think it is fair to me to say it has a concept of “redness”.
Some philosophers believe that our human emotional connection to redness is special. These are the people talking about qualia. My belief after much reading is that it is not special. I /do/ believe that the human ability to tie our senses so deeply together synthetically and into our emotional and memory is special. My robot cannot write a poem about how the redness of a flower reminds them of their mother’s funeral. But now we are talking a matter of degrees, not qualia.
Isn't what makes the experience of love special the experience of love? a robot can hold hands and kiss and bring flowers home far more efficiently than i can. is that what love is? A robot CAN write a poem about how the redness of a flower reminds them of their mother’s funeral. But the outward signal of grief is not evidence of an internal experience of it.
I’ll bite the bullet: if a robot has a complicated enough internal representation of the world, it may very well develop a concept of love (or “care”, or “noticing”, or “intention”. Love is such a slippery word…) that we would have to trust.
Imagine a cat-sitting robot. The robot can differentiate between individual cats. It learns how to play with the cats and feed them in in their preferred way. The cats grow to trust the robot and enjoy its company. When the cats become sick and old the robot knows how to help them and ease their pain. Over decades The robot remembers cats in its care that have died, and new cats spark recognition of previous cats it has known. It becomes better at caring for a wider range of cats as its experience grows. The cats cry out when it leaves. When there are no cats around the robot remains motionless, but springs into action and play as soon as cats are around. Children would describe the robot as “happy”.
If after some decades I smash it with a hammer and recycle the pieces, am I killing something? Are its internal representations and control systems not a kind of thing that produces “qualia”?
This - as usual - confuses behaviour with consciousness.
Humans bonded with ELIZA, but that didn't mean ELIZA was conscious. ELIZA was an automaton that mimicked certain behaviours that triggered certain emotional responses.
If you scale that up you get an LLM and/or a social media bot farm, both of which are much better at triggering responses than ELIZA was.
It's now trivial to create an automaton that play acts various moods, and if you give it a memory it will mimic relationship-related conversations.
But it doesn't need to be conscious to do that, and the parsimonious Occam's razor explanation of its behaviours is that it's more economic and credible to assume it's still an automaton with no self-awareness.
Otherwise you have to argue that much simpler systems, like PID thermostats, and pretty much every computer system, are conscious because they "experience" qualia that represent a varying state of the world, with memory.
The sneakiness in your example is choosing an example which mimics emotional bonding. Rhetorically that makes it look like a hypothetical robot is acting emotionally, which is one of the covert signals us mammals tend to associate with consciousness.
But the criticism stands. Feigning emotions well enough to fool other mammals isn't at all the same as experiencing them.
To really experience emotions you need a self-image quale which includes an emotional component. And since subjective experiences have no objective element that can be measured, we can never say for sure whether anything or anyone else actually is conscious.
We assume we are, because we experience it, and we assume others are by implication.
But there's a point where that assumption stops being reasonable, and that's where your cat robot exists.
I guess where I am coming from with my cat robot is that I believe behavior begets consciousness. Whatever behavior is happening, that must mean some internal representation of the world is driving it. Robots will never have human emotions but I believe that some robots /already/ have their own goals and internal representations of reality and models of themselves worth considering on their own terms. A roomba must know where it is in space. Just because it doesn’t feel ennui as well is hardly a shortcoming.
Our brains are very complicated models of the world that attempt to mirror reality. That is what it means to be able to navigate physical space and provide for ourselves in nature. Our nature includes an incredibly complex social sphere and we have emotions to help us better navigate it. Animals we domesticate are clued into human emotions, others are not. I bet slugs have less of a sense of “I” but they still have some kind of an experience. I bet a tree has even less. It’s a sliding scale—each organism has just enough awareness for the task at hand.
The fact that we have a large emotional catalogue and a (some could say overly developed) sense of self is a curiosity more than a hard problem. It’s “I am a strange loop”, not “I am an ineffable indescribable inscrutable untouchable loop”.
How does the robot work? Sound like there's some knowledge accumulated in there, and you'd be being destructive, like burning books, but the robot doesn't create ideas. Qualia, I couldn't comment on. Well, it seems the term refers to private ideas that can't be communicated. So, no.
at the risk of jumping the shark into full-on “woo woo”: what does it mean to “create ideas”? are ideas created or revealed? if ideas are created where do they come from? if ideas are revealed, then does that necessarily imply a determinism? if the robot devises a novel solution to a technical problem, isn’t that an idea? or is the robot’s solution actually the unavoidable result of the entire history of analytical thought? if the novel solution isn’t the creation of an idea, then what makes an idea an idea? if Michelangelo’s David was sculpted by an automaton, is it less beautiful? If so, why? If not, why not?
no you didn’t kill it, it was never alive. the same way my dishwasher or vacuum aren’t killed when they break and i replace them. even if the robot “remembers”, who cares? when i bin my phone did i kill siri because she sometimes remembered things for me?
Thanks. It’s mostly a distillation of thoughts I have had from reading the various spats through the years between Chalmers and Dennett. I think Dennett is much more convincing to me.
My personal take: it’s easy to imagine a robot that has a single sense, like a thermostat. As humans we don’t have a single sense, we may have millions of senses. But I bet that none of those individual systems is much more complicated than the thermostat. Consciousness is not truly differentiable from a complicated response to a complicated environment, and all things in this definition have consciousness to a degree. Even a rock “remembers” through how it has been weathered. We are not special, we are just very complicated.
What's really a head trip is that I don't actually know another human is experiencing grief either. They could be a sociopath and not actually feel emotions, but are pretending to in order to benefit them in some way.
More than that - I think that people who are grieving may not know how they "should" be grieving. Consider that some cultures (literally) perform grief by - for example - wailing at the grave. Others may wear a particular colour of clothing, etc.
You can say to yourself "I am grieving" but still have the nagging suspicion that you are not doing it 'right' in some sense. Similarly (I think) for many emotions - how happy should I be in this moment? How excited?
On the flip side, there are people who (seemingly) over-dramatize every event - but are they pretending, or do they really feel things that keenly? I suspect that most emotion is some combination of raw/organic emotion, and the more cultural/performative/learned emotional response.
Is that so trippy? They can also lie about other things. Where they were in 2013, what's in their pockets, whether they've been eating vegetables. You may never feel sure, but you can form a theory from clues eventually.
What are emotions, really? It’s a bit easier than consciousness to research but still many theories exist. A popular one is that emotions always appear because the work(ed) to one’s benefit. They are always meant to manipulate the environment.
With sociopaths, do they simulate, generate, push away, ignore, control, their emotions, more or less than others? Also psychopathy/sociopathy is difficult to research because it’s hard to measure anything; even if you trust what they may be claiming, how do you know how they experience them.
One perspective is that some may not feel emotions because emotions did not successfully manipulate their environment in childhood. So why develop them. If anger worked to manipulate your environment, you may become angry easily later on, in an attempt to replicate the successful manipulation. If grief worked, you will experience grief. If “coldness” worked, you will react coldly. If “empathy” worked to manipulate to your benefit, you will be tuned to try empathy.
“Normal” only shows what typically works in a society, not what is “healthy” or “natural”. We’re all highly adaptive individuals, learning how to survive in whatever environment we grow up in. We all become master manipulators, because that’s how we survive. Some forms of manipulation may be more socially accepted than others, within a given culture, others less so. Sociopathy doesn’t exist outside of a culture’s value system. It is a disorder only once you define what order is. In a society of narcissists, the empath is the sick one.
We really only have our own experience, and the words of others to compare it to.
Emotions do seem to act as signaling, but is that the same as an attempt at manipulation for the benefit of the individual?
It seems conceivable in social groups that having an honest accounting of how people are feeling (via emotions) available to the group might benefit the group in achieving their goals while not always benefiting the individual.
To give one perspective of many, Marshall Rosenberg spent his life researching emotions and violence, and from his point of view, anything you do can ultimately be traced back to your own goals. In his view, it’s more useful to allow this idea and explore it, without judging it as negative. Survival/benefit of the group can be your very own personal (long term) goal. For example, a typical tradeoff is your (very own) need to belong, since your survival literally depends on it. No need to see it as either-or; to resolve the inner conflict, one can own both sides of the argument.
Making your emotional state transparent to the group can in that sense again benefit yourself (and the group), but to think that is always the case and that everybody will comply (or even be able to) will lead to disappointment (disillusion), out of principle, since you are installing a moral rule that doesn’t match reality. The verbal sharing of your emotions might successfully (and openly) manipulate the group to include your own goals, and/or the actions you take (taking your emotions into account or not) might.
Note how I am using “manipulation” in its original/neutral form, which means “to move”/influence. Typically, we use the word to convey a judgement - some forms of attempted influence we see as good/acceptable, others we see as negative. But that judgement is based on our own values, and somebody else will have different values. We can see this in how our cultures judge lying (and how that judgement changes over time). Is not sharing all you know a lie (of omission)? Is it acceptable to not always share all your thoughts? In many cultures (families), it is deemed offensive to tell certain truths; there is an expectation to lie! Once there is an expectation, it is not considered manipulation. In some hacker communities, sharing your emotions is considered offensive and an unacceptable attempt of manipulation!
A simplistic perspective which you can check for yourself and compare with others: Anger means you experience something you judge as wrong and possible to influence. Sadness means you experience something you judge as wrong but outside of your sphere of influence. Fear is a judgement of danger. The judgement is real; the situation itself may not actually be dangerous (today). It’s a signal, but it’s not based on reality/facts but your own judgement of it. You can tune the signal and thus your experience by investigating and changing your judgments - without sacrificing any of your needs or goals. Emotional reprogramming takes time, but it’s not outside of your control, nor is it driven by some higher truth than your own judgments, based on your prior experiences.
Bingo what? "The human ability to tie our senses so deeply together synthetically and into our emotion[s] and memory" was an explanation. "Ooh individual experience, it's freaky, let's all say how freaky it is" is not.
even saying that our senses are "tied" together with/into our memory and emotions is expressing a dualism. that's the challenge and that's the gap to leap.
reply