Golden Path to save humanity from AI?
Posted: 26 Aug 2024 12:59
The last thing I want to do is lend any credence to the prequel novels...but. I've been reading Erewhon, the book by Samuel Butler that inspired the idea of the Buterlian Jihad, and got to the section where it finally goes into the history of how that society turned against machine development, and the argument given is specifically that machine consciousness is the threat to humanity to watch out for. Whereas it took biological life millions of years to develop into what it is, and for consciousness to emerge, machine advancement is much quicker, and potentially accelerates rather than slowing down. It doesn't quite state the idea of the omega point, but it comes close to implying it, i.e. that a time will come when machine advancement could suddenly leap forward of its own accord. It even suggests that the machines of 'today' (which in the book's case were somewhat futuristic compared to when the book was written) may have a sort of primitive consciousness already, since if we look at primitive life forms we can hardly ascribe consciousness to them, and yet the current level of consciousness did emerge from them. Or, on the other hand, if primitive forms don't have consciousness, then it implies that conscious beings can emerge out of non-conscience forms, as humans from mollusks, and that the current form of machines doesn't speak to what might come next. Either way, the ultimate threat to humanity is the conscious machine, or possibly even the more-than-conscious machine. This last concept antitipates FH's Destination: Void in a big way, and perhaps the Hyperion series as well.
Given how influential this work appears to have been in FH's mind, and since the arafel Leto II refers to appears to be self-adapting Ixian hunter-seekers, it seems to me only a minor step to say that these were intelligent machines. Maybe not intelligent in exactly the same way humans are intelligent, but about to reproduce, adapt, change themselves, and pursue their goals and needs to the utmost of their abilities. Artificial life, in the most important of senses. So why should we avoid saying that AI was to be the doom of humanity? Where things get messy is to suppose that this is precisely what was happening pre-Jihad, and that this threat already existed. I don't think it did, because otherwise it would have been no surprise to anyone to hear that all of humanity could be threatened from a single source. The threat of AI-advancement would no doubt have been well understood well before the Jihad. And it seems that it took until sometime during Leto II's reign for this technology to even become possible. But even if the Golden Path would prevent all of humanity falling victim to a single attack, it doesn't mean that the threat of AI would be completely neutralized. The Ixian arafel could still run amok and do a lot of damage, decimating at least most of the known universe.
Another interesting feature in Leto II's end is his marriage with Hwi, the Ixian ambassador. Yes, they engineered her for him. But at the same time, the notion that he found it inevitable to marry himself to the ambassador of the machines seems to point to something, something not yet explored even by the end of CH:D. Erewhon focuses heavily on man's relationship to machines, and how the two need each other and serve each other. Stop caring for the machines, and you stop being able to feed humanity, travel, etc. Advancing tech is necessary to advance humanity, and even in GEoD the Ixian naviagation machine is crucial for Leto II's plans to come to fruition. This interdependence with machines seems very important in GEoD, and it not quite revisited until maybe CH:D, when we see Duncan able to have some sort of connection with machines that is yet to be explained. This is one more piece of evidence that leads me to believe that there was definitely going to be a Dune 7 coming. Now I don't see much reason to believe that M&D were AI beings, but perhaps FH was pointing to the idea that at a certain point of advancement it might be hard to distinguish between biological beings and machines, being 'natural intelligence' and artificial intelligence. As an analogy, we already see that the Face-Dancers cease at a certain point to mimic the identity of a person, and actually fully take on the persona of a person. This gray line between mimicry and actually being the thing may have its analogue in human intelligence and machine intelligence coming to be more and more similar over time, and man and machine grow more complex together.
The key in all this would seem to prevent humanity being prematurely wiped out by machines, before it's possible to come to some sort of equilibrium or harmony with them that would no longer shut down man's need to think.
Given how influential this work appears to have been in FH's mind, and since the arafel Leto II refers to appears to be self-adapting Ixian hunter-seekers, it seems to me only a minor step to say that these were intelligent machines. Maybe not intelligent in exactly the same way humans are intelligent, but about to reproduce, adapt, change themselves, and pursue their goals and needs to the utmost of their abilities. Artificial life, in the most important of senses. So why should we avoid saying that AI was to be the doom of humanity? Where things get messy is to suppose that this is precisely what was happening pre-Jihad, and that this threat already existed. I don't think it did, because otherwise it would have been no surprise to anyone to hear that all of humanity could be threatened from a single source. The threat of AI-advancement would no doubt have been well understood well before the Jihad. And it seems that it took until sometime during Leto II's reign for this technology to even become possible. But even if the Golden Path would prevent all of humanity falling victim to a single attack, it doesn't mean that the threat of AI would be completely neutralized. The Ixian arafel could still run amok and do a lot of damage, decimating at least most of the known universe.
Another interesting feature in Leto II's end is his marriage with Hwi, the Ixian ambassador. Yes, they engineered her for him. But at the same time, the notion that he found it inevitable to marry himself to the ambassador of the machines seems to point to something, something not yet explored even by the end of CH:D. Erewhon focuses heavily on man's relationship to machines, and how the two need each other and serve each other. Stop caring for the machines, and you stop being able to feed humanity, travel, etc. Advancing tech is necessary to advance humanity, and even in GEoD the Ixian naviagation machine is crucial for Leto II's plans to come to fruition. This interdependence with machines seems very important in GEoD, and it not quite revisited until maybe CH:D, when we see Duncan able to have some sort of connection with machines that is yet to be explained. This is one more piece of evidence that leads me to believe that there was definitely going to be a Dune 7 coming. Now I don't see much reason to believe that M&D were AI beings, but perhaps FH was pointing to the idea that at a certain point of advancement it might be hard to distinguish between biological beings and machines, being 'natural intelligence' and artificial intelligence. As an analogy, we already see that the Face-Dancers cease at a certain point to mimic the identity of a person, and actually fully take on the persona of a person. This gray line between mimicry and actually being the thing may have its analogue in human intelligence and machine intelligence coming to be more and more similar over time, and man and machine grow more complex together.
The key in all this would seem to prevent humanity being prematurely wiped out by machines, before it's possible to come to some sort of equilibrium or harmony with them that would no longer shut down man's need to think.