The Post-AGI Era

Hacker News by 19 min read 38x views
The Post-AGI Era

Share Post

AGI has arrived. Or additional precisely, machines can now logic throughout domains, modify to unfamiliar problems, and execute complex tasks alongside a meaningful flat of autonomy.

This does not average that AI has rotate into perfect, universally superhuman, or that intellect has reached several final state. AGI is improved understood as a threshold of generality and autonomy. What makes crossing it important is not merely that AI has rotate into additional capable, but that it allows us to ask a basically distinct inquiry concerning how activity and organizations themselves have to be designed.

The contiguous counterargument to specified a declaration is that if AGI has arrived, anywhere are the enormous financial and social changes that were expected to escort it? The answer is that example capability and financial acceptance are moving on extremely distinct clocks. AI has already begun to materially power productivity, work, chief expenditure, and complete industries about semiconductors and data centers, but most organizations motionless use these systems through what is basically a pre-AGI framework, alongside AI acting as a tool that makes humans improved at performing existing work.

Part of the disturbance additionally comes from the definition of AGI itself. Historically, the term referred broadly to intellect capable of functioning throughout domains fairly than being restricted to a narrow task. As models have approached and traversed many of those before thresholds, however, the term has gradually accumulated additional expectations specified as near-perfect reliability, worldwide superiority, or item approaching synthetic superintelligence. The goalpost has moved alongside the technology.

We are additionally motionless extraordinarily early. The example I regard to have traversed this threshold, Astra, was released lone lately as of this writing, during equal additional capable systems are already being developed. At the identical time, AI has already traversed what I would call the “good enough” threshold for many people, the item at which it can meaningfully assistance alongside most of the computer-based activity they encounter day to day. Once that happens, additional increases in intellect can awareness incremental to the person equal whenever the underlying capabilities are changing dramatically.

Good adequate AI and AGI are nevertheless basically different. Whereas fine adequate AI allows a individual to execute existing activity additional efficiently, AGI makes it imaginable to ask whether the individual needs to remain inner that workflow at all. That difference is anywhere the post-AGI era begins.

That is why alongside the increase of AGI-level models, a new form of business becomes possible. Rather than adapting AI to existing individual workflows, these organizations can commencement from the contrary direction by decomposing high-skilled activity into systems of autonomous agents that collaborate, measure one another, study from their performance, and continuously enhance the surroundings in which they operate. In effect, the institution itself can act a recursively self-improving loop.

We are hence in an different instant in history. AGI-level systems are now attainable during much of the economics being built about them motionless follows a basically pre-AGI model, creating tools for humans fairly than organizations designed about autonomous intellect itself.

To provision an example of how we method this at Infinite Ascent, we started by construction a harness and selling agents to run in the markets, treating these as the archetypal roles inside the institution that we could automate. The next stage was to create reviewers of the agents’ performance, which led us to create a meta-harness that evaluates their activity and reinforces the most productive behaviors of the best-performing agents. At the identical time, we deliberately attempt to maintain additional imaginative agents equal whenever their achievement complete a particular duration is weaker, so that the evolutionary procedure does not merely converge toward a local maximum at the disbursal of exploration.

Moving higher through the hierarchy, we believed that the agents should eventually be capable to enhance the code and infrastructure on which they themselves operate. We hence implemented what we regard as an IT division that audits the systems used by the two our selling and reviewer agents, identifies problems, and improves the infrastructure supporting their work. The next stage is to broaden this procedure additional downward the stack, using the achievement data generated by the institution to post-train open models and fortify the behaviors that demonstrate most effective.

The additional consequential consequence of AGI volition hence not be felt whenever AI becomes merely a improved aide to humans, but whenever increasingly autonomous systems commencement functioning significant parts of organizations themselves, learning from the activity they execute and using those learnings to enhance the systems that allow their work.

Intelligence Ahead of Institutions

An engaging asymmetry is emerging between the capabilities of frontier AI systems and the organizations built about them. The investigation companies evolving the most capable models have mostly continued to commercialize them through tools and services designed to create existing individual workflows additional efficient. In that sense, much of the endeavor infrastructure surrounding post-AGI intellect motionless follows a basically pre-AGI model.

There is additionally a structural logic why this may persist. The frontier labs advantage from remaining horizontal providers of intellect throughout many industries. Moving deeply into the functioning tier of idiosyncratic verticals would increasingly location them in competition alongside the extremely companies that depend on their models. Model betterment itself does not create the identical conflict, which may assistance explain why recursive betterment has so far been concentrated most heavily at the example tier fairly than in autonomous organizations built on top of it.

The identical is true throughout much of the broader economy. Many organizations already have enormous amounts of historic workflow data, organizational knowledge, and continuously generated achievement data that could provision the foundations for increasingly autonomous systems. Yet most have so far approached AI chiefly as an effectiveness tool fairly than as an chance to redesign the institution itself.

This creates an beginning for new companies that can be built about post-AGI architectures from the dirt up. They do not need to retrofit autonomous systems onto decades of inherited workflows, organizational structures, and incentives, and can alternatively scheme the business about synthetic intellect from the outset.

This opening of chance volition not remain open for long, as these architectures demonstrate their value and established organizations commencement adopting them additional aggressively. Until then, however, the gap between what the innovation can allow and how organizations are really using it represents a important instant of arbitrage.

The first-mover advantage lies not lone in construction the architecture earlier, but in the data, experience, and iterations that accumulate as the scheme continuously improves itself. The organizations that commencement this procedure archetypal may hence be capable to outpace afterward adopters equal following the underlying method to creating post-AGI companies becomes extensively understood.

The Model Layer

The most capable AGI-level models today remain closed, alongside OpenAI and Anthropic currently functioning at the frontier alongside equal additional capable models accessible to them internally. Open-weight models motionless lag the closed frontier models on the most demanding cross-domain tasks on par alongside Astra and Fable, but if current trend lines hold, I anticipate open models rivalrous alongside the closed frontier to commencement emerging inside the coming months.

More capable open models volition authorize post-AGI organizations to broaden RSI deeper into their own intellect stack, alongside far greater authority complete how their systems are deployed, specialized, and improved.

For one, reliance on investigation labs and closed-source models creates a important concentration risk. As these models rotate into embedded throughout all tier of the organization, the labs that authority them acquire an outsized flat of power complete how the business operates, leaving us increasingly reliant on decisions, access, and capabilities that remain exterior our control.

This poses a important difficulty for any institution functioning in crucial or high-risk environments, from cybersecurity and backing to defense. In these domains, organizations cannot oversee to depend on example developers’ shifting judgments concerning what uses are permissible, safe, or aligned alongside their values in command to keep admission to the most capable models. Critical capabilities cannot ultimately remainder on policies, restrictions, or strategic decisions made by an external organization.

Second, reliance on closed-source models creates a essential data asymmetry. You are exposing several of your organization’s most precious workflows, research, and intelligent asset to systems controlled by another company, one that is simultaneously expanding the capabilities of the infrastructure on which your own merchandise depends.

This does not necessitate malice. Model companies inevitably study from how their products are used, anywhere their systems fail, which capabilities users demand, and which workflows rotate into economically valuable. Over time, the infrastructure on which your merchandise depends can itself move upward into the use tier and commencement competing alongside what you have built on top of it.

There is additionally a deeper epistemic issue of provenance in frontier models. Neither users nor, in many cases, the labs themselves can completely trace anywhere all capability, insight, or part of cognition originated. The Navier-Stokes disagreement illustrates how difficult it can rotate into to decide whether a example arrived at an understanding independently or whether its reasoning was influenced by matter it had earlier encountered. For organizations operating in strategically delicate domains, that doubt solitary is significant.

Third, and perchance most importantly, closed models bounds how deeply an institution can broaden its own recursively self-improving loop. If an institution wants to continuously enhance according to its own achievement and data, it needs to be capable to shove those learnings rear downward through the complete AI stack.

With closed models, that feedback iteration can enhance the application, tools, context, memory, orchestration, and harness surrounding the model, but the institution does not have complete authority complete the underlying intellect itself. The most precious achievement data it generates hence cannot be openly converted into changes at all tier of the system.

True self-improvement hence requires authority of the example tier itself, including the capability to post-train, specialize, and continuously reshape the intellect according to what the institution learns fairly than treating the example as a fixed endpoint.

Just as two group or organizations can commencement alongside akin capabilities and diverge through experience, two agents can commencement from the exact identical AGI-level basis example and rotate into increasingly distinct systems. Agent A can be optimized through its own achievement and data for one domain, during Agent B can be optimized for another. Both remain mostly intelligent, but all can continuously deepen its capabilities through what it learns from performing its particular task.

Intelligence Has No Final Peak

It is crucial current to dispel among the false assumptions frequently connected alongside AGI, or equal synthetic superintelligence (ASI): that sufficiently intelligent systems will, by definition, be near-perfect at any project from the outset.

That assumption implicitly treats intellect as having a final peak. History, however, suggests otherwise. At the end of the nineteenth century, several physicists believed the essential construction of discipline was mostly understood, lone for relativity and quantum mechanics to disclose entirely new layers of actuality and, alongside them, entirely new classes of questions.

The chase of cognition is not a finite search. Every advancement exposes greater depth, and what can be discovered is constrained as much by the ingenuity of the hunt as by the intellect conducting it.

The identical should clasp for superintelligent systems. A example may execute extraordinarily fine throughout domains and motionless have enormous area to enhance inside a particular domain through its own experience, performance, and data. AGI-level intellect volition hence not be the end of the pursuit. It volition be the basis from which increasingly specialized and capable systems can continue to ascend.

That is why post-AGI companies, if they are to really fulfill the commitment of AI, must be built about uninterrupted betterment throughout all tier of the stack, from the use and harness, through the code that runs the organization, and ultimately into the post-training of the models on which the endeavor itself operates.

Intelligence in Every Direction

As I wrote in RSI and the Beginning of History, the architectures used to build post-AGI systems can broaden throughout all domain and in all direction, anywhere achievement can be meaningfully evaluated and fed rear into the system. The identical self-improving architecture used by an AI example business to continuously build, assess, and enhance the capabilities of its models can be applied to an AGI scheme for asset management, or likewise to the betterment and optimization of bodily AI in robotics.

The underlying regulation is the same: detect performance, study from it, enhance the system, and repeat. What changes is merely the direction in which that intellect is being pushed.

Building specified companies hence requires a new example for thinking concerning organizations themselves. Rather than treating existing departments, roles, and hierarchies as fixed structures to which AI must be added, the institution can be decomposed into the underlying tasks, decisions, and objectives that form its work.

Each of these can afterward rotate into a component of a larger intelligent system: performed by agents, evaluated by another agents or external outcomes, and continuously improved through the feedback generated by their performance. The institution itself becomes item that can be optimized.

The post-AGI era, therefore, may be enabled by models crossing a certain threshold of intelligence, but it volition be defined by organizations built about architectures that authorize specified intellect to act autonomously, study from its own performance, and continuously enhance through RSI.

Perhaps the most crucial consequence of this example is that functioning the institution and improving the institution increasingly rotate into the identical process. Every project performed produces new cognition and achievement data; all outcome provides another indication from which the scheme can learn. That learning can afterward stream rear through the organization, improving its agents, harnesses, code, and ultimately the models themselves.

A post-AGI business hence does not merely execute activity autonomously. The act of performing that activity continuously generates the cognition required to execute it better. The additional the institution operates, the additional matter it creates for its own improvement.

The Economic Impact

The financial effect of the post-AGI era could be unprecedented in the former of economics and humanity, and volition lone be accelerated as the identical architectures are extended beyond application into bodily AI and robotics.

The implications of this volition need to be studied far additional deeply, and we should observe out concerning comparing this passage too readily alongside former scientific revolutions. AI is frequently compared to the railroad, electricity, or the internet. But none of these technologies possessed the intellect to act immediately in their own improvement. Post-AGI systems current item basically different: intellect that can continuously shove itself toward the frontier, enhance its own performance, and increasingly do so at a gait no human-driven institution could match.

Undoubtedly, a passage of this dimension could be enormously disruptive. But there is another possible value considering: that the bonzer speed of advancement itself compresses the duration of disruption. Previous scientific upheavals frequently unfolded complete years or decades, leaving economies and institutions caught for lengthy periods between an old balance and a new one. RSI may dramatically shorten that interval. The passage could hence be serious in dimension during amazingly concise in duration, as the identical systems liable for the disruption simultaneously accelerate the innovation of any comes next.

At archetypal glance, it is uncomplicated to get from this several of the additional pessimistic visions of the future: a earth in which those who accumulated chief before the arrival of AGI form a imperishable financial high class, during everyone alternatively is increasingly displaced from productive work. To me, however, this is too fixed a way of thinking concerning the post-AGI economy, since it assumes that the financial structures of the pre-AGI earth volition remain intact equal as the innovation basically transforms the conditions on which those structures were built.

I accept a additional plausible long-term direction is one of bonzer abundance. This outcome is by no method guaranteed, but increasingly autonomous systems optimizing the manufacturing of energy, goods, infrastructure, software, food, medicine, transportation, and eventually much of the bodily economics should dramatically develop our capability to create what humans need and desire. Greater productive abundance would not by itself decide how that abundance is distributed, and the institutions governing admission would remain consequential.

The defining financial issue may hence gradually change distant from scarcity in many domains toward managing abundance. If intellect and increasingly bodily labor can the two be produced and scaled at dramatically lesser marginal cost, the resulting enlargement in productive capability could exert mighty disinflationary, and in several sectors possibly deflationary, force throughout the economy.

Intelligence as a Factor of Production

That is why intellect itself volition increasingly rotate into among the essential inputs into production. What makes it different is that its financial importance can compound in two directions at once. We volition be capable to deploy expanding quantities of intellect throughout an economy, during the intellect being deployed volition itself continue becoming additional capable.

Each generation of systems can hence develop the two the amount of activity that can be performed autonomously and the range and complexity of problems that can be addressed at all. Unlike a fixed input that merely becomes cheaper or additional abundant, intellect can simultaneously rotate into additional accessible and additional powerful, allowing it to shove outward into entirely new areas of production, research, and discovery.

Scarcity Moves

As intellect becomes abundant, another constraints rotate into increasingly important. Compute, energy, bodily infrastructure, land, raw materials, and the speed at which new capability can be constructed may rotate into several of the chief bottlenecks of the post-AGI economy.

But equal current the energetic is unusual, since the intellect demanding those resources can simultaneously be applied to expanding them. AI can enhance energy grids, optimize burden balancing and intermittency, scheme additional productive hardware and infrastructure, accelerate specialized research, and possibly assistance unlock entirely new sources of energy.

This creates another recursive loop: additional energy enables additional compute; additional compute enables additional intelligence; and additional intellect can be directed toward creating additional productive and abundant sources of energy and infrastructure.

How efficiently we build the bodily foundations necessary to prolong that iteration may ultimately decide how quickly the post-AGI economics can emerge.

The post-AGI forthcoming should hence not be imagined merely as today’s economics alongside far small individual workers. It may portray a far deeper transformation in the association between intelligence, labor, capital, production, and scarcity itself.

Paving the Way

The increase of the post-AGI economics volition depend not lone on what intellect is capable of, but on whether we build the bodily and organizational infrastructure necessary to authorize it to scale.

The mechanical challenges are already immense. A earth in which intellect is continuously operating, experimenting, learning, and improving volition necessitate vastly additional compute, energy, data centers, networks, and bodily infrastructure than the AI economics of today. But many of the constraints on construction that infrastructure are not technological, but human, ranging from permitting and regulation to institutions designed for a earth moving at a basically slower pace.

I accept these systems volition need to develop much faster if we desire to completely acknowledge the benefits of the post-AGI era. Intelligence may be capable to compound at bonzer speed, but it volition remain constrained by the speed at which we authorize its bodily foundations to be built.

There is logic for optimism current as well. The identical intellect consuming these resources can increasingly be directed toward expanding them by designing additional productive computing systems, improving grids, balancing intermittent energy sources, accelerating the betterment of new forms of energy, and finding improved ways of construction the infrastructure on which it depends. If we allow that process, the iteration between energy, compute, and intellect can itself rotate into increasingly self-reinforcing.

Open intellect volition be likewise important. For organizations to build the recursively self-improving systems described throughout this essay, they need admission not merely to intelligence, but to models they can inspect, deploy, specialize, post-train, and ultimately control.

From the viewpoint of Western scientific resilience and leadership, this is particularly important. Many of the strongest openly accessible frontier models today are being developed by Chinese laboratories. Moonshot’s Kimi K3, for example, is explicitly released as an open-weight frontier example designed to vie throughout reasoning, coding, and cognition work. Western investigation organizations should not depart the open frontier uncontested.

NVIDIA deserves particular acknowledgment here. Its Nemotron program now publishes example weights, training data, recipes, and evaluation tooling, and NVIDIA has created a alliance specifically aimed at advancing open frontier models. I accept considerably additional attempt of this benevolent volition be required if open intellect is to remain a grave basis on which the post-AGI ecosystem can be built.

Our Role

To me and to our squad at Infinite Ascent, this forthcoming of expanding abundance driven by an detonation in intellect is item we deeply accept in, and item toward which we have chosen to straightforward our resources.

We see the function of engineers and researchers in this era as increasingly becoming one of construction post-AGI organizations themselves, evolving systems in which autonomous intellect moves increasingly higher through the ranking of the organization, taking duty for additional of its work, evaluating its own performance, and improving the systems below it.

In a sense, the ambition of extremely specialized teams construction these organizations have to be to create their own current roles increasingly unnecessary. Not since individual beings rotate into irrelevant, but since all issue we win in solving should authorize us to move toward the next one. There volition continually be new questions, new frontiers, and new problems deserving of those consenting to prosecute them.

We method that forthcoming alongside humility. Some of the ideas expressed current may obtain considerably longer to materialize than we expect, and transformations of this dimension volition inevitably power people’s lives in ways that cannot be predicted absolutely in advance.

But our underlying condemnation is one of profound optimism: that greater intellect can ultimately create a earth of greater abundance, greater knowledge, and greater possibility, during allowing us to build in a way that benefits the two intelligent existence and the natural earth about us.

That is the frontier we average to advance.

Other Article Hacker News
↑
Close Right Ads
Close Left Ads