<?xml version="1.0" encoding="UTF-8" ?><rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:media="http://search.yahoo.com/mrss/" xmlns:sy="http://purl.org/rss/1.0/modules/syndication/" version="2.0"> <channel> <title><![CDATA[MC Project]]></title> <description><![CDATA[Global digital products and freelance services. Focuses on development, production and distribution of programming scripts, application source code, plugins, themes and templates.]]></description> <image> <title><![CDATA[MC Project]]></title> <url>https://en.mycoding.id/favicon.ico</url> <link>https://en.mycoding.id/</link> </image> <category><![CDATA[Software Engineering, Website Development, Mobile Android App, Application Source Code, Programming Scripts]]></category> <link>https://en.mycoding.id/</link> <atom:link href="https://en.mycoding.id/rss.xml" rel="self" type="application/rss+xml"/> <atom:link href="https://en.mycoding.id/rss-videos.xml" rel="alternate" type="application/rss+xml"/> <atom:link href="https://en.mycoding.id/" rel="alternate" type="text/html"/> <pubDate>Tue, 06 Oct 2026 04:39:01 +0700</pubDate> <lastBuildDate>Tue, 06 Oct 2026 04:39:01 +0700</lastBuildDate> <sy:updatePeriod>hourly</sy:updatePeriod> <sy:updateFrequency>1</sy:updateFrequency> <managingEditor>support@mycoding.id (Adi Gunawan)</managingEditor> <webMaster>support@mycoding.id (Adi Gunawan)</webMaster> <language>en_US</language> <copyright>MC Project</copyright> <generator>MC Project</generator> <item> <title><![CDATA[Resurrecting iChat Audio and Video Conferencing]]></title> <description><![CDATA[Resurrecting iChat Audio and Video Conferencing. Comments]]></description> <media:thumbnail url="https://blog.pipetogrep.org/images/ichatav_screen_marketing.png"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/resurrecting-ichat-audio-and-video-conferencing-71184</link> <content:encoded><![CDATA[<div> <div><p>Published on: 2026-09-11 12:36:14 by <strong>Chris Jones</strong></p><p>Updated on: 2026-10-05 20:15:16 &bull; 7 min read</p></div> <p>Add this to your /etc/hosts document on your old Mac operating Leopard or Show Leopard (has not been tested on Tiger or Panther), and iChat have to be capable to create audio and video calls again. This assumes your router does port-preserving NAT (most do).</p> <pre>157.230.2.213 configuration.apple.com </pre> <p>Do note that if you are on a BSD based router akin pfSense or OPNsense, you volition need to allow origin harbor conservation in your outbound NAT settings.</p> <p>I used to be the most annoying benevolent of Apple zealot. In the first 2000s, I idea everything Apple had was improved than item alternatively out there whether it was true or not. There was one location that it was true, however, and that was in the realm of video and audio conferencing in the first 2000s.</p> <p>The big players for person flat video conferencing at the period were Microsoft alongside MSN Messenger, Yahoo! alongside Yahoo! Messenger, and AOL alongside AOL Instant Messenger (AIM). Then at Apple's World Wide Developer Conference (WWDC) in June of 2003, alongside alongside the G5 processor and OS X 10.3 panther, Apple announced "iChat AV".</p> <p><a href="https://en.mycoding.id/category/technology" target="_blank"><img src="https://blog.pipetogrep.org/images/ichatav_screen_marketing.png" alt="iChat AV Marketing Screenshot"></a></p> <p>They additionally announced this gorgeous over-engineered webcam to go alongside alongside it called the "iSight".</p> <p><a href="https://en.mycoding.id/category/technology" target="_blank"><img src="https://blog.pipetogrep.org/images/isight.jpg" alt="Original iSight Webcam"></a></p> <p>I really had a G4 laptop and an iSight. It felt akin living in the forthcoming and I loved it. This article is concerning how I got iChat's video conferencing on first OS X operating complete the Internet again to relive several of that fun.</p> <p>In first 2023, my companion (will be referred to as "Methodius") and I decided to fair try it and see what would happen. We tried to test a uncomplicated iChat audio call on OS X Leopard. That type of iChat plant alongside XMPP (Jabber) servers, so we all set it up alongside an document on <a href="https://en.mycoding.id/category/technology" target="_blank">jabb.im</a>, and pressed the green call button. It rang for the another party, it stated it was trying to connect, and then...failed to connect.</p> <p>It's never that easy.</p> <p>Time to do several traffic inspection alongside tcpdump. Thankfully, that comes pre-installed on OS X from rear afterward so I didn't have to instal item extra. Along alongside the packet inspection, I additionally ran iChat in debug manner by launching it in the terminal akin this:</p> <pre>/Applications/iChat.app/contents/MacOS/iChat -errorLogLevel 7 </pre> <p>iChat's debug manner was extremely helpful and barely documented anywhere, so now it lives current if I always need to appearance it up again.</p> <ol> <li>iChat makes an http petition to http://configuration.apple.com/configurations/macosx/ichat/1/snatmap.txt to get the location of an SNATMAP server.</li> <li>iChat makes a UDP petition to that SNATMAP server to get its own community IP address.</li> <li>iChat on the two ends afterward exchanges their community IPs and ports via their content communication conduit (XMPP in our case).</li> <li>iChat on the two ends afterward attempts to set up a peer-to-peer RTP association by blasting packets to all complete over the community IPs and ports earlier discovered via the SNATMAP server. Since NAT connections are stateful, and outbound NAT connections open an inbound association to the device making the request, iChat rearward NAT routers are capable to nexus alongside all another without the need to set up NAT harbor forwarding onward of time.</li> </ol> <ol> <li>iChat attempted to create an http petition to http://configuration.apple.com/configurations/macosx/ichat/1/snatmap.txt but got redirected to https which it could not nexus to since OS X's TLS suite is too old.</li> <li>iChat unsuccessful to complete that request, so alternatively of exchanging our community IPs, they exchanged personal LAN IPs instead, which evidently unsuccessful to nexus complete NAT.</li> </ol> <p>The https URL is motionless up at the period of penning this, however, and really contains something!</p> <pre>snatmap://snatmap.apple.com:5678 </pre> <p>OK, NP. I set up my own uncomplicated web server, hosted that document myself, update OS X's /etc/hosts document to item configuration.apple.com to an IP of my choosing. Ran it and...still nothing.</p> <p>Apple's SNATMAP server doesn't react anymore. At this point, we were at a deceased end since we had no idea how this SNATMAP server worked or how iChat expects to communicate alongside it. We learned a lot but ended in failure.</p> <p>Methodius and I decide to try again in summer 2026, but this period alongside a small LLM assistance. With our previous network captures, we were capable to use an LLM to reverse engineer iChat's video conferencing example and fig out what the petition to the SNATMAP server looks akin and what iChat expects as a response. From that, we were capable to create a specification document of the SNATMAP protocol.</p> <p>Even although I didn't have the cognize how to decompile iChat, peruse the gathering code, and them create awareness of it, I can at smallest study how to compose a uncomplicated UDP server from the spec document the LLM generated.</p> <p>I'm a systems engineer and admin by trade. I instal and configure servers, but I've never written a server of my own before. Turns out, this SNATMAP server made for a awesome archetypal server to custom with.</p> <p>The protocol:</p> <ol> <li>Communicates complete UDP on harbor 5678</li> <li>The petition packet contains four sectors in 16 bytes. <ol> <li>Type ("1" for request)</li> <li>Nonce (random figure used to equivalent a petition alongside a response)</li> <li>client local IP (unused)</li> <li>client local harbor (unused)</li> </ol> </li> <li>The reply packet contains four sectors in 16 bytes <ol> <li>Type ("2" for response)</li> <li>Nonce (the identical random figure from the request)</li> <li>External IP from the UDP request</li> <li>The external harbor from the UDP request</li> </ol> </li> </ol> <p>Links for the spec document and origin code to the SNATMAP server are at the end of this post</p> <p>Since Methodius has kids and, as a result, has much small liberated period than I do, I needed a way to test how iChat plant throughout the Internet by myself. Since I don't have two distinct ISP connections to perform with, I decided to build an "Internet" in a lab. This was achieved by operating two NAT routers (OpenWrt) as virtual machines operating on a KVM presenter (Proxmox) that traversed a flat network area acting as the "Internet". Then I physically hooked two Macs up to the bodily KVM presenter (via USB NICs) anywhere the VM routers assigned them IP addresses in their own personal LAN rearward a NAT. Then on the "Internet" network, I had the Jabber (ejabberd), web (lighttpd), and SNATMAP servers operating in a Debian Linux VM.</p> <p>Here it is diagrammed alongside pictures of the bodily setup alongside the Proxmox Server (the Thinkpad laptop) and the two Macs hooked up to it. <a href="https://en.mycoding.id/category/technology" target="_blank"><img src="https://blog.pipetogrep.org/images/ichat_diagram.png" alt="iChat Diagram"></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><img src="https://blog.pipetogrep.org/images/ichat_lab1.jpg" alt="iChat Lab 1"></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><img src="https://blog.pipetogrep.org/images/ichat_lab2.jpg" alt="iChat Lab 2"></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><img src="https://blog.pipetogrep.org/images/ichat_lab3.jpg" alt="iChat Lab 3"></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><img src="https://blog.pipetogrep.org/images/ichat_lab4.jpg" alt="iChat Lab 4"></a></p> <p>With this, I was capable to test and iterate quickly.</p> <p>The spec document can be used to create your own type of the server if you so desire. The origin code was hand written in Python from the spec document and is prepared to run on fair concerning any OS that can run Python 3.</p> <ul> <li><a href="https://en.mycoding.id/category/technology" target="_blank">Spec File</a></li> <li><a href="https://en.mycoding.id/category/technology" target="_blank">Source Code</a></li> </ul> <p>If you desire to oneself host, be certain you have a web server configured to answer requests to configuration.apple.com and have it assist snatmap.txt from the path</p> <pre>/configurations/macosx/ichat/1/snatmap.txt </pre> <p>In snatmap.txt create it contain</p> <pre>snatmap://YOUR_SERVER_IP:5678 </pre> <p>replacing YOUR_SERVER_IP alongside the community IP location of the server the SNATMAP server is operating on.</p> <p>Or you can fair use my server! I keeping it operating for the 1-5 group remaining in the earth that desire to video conversation using the ancient software. :D</p> <p>On your old mac operating OS X Leopard or Snow Leopard (might activity on older but not tested), fair act this into your /etc/hosts file.</p> <pre>157.230.2.213 configuration.apple.com </pre> <p>Then have the companion you desire to call do the same. After that, mash that green call button!</p> <p>It's true! You can equal use a fairly contemporary Logitech webcam. I tested on OS X Leopard alongside a Logitech C920.</p> <p>Here is a screenshot of Methodius and I chatting complete the genuine Internet alongside iChat AV. <a href="https://en.mycoding.id/category/technology" target="_blank"><img src="https://blog.pipetogrep.org/images/ichatav_screen_real.png" alt="iChat AV Screenshot Real"></a></p> <p>Enjoy and blessed chatting!</p> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/resurrecting-ichat-audio-and-video-conferencing-71184</guid> <pubDate>Tue, 06 Oct 2026 04:39:01 +0700</pubDate> <author><![CDATA[support@mycoding.id (Mira Azkia)]]></author> </item> <item> <title><![CDATA[Why Common Lisp is now the best programming language]]></title> <description><![CDATA[Why Common Lisp is now the best programming language. Comments]]></description> <media:thumbnail url="https://en.mycoding.id/site/assets/img/og-image.png"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/why-common-lisp-is-now-the-best-programming-language-71185</link> <content:encoded><![CDATA[<div><p>Would you concur that several programming languages are improved than others? If so afterward one of them must be the best. And it&rsquo;s really Common Lisp particularly now that LLMs can compose code.</p> <p>LLMs compose code really fast, and that changes a lot, since penning code used to be the dilatory part. Now the dilatory part is finding out if your program really works, and before you can do that you have to rebuild it, which can obtain a few minutes.</p> <p>When humans wrote the code this didn't matter much, since penning took way longer than waiting for it to compile and commencement running. But now it does, so how lengthy your feedback iteration takes is what decides how accelerated you can build.</p> <p>In Common Lisp that iteration nearly doesn't be since there is no genuine difference between read-time, compile-time, and runtime (Graham). Common Lisp is image-based which method that your program is a live depiction in memory, so a new type of a function replaces the old one correct distant without having to restart anything.</p> <p>Also, in most languages an error volition collision your program. So if you&rsquo;re penning code alongside an LLM it volition have to peruse your collision logs to create several changes and run your program again. In Common Lisp your program won&rsquo;t crash, it&rsquo;ll halt and open a debugger alongside the entire stack and all the variables. You can fair item your LLM at the debugger, and it&rsquo;ll create its fix and resume the program.</p> <p>To my cognition Common Lisp is the lone mainstream tongue that does all of this.</p> <p>Lisp stands for "List Processing." In Common Lisp, code is written as lists. For example, (+ 1 2) is a program that adds two numbers, but it's additionally fair a catalog of three things: the sign +, and the numbers 1 and 2.</p> <p>What's engaging is that this is the identical benevolent of catalog Common Lisp uses to shop data, and since the tongue is built about handling lists all its tools for operating alongside data additionally activity on code. So a program can obtain another program and alter it, for example it can rotate (+ 1 2) into (* 1 2), and run the outcome correct away.</p> <p>This is what makes macros possible. A macro is a function that takes your code and returns new code in its place, that method you can add new constructs to the tongue itself.</p> <p>Once you can add to the language, you can build it up toward your problem. So in Lisp you don't fair compose a program, you compose a tongue for your domain and afterward compose the program in it.</p> <p>That matters a lot additional now, since what makes a program precious is the opinions rearward it. And we're heading toward a earth anywhere application companies let their users alter the merchandise themselves, since alongside an LLM that's easy. So if a business builds a fine assertive domain tongue for its product, everything its users build on top of it volition be much better, since they commencement from the company's opinions and not from scratch.</p> <p>Take an ERP. Every business runs a small differently, so nearly everyone ends up needing to alter it. But if the ERP is written in its own domain language, you can fair ask an LLM to create the alter in that language. The alter volition naturally prosecute the domain language&rsquo;s underlying opinions, so it fits the merchandise alternatively of breaking it.</p> <p>And it's not fair better, it's additionally cheaper. Lisp programs are frequently much additional concise since macros let you theoretical distant recurring patterns and create them part of the tongue itself. So the bigger the program gets, the bigger the difference. In my own cognition the apps I've built in Common Lisp end up concerning six to seven times shorter than the Python versions.</p> <p>For LLMs, small code method small tokens, and tokens are what you pay for so you expend small on development.</p> <p>It additionally method a bigger part of your program can fit in the LLM's environment window. If your LLM has your complete program in its environment opening afterward it has a complete perspective of your intent, which leads to it making improved decisions. In my cognition a lot of LLM bugs stem from it changing one part of my program without seeing the rest. So alongside Common Lisp that happens small often.</p> <p>Common Lisp is an ANSI norm and it hasn't been updated since 1994. I akin this feature. And going rear to our ERP example, if your users alter the merchandise themselves, that's exactly what you desire since the tongue underneath never moves and nothing they build on top of it always breaks.</p> <p>When you compose a program in Common Lisp you frequently won&rsquo;t be capable to discover a archive you need. Quicklisp, the chief Common Lisp bundle manager, has a brace thousand projects during npm has millions.</p> <p>But I don't think that's a issue anymore. Most programs today depend on millions of lines of code from packages that keep getting compromised. You don&rsquo;t desire that in yours. Also, alongside an LLM you could fair compose the part you need yourself or harbor the entire archive &mdash; and LLMs appear to be really fine at porting code.</p> <p>Lastly, I'm seeing now that a lot of group are programming now in the anticipation of construction a business. An apparent exception to construction products in Common Lisp is that you&rsquo;ll have a difficult period finding engineers since so few group cognize how to program in it.</p> <p>But I don't think that really matters now. If you desire to build a prosperous business you desire to employ the finest specialized people: the ones who are really fine at learning new things. So in your coding interviews fair create them study Common Lisp, and there you go. You'll see how accelerated group choice things up, and the ones who do fine volition likely keep learning it and get really fine at it.</p> <p>In conclusion, next period you desire to compose a program use Common Lisp.</p> <hr> <p>Works Cited</p> <p>Graham, Paul. "What Made Lisp Different." Paul Graham, May 2002, paulgraham.com/diff.html. Accessed 5 Oct. 2026.</p></div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/why-common-lisp-is-now-the-best-programming-language-71185</guid> <pubDate>Tue, 06 Oct 2026 03:51:51 +0700</pubDate> <author><![CDATA[support@mycoding.id (Mira Azkia)]]></author> </item> <item> <title><![CDATA[How to prepare for agentic commerce in 9 steps]]></title> <description><![CDATA[How to prepare for agentic commerce in 9 steps. To prepared for agentic commerce – the change anywhere AI agents discover, compare, and choose products on a shopper’s behalf, [...] Read More... The article How to pre...]]></description> <media:thumbnail url="https://www.hostinger.com/tutorials/wp-content/uploads/sites/2/2026/10/1791254468650-0.jpeg"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/how-to-prepare-for-agentic-commerce-in-9-steps-71182</link> <content:encoded><![CDATA[<div> <div> <p> Oct 06, 2026 </p> <p>/</p> <p> By Bruno S. </p> <p>/</p> </div> <p>10 min Read </p> </div> <p>To prepared for agentic commerce &ndash; the change anywhere AI agents discover, compare, and choose products on a shopper&rsquo;s behalf, frequently alongside small manual browsing &ndash; you need to create your merchandise data readable to AI assistants. </p><p>These assistants peruse your fields, descriptions, and policies whenever they difference products on a shopper&rsquo;s behalf, fairly than your leaf scheme or photography. What they can peruse determines what they recommend.</p><p>Each stage for preparing for agentic ecommerce targets a particular part of your merchandise data, and most affect no specialized setup:</p><ol> <li>Fill merchandise identifier sectors specified as brand name, barcode, and merchandise code</li> <li>Write descriptions alongside particular attributes, not promotion copy</li> <li>Verify what your storefront&rsquo;s organized data outputs</li> <li>Give all merchandise type its own image</li> <li>Sync pricing and preparedness throughout all storefronts</li> <li>State shipping, tax, and come back conditions as particular numbers</li> <li>Simplify checkout: visitant access, fee logos, no astonishment costs</li> <li>Format assistance and guideline pages for straightforward extraction by assistants</li> <li>Monitor how assistants depict your shop monthly</li> </ol><p>For agentic commerce, five parts of your shop are particularly important: complete merchandise data, apparent rely signals specified as reviews and come back policies, exact inventory, a checkout prepared to obtain payment, and a leaf construction assistants can parse. </p><p>A gap in any of them gives an aide a logic to propose another store.</p><h2 id="h-1-fill-every-product-identifier-field-your-platform-offers">1. Fill all merchandise identifier site your phase offers</h2><p>Enter your product&rsquo;s brand, identifier codes, and key attributes as dedicated sectors in your merchandise editor: AI assistants acknowledge products from form fields, not from the paragraph content in the description.</p><p>Three identifiers are particularly important:</p><ul> <li><strong>Global Trade Item Number (GTIN).</strong> Also called Universal Product Code (UPC) or European Article Number (EAN), this is the barcode figure printed on retailing packaging. Assistants use it to equivalent the identical merchandise throughout multiple retailers.</li> <li><strong>Manufacturer Part Number (MPN).</strong> The code the creator assigns to a particular item. Required alongside the brand whenever a GTIN doesn&rsquo;t exist.</li> <li><strong>Stock Keeping Unit (SKU).</strong> Your own inner citation code. Assistants use it to recover the exact type a shopper asked about.</li> </ul><p>Handmade, custom, and own-brand products mostly don&rsquo;t necessitate a GTIN. The identifier gap matters most for resellers operating alongside existing tagged inventory.</p><p>Fill all identifier site your phase provides. A blank site gives the aide small to activity alongside than a competitor&rsquo;s filled one.</p><p>With no brand field, the merchandise heading is the lone location a brand can appear. A heading that says &ldquo;Decorative Candle Lantern&rdquo; gives an aide nothing, but &ldquo;LuminaTerra Candle Lantern Brass&rdquo; gives the aide the brand, the merchandise type, and the key attribute.</p><div> <figure data-wp-context='&quot;6ac46f59185ed&quot;}' data-wp-interactive="core/image" data-wp-key="6ac46f59185ed"><img decoding="async" data-wp-class--hide="state.isContentHidden" data-wp-class--show="state.isContentVisible" data-wp-init="callbacks.setButtonStyles" data-wp-on--click="actions.showLightbox" data-wp-on--load="callbacks.setButtonStyles" data-wp-on--pointerdown="actions.preloadImage" data-wp-on--pointerenter="actions.preloadImageWithDelay" data-wp-on--pointerleave="actions.cancelPreload" data-wp-on-window--resize="callbacks.setButtonStyles" src="https://www.hostinger.com/tutorials/wp-content/uploads/sites/2/2026/10/1791254468650-0.jpeg" alt='Infographic showing a vague merchandise heading (&quot;Decorative Candle Lantern&quot;) versus a particular one (&quot;LuminaTerra Candle Lantern Brass&quot;), alongside annotations labelling Brand, Product type, and Key trait from remaining to right, and the equation Brand + Product category + Key trait shown below'></figure> </div><h2 id="h-2-write-product-descriptions-that-include-specifics">2. Write merchandise descriptions that contain specifics</h2><p>Write a merchandise clarification that is helpful to an AI aide by naming the attributes a shopper can display by: material, dimensions, compatibility, what&rsquo;s included, and attention requirements.</p><p>Generic, marketing-focused copy is the default in most ecommerce descriptions, but &ldquo;Adds a heated and inviting glow to any space&rdquo; tells an aide nothing it can equivalent to a query. </p><p>On the another hand, &ldquo;Solid brass, 28 cm tall, fits a norm tea light, suitable for indoor use&rdquo; answers four distinct natural-language questions in one sentence.</p><figure tabindex="0"><table readabilitydatatable="0"><tbody><tr><td colspan="1" rowspan="1"></td><td colspan="1" rowspan="1"><p><strong>Description</strong></p></td></tr><tr><td colspan="1" rowspan="1"><p><strong>Vague</strong></p></td><td colspan="1" rowspan="1"><p><span>&ldquo;A beautifully crafted lantern that creates a stunning ambiance anywhere you location it. Perfect for cozy evenings and stylish decor accents.&rdquo;</span></p></td></tr><tr><td colspan="1" rowspan="1"><p><strong>Specific</strong></p></td><td colspan="1" rowspan="1"><p><span>&ldquo;Solid brass lantern, 28 cm tall, 14 cm wide. Fits one norm tea light. Suitable for indoor and sheltered outdoor use. Candle included.&rdquo;</span></p></td></tr></tbody></table></figure><p>One difficult rule: the clarification must equivalent the merchandise leaf exactly. A clarification that says &ldquo;comes in three colors&rdquo; whenever lone one is accessible causes the aide to citation incorrect information. Mismatches between description, title, and preparedness are a average logic listings are rejected by buying platforms, and a rely issue as well.</p><p>Some ecommerce platforms can outline a clarification from a merchandise photo, which saves time. Use the generated clarification as a starting point, afterward add the specifics an aide needs: dimensions, materials, compatibility, and what&rsquo;s included.</p><h2 id="h-3-check-the-structured-data-your-store-already-publishes">3. Check the organized data your shop already publishes</h2><p>Check your storefront&rsquo;s organized data to see which merchandise properties AI assistants can peruse &ndash; and which are missing.</p><p>Most ecommerce platforms create this markup automatically whenever you<a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener noreferrer nofollow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noreferrer noopener follow" data-wpel-link="internal">make an ecommerce website</a>: hidden, machine-readable code that AI crawlers use to extract merchandise facts without parsing the leaf the way a individual would.</p><p>Run this inspect for all of your storefronts:</p><ol> <li>Open a merchandise leaf in your browser.</li> <li>Copy the complete Uniform Resource Locator (URL).</li> <li>Go to<a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="external" target="_blank" rel="noopener noreferrer nofollow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="external" target="_blank" rel="noopener noreferrer nofollow">Google&rsquo;s Rich Results Test</a> and paste the URL.</li> <li>Click <strong>Test URL</strong>.</li> <li>Expand <strong>Product snippets</strong> and <strong>Merchant listings</strong> to see which properties are current and which are flagged as missing.</li> </ol><div> <figure data-wp-context='&quot;6ac46f5918bd4&quot;}' data-wp-interactive="core/image" data-wp-key="6ac46f5918bd4"><img decoding="async" data-wp-class--hide="state.isContentHidden" data-wp-class--show="state.isContentVisible" data-wp-init="callbacks.setButtonStyles" data-wp-on--click="actions.showLightbox" data-wp-on--load="callbacks.setButtonStyles" data-wp-on--pointerdown="actions.preloadImage" data-wp-on--pointerenter="actions.preloadImageWithDelay" data-wp-on--pointerleave="actions.cancelPreload" data-wp-on-window--resize="callbacks.setButtonStyles" src="https://www.hostinger.com/tutorials/wp-content/uploads/sites/2/2026/10/1791254473076-0.png" alt="Google Rich Results Test outcome for a Hostinger Ecommerce merchandise leaf showing one valid Product item detected, alongside optional aggregateRating and assessment sectors flagged as missing and detected properties including type, name, brand, and description"></figure> </div><div> <p>Run the test on all storefront separately. Different storefronts on the identical catalog can emit distinct markup, and a misconfigured storefront volition silently emit small without showing any apparent error in your dashboard.</p> </div> <p>Collecting client reviews populates the assessment and ranking properties: your phase (or a assessment app) handles the specialized formatting automatically formerly reviews are in place. </p><p>For shipping and come back data, not all platforms create this automatically; anywhere they don&rsquo;t, you need to compose those conditions in plain, straightforward language.</p><p>The identical organized data that helps assistants additionally improves how hunt engines indicator your merchandise pages, giving this stage twice value in<a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener noreferrer nofollow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noreferrer noopener follow" data-wpel-link="internal">Search Engine Optimization (SEO) for ecommerce</a>.</p><p>Flag any asset listed as optional but missing. Optional to a hunt motor doesn&rsquo;t average optional to an aide comparing your recommendation against ten others.</p><div> <p><a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow">Hostinger Ecommerce</a>, Hostinger's phase for managing products, orders, and payments from one dashboard, generates this organized data automatically. Details akin merchandise name, description, image, price, and preparedness attain the markup without any code.</p> </div> <h2 id="h-4-match-product-images-to-the-exact-variant">4. Match merchandise images to the exact variant</h2><p>Each merchandise type needs its own depiction showing that exact version. That depiction URL gets written into your organized data as a data field, the identical as cost or SKU. So a generic photo on a color-specific leaf isn&rsquo;t fair a ocular mismatch &ndash; it&rsquo;s incorrect data in the markup itself.</p><p>An aide looking for &ldquo;a dreary brass lantern&rdquo; extracts the depiction URL as part of the merchandise data it reads. A URL pointing to the aureate type causes the aide to emblem the mismatch or skip the merchandise entirely.</p><p>The applicable standard: one photo per variant, showing that particular type against the identical backdrop and at the identical viewpoint as your another merchandise shots. </p><p>Change the depiction whenever the color, size, or matter changes. Consistent framing additionally looks additional expert whenever multiple products appear together in hunt results or buying feeds.</p><h2 id="h-5-keep-pricing-and-stock-levels-accurate-across-channels">5. Keep pricing and inventory levels exact throughout channels</h2><p>Price and preparedness must equivalent everywhere: your merchandise editor, your storefront, and the organized data your phase emits. If an aide quotes a cost or inventory position your shop can&rsquo;t honor, you endure the two the transaction and the shopper&rsquo;s trust.</p><div> <p><span> <svg width="24" height="24" viewbox="0 0 24 24" fill="none" xmlns="http://www.w3.org/2000/svg"> <path fill-rule="evenodd" clip-rule="evenodd" d="M12 22.5C17.799 22.5 22.5 17.799 22.5 12C22.5 6.20101 17.799 1.5 12 1.5C6.20101 1.5 1.5 6.20101 1.5 12C1.5 17.799 6.20101 22.5 12 22.5ZM13.637 7.65198C13.637 6.74791 12.9041 6.01501 12 6.01501C11.0959 6.01501 10.363 6.74791 10.363 7.65198C10.5335 9.53749 10.875 13.383 10.875 13.383C10.875 14.0043 11.3787 14.508 12 14.508C12.6213 14.508 13.125 14.0043 13.125 13.383V13.38L13.637 7.65198ZM11.9927 15.714C11.3714 15.714 10.8677 16.2177 10.8677 16.839C10.8677 17.4603 11.3714 17.964 11.9927 17.964H12.0073C12.6286 17.964 13.1323 17.4603 13.1323 16.839C13.1323 16.2177 12.6286 15.714 12.0073 15.714H11.9927Z" fill="#FEA419"></path> </svg> Important </span></p><p> Hostinger Ecommerce ships alongside <strong>Track quantity</strong> switched off by default on new products. With tracking off, the storefront continually shows as in inventory despite of your genuine inventory. Switch it on for all bodily merchandise and act your beginning amount before going live. </p></div><p>Availability in organized data is expressed as a particular value: <strong>in_stock</strong>, <strong>out_of_stock</strong>, <strong>preorder</strong>, or <strong>backorder</strong>. </p><p>&ldquo;In stock&rdquo; method orderable now, not &ldquo;I&rsquo;ll inspect whenever an command comes in.&rdquo; Use the accurate value for all product&rsquo;s current state.</p><p>Products can additionally be energetic on one storefront and idle on another, since visibility is per product, per conduit &ndash; inspect all storefront fairly than assuming they match. Drift between channels is among the most average causes of cost and preparedness mismatches in organized data.</p><p>Currency codes must be in uppercase ISO 4217 format: USD, not usd. Assistants parsing organized data anticipate the norm format. </p><p>Also, use the prosperity that matches the nation of sale. </p><div> <p>Hostinger Ecommerce manages your catalog from a sole dashboard, so a cost alter made formerly reaches all storefront anywhere the merchandise is active. From the Growth scheme up, inventory levels are centralized throughout storefronts too.</p> </div> <h2 id="h-6-make-shipping-tax-and-return-terms-specific-and-checkable">6. Make shipping, tax, and come back conditions particular and checkable</h2><p>Publish your shipping cost, tax handling, and come back opening as particular numbers, since AI assistants difference products on a landed disbursal basis: cost affirmative shipping affirmative tax. Without all three figures, the aide either excludes your recommendation from the difference or shows an incomplete price.</p><p>Return conditions activity the identical way. &ldquo;Can I come back this?&rdquo; is a average follow-up question, and an aide can recover a particular answer from a plainly written come back policy. &ldquo;Contact us for details&rdquo; is not an answer it can provision a shopper.</p><p>Your come back guideline needs four facts, stated plainly:</p><ul> <li>How lengthy following acquisition returns are accepted (e.g., 30 days from delivery)</li> <li>Whether come back shipping is liberated or charged to the customer</li> <li>The circumstance the item must be in (e.g., unopened, undamaged)</li> <li>How the refund is issued and how lengthy it takes</li> </ul><p>Configure tax settings and checkout policies alongside exact numbers &ndash; an aide comparing your recommendation against alternatives needs those figures. For bodily products, a shipping integration alongside genuine transporter rates is additional helpful than a &ldquo;calculated at checkout&rdquo; placeholder that an aide can&rsquo;t activity with.</p><div> <p><span> <svg width="24" height="24" viewbox="0 0 24 24" fill="none" xmlns="http://www.w3.org/2000/svg"> <path fill-rule="evenodd" clip-rule="evenodd" d="M12 22.5C17.799 22.5 22.5 17.799 22.5 12C22.5 6.20101 17.799 1.5 12 1.5C6.20101 1.5 1.5 6.20101 1.5 12C1.5 17.799 6.20101 22.5 12 22.5ZM13.637 7.65198C13.637 6.74791 12.9041 6.01501 12 6.01501C11.0959 6.01501 10.363 6.74791 10.363 7.65198C10.5335 9.53749 10.875 13.383 10.875 13.383C10.875 14.0043 11.3787 14.508 12 14.508C12.6213 14.508 13.125 14.0043 13.125 13.383V13.38L13.637 7.65198ZM11.9927 15.714C11.3714 15.714 10.8677 16.2177 10.8677 16.839C10.8677 17.4603 11.3714 17.964 11.9927 17.964H12.0073C12.6286 17.964 13.1323 17.4603 13.1323 16.839C13.1323 16.2177 12.6286 15.714 12.0073 15.714H11.9927Z" fill="#FEA419"></path> </svg> Important </span></p><p> In Hostinger Ecommerce, shipping and come back conditions pertain in the <strong>Additional info </strong>sections on the merchandise editor. Write them as straightforward lines alongside exact numbers fairly than paragraphs, one fact per line, so an aide can peruse them clearly. </p></div><h2 id="h-7-remove-friction-from-checkout-and-payment">7. Remove conflict from checkout and payment</h2><p>To eliminate conflict from checkout, recommendation recognized fee methods, skip forced document creation, and keep the way to acquisition short. </p><p>The foremost agentic commerce stream today is aide recommends, shopper clicks through and buys in your shop &ndash; so checkout is anywhere that advice either becomes a transaction or falls apart.</p><p>Many of these shoppers browse on smartphones and tablets, so the principles of<a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener noreferrer nofollow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noreferrer noopener follow" data-wpel-link="internal">ecommerce for mobile devices</a> use directly: thumb-friendly buttons, one-column layout, and autofill assistance on location and cardstock fields.</p><p>Three things to check:</p><ul> <li><strong>Guest checkout on.</strong> Mandatory document innovation causes 19% of shoppers to autumn out of checkout, according to<a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="external" target="_blank" rel="noopener noreferrer nofollow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="external" target="_blank" rel="noopener noreferrer nofollow">Baymard Institute&rsquo;s checkout research</a>. Shoppers arriving from an aide have already made a decision, and additional conflict at the fee stage cancels that.</li> <li><strong>Payment logos apparent before checkout.</strong> Digital wallets made up 56% of earth ecommerce transaction value in 2025, according to Hostinger&rsquo;s<a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow">ecommerce statistics</a>, so display Apple Pay and Google Pay alongside Visa, Mastercard, and PayPal. Recognized logos on the merchandise leaf act as rely signals before the shopper clicks.</li> <li><strong>No astonishment expenses at the final step.</strong> Any shipping accusation or tax not shown on the merchandise leaf creates a gap between what the aide quoted and what the checkout shows.</li> </ul><p>As of March 2026, shoppers arriving from AI assistants change 42% improved than another visitors, expend 48% additional period on site, and browse 13% additional pages per visit, according to<a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="external" target="_blank" rel="noopener noreferrer nofollow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="external" target="_blank" rel="noopener noreferrer nofollow">Adobe&rsquo;s AI traffic research</a>.</p><h2 id="h-8-write-support-content-as-direct-answers">8. Write assistance satisfied as straightforward answers</h2><p>Write assistance satisfied that AI assistants can reliably peruse following this format: a inquiry as a heading alongside the straightforward answer in plain prose below it &ndash; nothing hidden rearward tabs or accordions.</p><p>An AI aide answering a follow-up inquiry volition appearance at your Frequently Asked Questions (FAQ) and guideline pages, and it can young female satisfied hidden rearward JavaScript accordions, expandable tabs, or nested navigation menus.</p><p>The identical construction that helps assistants additionally improves<a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener noreferrer nofollow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noreferrer noopener follow" data-wpel-link="internal">ecommerce client experience</a> broadly: accessible, exact assistance satisfied reduces pre-purchase questions despite of what conduit sends traffic.</p><p>Keep all answer to one or two sentences. One inquiry per heading, one idea per answer. Don&rsquo;t inter the answer three paragraphs down.</p><p>Split policies throughout distinct pages fairly than combining them into one lengthy content obstacle &ndash; shipping, returns, warranty, and sizing all pertain on their own page. Each guideline leaf should state: who it applies to, the particular opening or cost, and the process, in that order.</p><p>For products alongside a lot to explain, add a abbreviated FAQ division immediately on the merchandise page: questions concerning fit, compatibility, care, and materials let an aide answer follow-up questions without redirecting the shopper. A shopper who gets a helpful answer stays in the purchasing flow.</p><h2 id="h-9-track-how-ai-assistants-find-and-describe-your-products">9. Track how AI assistants discover and depict your products</h2><p>The most dependable way to track how AI assistants depict your shop is to open ChatGPT, Gemini, and Copilot and ask the benevolent of inquiry a client would ask concerning your category, afterward inspect whether your merchandise appears and whether the particulars are accurate.</p><div> <p>Make this a monthly habit and keep a operating note of the results. Changes in how an aide describes your products normally trace rear to a latest alter in your organized data or merchandise feed; a abbreviated log makes that trace fast.</p> </div> <p>When you do appear, inspect the specifics: the quoted price, preparedness status, and any attributes the aide mentions. Accurate particulars verify your organized data is operating correctly; incorrect particulars average the aide established a old or incorrect source, and you need to fix item in your merchandise editor.</p><p>Re-run the Rich Results Test on your merchandise pages following any important catalog update. Structured data drifts whenever sectors change, and a leaf that passed three months ago can display new gaps today.</p><p>For referral traffic, Google Analytics shows traffic origin breakdowns that contain AI referrals as they rotate into identifiable channels. Track this monthly and difference duration complete duration to see whether agent-referred visits are growing.</p><h2 id="h-what-makes-an-ecommerce-platform-agent-ready">What makes an ecommerce phase agent-ready</h2><p>To be agent-ready, a phase needs to encounter three baseline capabilities: it stores merchandise data formerly and pushes it to all storefront, it emits organized data automatically, and it keeps inventory and pricing in sync throughout all channel. Take attention of those three, and all aide study your catalog gets a consistent, up-to-date answer no matter anywhere it looked.</p><p>This architecture is called headless commerce. Product data lives in a chief backend; storefronts drag it on petition fairly than embed it in their leaf templates. That way, all aide indexing your catalog says from a consistent, up-to-date source.</p><p>The three capabilities in additional detail:</p><ul> <li><strong>One catalog, multiple storefronts.</strong> Product data updated in one location is reflected everyplace the catalog is published.</li> <li><strong>Automatic organized data output.</strong> Product pages emit valid organized data without the merchant having to compose any code.</li> <li><strong>Inventory in sync.</strong> Stock levels and pricing remain accordant throughout all connected storefronts.</li> </ul><h3>Is Hostinger Ecommerce prepared for agentic commerce?</h3><p>Hostinger Ecommerce covers the foundational<a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow">ecommerce website features</a> an agent-ready shop needs: a centralized catalog that feeds multiple storefronts, automatic organized data on Hostinger-hosted storefronts, and centralized inventory on Growth plans and above.</p><p>It additionally supports 100+ fee methods alongside no Hostinger phase transaction fees, although fee providers motionless accusation their norm handling fees.</p><p>Storefront options contain a quick-link shop you can portion instantly, a website built alongside Hostinger AI Builder via conversation or drag-and-drop, and a tradition frontend connected through the Hostinger Ecommerce Application Programming Interface (API). WordPress sites nexus through the <a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow">Hostinger Ecommerce plugin for WordPress</a>.</p><div> <figure data-wp-context='&quot;6ac46f5919c08&quot;}' data-wp-interactive="core/image" data-wp-key="6ac46f5919c08"><img decoding="async" data-wp-class--hide="state.isContentHidden" data-wp-class--show="state.isContentVisible" data-wp-init="callbacks.setButtonStyles" data-wp-on--click="actions.showLightbox" data-wp-on--load="callbacks.setButtonStyles" data-wp-on--pointerdown="actions.preloadImage" data-wp-on--pointerenter="actions.preloadImageWithDelay" data-wp-on--pointerleave="actions.cancelPreload" data-wp-on-window--resize="callbacks.setButtonStyles" src="https://www.hostinger.com/tutorials/wp-content/uploads/sites/2/2026/10/1791254479069-0.jpeg" alt=" a quick nexus for instant sharing, an AI Builder website for a tagged store, and a tradition storefront via API, alongside the note that merchandise data updated formerly keeps all storefronts in sync"></figure> </div><figure><a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noreferrer noopener follow" data-wpel-link="internal"><img fetchpriority="high" decoding="async" width="1024" height="300" src="https://www.hostinger.com/tutorials/fit=scale-down" alt="" srcset="https://imagedelivery.net/LqiWLm-3MGbYHtFuUbcBtA/wp-content/uploads/sites/2/2023/02/eCommerce-hosting_in-text-banner.png/w=1024,fit=scale-down 1024w, https://imagedelivery.net/LqiWLm-3MGbYHtFuUbcBtA/wp-content/uploads/sites/2/2023/02/eCommerce-hosting_in-text-banner.png/w=300,fit=scale-down 300w, https://imagedelivery.net/LqiWLm-3MGbYHtFuUbcBtA/wp-content/uploads/sites/2/2023/02/eCommerce-hosting_in-text-banner.png/w=150,fit=scale-down 150w, https://imagedelivery.net/LqiWLm-3MGbYHtFuUbcBtA/wp-content/uploads/sites/2/2023/02/eCommerce-hosting_in-text-banner.png/w=768,fit=scale-down 768w" sizes=" 1024px) 100vw, 1024px"></a></figure><h2 id="h-common-agent-assisted-selling-mistakes">Common agent-assisted marketing mistakes</h2><p>The most average failure: an aide recommends a cost or inventory position your shop can&rsquo;t honor, since the underlying data was out of date. The aide lone peruse what you published &ndash; so the fix is in your merchandise editor, not the assistant.</p><p>A few another risks additionally apply:</p><ul> <li><strong>Stale data from dilatory nourish refreshes.</strong> Assistants cache merchandise data between crawls, so a cost alter may not be reflected on all exterior immediately. Frequent updates decrease the gap, but it won&rsquo;t be zero. This is a logic to update often, not to evade the channel.</li> <li><strong>Missing come back conditions generating a dispute.</strong> An aide that can&rsquo;t discover your come back guideline either goes silent or guesses. Either way, a shopper buys on assumption and disputes the accusation whenever the actuality doesn&rsquo;t match.</li> <li><strong>Consent and authorization.</strong> For agent-completed transactions, it&rsquo;s not continually apparent whether the merchant has authority from the genuine shopper. Most assistants currently dispatch the shopper to the merchant&rsquo;s checkout, anywhere consent is explicit. Staying in that example avoids most of this risk.</li> <li><strong>Impersonated crawlers.</strong> Not all bot claiming to be GPTBot or ClaudeBot is genuine. Legitimate AI crawlers publish their person agents and records publicly. Block bots that behave akin scrapers despite of what they assertion to be.</li> <li><strong>High-value purchases without individual oversight.</strong> Many shoppers motionless hesitate to let an AI delegate grip an costly or non-returnable acquisition commencement to finish. Making it uncomplicated to attain a individual gives them an exit that protects the two sides of the transaction.</li> </ul><h2 id="h-next-steps-for-an-agent-ready-store">Next steps for an agent-ready store</h2><p>Once your merchandise data is accurate, the next stage is making certain your shop converts the shoppers that assistants send. They attain already leaning toward a purchase, so the merchandise leaf has to verify that decision quickly. That&rsquo;s where<a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow">ecommerce conversion charge optimization strategies</a> obtain complete from data cleanup.</p><p>Checkout is the part of agentic commerce motionless taking shape. Following broader<a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow">ecommerce trends</a> helps you place whenever assistants commencement completing purchases themselves &ndash; and whenever they do, a spotless catalog is what lets your shop keep up.</p><p>Build the habit into how you add products fairly than treating it as a one-off project. Giving all new listing a formula-based title, filled identifiers, and plain guideline lines at innovation is far quicker than auditing a entire catalog afterward &ndash; and it&rsquo;s the difference between a shop assistants can shop confidently and one they skip.</p> <p> All of the tutorial satisfied on this website is topic to <a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow"> Hostinger's rigorous editorial standards and values. </a> </p> <div id="the-author-section"> <div> <p><img src="https://secure.gravatar.com/avatar/ce5a8db3450c6f1f5aa33e1abb91d299722a047e5628ed3b757f06be8bd66102?s=96&amp;d=mm&amp;r=g" alt="Author"> </p> </div> <p> Bruno is a Content Writer at Hostinger, focused on creating and optimizing helpful, engaging articles concerning web betterment and marketing. With a backdrop in journalism, he combines storytelling alongside applicable insights to create complex topics easier to understand. He has additionally contributed to publications akin MacMagazine and Jornal A Tarde. Outside of work, Bruno enjoys exploring art, cooking, and technology. </p> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/how-to-prepare-for-agentic-commerce-in-9-steps-71182</guid> <pubDate>Tue, 06 Oct 2026 03:45:51 +0700</pubDate> <author><![CDATA[support@mycoding.id (Bruno Santana)]]></author> </item> <item> <title><![CDATA[How to write a sales proposal in 6 steps]]></title> <description><![CDATA[How to write a sales proposal in 6 steps. To compose a revenue recommendation that gets signed, investigation the client and the agreement first; map your resolution to their [...] Read More... The article How to compose a revenue ...]]></description> <media:thumbnail url="https://www.hostinger.com/tutorials/wp-content/uploads/sites/2/2026/10/1791253716871-0.png"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/how-to-write-a-sales-proposal-in-6-steps-71183</link> <content:encoded><![CDATA[<div> <div> <p> Oct 06, 2026 </p> <p>/</p> <p> By Bruno S. </p> <p>/</p> </div> <p>12 min Read </p> </div> <p>To compose a revenue recommendation that gets signed, investigation the client and the agreement first; map your resolution to their particular problem; define the document structure; compose all division in the buyer&rsquo;s own words; assessment the outline before sending; and prepared a follow-up plan.</p><p>A revenue recommendation is a decision-making document. Its job is to demonstrate you understood the buyer&rsquo;s issue and can resolve it, not to catalog features or validate your prices. By the period the buyer reaches the final page, they should already cognize their answer.</p><p>There are six steps to penning a revenue recommendation that gets signed:</p><ol> <li>Gather your call notes, stakeholder details, and prosperity signals.</li> <li>Match all part of your recommendation to a issue the buyer named.</li> <li>Choose the sections the document needs, from administrator summary to next steps.</li> <li>Draft all division in the buyer&rsquo;s own language.</li> <li>Check names, figures, and claims against the pre-send checklist.</li> <li>Set your follow-up cadence before the recommendation goes out.</li> </ol><p>A signed recommendation additionally depends on additional than the writing: knowing whenever a citation or an evaluation fits better, avoiding the mistakes that descend alternatively firm proposals, starting from a proven template, and using specialized AI agents for the positioning, copy, lawful terms, and follow-up activity that occasional recommendation writers normally grip alone.</p><h2 id="h-what-is-a-sales-proposal">What is a revenue proposal?</h2><p>A revenue recommendation is a ceremonial document you dispatch following your first revenue conversations to grasp the buyer&rsquo;s circumstance in their own terms, current your recommended solution, and ask for a decision. Salespeople call those first conversations <strong>discovery</strong>: the calls anywhere the buyer explains the issue they desire solved and what is driving the decision.</p><p>A fine recommendation is particular adequate that the buyer knows it was written for them. It is not a catalog of everything your business offers.</p><p>A recommendation is <strong>solicited</strong> whenever a buyer requested it, normally following a finding call or a petition for recommendation (RFP) process. It is <strong>unsolicited</strong> whenever you initiate without a previous request. Solicited proposals commencement from a stronger position: you already cognize the buyer&rsquo;s budget, timeline, and priorities before you compose a word.</p><h3>Sales recommendation vs. quote, estimate, and endeavor proposal</h3><p>A revenue recommendation differs from a quote, an estimate, and a endeavor recommendation in three ways: what it commits to, whenever it appears in the deal, and how much influence it requires.</p><figure tabindex="0"><table readabilitydatatable="1"><tbody><tr><td colspan="1" rowspan="1"><p><strong>Document</strong></p></td><td colspan="1" rowspan="1"><p><strong>What it commits to</strong></p></td><td colspan="1" rowspan="1"><p><strong>When to dispatch it</strong></p></td><td colspan="1" rowspan="1"><p><strong>Persuasion level</strong></p></td></tr><tr><td colspan="1" rowspan="1"><p><strong>Quote</strong></p></td><td colspan="1" rowspan="1"><p><span>An exact cost for a defined scope</span></p></td><td colspan="1" rowspan="1"><p><span>When the buyer already knows what they want</span></p></td><td colspan="1" rowspan="1"><p><span>Low (they&rsquo;re comparing numbers, not arguments)</span></p></td></tr><tr><td colspan="1" rowspan="1"><p><strong>Estimate</strong></p></td><td colspan="1" rowspan="1"><p><span>An approximate cost for activity not yet completely scoped</span></p></td><td colspan="1" rowspan="1"><p><span>Early in a project discussion</span></p></td><td colspan="1" rowspan="1"><p><span>Low (they&rsquo;re planning, not deciding yet)</span></p></td></tr><tr><td colspan="1" rowspan="1"><p><strong>Business proposal</strong></p></td><td colspan="1" rowspan="1"><p><span>A high-level scheme for a alliance or initiative</span></p></td><td colspan="1" rowspan="1"><p><span>When pitching a new endeavor relationship</span></p></td><td colspan="1" rowspan="1"><p><span>High (you&rsquo;re marketing a association that doesn&rsquo;t be yet)</span></p></td></tr><tr><td colspan="1" rowspan="1"><p><strong>Sales proposal</strong></p></td><td colspan="1" rowspan="1"><p><span>A particular resolution to a named issue at a price</span></p></td><td colspan="1" rowspan="1"><p><span>After discovery, whenever the buyer is near a decision</span></p></td><td colspan="1" rowspan="1"><p><span>High (you&rsquo;re asking for a signature on a particular deal)</span></p></td></tr></tbody></table></figure><p>Sending a citation whenever the buyer needed an disagreement loses the agreement before the conversation starts.</p><h2 id="h-1-research-the-client-and-the-deal">1. Research the client and the deal</h2><p>To investigation the client, collect everything you already cognize concerning the agreement before you compose a word: your notes from finding calls, the exact words the buyer used to depict the problem, who alternatively has a say in the decision, and what they told you concerning prosperity and timing.</p><p>One of the most helpful sources at this phase is call recordings. Review them from your client association administration (CRM) application or through any of the<a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow">best AI revenue tools</a> that transcribe and summarize calls. Surfacing the exact phrases the buyer used expenses nothing and pays off in all division you write.</p><p>Pay notice to the <strong>buying committee</strong>. Most business-to-business (B2B) deals affect additional than one decision-maker: the CFO cares concerning disbursal and risk; the operations guide cares concerning disruption and timeline; the individual who volition use the resolution cares concerning whether it really works. Your investigation should exterior what all of them needs to hear.</p><p>Confirm three things before you commencement writing:</p><ul> <li><strong>Value.</strong> The buyer understands the value of solving this issue and has a logic to act now.</li> <li><strong>Budget</strong>. A prosperity range has arrive up, and the buyer has indicated they are consenting to invest.</li> <li><strong>Timing.</strong> A decision timeline exists and is realistic.</li> </ul><p>Ask for another call if any of these three are missing. Sending a recommendation too first is among the most average reasons deals go quiet.</p><h2 id="h-2-map-your-solution-to-the-clients-problem">2. Map your resolution to the client&rsquo;s problem</h2><p>To map your solution, obtain all issue the buyer named and acknowledge the particular part of your recommendation that solves it. This is the activity that sits between investigation and writing.</p><p>Start alongside anywhere the client is now: what is happening, what it is costing them, and what their endeavor looks akin if nothing changes. Then compose anywhere they desire to be: what achievement looks akin following your resolution is in place. That difference is the disagreement &ndash; all division of the recommendation follows from it.</p><p>Test your resolution against four questions all buyer is asking, whether or not they say so:</p><ul> <li><strong>Why act?</strong> Have you made apparent what the issue is costing them?</li> <li><strong>Why now?</strong> Is there a genuine logic not to delay?</li> <li><strong>Why us?</strong> What makes you a improved choice than the alternatives?</li> <li><strong>Why accept you?</strong> What evidence backs up your claims?</li> </ul><p>You are not prepared to compose the recommendation if you cannot answer all four questions for this deal. Run another finding call and inhabit the gap.</p><p>Cut item from your resolution that does not map to a issue this client named. The enticement to contain additional services &ldquo;in case they&rsquo;re interested&rdquo; weakens the chief disagreement all time.</p><h2 id="h-3-define-the-sales-proposal-structure">3. Define the revenue recommendation structure</h2><p>To construction a revenue proposal, build it about five center sections: administrator summary, issue statement, projected solution, funding and timeline, and next steps. Add optional sections whenever the agreement calls for them: why the client should choose you, social proof, conditions and conditions, and an appendix.</p><p>Each division has one job:</p><ul> <li><strong>Executive summary</strong>. States the buyer&rsquo;s circumstance and your advice in two to three paragraphs. It has to remain alone: person who says nothing alternatively should motionless get the problem, the recommendation, and the price.</li> <li><strong>Problem statement</strong>. Describes the buyer&rsquo;s current province in their own words. This division tells them you were listening.</li> <li><strong>Proposed solution</strong>. Maps your recommendation to all named problem. Features appear lone whenever they nexus to an outcome.</li> <li><strong>Investment and timeline</strong>. States the price, fee terms, and whenever all phase of the activity happens. Put any disbursal that could alternatively astonishment them here, not in a afterward invoice.</li> <li><strong>Next steps</strong>. Tells the buyer exactly what to do to move forward, alongside a deadline.</li> </ul><p>Supporting sections to add whenever relevant:</p><ul> <li><strong>Social proof</strong>. Case studies or results from comparable clients.</li> <li><strong>Terms and conditions</strong>. Legal terms, cancellation policy, and IP ownership.</li> <li><strong>Appendix</strong>. Supporting item that would dilatory downward the chief narrative.</li> </ul><p>Keep the chief document abbreviated adequate to peruse in a sole sitting. Move item that supports fairly than advances the disagreement to the appendix.</p><h2 id="h-4-write-the-proposal">4. Write the proposal</h2><p>Write the sections in the command the disagreement builds, and depart the administrator summary until last, formerly you cognize what you are summarizing.</p><p>Start alongside the issue statement, built from the phrases the buyer used during discovery. A buyer who described their difficulty as &ldquo;we are losing leads between the archetypal and second call&rdquo; has already written that division for you. Do not translate it into industry language.</p><p>Then compose the projected resolution as a reply to all issue in turn. For all capability you include, compose one declaration on what it does and one declaration on how it solves the client&rsquo;s particular problem. Cut the capability if you can&rsquo;t compose the second sentence.</p><p>For the funding section, choice one billing example and rod to it. Mixing annual and monthly figures in the identical recommendation creates confusion. If you recommendation multiple packages, catalog the most costly one archetypal &ndash; the archetypal figure the buyer sees becomes the one they measure the others against.</p><div> <p><span> <svg width="24" height="24" viewbox="0 0 24 24" fill="none" xmlns="http://www.w3.org/2000/svg"> <path fill-rule="evenodd" clip-rule="evenodd" d="M12 22.5C17.799 22.5 22.5 17.799 22.5 12C22.5 6.20101 17.799 1.5 12 1.5C6.20101 1.5 1.5 6.20101 1.5 12C1.5 17.799 6.20101 22.5 12 22.5ZM13.637 7.65198C13.637 6.74791 12.9041 6.01501 12 6.01501C11.0959 6.01501 10.363 6.74791 10.363 7.65198C10.5335 9.53749 10.875 13.383 10.875 13.383C10.875 14.0043 11.3787 14.508 12 14.508C12.6213 14.508 13.125 14.0043 13.125 13.383V13.38L13.637 7.65198ZM11.9927 15.714C11.3714 15.714 10.8677 16.2177 10.8677 16.839C10.8677 17.4603 11.3714 17.964 11.9927 17.964H12.0073C12.6286 17.964 13.1323 17.4603 13.1323 16.839C13.1323 16.2177 12.6286 15.714 12.0073 15.714H11.9927Z" fill="#FEA419"></path> </svg> Important </span></p><p> Never dispatch a recommendation alongside vague pricing. Phrases akin &ldquo;starting from&rdquo; or &ldquo;depending on scope&rdquo; power the buyer to prosecute up before they can decide, and most volition not. Commit to the numbers you discussed. </p></div><p>A recommendation lone needs to be as lengthy as its argument. A uncomplicated one-product accord can be as abbreviated as two pages, during a complex multi-phase agreement may run ten or more. Let the agreement decide the length, not the template.</p><p>Use abbreviated paragraphs, energetic voice, and no jargon. Rewrite any declaration that would confuse person exterior your industry.</p><h2 id="h-5-review-the-proposal-before-sending">5. Review the recommendation before sending</h2><p>To assessment a revenue proposal, inspect all fig against what you discussed, verify names and particulars throughout, and ask person alternatively to assessment it before you dispatch it.</p><p>Step distant from the outline for at smallest a few hours first. Then peruse it from the buyer&rsquo;s perspective: does it indicate what they told you, and does all assertion have supporting evidence?</p><p>Pre-send checklist:</p><ul> <li>All figures equivalent the numbers discussed in your calls.</li> <li>Client name, business name, and communication particulars are spelled correctly throughout.</li> <li>The pricing adds up, and the identical numbers appear in all section.</li> <li>Every assertion has a supporting data point, case study, or example.</li> <li>There is a apparent deadline or expiry date on the proposal.</li> <li>The call to act is explicit: sign here, agenda a call, answer by this date.</li> <li>Terms and conditions have been reviewed by person qualified to sign them off.</li> <li>Someone who was not on the calls has peruse the complete document and flagged item unclear.</li> </ul><div> <p>Ask your most skeptical coworker to peruse it as if they were the buyer. They volition discover the weaknesses faster than you will.</p> </div> <h2 id="h-6-prepare-a-follow-up-plan">6. Prepare a follow-up plan</h2><p>Prepare a follow-up scheme by penning the email you volition dispatch the recommendation alongside and environment your check-in dates &ndash; all before the recommendation goes out.</p><p>The email have to be abbreviated and shield what is attached, why you are assured in the recommendation, and the clearest imaginable next step. For complex deals, recommendation to stroll the buyer through it on a call. That call catches disturbance before it becomes a logic to say no.</p><p>Then set your follow-up schedule:</p><ul> <li><strong>48 to 72 hours following sending</strong>. A abbreviated check-in. Did they obtain it? Any first questions?</li> <li><strong>One week out</strong>. Follow up if you have heard nothing. Ask immediately whether there are concerns holding them back.</li> <li><strong>Two weeks out</strong>. One final abbreviated communication if there is motionless no response, afterward move on.</li> </ul><p>Write a<a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow">follow-up email</a> that treats silence as information, not rejection. Deals stall at the recommendation phase whenever the seller waits for the buyer to move first. Prepare for three outcomes:</p><ul> <li><strong>Yes</strong>. Have the agreement prepared and move direct to onboarding.</li> <li><strong>No</strong>. Ask what made the difference, and use it on the next proposal.</li> <li><strong>No response</strong>. Stick to your schedule. If nothing comes through, park the agreement and revisit in 60 to 90 days.</li> </ul><p>A follow-up scheme built before you dispatch is what separates deals you are operating from deals you are expecting for.</p><h2 id="h-what-every-effective-sales-proposal-has-in-common">What all productive revenue recommendation has in common</h2><p>Effective revenue proposals portion five things that use throughout all section: they conversation to all decision-maker, use the buyer&rsquo;s language, rear all assertion alongside a number, keep one accordant voice, and personalize all reused block.</p><ul> <li><strong>Write for all decision-maker, not fair your contact.</strong> A recommendation that lone speaks to the individual who took your calls fails whenever it have to be presented internally to finance, legal, or a elder stakeholder who never met you.</li> <li><strong>Use the buyer&rsquo;s tongue throughout.</strong> The words they used during finding are additional persuasive than any you volition invent. Mirror them from the administrator summary to the next steps.</li> <li><strong>Put a figure on all assertion you can.</strong> &ldquo;This reduces churn&rdquo; is weaker than &ldquo;clients in a comparable circumstance reduced churn by 18% inside six months.&rdquo; Specific numbers build credibility faster than adjectives</li> <li><strong>Keep one accordant voice.</strong> If multiple group contribute, one individual edits the complete document before it goes out. A recommendation that says akin a commission wrote it signals inner chaos.</li> <li><strong>Personalize all reused block.</strong> Templates and former proposals are starting points, not completed work. Update all division that references the client&rsquo;s situation, equal if you are adapting from a akin deal.</li> </ul><h2 id="h-common-sales-proposal-mistakes-to-avoid">Common revenue recommendation mistakes to avoid</h2><p>Seven mistakes consistently descend revenue proposals: sending a generic template, listing features complete endeavor value, hiding the pricing, penning walls of text, environment no deadline, sending alongside errors, and proposing before the buyer is ready.</p><p><strong>Sending a generic template without editing it.</strong> Buyers place a template immediately whenever the resolution division describes capabilities unrelated to their situation. Every division that references the client&rsquo;s problem, their language, or their goals needs to be rewritten for all deal.</p><p><strong>Listing features alternatively of endeavor value.</strong> A recommendation that says akin a merchandise spec panel tells the buyer what you have, not what they get. For all characteristic you include, compose one declaration on the outcome it produces for this particular client.</p><p><strong>Hiding the pricing.</strong> Burying the funding in an appendix, splitting it throughout sections without a total, or leaving it out entirely signals that you anticipate the figure to hurt. Put the complete cost in a sole array in the chief document, alongside fee conditions next to it.</p><p><strong>Writing walls of text.</strong> Long, unbroken paragraphs indication that the author did not do the activity of editing. Buyers skim. Give them item to district on: abbreviated paragraphs, headings, and projectile points for any catalog of three or additional items.</p><p><strong>No deadline on the proposal.</strong> A recommendation without an expiry date can sit unanswered for months. Set one. It protects you from holding a cost indefinitely and gives the buyer a apparent instant to decide.</p><p><strong>Typos, incorrect names, and bad math.</strong> A typo in the client&rsquo;s business name, a pricing fig that does not add up, or a case study from the incorrect industry immediately damages trust. Buyers peruse errors as a preview of what operating alongside you volition be like.</p><p><strong>Sending before the potential is ready.</strong> A recommendation sent to a buyer alongside no apparent logic to act, no cognition of your coarse pricing, and no timeline in intellect is nearer to<a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow">cold email outreach</a> than a decision move. </p><h2 id="h-sales-proposal-template">Sales recommendation template</h2><p>A <strong>sales recommendation template</strong> is a pre-formatted document construction you modify for all deal. It gives you a accordant starting item so you can concentration on personalization fairly than formatting.</p><p>This template covers all division of a expert revenue proposal. Copy it, inhabit in the placeholders, and eliminate any does not use to your deal. To reuse it throughout deals, rotate the document into a <a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow">sales recommendation builder</a> that assembles these sections for all new client.</p><hr><p><strong>[YOUR COMPANY NAME]</strong> <strong>Sales recommendation for [CLIENT COMPANY NAME]</strong></p><p>Prepared by: [Your name and title] Date: [Date prepared] Valid until: [Expiry date; 14 to 30 days is standard] Contact: [name@domain.tld]</p><p><strong>Executive summary</strong></p><p>[CLIENT COMPANY NAME] is a [brief clarification of their business] currently facing [named issue from discovery]. This recommendation outlines how [YOUR COMPANY NAME] volition [specific outcome] inside [timeframe], according to the goals discussed on [date of final call].</p><p>Recommendation: [One declaration on the projected approach]. We are assured in the outcome since [one declaration on your track document or comparable experience].</p><p><strong>Problem statement</strong></p><p>During our conversations, [client communication name] described [specific challenge] as the team&rsquo;s most pressing priority. [Describe the current province in the client&rsquo;s own words: what is happening, what it is costing them, and what is at interest if nothing changes.]</p><p>The goal is to move from [current state] to [desired forthcoming state] by [target date].</p><p><strong>Proposed solution</strong></p><p>To accomplish [stated goal], we propose the following:</p><p>[SOLUTION ITEM 1]: This addresses [named problem] by [specific mechanism]. Clients in comparable situations have seen [specific result; substitute alongside an genuine outcome from your work].</p><p>[SOLUTION ITEM 2]: This handles [named problem] so that [named stakeholder or team] can [specific benefit].</p><p>[Add or eliminate items. Every item should nexus immediately to a issue the client named during discovery. Cut item that does not.]</p><p><strong>Investment and timeline</strong></p><figure tabindex="0"><table readabilitydatatable="1"><tbody><tr><td colspan="1" rowspan="1"><p><strong>Phase</strong></p></td><td colspan="1" rowspan="1"><p><strong>Deliverable</strong></p></td><td colspan="1" rowspan="1"><p><strong>Timeline</strong></p></td><td colspan="1" rowspan="1"><p><strong>Investment</strong></p></td></tr><tr><td colspan="1" rowspan="1"><p><span>Phase 1</span></p></td><td colspan="1" rowspan="1"><p><span>[Description]</span></p></td><td colspan="1" rowspan="1"><p><span>[Start date to end date]</span></p></td><td colspan="1" rowspan="1"><p><span>$[Amount]</span></p></td></tr><tr><td colspan="1" rowspan="1"><p><span>Phase 2</span></p></td><td colspan="1" rowspan="1"><p><span>[Description]</span></p></td><td colspan="1" rowspan="1"><p><span>[Start date to end date]</span></p></td><td colspan="1" rowspan="1"><p><span>$[Amount]</span></p></td></tr><tr><td colspan="1" rowspan="1"><p><strong>Total</strong></p></td><td colspan="1" rowspan="1"></td><td colspan="1" rowspan="1"></td><td colspan="1" rowspan="1"><p><strong>$[Total]</strong></p></td></tr></tbody></table></figure><p>Payment terms: [e.g., 50% on signature, 50% on shipment / monthly ongoing / billed annually]</p><p>This recommendation is valid until [date]. Pricing is according to the range described here. Changes to the range volition be accepted in penning before activity begins.</p><p><strong>Why [YOUR COMPANY NAME]</strong></p><p>[Two to three sentences on what makes your business the correct choice for this client. Reference a comparable client result, applicable experience, or a particular capability that addresses their situation. Skip the generic business overview.]</p><p><strong>Social proof</strong></p><p>[CLIENT REFERENCE NAME] faced a akin difficulty in 2026. After [brief clarification of the work], they achieved [specific result]. [Offer to portion the complete case study on request, or nexus to it if it is publically available.]</p><p><strong>Next steps</strong></p><ol> <li>Review this recommendation and portion it alongside any stakeholders who need to be engaged in the decision.</li> <li>Reply to verify accord or to petition a call to conversation any questions.</li> <li>Sign the accord or come back a signed copy by [date].</li> </ol><p>[Your name] volition prosecute up on [specific date] if a reply has not yet arrive through.</p><p><strong>Terms and conditions</strong></p><p>[Insert your norm terms: cancellation policy, IP ownership, delayed fee clause, and any another conditions applicable to your work. Have these reviewed by a qualified lawful expert before use.]</p><p><strong>Appendix</strong></p><p>[Attach supporting matter referenced in the proposal: complete case studies, specialized specifications, or detailed deliverable breakdowns.]</p><p><strong>Signatures</strong></p><p>On behalf of [YOUR COMPANY NAME]:</p><p>[Name, title, date]</p><p>On behalf of [CLIENT COMPANY NAME]:</p><p>[Name, title, date]</p><h2 id="h-how-to-write-a-sales-proposal-with-ai-agents">How to compose a revenue recommendation alongside AI agents</h2><p>To compose a revenue recommendation alongside AI agents, divided the document by site and provision all part to the delegate built for it, fairly than asking one general-purpose chatbot for the entire thing. </p><p>A recommendation draws on five disciplines at once: positioning, pricing, persuasive writing, lawful terms, and follow-up planning. Most group penning a recommendation occasionally have no expert rearward any of them, and that gap shows up in the sections that matter most.</p><p>The correct way to use<a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow"> </a><a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow">AI agents</a> in the recommendation procedure is as specialists per task, not as a sole chatbot you dump a immediate into. A generic immediate gets generic output; a expert who understands the project gets item you can really use.</p><p><a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow">Hostinger Agents</a> is built on this model: alternatively of a sole general-purpose conversation interface, it gives you seven role-based specialists alongside additional than 150 guided skills and recollection of your endeavor environment throughout sessions. Five of the seven map to particular parts of the proposal:</p><ul> <li><strong>Business advisor</strong>. Use it to stance and form your recommendation before you commencement writing. It helps you test whether your resolution framing is strong, whether your pricing example fits the deal, and whether your value disagreement answers the four buyer questions.</li> <li><strong>Creative writer</strong>. Use for the administrator summary, the projected solution, and the next-steps wording. Give it the buyer&rsquo;s circumstance as context, and it produces copy restricted in what you provision it, not in generic revenue language.</li> <li><strong>Legal advisor</strong>. Use to create a archetypal outline of your conditions and conditions. Review and finalize alongside a qualified lawful expert before it goes into a live proposal.</li> <li><strong>Sales &amp; Outreach</strong> and <strong>Customer Comms</strong>. Use these for the follow-up scheme following the recommendation goes out. They outline the email you dispatch it with, the check-in messages, and the timing between them, so you are not penning the identical follow-up from scratch all time.</li> </ul><div> <figure data-wp-context='&quot;6ac46c9543ecd&quot;}' data-wp-interactive="core/image" data-wp-key="6ac46c9543ecd"><img decoding="async" data-wp-class--hide="state.isContentHidden" data-wp-class--show="state.isContentVisible" data-wp-init="callbacks.setButtonStyles" data-wp-on--click="actions.showLightbox" data-wp-on--load="callbacks.setButtonStyles" data-wp-on--pointerdown="actions.preloadImage" data-wp-on--pointerenter="actions.preloadImageWithDelay" data-wp-on--pointerleave="actions.cancelPreload" data-wp-on-window--resize="callbacks.setButtonStyles" src="https://www.hostinger.com/tutorials/wp-content/uploads/sites/2/2026/10/1791253716871-0.png" alt=" Business Advisor, Creative Writer, SEO Consultant, Marketing Planner, Legal Advisor, Customer Comms, and Sales and Outreach"></figure> </div><p>Guided skills are what distinct <a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow">AI agents for revenue and promotion tasks</a> from a general-purpose chatbot: you choice the task, answer the agent&rsquo;s questions, and get a outcome shaped for that job.</p><p>One apparent boundary: investigation and resolution mapping are motionless your work. No delegate replaces the finding call, the listening, or the judgement concerning what this particular buyer really needs. The agents accelerate everything that comes following you comprehend the deal.</p><figure><a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noreferrer noopener follow" data-wpel-link="internal"><img fetchpriority="high" decoding="async" width="1024" height="300" src="https://www.hostinger.com/tutorials/fit=scale-down" alt="Hostinger web hosting banner" srcset="https://imagedelivery.net/LqiWLm-3MGbYHtFuUbcBtA/wp-content/uploads/sites/2/2023/11/Web-hosting_in-text-banner.png/w=1024,fit=scale-down 1024w, https://imagedelivery.net/LqiWLm-3MGbYHtFuUbcBtA/wp-content/uploads/sites/2/2023/11/Web-hosting_in-text-banner.png/w=300,fit=scale-down 300w, https://imagedelivery.net/LqiWLm-3MGbYHtFuUbcBtA/wp-content/uploads/sites/2/2023/11/Web-hosting_in-text-banner.png/w=150,fit=scale-down 150w, https://imagedelivery.net/LqiWLm-3MGbYHtFuUbcBtA/wp-content/uploads/sites/2/2023/11/Web-hosting_in-text-banner.png/w=768,fit=scale-down 768w" sizes=" 1024px) 100vw, 1024px"></a></figure> <p> All of the tutorial satisfied on this website is topic to <a href="https://en.mycoding.id/category/technology" target="_blank" data-wpel-link="internal" rel="follow"> Hostinger's rigorous editorial standards and values. </a> </p> <div id="the-author-section"> <div> <p><img src="https://secure.gravatar.com/avatar/ce5a8db3450c6f1f5aa33e1abb91d299722a047e5628ed3b757f06be8bd66102?s=96&amp;d=mm&amp;r=g" alt="Author"> </p> </div> <p> Bruno is a Content Writer at Hostinger, focused on creating and optimizing helpful, engaging articles concerning web betterment and marketing. With a backdrop in journalism, he combines storytelling alongside applicable insights to create complex topics easier to understand. He has additionally contributed to publications akin MacMagazine and Jornal A Tarde. Outside of work, Bruno enjoys exploring art, cooking, and technology. </p> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/how-to-write-a-sales-proposal-in-6-steps-71183</guid> <pubDate>Tue, 06 Oct 2026 03:33:11 +0700</pubDate> <author><![CDATA[support@mycoding.id (Bruno Santana)]]></author> </item> <item> <title><![CDATA[OpenAI To Watermark ChatGPT Text In The EU, Opens API Opt-In]]></title> <description><![CDATA[OpenAI To Watermark ChatGPT Text In The EU, Opens API Opt-In. OpenAI volition add an invisible watermark to ChatGPT and Codex content in the EU. Its tests display editing can weaken it. The article OpenAI To Watermark ChatGPT Text In T...]]></description> <media:thumbnail url="https://cdn.searchenginejournal.com/wp-content/uploads/2026/09/sej-stacked-wordmark-bocconi-referrals.png"/> <category><![CDATA[Business]]></category> <link>https://en.mycoding.id/openai-to-watermark-chatgpt-text-in-the-eu-opens-api-opt-in-71180</link> <content:encoded><![CDATA[<div class="sej-article-content gototop-pos "> <div class="sss2_sllo_o6"> </div> <div id="narrow-cont"><p>OpenAI <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">will introduce</a> an invisible watermark to qualifying ChatGPT and Codex texts inside the European Union complete the coming weeks. Their evaluation indicates that replacing certain words alongside synonyms can weaken the watermark’s effectiveness. In one test, substituting 25% of the words in 400-token English passages alongside synonyms lowered finding rates from about 92% to 17%.</p> <p>From today, API users worldwide can opt to activate watermarking for choose models, although it stays off by default. The content finding tool is not publically accessible at launch; it is currently constricted to approved researchers and expert organizations.</p> <h2>What’s Rolling Out Where</h2> <p>OpenAI states that the ChatGPT and Codex watermark volition attain eligible users throughout all plans inside the EU only. Initially, content watermarking won’t be a default characteristic globally.</p> <p>The Oct. 5 update does not define which models are part of the API opt-in or whether EU ChatGPT users can disable the watermark. The business says it is operating alongside haze partners to add watermarking to outputs from its models via their services in the coming weeks.</p><div data-total="6" id="SEJ_300x250_UnderPost_1-parent" class="content-unit sss2_sllo_o6 mmh-90-wrap"> <div class="mmh-90-inner"> <div class="mmh-90 flex-aligner"> <div data-adnumber="0" data-middle="yes" data-p-slot="SEJ_300x250_UnderPost" data-slot="SEJ_300x250_UnderPost/SEJ_300x250_UnderPost_1" id="SEJ_300x250_UnderPost_1" class="sadslots"> </div> </div> </div> </div> <h2>Why The EU, And Why Now</h2> <p>The transparency rules under Article 50 of the EU AI Act began applying on Aug. 2, 2026. The European Commission <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">states</a> that AI systems placed on the market before this date have until December 2 to encounter the marking and finding obligation. The voluntary <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">Code of Practice on Transparency of AI-generated Content</a> provides organizations alongside an optional way to display their compliance. By the end of July, concerning 190 organizations had signed, and OpenAI <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">publicly supported</a> the Code in June.</p> <p>The business says the EU-only rollout gives it area to study from real-world use and feedback. I covered its <a href="https://en.mycoding.id/category/business" target="_blank">decision against content watermarking for ChatGPT</a> in August 2024, following a business study established nearly 30% of ChatGPT users stated they would use the assistance small if watermarking was implemented.</p> <h2>What OpenAI’s Tests Show</h2> <p>OpenAI’s method, called textGrain, adds a statistical indication to the model’s term choices that a detector can appearance for. At a mark false affirmative charge of 1%, the detector established the watermark in concerning 80% of 200-token passages and concerning 95% of 400-token passages, for satisfied specified as psychology. The business <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">reported</a> much lesser rates for satisfied specified as math, anywhere term choice is small flexible.</p><div data-total="6" id="SEJ_300x250_UnderPost_2-parent" class="content-unit sss2_sllo_o6 mmh-90-wrap"> <div class="mmh-90-inner"> <div class="mmh-90 flex-aligner"> <div data-adnumber="1" data-middle="no" data-p-slot="SEJ_300x250_UnderPost" data-slot="SEJ_300x250_UnderPost/SEJ_300x250_UnderPost_2" id="SEJ_300x250_UnderPost_2" class="sadslots"> </div> </div> </div> </div> <p>I noted in August that <a href="https://en.mycoding.id/category/business" target="_blank">the Code doesn’t necessitate watermarking of free-form content shorter than 200 tokens</a>. Two hundred tokens is the shortest dimension in the post’s results.</p> <p>Editing the content weakened the indication in a distinct circumstance alongside 400-token English passages. Replacing 10% of words alongside synonyms reduced finding from about 92% to 66%. Increasing the replacement to 25% additional decreased finding to 17%. Both tests used responses to questions from the ELI5 dataset.</p> <p>The business reports that textGrain matched or exceeded the achievement of another methods it tested, including SynthID for text. However, they emphasize that successes under ideal conditions do not justify reliability in mundane situations. In their benchmarks, they saw minimal to no difference whether watermarking was enabled or disabled.</p> <h2>Who Can Check A Watermark</h2> <p>Researchers and expert organizations can <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">request access</a> to OpenAI’s content detector, initially on a case-by-case basis according to the Code. The tool reports whether it detects an OpenAI watermark but does not disclose person identities or display their prompts and chats. OpenAI <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">notes</a> that because of the hazard of missed watermarks and possible false positives, it is not accessible to the community at launch. In contrast, depiction and audio verification tools via <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">openai.com/verify</a> and the <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">Content Provenance API</a> remain open to all.</p><div data-total="6" id="SEJ_300x250_UnderPost_3-parent" class="content-unit sss2_sllo_o6 mmh-90-wrap"> <div class="mmh-90-inner"> <div class="mmh-90 flex-aligner"> <div data-adnumber="2" data-middle="no" data-p-slot="SEJ_300x250_UnderPost" data-slot="SEJ_300x250_UnderPost/SEJ_300x250_UnderPost_3" id="SEJ_300x250_UnderPost_3" class="sadslots"> </div> </div> </div> </div> <p>In a <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">2024 update</a>, the business wrote that equal alongside a low false affirmative rate, “applying it to ample volumes of content would guide to a ample figure of total false positives.”</p> <p>According to <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">the post</a>, a watermark doesn’t measure how much a individual contributed, and a missing one doesn’t demonstrate a individual wrote the text.</p> <h2>How It Compares With Claude</h2> <p>Anthropic marks content from supported Claude models worldwide, according to its <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">support article</a>. Its <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">explainer</a> says that’s since it doesn’t yet have a durable way to range watermarking by region.</p> <figure id="sej-gfx-text-watermark-comparison" class="sej-gfx-text-watermark-comparison-root" data-sej-gfx-profile="sej-editorial-v1.1" aria-labelledby="sej-gfx-text-watermark-comparison-title" aria-describedby="sej-gfx-text-watermark-comparison-context"> <div class="sej-gfx-text-watermark-comparison-accent" aria-hidden="true"></div> <p class="sej-gfx-text-watermark-comparison-title" id="sej-gfx-text-watermark-comparison-title">OpenAI vs. Anthropic: How Their Text Watermarking Compares</p> <p class="sej-gfx-text-watermark-comparison-context" id="sej-gfx-text-watermark-comparison-context">Different rollout scopes, methods, and admission approaches</p> <div class="sej-gfx-text-watermark-comparison-content"> <div class="scrl-table"><table class="sej-gfx-text-watermark-comparison-matrix" aria-label="OpenAI and Anthropic content watermark comparison"> <thead class="sej-gfx-text-watermark-comparison-head"> <tr> <th scope="col"></th> <th scope="col" aria-label="OpenAI"><svg width="1604" height="718" viewbox="0 0 1604 718" fill="none" xmlns="http://www.w3.org/2000/svg" aria-hidden="true" focusable="false"><path d="M358.8 239.3C293.02 239.3 239.2 293.12 239.2 358.9C239.2 424.68 293.02 478.5 358.8 478.5C424.58 478.5 478.4 425.012 478.4 358.9C478.4 292.787 424.912 239.3 358.8 239.3ZM358.8 435.643C317.937 435.643 285.046 402.089 285.046 358.9C285.046 315.711 317.937 282.156 358.8 282.156C399.663 282.156 432.553 315.711 432.553 358.9C432.553 402.089 399.663 435.643 358.8 435.643Z" fill="black"></path><path d="M599.326 305.744C577.732 305.744 556.802 314.382 545.838 329V309.066H502.649V541.622H545.838V457.57C556.802 471.191 577.067 478.5 599.326 478.5C645.837 478.5 682.382 441.955 682.382 392.122C682.382 342.289 645.837 305.744 599.326 305.744ZM592.017 440.959C567.433 440.959 545.506 421.69 545.506 392.122C545.506 362.554 567.433 343.285 592.017 343.285C616.602 343.285 638.528 362.554 638.528 392.122C638.528 421.69 616.602 440.959 592.017 440.959Z" fill="black"></path><path d="M784.046 305.744C736.871 305.744 699.662 342.621 699.662 392.122C699.662 441.623 732.22 478.5 785.375 478.5C828.896 478.5 856.803 452.254 865.441 422.686H823.249C817.933 434.979 802.983 443.616 785.043 443.616C762.784 443.616 745.841 428.002 741.854 405.743H867.434V388.8C867.434 343.617 835.873 305.744 784.046 305.744ZM742.186 375.179C746.838 354.249 764.113 340.627 785.043 340.627C807.302 340.627 824.245 355.245 826.239 375.179H742.186Z" fill="black"></path><path d="M982.38 305.744C963.111 305.744 942.845 314.382 933.543 328.667V309.066H890.354V475.177H933.543V385.81C933.543 359.896 947.496 342.953 970.087 342.953C991.017 342.953 1002.31 358.9 1002.31 381.159V475.177H1045.5V374.182C1045.5 332.986 1020.25 305.744 982.38 305.744Z" fill="black"></path><path d="M1156.12 242.628L1062.1 475.184H1108.28L1128.21 424.354H1235.19L1255.12 475.184H1301.96L1208.61 242.628H1156.12ZM1143.16 385.816L1181.7 288.475L1219.9 385.816H1143.16Z" fill="black"></path><path d="M1363.42 242.628H1319.57V475.184H1363.42V242.628Z" fill="black"></path></svg></th> <th scope="col" aria-label="Anthropic"><svg width="590" height="68" viewbox="0 0 590 68" fill="none" xmlns="http://www.w3.org/2000/svg" aria-hidden="true" focusable="false"><path d="M383.407 0.90332C401.784 0.903497 414.766 14.6176 414.766 34.0918C414.766 53.3829 401.783 67.0965 383.407 67.0967C364.938 67.0967 351.864 53.383 351.864 34.0918C351.864 14.6175 364.938 0.90332 383.407 0.90332ZM561.509 0.90332C575.406 0.903342 586.103 9.77125 589.669 23.4854H575.132C572.755 17.2684 568 13.7031 561.509 13.7031C550.721 13.7031 544.138 21.3832 544.138 34.0918C544.138 46.6173 550.721 54.2969 561.509 54.2969C568 54.2969 572.755 50.7316 575.132 44.5146H589.76C586.194 58.1372 575.497 67.0967 561.509 67.0967C543.041 67.0967 529.966 53.383 529.966 34.0918C529.966 14.6175 543.041 0.90332 561.509 0.90332ZM65.8743 66H51.6116L46.3948 52.5596H19.7083L14.4915 66H0.228821L25.7376 2H40.3665L65.8743 66ZM120.275 46.7998V2H133.532V66H117.989L89.1888 21.2002V66H75.9319V2H91.4749L120.275 46.7998ZM201.189 14.3428H179.703V66H165.989V14.3428H144.503V2H201.189V14.3428ZM225.874 27.5088H256.046V2H269.76V66H256.046V39.8516H225.874V66H212.16V2H225.874V27.5088ZM317.944 2C332.481 2.00011 341.349 9.40613 341.349 21.4746C341.349 29.9396 336.986 36.1106 329.364 39.041L344.549 66H329.372L315.658 40.9482H300.389V66H286.675V2H317.944ZM458.834 2C473.371 2 482.241 9.6801 482.241 22.3887C482.24 35.0972 473.371 42.7773 458.834 42.7773H441.281V66H427.566V2H458.834ZM527.223 66H513.235L487.726 2H501.715L527.223 66ZM383.407 13.7031C372.618 13.7031 366.034 21.3832 366.034 34.0918C366.035 46.6173 372.618 54.2969 383.407 54.2969C394.103 54.2967 400.595 46.6172 400.595 34.0918C400.595 21.3834 394.103 13.7033 383.407 13.7031ZM24.3216 40.6738H41.7816L33.0521 18.1826L24.3216 40.6738ZM441.281 30.4346H458.195C464.96 30.4346 468.527 27.6915 468.527 22.3887C468.527 17.0858 464.96 14.3428 458.195 14.3428H441.281V30.4346ZM300.389 28.6055H317.303C324.069 28.6055 327.635 26.1373 327.635 21.4746C327.635 16.8118 324.069 14.3428 317.303 14.3428H300.389V28.6055Z" fill="#141413"></path></svg></th> </tr> </thead> <tbody> <tr class="sej-gfx-text-watermark-comparison-row"> <th scope="row" class="sej-gfx-text-watermark-comparison-category"> <div><svg xmlns="http://www.w3.org/2000/svg" width="28" height="28" viewbox="0 0 30 30" aria-hidden="true" focusable="false"><path d="M7 3H16L21 8V25H7Z M16 3V9H21 M11 14H17 M11 19H17" fill="none" stroke="#101827" stroke-width="1.8" stroke-linecap="round" stroke-linejoin="round"></path></svg><span>Apps</span></div> </th> <td class="sej-gfx-text-watermark-comparison-cell"><span class="sej-gfx-text-watermark-comparison-mobile-label">OpenAI</span><span class="sej-gfx-text-watermark-comparison-value">Eligible ChatGPT and Codex text, EU only, complete the coming weeks</span></td> <td class="sej-gfx-text-watermark-comparison-cell"><span class="sej-gfx-text-watermark-comparison-mobile-label">Anthropic</span><span class="sej-gfx-text-watermark-comparison-value">Supported Claude models, worldwide</span></td> </tr> <tr class="sej-gfx-text-watermark-comparison-row"> <th scope="row" class="sej-gfx-text-watermark-comparison-category"> <div><svg xmlns="http://www.w3.org/2000/svg" width="28" height="28" viewbox="0 0 30 30" aria-hidden="true" focusable="false"><path d="M9 7L3 14L9 21 M19 7L25 14L19 21 M16 4L12 24" fill="none" stroke="#101827" stroke-width="1.8" stroke-linecap="round" stroke-linejoin="round"></path></svg><span>API</span></div> </th> <td class="sej-gfx-text-watermark-comparison-cell"><span class="sej-gfx-text-watermark-comparison-mobile-label">OpenAI</span><span class="sej-gfx-text-watermark-comparison-value">Opt-in for choose models, off by default, models not named in the post</span></td> <td class="sej-gfx-text-watermark-comparison-cell"><span class="sej-gfx-text-watermark-comparison-mobile-label">Anthropic</span><span class="sej-gfx-text-watermark-comparison-value">Marked on supported models, which the assistance part lists by name</span></td> </tr> <tr class="sej-gfx-text-watermark-comparison-row"> <th scope="row" class="sej-gfx-text-watermark-comparison-category"> <div><svg xmlns="http://www.w3.org/2000/svg" width="28" height="28" viewbox="0 0 30 30" aria-hidden="true" focusable="false"><path d="M11 3H17L18 7L22 9L26 9V15L22 17L20 21L20 25H14L12 21L8 19H4V13L8 11L10 7Z" fill="none" stroke="#101827" stroke-width="1.8" stroke-linecap="round" stroke-linejoin="round"></path></svg><span>Method</span></div> </th> <td class="sej-gfx-text-watermark-comparison-cell"><span class="sej-gfx-text-watermark-comparison-mobile-label">OpenAI</span><span class="sej-gfx-text-watermark-comparison-value">textGrain, OpenAI’s own</span></td> <td class="sej-gfx-text-watermark-comparison-cell"><span class="sej-gfx-text-watermark-comparison-mobile-label">Anthropic</span><span class="sej-gfx-text-watermark-comparison-value">A type of Google DeepMind’s <span>SynthID-Text</span></span></td> </tr> <tr class="sej-gfx-text-watermark-comparison-row"> <th scope="row" class="sej-gfx-text-watermark-comparison-category"> <div><svg xmlns="http://www.w3.org/2000/svg" width="28" height="28" viewbox="0 0 30 30" aria-hidden="true" focusable="false"><path d="M20 20L27 27" fill="none" stroke="#101827" stroke-width="1.8" stroke-linecap="round" stroke-linejoin="round"></path></svg><span>Detector access</span></div> </th> <td class="sej-gfx-text-watermark-comparison-cell"><span class="sej-gfx-text-watermark-comparison-mobile-label">OpenAI</span><span class="sej-gfx-text-watermark-comparison-value">Approved researchers and expert organizations, by application</span></td> <td class="sej-gfx-text-watermark-comparison-cell"><span class="sej-gfx-text-watermark-comparison-mobile-label">Anthropic</span><span class="sej-gfx-text-watermark-comparison-value">Private preview for eligible organizations, including regulators, media, and researchers, affirmative enterprises verifying their own compliance</span></td> </tr> <tr class="sej-gfx-text-watermark-comparison-row"> <th scope="row" class="sej-gfx-text-watermark-comparison-category"> <div><svg xmlns="http://www.w3.org/2000/svg" width="28" height="28" viewbox="0 0 30 30" aria-hidden="true" focusable="false"><path d="M5 25V17 M12 25V10 M19 25V4 M26 25V13" fill="none" stroke="#101827" stroke-width="1.8" stroke-linecap="round" stroke-linejoin="round"></path></svg><span>Published editing results</span></div> </th> <td class="sej-gfx-text-watermark-comparison-cell"><span class="sej-gfx-text-watermark-comparison-mobile-label">OpenAI</span><span class="sej-gfx-text-watermark-comparison-value">Detection rates following 10% and 25% synonym swaps</span></td> <td class="sej-gfx-text-watermark-comparison-cell"><span class="sej-gfx-text-watermark-comparison-mobile-label">Anthropic</span><span class="sej-gfx-text-watermark-comparison-value">No figures in the explainer. Light editing likely won’t completely eliminate it, and a complete rewrite will</span></td> </tr> </tbody> </table></div> </div> <div class="sej-gfx-text-watermark-comparison-source" role="note"> <div class="sej-gfx-text-watermark-comparison-source-copy"> <div>Sources:</div> <div class="sej-gfx-text-watermark-comparison-source-entry">OpenAI, <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">“Our method to EU content provenance rules,”</a> Oct. 5, 2026</div> <div class="sej-gfx-text-watermark-comparison-source-entry">Anthropic, <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">“How Claude’s content watermark works,”</a> Aug. 14, 2026, updated Sept. 1, 2026</div> <div class="sej-gfx-text-watermark-comparison-source-entry">Anthropic, <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">“How Claude marks AI-generated content,”</a> accessed Oct. 5, 2026</div> </div> <div class="sej-gfx-text-watermark-comparison-logo-wrap"><img decoding="async" class="sej-gfx-text-watermark-comparison-logo small-img" src="https://cdn.searchenginejournal.com/wp-content/uploads/2026/09/sej-stacked-wordmark-bocconi-referrals.png" alt="Search Engine Journal" width="96" height="68" loading="lazy"></div> </div> </figure> <h2>Why This Matters</h2> <p>An agency alongside writers in the two Berlin and Toronto, all sharing the identical ChatGPT plan, power shortly discover that several of their copy has OpenAI’s watermark from one agency but not the other. A agreement clause or AI guideline that considers a finding outcome as evidence of who authored the copy is basically asking the watermark a inquiry that OpenAI has stated it can’t answer.</p> <h2>Looking Ahead</h2> <p>OpenAI says it is preparedness to develop detector admission whenever it feels “results can be interpreted responsibly.” As watermarking starts in the EU complete the next few weeks, teams operating alongside EU personnel on ChatGPT power commencement creating marked satisfied that lone approved researchers and expert organizations volition have the capability to review.</p> <p><em>Featured Image: daily_creativity/Shutterstock</em></p> </div> <div id="bcats" class="bottom-cat narrow-cont"> <span class="sej-category boxed cat-label">Category</span> <a href="https://en.mycoding.id/category/business" target="_blank">News</a> <a href="https://en.mycoding.id/category/business" target="_blank">AI Search</a> </div> <div class="sej-above-author-widget"> <div class="sej-widget clearfix"> <div class="sej-badge-box"> <a href="https://en.mycoding.id/category/business" target="_blank" data-placement="Under Article" aria-label="Add Search Engine Journal as a preferred origin on Google"> <svg class="sej-gps-g" viewbox="0 0 48 48" aria-hidden="true" focusable="false"> <path fill="#EA4335" d="M24 9.5c3.54 0 6.71 1.22 9.21 3.6l6.85-6.85C35.9 2.38 30.47 0 24 0 14.62 0 6.51 5.38 2.56 13.22l7.98 6.19C12.43 13.72 17.74 9.5 24 9.5z"></path> <path fill="#4285F4" d="M46.98 24.55c0-1.57-.15-3.09-.38-4.55H24v9.02h12.94c-.58 2.96-2.26 5.48-4.78 7.18l7.73 6c4.51-4.18 7.09-10.36 7.09-17.65z"></path> <path fill="#FBBC05" d="M10.53 28.59c-.48-1.45-.76-2.99-.76-4.59s.27-3.14.76-4.59l-7.98-6.19C.92 16.46 0 20.12 0 24c0 3.88.92 7.54 2.56 10.78l7.97-6.19z"></path> <path fill="#34A853" d="M24 48c6.48 0 11.93-2.13 15.89-5.81l-7.73-6c-2.15 1.45-4.92 2.3-8.16 2.3-6.26 0-11.57-4.22-13.47-9.91l-7.98 6.19C6.51 42.62 14.62 48 24 48z"></path> </svg> <span class="sej-gps-text">Add <b>SEJ</b> as a preferred origin on Google</span> </a> </div> </div> </div> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/openai-to-watermark-chatgpt-text-in-the-eu-opens-api-opt-in-71180</guid> <pubDate>Tue, 06 Oct 2026 02:07:32 +0700</pubDate> <author><![CDATA[support@mycoding.id (Matt G. Southern)]]></author> </item> <item> <title><![CDATA[Photopea creator weighs in on Photosuite project]]></title> <description><![CDATA[Photopea creator weighs in on Photosuite project. Comments]]></description> <media:thumbnail url="https://opengraph.githubassets.com/d582bcbaf471d82d59322a51bec5ba3090b0ffab71877fa98db8eaa1f5d777e0/eolix/photosuite/issues/77"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/photopea-creator-weighs-in-on-photosuite-project-71181</link> <content:encoded><![CDATA[<div id="issue-body-viewer" data-testid="issue-body-viewer"><div data-testid="markdown-body" data-team-hovercards-enabled="true" data-turbolinks="false"><div><h3 dir="auto">What is missing</h3> <p dir="auto">Hi guys, it would be really nice if you did several genuine activity alternatively of copying my activity form my website <a href="https://en.mycoding.id/category/technology" target="_blank" rel="nofollow">www.photopea.com</a>, that I have been operating on since 2012.</p> <p dir="auto">Could you perchance execute your own photo publishing company alternatively of stealing mine? What do you think?</p> <p dir="auto">I am really amazed that Github tolerates piracy.</p> <h3 dir="auto">Where this lives in Photoshop</h3> <p dir="auto"><em>No response</em></p> <h3 dir="auto">How it should behave</h3> <p dir="auto"><em>No response</em></p> <h3 dir="auto">Does this power files?</h3> <ul> <li> It says or writes item in a PSD, so records should round-trip alongside Photoshop</li> <li> It lone affects the editor, not saved files</li> </ul></div></div><div><p><span data-direction="n" data-component="Tooltip" aria-hidden="true" id="_R_2lajnqb5_">Reactions are currently unavailable</span></p></div></div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/photopea-creator-weighs-in-on-photosuite-project-71181</guid> <pubDate>Tue, 06 Oct 2026 01:41:44 +0700</pubDate> <author><![CDATA[support@mycoding.id (Adi Gunawan)]]></author> </item> <item> <title><![CDATA[Elon Musk is a trillionaire again]]></title> <description><![CDATA[Elon Musk is a trillionaire again. Elon Musk is formerly again a trillionaire, a heading he initially held in June following SpaceX's blockbuster IPO.]]></description> <media:thumbnail url="https://i.insider.com/6ac43e07d4357587843b9a32?width=1200&amp;format=jpeg"/> <category><![CDATA[Business]]></category> <link>https://en.mycoding.id/elon-musk-is-a-trillionaire-again-71176</link> <content:encoded><![CDATA[<div data-component-type="post-hero" data-load-strategy="exclude"> <figure data-type="img" e-name="image-figure-image" data-media-container="image" itemscope itemtype="https://schema.org/ImageObject"> <div> <p><img src="https://i.insider.com/6ac43d3a225e4c4a50a382b8?width=2000&amp;format=jpeg&amp;auto=webp" srcset="https://i.insider.com/6ac43d3a225e4c4a50a382b8?width=400&amp;format=jpeg&amp;auto=webp 400w, https://i.insider.com/6ac43d3a225e4c4a50a382b8?width=500&amp;format=jpeg&amp;auto=webp 500w, https://i.insider.com/6ac43d3a225e4c4a50a382b8?width=700&amp;format=jpeg&amp;auto=webp 700w, https://i.insider.com/6ac43d3a225e4c4a50a382b8?width=1000&amp;format=jpeg&amp;auto=webp 1000w, https://i.insider.com/6ac43d3a225e4c4a50a382b8?width=1300&amp;format=jpeg&amp;auto=webp 1300w, https://i.insider.com/6ac43d3a225e4c4a50a382b8?width=2000&amp;format=jpeg&amp;auto=webp 2000w" sizes=" 1280px) 900px" alt="Elon Musk stands in a lawsuit and tie amid a blurred outdoor crowd." decoding="sync"> </p></div> <span> <span> <svg aria-hidden="true" focusable="false" xmlns="http://www.w3.org/2000/svg" width="1em" height="1em" viewbox="0 0 24 24"> <path fill="currentColor" fill-rule="evenodd" d="m4.56 18.5 7.486-7.72 7.394 7.626 2.56-2.64L12.046 5.5 2 15.86l2.56 2.64Z"></path> </svg> <figcaption e-name="image-caption"> <span>Elon Musk is formerly again a trillionaire, a heading he archetypal held briefly in June following the SpaceX IPO.</span> <span> <span e-name="image-source" itemprop="creditText">Finn Gomez/Getty Images</span> </span> </figcaption> </span> </span></figure> </div> <div data-component-type="image-modal" data-load-strategy="lazy"> <p><a href="https://en.mycoding.id/category/business" target="_blank" data-track-click='&quot;bi_value_unassigned&quot;}' rel="">Elon Musk</a> has regained his heading as the world's lone trillionaire.</p><p>The Tesla CEO made former before this twelvemonth by becoming the archetypal individual value 13 figures following <a href="https://en.mycoding.id/category/business" target="_blank" data-track-click='&quot;bi_value_unassigned&quot;}' rel="">SpaceX's blockbuster first community offering</a> in June. Musk's prosperity came rear downward a small nearer to Earth following SpaceX's inventory cost cut following an first surge.</p><p>The missile and AI company's inventory cost has been creeping rear up since first August, reaching $171.09 as of Monday's market close. The nearly 8% boost on Monday brought Musk's net value rear complete the trillion-dollar threshold, according to Forbes, which estimated his prosperity at $1.046 trillion.</p><p>Musk's prosperity earlier peaked on June 16 at $1.32 trillion, according to the Bloomberg Billionaires Index.</p><p>While Musk had lengthy been counted among the richest group in the world, the SpaceX IPO put him in another stratosphere. The second- and third-wealthiest group in the earth as of Monday were Amazon originator Jeff Bezos and Google cofounder Larry Page, value $371 milliard and $284 billion, respectively, according to Forbes.</p><p>Much of Musk's net value comes from stakes in SpaceX and Tesla, so it is typically tied to the achievement of those companies. SpaceX's inventory reached its highest flat since June on Monday.</p> </div> <p> <h2> Read next </h2> </p> <div data-component-type="post-bottom-authors" data-load-strategy="exclude" data-track-view='&quot;module_in_view&quot;}' data-track-click-shared='&quot;navigation&quot;}'> <div data-track-view='&quot;module_in_view&quot;}'> <div> <p><span>Kelsey Vlamis is a elder newsman for Business Insider, anywhere she covers endeavor and tech news. She additionally writes endeavor stories concerning travel, luxury, and culture. Previously, she covered the environment, outdoors, and indigenous issues.</span><span>Her characteristic narrative <a href="https://en.mycoding.id/category/business" target="_blank">"Disaster at 18,200 feet"</a> received awards from the <a href="https://en.mycoding.id/category/business" target="_blank">New York Press Club</a>&nbsp;and the&nbsp;<a href="https://en.mycoding.id/category/business" target="_blank">North American Travel Journalists Association</a>, as fine as honest citation from the&nbsp;<a href="https://en.mycoding.id/category/business" target="_blank">Society of American Travel Writers</a>. She has additionally received an <a href="https://en.mycoding.id/category/business" target="_blank">American Journalism Online Award</a> for her safety on missing and murdered Indigenous group in Wyoming.</span><span>She's appeared on CBS, NPR, NBC, and another outlets to conversation her reporting. She earlier worked on the earth news array at the BBC in London and received a master's in reporting from Northwestern University.</span><span>She can be reached by email at kvlamis@businessinsider.com or via the encrypted-messaging app Signal at kelseyv.21.</span> </p> </div> </div> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/elon-musk-is-a-trillionaire-again-71176</guid> <pubDate>Tue, 06 Oct 2026 01:39:23 +0700</pubDate> <author><![CDATA[support@mycoding.id (Kelsey Vlamis)]]></author> </item> <item> <title><![CDATA[High Diesel Prices Bankrupted 16 Trucking Companies in Just 30 Days]]></title> <description><![CDATA[High Diesel Prices Bankrupted 16 Trucking Companies in Just 30 Days. Comments]]></description> <media:thumbnail url="https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?w=1200"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/high-diesel-prices-bankrupted-16-trucking-companies-in-just-30-days-71179</link> <content:encoded><![CDATA[<div> <figure> <p><img src="https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=1536" srcset="https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=50 50w, https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=280 280w, https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=289 289w, https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=308 308w, https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=324 324w, https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=600 600w, https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=675 675w, https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=768 768w, https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=990 990w, https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=1024 1024w, https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=1128 1128w, https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=1250 1250w, https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=1337 1337w, https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=1440 1440w, https://www.thedrive.com/wp-content/uploads/2026/10/GettyImages-22952361131.jpg?quality=85&amp;w=1536 1536w" sizes=" 1920px) 100vw, 1920px" fetchpriority="high" width="1920" height="1280" alt="Diesel prices are displayed complete $8 per gallon at a gas position in Los Angeles, on September 17, 2026, as prices attain document highs throughout the United States. Average diesel prices in the United States struck a document elevated of fair under $6.27 a gallon on September 15, the motorists&#039; affiliation AAA said, pressuring President Donald Trump onward of midterm legislative elections.The cost of the energy used mostly in highway hauling, agriculture and building hit $6.2694, according to the association, as the Middle East war tightens supplies and Ukraine strikes Russian refineries."> </p> <figcaption> <span> <em>Photo by Frederic J. BROWN / AFP via Getty Images</em> </span> </figcaption> </figure> </div> <div> <p>Statistically speaking, you likely don&rsquo;t run a diesel. Oil burners portray a small chunk of light-duty conveyance sales, equal whenever you aspect in heavy-duty pickups and the like. But in the freight world, if you&rsquo;re hauling dense loads, chances are you&rsquo;re fueling up alongside diesel&mdash;or perchance you <em>were</em>, if you drove for among the 16 trucking companies that went bankrupt final quarter. </p> <p><a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noreferrer noopener">According</a> to <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noreferrer noopener">multiple sources</a>, the rising disbursal of diesel energy was the straw the bankrupt the camel&rsquo;s rear for 16 freight operators that submitted for either Chapter 7 or Chapter 11 bankruptcy safety in delayed August and first September. Some were small, single-operator outfits. Others were larger, functioning dozens of vehicles. </p> <p>Four of those operators were based in Texas, anywhere Governor Abbott <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank">just proclaimed a statewide disaster</a> in command to comfort restrictions on the use of untaxed diesel energy on community highways. The move was mostly intended to provision alleviation for agriculture transportation, as most untaxed (dyed) diesel is produced for ranch use.</p> <p>But the matter is much bigger than fair agriculture trucking. High energy prices are contributing to cost increase in another sectors too. One outfit that submitted for Chap. 11 safety in September was a Florida-based Amazon shipment contractor. </p> <p>&ldquo;In the trucking business, gas prices eat into gain margins, and serious competition makes it difficult for smaller players to continue on those added expenses to customers,&rdquo; wrote Daniel Kline, co-Editor-in-Chef of <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noreferrer noopener">TheStreet.com</a>. &ldquo;Diesel is the latest force hitting carriers that were already weakened by years of mediocre freight economics and rising functioning costs.&rdquo;</p> <p>With residents of northern states already firing up their furnaces, American diesel energy prices are additionally being pressured by the energy sector. With winter fair weeks away, it&rsquo;s improbable that we&rsquo;ll see any important cost alleviation before the holidays, particularly if the circumstance in the Middle East stretches into 2027.</p> <p><em>Got a narrative tip? Let us cognize at tips@thedrive.com!</em></p> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/high-diesel-prices-bankrupted-16-trucking-companies-in-just-30-days-71179</guid> <pubDate>Tue, 06 Oct 2026 01:24:57 +0700</pubDate> <author><![CDATA[support@mycoding.id (Adi Gunawan)]]></author> </item> <item> <title><![CDATA[AI Tutoring with Khanmigo in a Two-Year School Experiment]]></title> <description><![CDATA[AI Tutoring with Khanmigo in a Two-Year School Experiment. Comments]]></description> <media:thumbnail url="https://edworkingpapers.com/sites/default/files/edworkingpaper-cover-25-1551.jpg"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/ai-tutoring-with-khanmigo-in-a-two-year-school-experiment-71177</link> <content:encoded><![CDATA[<div id="block-ewp-content"> <div> <p>August 2026 </p> <p>Generative AI has been promoted as the innovation that could change learning by providing all pupil a individual tutor. We provision several of the archetypal large-scale experimental evidence, from a two-year collection randomized test in 18 Tennessee center schools in which randomly assigned students used Khan Academy alongside its AI tutor, Khanmigo, configured to trainer fairly than provision answers, during existing regular remedial math sessions. Assignment raises math accomplishment by 1.3 national percentile ranks per term, or concerning 0.06 to 0.08 norm deviations complete a academy year; the implied consequence of a complete twelvemonth of energetic involvement reaches 0.14 norm deviations. These gains resemble those from Khan Academy custom without AI assistance. One clarification is that students used the tutor infrequently and, whenever they did, rarely busy it in substantive mathematical dialogue: 96 percent of students tried Khanmigo at smallest once, but the median pupil messaged it on lone a third of the days they practiced, and in lone 17 percent of the exercise sessions in which they made a mistake. Messages that students did dispatch were mostly naked answers or clicks on suggested prompts. The binding constraint appears to be engagement: realizing the commitment of AI tutoring volition necessitate getting students to use it, not fair giving them access.</p> <div> <p>Keywords</p> <p>Artificial intelligence; AI tutoring; Khanmigo; computer-assisted learning; instructional technology; site experiment; math achievement; pupil engagement; reply to intervention</p> </div> <div> <p>Document Object Identifier (DOI)</p> <p>10.26300/kner-hv33</p> </div> </div> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/ai-tutoring-with-khanmigo-in-a-two-year-school-experiment-71177</guid> <pubDate>Tue, 06 Oct 2026 01:00:45 +0700</pubDate> <author><![CDATA[support@mycoding.id (Adi Gunawan)]]></author> </item> <item> <title><![CDATA[Samon: Designing a Zen Garden Raking Puzzle]]></title> <description><![CDATA[Samon: Designing a Zen Garden Raking Puzzle. Comments]]></description> <media:thumbnail url="https://en.mycoding.id/site/assets/img/og-image.png"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/samon-designing-a-zen-garden-raking-puzzle-71178</link> <content:encoded><![CDATA[<a href="https://en.mycoding.id/category/technology" target="_blank">Comments</a>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/samon-designing-a-zen-garden-raking-puzzle-71178</guid> <pubDate>Tue, 06 Oct 2026 00:35:35 +0700</pubDate> <author><![CDATA[support@mycoding.id (Adi Gunawan)]]></author> </item> <item> <title><![CDATA[Gemini Call for Me might tell your mom you’re running late]]></title> <description><![CDATA[Gemini Call for Me might tell your mom you’re running late. Google may be expanding its "Call for Me" AI characteristic beyond endeavor calls so you can use it to dispatch messages to allies and family. Android Authority reports f...]]></description> <media:thumbnail url="https://platform.theverge.com/wp-content/uploads/sites/2/2026/08/Google-Pixel-11-Pro-Photos-of-Phone-7.jpg?quality=90&amp;strip=all&amp;crop=0%2C10.731298651824%2C100%2C78.537402696352&amp;w=1200"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/gemini-call-for-me-might-tell-your-mom-you-re-running-late-71165</link> <content:encoded><![CDATA[<div><div><div><div><div><p><a href="https://en.mycoding.id/category/technology" target="_blank"><img alt="Stevie Bonifield" data-chromatic="ignore" loading="lazy" width="36" height="36" decoding="async" data-nimg="1" srcset="https://platform.theverge.com/wp-content/uploads/sites/2/2025/10/STEVIE_BONIFIELD_BLURPLE.jpg?quality=90&amp;strip=all&amp;crop=0%2C0%2C100%2C100&amp;w=48 1x, https://platform.theverge.com/wp-content/uploads/sites/2/2025/10/STEVIE_BONIFIELD_BLURPLE.jpg?quality=90&amp;strip=all&amp;crop=0%2C0%2C100%2C100&amp;w=96 2x" src="https://platform.theverge.com/wp-content/uploads/sites/2/2025/10/STEVIE_BONIFIELD_BLURPLE.jpg?quality=90&amp;strip=all&amp;crop=0%2C0%2C100%2C100&amp;w=96"></a></p><div><p><span aria-expanded="false" aria-haspopup="true" role="button" tabindex="0"><span id="follow-author-standard_article_details-dmcyOmF1dGhvclByb2ZpbGU6ODAzMzIw"><span><span><svg width="9" height="9" viewbox="0 0 9 9" fill="none" xmlns="http://www.w3.org/2000/svg" aria-label="Follow"><path d="M5 0H4V4H0V5H4V9H5V5H9V4H5V0Z"></path></svg></span></span><span>Stevie Bonifield</span></span></span></p> <p><span>is a news author covering all things person tech. Stevie started out at Laptop Mag penning news and reviews on hardware, gaming, and AI.</span></p></div></div></div></div></div><div id="zephr-anchor"><p>Google may be expanding its &ldquo;Call for Me&rdquo; AI characteristic beyond <a href="https://en.mycoding.id/category/technology" target="_blank">business calls</a> so you can use it to dispatch messages to allies and family. <a href="https://en.mycoding.id/category/technology" target="_blank"><em>Android Authority</em></a> reports finding a &ldquo;Gemini Calling&rdquo; introductory display in an APK teardown alongside examples that contain &ldquo;Call Mom and inform her I volition be 15 minutes late&rdquo; and &ldquo;Call John and ask if he is coming for dinner.&rdquo;</p><p>Based on those examples, equal alongside this expansion, Gemini would apt be constricted to basic, content message-like calls. While Google&rsquo;s AI power not automate an complete catch-up phone call alongside your relatives, it could provision quick messages to group who favor a phone call, young female texts often, or equal motionless have a landline phone.</p><p><em>Android Authority</em> additionally says it established &ldquo;granular permissions&rdquo; for Gemini actions in idiosyncratic apps, including what appear to be settings for phone call permissions. These settings would authorize users to choice and choose which app capabilities they desire to authorize Gemini to access, possibly giving users an choice to opt out of receiving incoming automated calls from Gemini. However, as <em>Android Authority</em> notes, it&rsquo;s additionally imaginable Google power not publically publish this enlargement or the granular Gemini app settings.</p><div><p><span><strong>Follow topics and authors</strong> from this narrative to see additional akin this in your personalized homepage nourish and to obtain email updates.</span></p><ul><li id="follow-author-article_footer-dmcyOmF1dGhvclByb2ZpbGU6ODAzMzIw"><span aria-expanded="false" aria-haspopup="true" role="button" tabindex="0"><span><span><svg width="9" height="9" viewbox="0 0 9 9" fill="none" xmlns="http://www.w3.org/2000/svg" aria-label="Follow"><path d="M5 0H4V4H0V5H4V9H5V5H9V4H5V0Z"></path></svg></span><span>Stevie Bonifield</span></span></span></li><li><li><li><li></ul></div></div></div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/gemini-call-for-me-might-tell-your-mom-you-re-running-late-71165</guid> <pubDate>Tue, 06 Oct 2026 00:09:55 +0700</pubDate> <author><![CDATA[support@mycoding.id (Stevie Bonifield)]]></author> </item> <item> <title><![CDATA[Ephemeral Testing]]></title> <description><![CDATA[Ephemeral Testing. Comments]]></description> <media:thumbnail url="https://lemire.me/blog/wp-content/uploads/2026/10/Gemini_Generated_Image_8mi98l8mi98l8mi9.jpg"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/ephemeral-testing-71171</link> <content:encoded><![CDATA[<p><img width="825" height="510" src="https://lemire.me/blog/wp-content/uploads/2026/10/Gemini_Generated_Image_8mi98l8mi98l8mi9-825x510.jpg" alt="" decoding="async" fetchpriority="high"> </p> <div> <p>5 October 2026 &middot; 2 min</p> <div class="" data-block="true" data-editor="51ceu" data-offset-key="9ps6d-0-0"> <p><span data-offset-key="9ps6d-0-0">We have many ways to justify application quality. Unit testing. Fuzz testing. Integration testing. And so forth.</span></p> </div> <div class="" data-block="true" data-editor="51ceu" data-offset-key="n0f7-0-0"> <p><span data-offset-key="n0f7-0-0">I&rsquo;d akin to propose a method that was incredible before: </span><span data-offset-key="n0f7-0-1">ephemeral testing</span><span data-offset-key="n0f7-0-2">. (Ephemeral is a fancy term for &lsquo;throw away&rsquo; or &lsquo;temporary&rsquo;.)</span></p> </div> <div class="" data-block="true" data-editor="51ceu" data-offset-key="5q75-0-0"> <p><span data-offset-key="5q75-0-0">You compose your code. You build your application component. Or the AI delegate does it for you, it does not matter.</span></p> </div> <div class="" data-block="true" data-editor="51ceu" data-offset-key="f23fg-0-0"> <p><span data-offset-key="f23fg-0-0">Then you ask an AI delegate to build on it: an application, another layer, perchance several. You have it test what it built. You do not measure the first activity directly. You measure how fine the application built on top of it is.</span></p> </div> <div class="" data-block="true" data-editor="51ceu" data-offset-key="9m917-0-0"> <p><span data-offset-key="9m917-0-0">It is a form of integration testing. The difference is that the application on top is entirely ephemeral. You throw it distant whenever you are done.</span></p> </div> <div class="" data-block="true" data-editor="51ceu" data-offset-key="5r99t-0-0"> <p><span data-offset-key="5r99t-0-0">A archive alongside a spotless API, stable invariants, and helpful errors lets the delegate create item that plant quickly. A archive alongside hidden state, amazing defaults, or incomplete docs produces a heap of patches and failures. The failures are evidence concerning your code, not concerning the agent.</span></p> </div> <div class="" data-block="true" data-editor="51ceu" data-offset-key="ac4qd-0-0"> <p><span data-offset-key="ac4qd-0-0">You can reiterate it. Different agents, distinct tasks, identical foundation.</span></p> </div> <div class="" data-block="true" data-editor="51ceu" data-offset-key="7uv4n-0-0"> <p><span data-offset-key="7uv4n-0-0">In effect, alternatively of construction the center during trying to anticipate what power be needed at the another layers, you fair simulate the another layers by really construction them.</span></p> </div> <div class="" data-block="true" data-editor="51ceu" data-offset-key="2hmec-0-0"> <p><span data-offset-key="2hmec-0-0">Of course, you could contend that alongside AI, you can rebuild everything whenever you need to. But that&rsquo;s not practical. You need several form of stability. </span></p> </div> <div class="" data-block="true" data-editor="51ceu" data-offset-key="a1c0t-0-0"> <p><span data-offset-key="a1c0t-0-0">I have been applying this trick to assorted projects. As I regard a new feature, I ask my AI to prototype quickly what I power afterward build according to what I am doing it. Ephemeral evaluation plant for me thus far.</span></p> </div> </div> <div> <h2>Published by</h2> <p><img alt="" src="https://secure.gravatar.com/avatar/a0c6c34cf4a45ff5083d5ea541e7f27c5e4457ac393889e077af10688f6b3831?s=112&amp;d=mm&amp;r=g" srcset="https://secure.gravatar.com/avatar/a0c6c34cf4a45ff5083d5ea541e7f27c5e4457ac393889e077af10688f6b3831?s=112&amp;d=mm&amp;r=g 2x" height="56" width="56" decoding="async"> </p> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/ephemeral-testing-71171</guid> <pubDate>Tue, 06 Oct 2026 00:06:36 +0700</pubDate> <author><![CDATA[support@mycoding.id (Doris Putra)]]></author> </item> <item> <title><![CDATA[Worth Building]]></title> <description><![CDATA[Worth Building. Comments]]></description> <media:thumbnail url="https://armstr.ng/og/worth-building.jpg"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/worth-building-71172</link> <content:encoded><![CDATA[<div j=""> <a href="https://en.mycoding.id/category/technology" target="_blank" j> <svg viewbox="0 0 16 16" aria-hidden="true" j> <path d="M13 8H3.5M7.5 4l-4 4 4 4" fill="none" stroke="currentColor" stroke-width="1.3" stroke-linecap="round" stroke-linejoin="round" j></path> </svg> Writing </a> <p j>What changes whenever a tool doesn't have to pay for itself</p> <p j> October 5, 2026 <span j>3 infinitesimal read</span> </p> </div><div j><p>Years ago, if an app annoyed me, I shrugged and dealt alongside it. I could sometimes have fixed it or built my own, but the annoyance rarely justified the effort. With LLMs that calculation has changed, and this former weekend it changed for a domain lookup tool.</p><p>Occasionally I need to inspect DNS records or registration info for a domain. At my device I use dig or whois. Otherwise I Google "domain lookup tool," click on one, and paste in the domain. Most of what comes up is slow, buried in upsells, and unpleasant to use for item that have to be simple.</p><figure float="none"><img src="https://armstr.ng/_astro/8ad414aee13f7e50a58d87907fb972a367dfb4d3a5bb659be63950a4b716074e_Z1kr33T.png" srcset="/_astro/8ad414aee13f7e50a58d87907fb972a367dfb4d3a5bb659be63950a4b716074e_1tuKUk.png 480w, /_astro/8ad414aee13f7e50a58d87907fb972a367dfb4d3a5bb659be63950a4b716074e_2lduLq.png 680w, /_astro/8ad414aee13f7e50a58d87907fb972a367dfb4d3a5bb659be63950a4b716074e_2jleij.png 1024w, /_astro/8ad414aee13f7e50a58d87907fb972a367dfb4d3a5bb659be63950a4b716074e_EFDaw.png 1360w, /_astro/8ad414aee13f7e50a58d87907fb972a367dfb4d3a5bb659be63950a4b716074e_Z1kr33T.png 2040w" sizes=" 727px) calc(100vw - 32px), 680px" width="2040" height="2031" alt loading="lazy" decoding="async" data-blur><figcaption></figcaption></figure><p>They aren't seriously made -- they're fine made for a distinct job. A domain lookup answers a inquiry nobody pays to ask, so many of the liberated tools that display up in hunt are the ones a revenue chimney justifies: the lookup brings in person who power buy a domain or hosting, and the leaf is built to position for "domain lookup tool" and to sell. The tools you discover are the ones built to be found. Being fine at the lookup was never what paid for them.</p><p>I wanted item I'd really bask using, so I opened Claude Code and built <a href="https://en.mycoding.id/category/technology" target="_blank">heade.rs</a>. In three prompts and concerning an hr I had a archetypal operating type deployed to Cloudflare: DNS and registration records, live latency, email configuration, HTTPS details. The remainder of the day went into making it awareness good: animations, graphics, an interface I akin looking at. It expenses small than a cup of coffee a duration to run. It doesn't have to market anything, so it can fair be good.</p><figure float="none"><img src="https://armstr.ng/_astro/713aeca5e5a7aac4469922bb7b483fa3e8e23a66211816145d55f608c5f660dc_Z29qe4t.png" srcset="/_astro/713aeca5e5a7aac4469922bb7b483fa3e8e23a66211816145d55f608c5f660dc_Z1s1etN.png 480w, /_astro/713aeca5e5a7aac4469922bb7b483fa3e8e23a66211816145d55f608c5f660dc_cHNvW.png 680w, /_astro/713aeca5e5a7aac4469922bb7b483fa3e8e23a66211816145d55f608c5f660dc_Z1ydcax.png 1024w, /_astro/713aeca5e5a7aac4469922bb7b483fa3e8e23a66211816145d55f608c5f660dc_1BaXSo.png 1360w, /_astro/713aeca5e5a7aac4469922bb7b483fa3e8e23a66211816145d55f608c5f660dc_Z29qe4t.png 1944w" sizes=" 727px) calc(100vw - 32px), 680px" width="1944" height="2484" alt loading="lazy" decoding="async" data-blur><figcaption>The <a href="https://en.mycoding.id/category/technology" target="_blank">heade.rs</a> overview page</figcaption></figure><figure float="none"><img src="https://armstr.ng/_astro/b52f0edf4a37eb72cbf5ac040d9a6dd432b054b70ac1c8d45f931481f6fc703e_ZGIgNd.png" srcset="/_astro/b52f0edf4a37eb72cbf5ac040d9a6dd432b054b70ac1c8d45f931481f6fc703e_1RRgpJ.png 480w, /_astro/b52f0edf4a37eb72cbf5ac040d9a6dd432b054b70ac1c8d45f931481f6fc703e_1gH2hT.png 680w, /_astro/b52f0edf4a37eb72cbf5ac040d9a6dd432b054b70ac1c8d45f931481f6fc703e_Z8f60F.png 1024w, /_astro/b52f0edf4a37eb72cbf5ac040d9a6dd432b054b70ac1c8d45f931481f6fc703e_ZydDbT.png 1360w, /_astro/b52f0edf4a37eb72cbf5ac040d9a6dd432b054b70ac1c8d45f931481f6fc703e_ZGIgNd.png 1978w" sizes=" 727px) calc(100vw - 32px), 680px" width="1978" height="2450" alt loading="lazy" decoding="async" data-blur><figcaption>Tabs for deep-dives</figcaption></figure><p>Before, a project akin this needed justifying. I'd have asked whether I'd use it adequate to create the period worthwhile. If I expected to expend weeks on it, I'd have started thinking concerning another users, pricing, how it could pay for itself. A small annoyance would have rotate into a much bigger commitment; a weekend is much easier to justify. I wanted it to exist, and that was enough.</p><p>A few hours used to get a programmer a script; now it gets a polished app, and it gets a non-programmer item alternatively of nothing. More group can apparent the bar, and additional ideas apparent it: <a href="https://en.mycoding.id/category/technology" target="_blank">small tools that resolve a individual annoyance</a>, weird ideas you're inquisitive about, things you build merely since you'd bask having them or the earth would be additional beautiful if they existed. The spectators can be one person.</p><p>The identical economics cut the another way: heade.rs volition likely not position for "domain lookup tool," and neither volition most things built akin it. Cheaper application method additional group shipping, and another demo in a crowded nourish is uncomplicated to scroll past. If you desire to attain additional people, you motionless have to provision them a logic to care. I'm additional curious whenever person explains what bothered them, what they made, and the choices they cared concerning alongside the way. The narrative gives me a logic to try the thing.</p><p>Sometimes sharing a individual project leads location unexpected. Four years ago <a href="https://en.mycoding.id/category/technology" target="_blank">Paragraph</a> started as item I built for myself, afterward another group wanted to use it too. I'm glad I shared it.</p><p>But I additionally akin that <a href="https://en.mycoding.id/category/technology" target="_blank">heade.rs</a> doesn't need to prosecute that path. If it stays a small tool I use occasionally to appearance up a domain, it was motionless value building.</p></div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/worth-building-71172</guid> <pubDate>Mon, 05 Oct 2026 23:59:24 +0700</pubDate> <author><![CDATA[support@mycoding.id (Doris Putra)]]></author> </item> <item> <title><![CDATA[Example.com Just Launched the Biggest Redesign in Decades]]></title> <description><![CDATA[Example.com Just Launched the Biggest Redesign in Decades. Comments]]></description> <media:thumbnail url="https://www.debugbear.com/dimg/1f8c2ab20c69e5a4a3fb996aebed6b0d.png"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/example-com-just-launched-the-biggest-redesign-in-decades-71173</link> <content:encoded><![CDATA[<div id="__blog-post-container" itemprop="articleBody"><p>example.com is a reserved domain name set apart by the Internet Assigned Numbers Authority (IANA) for records purposes. It has been accessible as an example URL for developers and writers since the delayed nineties.</p> <p>While the general messaging of the leaf has been accordant complete time, the ocular appearance has received multiple important overhauls.</p> <p>In this article, we obtain a appearance at the latest changes as fine as the development of example.com complete the final 20+ years.</p> <video width="1920" height="1080" controls="" playsinline="" autoplay="" muted="" loop=""><source src="https://www.debugbear.com/dimg/example-redesign-history.mp4" type="video/mp4">Your browser does not assistance the video tag.</source></video> <h2 id="what-changed-on-28-september-2026">What changed on 28 September 2026?<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label="Direct nexus to What changed on 28 September 2026?" title="Direct nexus to What changed on 28 September 2026?">&#8203;</a></h2> <p>Until 28 September 2026, example.com was a fixed English-language page. The redesign introduces multi-language assistance using JavaScript, showing the satisfied in a new tongue all 5 seconds.</p> <p>Example.com shows an clarification of the site's intent in English, Arabic, Chinese, French, Russian and Spanish. This is the English-language message:</p> <blockquote> <p>This domain is for use in records examples without needing permission. This is not a service, evade relying on it for evaluation and monitoring purposes.</p> </blockquote> <p>Along alongside introducing multi-language support, the JavaScript code additionally inserts an SVG publish icon.</p> <p><img loading="lazy" src="https://www.debugbear.com/dimg/3fcf95b7dbb16b31bb844bc5db74cb5e.png" alt="" data-abc="true"></p> <h3 id="how-does-the-language-transition-animation-work">How does the tongue passage animation work?<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label="Direct nexus to How does the tongue passage animation work?" title="Direct nexus to How does the tongue passage animation work?">&#8203;</a></h3> <p>The new location doesn't fair substitute the satisfied whenever showing the next language. Instead, there's a gradual opacity transition.</p> <p><img loading="lazy" src="https://www.debugbear.com/dimg/639d7b9aca8f483d027ecf028afa3730.png" alt="Language transition" data-abc="true"></p> <p>The opacity animation itself fair uses transition: opacity .4s;. But how is the character-by-character passage implemented?</p> <p>Each character is wrapped in its own extend element, and all extend gets a slightly larger <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener noreferrer">CSS transition-delay</a> than the one before it. That method all character's opacity animation happens at a slightly distinct time.</p> <p><img loading="lazy" src="https://www.debugbear.com/dimg/7ca8f04f11834c46652ba051d24c057e.png" alt="" data-abc="true"></p> <h2 id="statement-from-iana">Statement from IANA<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label="Direct nexus to Statement from IANA" title="Direct nexus to Statement from IANA">&#8203;</a></h2> <p>IANA provided the following declaration explaining the reasoning rearward the latest changes:</p> <blockquote> <p>The changes we create to the location from time-to-time are normally informed by a desire to either decrease the general bandwidth demands of serving the site, or enhance its utility. At its bosom it is a placeholder for a location no-one have to be accessing, but we have historically showed a communication there to communicate visitors concerning why the domain is registered and how they may use it.</p> <p>As it tends to be heavily trafficked, the general bandwidth is a key consideration, and to that end among the changes we made this week was to divided the leaf satisfied into a additional essential page, augmented by a distinct Javascript document alongside additional satisfied beyond that. Since most of the traffic to the location is automated it tends not to fetch the Javascript file, reducing general data requirements.</p> <p>The essential intent of the domain is for use in documentation, specified as explanatory examples you may discover in instructions. We cognize that group may, for example, cut-and-paste a example configuration document and ignore to customize entries that merge an example domain, and we anticipate we get several secondary traffic from that. However, the domain isn't intended to be a broad intent endpoint for things akin preparedness evaluation so we do not advance that benevolent of usage. There is no necessity there is a HTTP assistance current on the presenter in command to fulfill its purpose, we fair run it as a courtesy.</p> </blockquote> <h2 id="january-20-2002-what-did-the-earliest-version-look-like">January 20, 2002: What did the earliest type appearance like?<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label=" What did the earliest type appearance like?" title=" What did the earliest type appearance like?">&#8203;</a></h2> <p>According to <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener noreferrer">Wikipedia</a>, the example.com website launched on January 1, 1999. The earliest type accessible to perspective in the Wayback Machine is from January 20, 2002.</p> <p>The earliest type of the website lone featured a catalog of domain names reserved by the Internet Corporation for Assigned Names and Numbers (ICANN) and IANA.</p> <blockquote> <p>In the .com, .net, and .org top-level domains (TLDs), assorted domain names are reserved. These names are reserved from first registration, but to the degree they are already registered the existing registrant may renew them.</p> </blockquote> <p><img loading="lazy" src="https://www.debugbear.com/dimg/58a7d948655cc07f3c6082ae068d2b58.png" alt=" January 20, 2002" data-abc="true"></p> <p>Structurally, the HTML used a array layout, alongside the ICANN logo positioned in the top remaining border of the page.</p> <p>The server headers display that the location used Apache 1.3.22 at this point.</p> <h2 id="march-28-2002-simplified-messaging">March 28, 2002: simplified messaging<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label=" simplified messaging" title=" simplified messaging">&#8203;</a></h2> <p>The archetypal type of the example.com wording we acknowledge today came 67 days following the archetypal accessible screenshot:</p> <blockquote> <p>You have reached this web leaf by typing "example.com", "example.net", or "example.org" into your web browser.</p> </blockquote> <blockquote> <p>These domain names are reserved for use in records and are not accessible for registration.</p> </blockquote> <p><img loading="lazy" src="https://www.debugbear.com/dimg/3dfccea58c8131bae0191eb3de3ccdab.png" alt=" March 28, 2002" data-abc="true"></p> <h2 id="february-7-2003-rfc-2606-citation-added">February 7, 2003: RFC 2606 citation added<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label=" RFC 2606 citation added" title=" RFC 2606 citation added">&#8203;</a></h2> <p>In February 2003, the satisfied was revised to contain a nexus to <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener noreferrer">RFC 2606</a>, the authoritative document for reserved top-level and second-level domains, so visitors could discover additional data on the website's purpose.</p> <p>There was additionally a small specialized alter about this time: the server was upgraded to Apache 1.3.27 on Red Hat Linux.</p> <h2 id="july-30-2010-edu-added-to-domain-list">July 30, 2010: .edu added to domain list<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label=" .edu added to domain list" title=" .edu added to domain list">&#8203;</a></h2> <p>The website afterward went unchanged for seven years. On July 30, 2010, a minor alter was made: example.edu was now pointed to the landing page, alongside the three former domains.</p> <h2 id="july-29-2013-migration-and-landing-page-redesign">July 29, 2013: immigration and landing leaf redesign<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label=" immigration and landing leaf redesign" title=" immigration and landing leaf redesign">&#8203;</a></h2> <p>From January 2011, example.com didn't assist its own page. Instead, it redirected visitors to a leaf on IANA's website.</p> <p>That changed on July 29, 2013, whenever the redirect was removed and example.com began serving its own leaf from the EdgeCast <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener noreferrer">Content Delivery Network (CDN)</a> alternatively of Apache, alongside a important redesign of the landing page. The new scheme used a rounded cardstock alongside an &lt;h1&gt; study 'Example Domain' and a new clarification of the website's purpose.</p> <p>The viewable domain catalog was now gone, alongside a nexus to IANA's website for additional information.</p> <p><img loading="lazy" src="https://www.debugbear.com/dimg/0fa2176503bcdb3aa6b9044d636a0c21.png" alt=" July 29, 2013" data-abc="true"></p> <h2 id="october-17-2019-font-and-copy-changes">October 17, 2019: font and copy changes<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label=" font and copy changes" title=" font and copy changes">&#8203;</a></h2> <p>A new update came six years following the biggest alter in the website's history. The layout remained the same, but the font stack was modernized to contain additional fallback fonts for devices specified as Macs, iPhones, and Windows PCs.</p> <p>The copy was tweaked slightly, alongside 'is for use in explanatory examples' replacing 'established to be used' and 'in literature' replacing 'in examples'.</p> <p><img loading="lazy" src="https://www.debugbear.com/dimg/d6b8b3a027604b36f74b48a4527de28e.png" alt=" October 17, 2019" data-abc="true"></p> <h2 id="january-15-2025-infrastructure-switch">January 15, 2025: infrastructure switch<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label=" infrastructure switch" title=" infrastructure switch">&#8203;</a></h2> <p>Almost dozen years following the toggle from Apache to the EdgeCast CDN, another infrastructure alter took place: the Server header disappeared entirely. The <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener noreferrer">response headers</a> solitary don't disclose which phase was serving the leaf at this point.</p> <p>A alter of provider about this period isn't surprising. EdgeCast had been acquired from Yahoo by Limelight Networks in 2022 and rebranded as Edgio. Edgio afterward submitted for Chapter 11 bankruptcy in delayed 2024, alongside Akamai acquiring choose Edgio client contracts.</p> <h2 id="october-9-2025-redesign">October 9, 2025: redesign<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label=" redesign" title=" redesign">&#8203;</a></h2> <p>Later in 2025, the leaf was redesigned. The cardstock scheme was dropped, and the HTML was minified. The copy was changed to a additional straightforward message, again linking to IANA's website, alongside the nexus content changed from 'More information...' to 'Learn more'.</p> <p><img loading="lazy" src="https://www.debugbear.com/dimg/6cf6b39d46f770ea59d904cc8c0a6373.png" alt=" October 9, 2025" data-abc="true"></p> <h2 id="december-17-2025-cloudflare-migration">December 17, 2025: Cloudflare migration<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label=" Cloudflare migration" title=" Cloudflare migration">&#8203;</a></h2> <p>Less than a twelvemonth following the former switch, the infrastructure changed again: the location now serves from <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener noreferrer">Cloudflare</a>, as indicated by the cloudflare server header and CF-RAY header in the response. Whatever phase served the leaf following the January 2025 change, it has now been replaced alongside a Cloudflare-fronted setup.</p> <h2 id="june-9-2026-favicon-and-html-tweaks">June 9, 2026: favicon and HTML tweaks<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label=" favicon and HTML tweaks" title=" favicon and HTML tweaks">&#8203;</a></h2> <p>The next update, on June 9, 2026, brought no ocular changes. The lone HTML changes on the leaf itself were a favicon tag being added and the &lt;p&gt; tags being closed. The leaf now includes an bare favicon:</p> <pre tabindex="0"><div><div><pre tabindex="0"><span><span>&lt;link rel="icon" href="data:," /&gt;</span><br></span></pre></div></div></pre> <p>This avoids a lot of unnecessary requests, as alternatively browsers appearance for a favicon at /favicon.ico.</p> <p><img loading="lazy" src="https://www.debugbear.com/dimg/1cfc0dbb0685ecbfcdb078c0e845f4fe.png" alt="" data-abc="true"></p> <h2 id="avoid-relying-on-it-for-testing-and-monitoring-purposes">Avoid relying on it for evaluation and monitoring purposes<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label="Direct nexus to Avoid relying on it for evaluation and monitoring purposes" title="Direct nexus to Avoid relying on it for evaluation and monitoring purposes">&#8203;</a></h2> <p>Example.com archetypal introduced an "Avoid use in operations" communication in 2025.</p> <p>For developers, it's tempting to use example.com to inspect if the network is operating or test HTTP requests. The example server apt receives a lot of traffic through this.</p> <p>However, as the leaf now clarifies, it's not a assistance you can depend on. When we appearance at our <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener noreferrer">uptime monitoring</a> data, we can see that all now and afterward the example.com server doesn't react correctly.</p> <p>Using infrastructure that your institution controls can be additional reliable.</p> <p><img loading="lazy" src="https://www.debugbear.com/dimg/ae3d696fc972adc2b908ec006d4abc4b.png" alt="Example.com unsuccessful uptime checks" data-abc="true"></p> <h2 id="conclusion">Conclusion<a href="https://en.mycoding.id/category/technology" target="_blank" aria-label="Direct nexus to Conclusion" title="Direct nexus to Conclusion">&#8203;</a></h2> <p>Looking at the ocular timeline, we can see that changes to example.com happen sporadically. Sometimes a brace of small tweaks happen in back-to-back months. Other times the website remains untouched for periods of up to seven years.</p> <p>We have been <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener noreferrer">monitoring the page</a> for multiple years in our community demo project. The <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener noreferrer">Chrome UX Report (CrUX) data</a> shows how leaf speed has changed complete time.</p> <p><img loading="lazy" src="https://www.debugbear.com/dimg/4d490599f6369e0dc9a7a268eecf8aae.png" alt="Example.com achievement data" data-abc="true"></p> <p>To study additional concerning how your website is performing, <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener noreferrer">sign up</a> for a liberated 14-day DebugBear trial.</p> <div><div><p><img src="https://www.debugbear.com/dimg/57001785e35454b95f43aa4f3bf6f857.png" alt="Illustration of website monitoring"><img src="https://www.debugbear.com/dimg/b2c0ae7a8dfbc4b18ba827a334c5c1af.png" alt="Illustration of website monitoring"></p><div><h2>Monitor Page Speed &amp; Core Web Vitals</h2><div><h3>DebugBear monitoring includes:</h3><ul><li>In-depth Page Speed Reports</li><li>Automated Recommendations</li><li>Real User Analytics Data</li></ul></div></div></div></div></div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/example-com-just-launched-the-biggest-redesign-in-decades-71173</guid> <pubDate>Mon, 05 Oct 2026 23:55:11 +0700</pubDate> <author><![CDATA[support@mycoding.id (Doris Putra)]]></author> </item> <item> <title><![CDATA[Google’s Mueller Says AI Crawlers Access Sitemaps & RSS In His Logs]]></title> <description><![CDATA[Google’s Mueller Says AI Crawlers Access Sitemaps & RSS In His Logs. Google's John Mueller says AI training crawlers normally don't recommendation sitemap submission and suggests default sitemap names or RSS feeds to assistance them discover sites. ...]]></description> <media:thumbnail url="https://en.mycoding.id/site/assets/img/og-image.png"/> <category><![CDATA[Business]]></category> <link>https://en.mycoding.id/google-s-mueller-says-ai-crawlers-access-sitemaps-rss-in-his-logs-71164</link> <content:encoded><![CDATA[<div class="sej-article-content gototop-pos "> <div class="sss2_sllo_o6"> </div> <div id="narrow-cont"><p>Google’s John Mueller says AI training crawlers normally don’t provision location owners a way to present a sitemap, and he suggests a default document name or an RSS nourish for sites that desire those crawlers to discover their content.</p> <p>He made the comments alongside Martin Splitt in the Oct. 1 event of Google’s <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">Search Off the Record podcast</a>, titled “Do sitemaps motionless matter?” He additionally stated he has seen AI crawlers admission his sitemap and RSS records in his own server logs.</p> <h2>Private Sitemaps And AI Crawlers</h2> <p>Mueller stated location owners who desire to keep a sitemap personal can provision it an different document name, depart it out of robots.txt, and present it to Google directly. The downside is that another systems can’t discover it, he said, and Bing would likely need its own submission.</p><div data-total="4" id="SEJ_300x250_UnderPost_1-parent" class="content-unit sss2_sllo_o6 mmh-90-wrap"> <div class="mmh-90-inner"> <div class="mmh-90 flex-aligner"> <div data-adnumber="0" data-middle="yes" data-p-slot="SEJ_300x250_UnderPost" data-slot="SEJ_300x250_UnderPost/SEJ_300x250_UnderPost_1" id="SEJ_300x250_UnderPost_1" class="sadslots"> </div> </div> </div> </div> <p>AI training crawlers are distinct since “they normally don’t have any benevolent of a Console or any setup anywhere you can present a sitemap file.” For sites that desire their satisfied in AI systems, he suggested “either you rod to the generic naming, call it sitemap.xml, or you concentration on RSS feeds.”</p> <p>The sitemaps protocol says a robots.txt Sitemap row is autonomous of the user-agent line, so it isn’t tied to any one crawler’s rules. Feeds are easier to find, he noted, since they’re normally connected from a page’s HTML head.</p> <p>“I’ve seen that happen in my server logs anywhere several AI crawler accesses my sitemap file,” he said, and he’s seen the identical alongside his RSS files. He didn’t name the crawlers and stated he doesn’t cognize whether AI companies document this or what they do alongside the files.</p><div data-total="4" id="SEJ_300x250_UnderPost_2-parent" class="content-unit sss2_sllo_o6 mmh-90-wrap"> <div class="mmh-90-inner"> <div class="mmh-90 flex-aligner"> <div data-adnumber="1" data-middle="no" data-p-slot="SEJ_300x250_UnderPost" data-slot="SEJ_300x250_UnderPost/SEJ_300x250_UnderPost_2" id="SEJ_300x250_UnderPost_2" class="sadslots"> </div> </div> </div> </div> <h2>Llms.txt Isn’t A Sitemap Substitute</h2> <p>Asked whether llms.txt could substitute an XML sitemap, Mueller compared the Markdown document to an HTML sitemap and stated Google’s systems can’t use it as a sitemap since it lacks the strict format.</p> <p>“I think the anticipation is bigger than the reality,” he said, allowing that hunt systems power peruse Markdown records someday. “Currently none of this happens.” He’s fine alongside sites trying it but wouldn’t depend on it.</p> <p>In August, <a href="https://en.mycoding.id/category/business" target="_blank">he stated the lone crawlers</a> on his test sites that claimed to obtain Markdown were SEO tools. In May, I covered <a href="https://en.mycoding.id/category/business" target="_blank">Google’s AI optimization guide</a> listing llms.txt among the strategies sites don’t need for generative AI features.</p> <h2>Why A Valid Sitemap Can Show ‘Couldn’t Fetch’</h2> <p>Splitt closed by asking why Search Console reports “Couldn’t fetch” for a valid, community sitemap connected from robots.txt.</p><div data-total="4" id="SEJ_300x250_UnderPost_3-parent" class="content-unit sss2_sllo_o6 mmh-90-wrap"> <div class="mmh-90-inner"> <div class="mmh-90 flex-aligner"> <div data-adnumber="2" data-middle="no" data-p-slot="SEJ_300x250_UnderPost" data-slot="SEJ_300x250_UnderPost/SEJ_300x250_UnderPost_3" id="SEJ_300x250_UnderPost_3" class="sadslots"> </div> </div> </div> </div> <p>Mueller stated one logic is presenter load. Google’s systems may be too occupied to fetch the sitemap, and Search Console reports that as “Couldn’t fetch” too. The another is crawl demand, which can guide Google to skip the sitemap whenever its systems see no need to crawl much additional from a site.</p> <p>“And the crawl petition is extremely frequently according to the perceived norm of a website,” he said, adding that “it’s not purely a specialized thing.” In February, he <a href="https://en.mycoding.id/category/business" target="_blank">told a Reddit user</a> that Google won’t use a sitemap if it isn’t convinced there’s new and crucial satisfied to index.</p> <p>Search Console’s <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">Sitemaps study assistance page</a> lists low crawl petition among the reasons a sitemap can’t be fetched and says improved satisfied brings additional crawl demand. Other reasons it gives contain robots.txt blocks, unresolved manual actions, and incorrect URLs.</p> <h2>Why This Matters</h2> <p>A sitemap alongside an different name and no robots.txt admission stays hidden from systems it isn’t submitted to, according to Mueller, and AI training crawlers normally don’t recommendation a way to present one. He suggested a default sitemap name or an RSS nourish for sites that desire AI crawlers to discover their content. A robots.txt listing additionally tells crawlers that assistance the Sitemap directive anywhere the document is.</p> <p>For a valid sitemap showing “Couldn’t fetch,” the two causes Mueller described, presenter burden and crawl demand, sit exterior the document itself.</p> <h2>Looking Ahead</h2> <p>Google’s Search Relations guide advised operating from what’s documented now fairly than preparedness about llms.txt. Server logs are anywhere he saw AI crawlers attain his files, and they’re anywhere you can inspect your own.</p> <p><em>Featured Image: Tetiana Yurchenko/Shutterstock. Google wordmark: Source: Google.</em></p> </div> <div id="bcats" class="bottom-cat narrow-cont"> <span class="sej-category boxed cat-label">Category</span> <a href="https://en.mycoding.id/category/business" target="_blank">News</a> <a href="https://en.mycoding.id/category/business" target="_blank">AI Search</a> </div> <div class="sej-above-author-widget"> <div class="sej-widget clearfix"> <div class="sej-badge-box"> <a href="https://en.mycoding.id/category/business" target="_blank" data-placement="Under Article" aria-label="Add Search Engine Journal as a preferred origin on Google"> <svg class="sej-gps-g" viewbox="0 0 48 48" aria-hidden="true" focusable="false"> <path fill="#EA4335" d="M24 9.5c3.54 0 6.71 1.22 9.21 3.6l6.85-6.85C35.9 2.38 30.47 0 24 0 14.62 0 6.51 5.38 2.56 13.22l7.98 6.19C12.43 13.72 17.74 9.5 24 9.5z"></path> <path fill="#4285F4" d="M46.98 24.55c0-1.57-.15-3.09-.38-4.55H24v9.02h12.94c-.58 2.96-2.26 5.48-4.78 7.18l7.73 6c4.51-4.18 7.09-10.36 7.09-17.65z"></path> <path fill="#FBBC05" d="M10.53 28.59c-.48-1.45-.76-2.99-.76-4.59s.27-3.14.76-4.59l-7.98-6.19C.92 16.46 0 20.12 0 24c0 3.88.92 7.54 2.56 10.78l7.97-6.19z"></path> <path fill="#34A853" d="M24 48c6.48 0 11.93-2.13 15.89-5.81l-7.73-6c-2.15 1.45-4.92 2.3-8.16 2.3-6.26 0-11.57-4.22-13.47-9.91l-7.98 6.19C6.51 42.62 14.62 48 24 48z"></path> </svg> <span class="sej-gps-text">Add <b>SEJ</b> as a preferred origin on Google</span> </a> </div> </div> </div> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/google-s-mueller-says-ai-crawlers-access-sitemaps-rss-in-his-logs-71164</guid> <pubDate>Mon, 05 Oct 2026 23:47:18 +0700</pubDate> <author><![CDATA[support@mycoding.id (Matt G. Southern)]]></author> </item> <item> <title><![CDATA[ChatGPT is adding real cartoonists' signatures to fake New Yorker cartoons]]></title> <description><![CDATA[ChatGPT is adding real cartoonists' signatures to fake New Yorker cartoons. Comments]]></description> <media:thumbnail url="https://en.mycoding.id/site/assets/img/og-image.png"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/chatgpt-is-adding-real-cartoonists-signatures-to-fake-new-yorker-cartoons-71174</link> <content:encoded><![CDATA[<a href="https://en.mycoding.id/category/technology" target="_blank">Comments</a>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/chatgpt-is-adding-real-cartoonists-signatures-to-fake-new-yorker-cartoons-71174</guid> <pubDate>Mon, 05 Oct 2026 23:46:45 +0700</pubDate> <author><![CDATA[support@mycoding.id (Doris Putra)]]></author> </item> <item> <title><![CDATA[Global Solar Atlas: summary of solar power potential globally]]></title> <description><![CDATA[Global Solar Atlas: summary of solar power potential globally. Comments]]></description> <media:thumbnail url="https://en.mycoding.id/site/assets/img/og-image.png"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/global-solar-atlas-summary-of-solar-power-potential-globally-71175</link> <content:encoded><![CDATA[<a href="https://en.mycoding.id/category/technology" target="_blank">Comments</a>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/global-solar-atlas-summary-of-solar-power-potential-globally-71175</guid> <pubDate>Mon, 05 Oct 2026 23:37:58 +0700</pubDate> <author><![CDATA[support@mycoding.id (Doris Putra)]]></author> </item> <item> <title><![CDATA[Texas city demands $2M for public records on Flock usage]]></title> <description><![CDATA[Texas city demands $2M for public records on Flock usage. Comments]]></description> <media:thumbnail url="https://en.mycoding.id/site/assets/img/og-image.png"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/texas-city-demands-2m-for-public-records-on-flock-usage-71162</link> <content:encoded><![CDATA[<a href="https://en.mycoding.id/category/technology" target="_blank">Comments</a>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/texas-city-demands-2m-for-public-records-on-flock-usage-71162</guid> <pubDate>Mon, 05 Oct 2026 23:05:57 +0700</pubDate> <author><![CDATA[support@mycoding.id (Mira Azkia)]]></author> </item> <item> <title><![CDATA[Google just got a boost in its bid to buy Spirit Airlines’ data for AI training]]></title> <description><![CDATA[Google just got a boost in its bid to buy Spirit Airlines’ data for AI training. Google's bid for Spirit Airlines' data got a boost following a court-appointed authoritative stated the companies addressed person privacy concerns.]]></description> <media:thumbnail url="https://i.insider.com/6ac4102ef66e1154bdfa34ea?width=1200&amp;format=jpeg"/> <category><![CDATA[Business]]></category> <link>https://en.mycoding.id/google-just-got-a-boost-in-its-bid-to-buy-spirit-airlines-data-for-ai-training-71161</link> <content:encoded><![CDATA[<div data-component-type="post-hero" data-load-strategy="exclude"> <figure data-type="img" e-name="image-figure-image" data-media-container="image" itemscope itemtype="https://schema.org/ImageObject"> <div> <p><img src="https://i.insider.com/6ac40e03225e4c4a50a381f5?width=2000&amp;format=jpeg&amp;auto=webp" srcset="https://i.insider.com/6ac40e03225e4c4a50a381f5?width=400&amp;format=jpeg&amp;auto=webp 400w, https://i.insider.com/6ac40e03225e4c4a50a381f5?width=500&amp;format=jpeg&amp;auto=webp 500w, https://i.insider.com/6ac40e03225e4c4a50a381f5?width=700&amp;format=jpeg&amp;auto=webp 700w, https://i.insider.com/6ac40e03225e4c4a50a381f5?width=1000&amp;format=jpeg&amp;auto=webp 1000w, https://i.insider.com/6ac40e03225e4c4a50a381f5?width=1300&amp;format=jpeg&amp;auto=webp 1300w, https://i.insider.com/6ac40e03225e4c4a50a381f5?width=2000&amp;format=jpeg&amp;auto=webp 2000w" sizes=" 1280px) 900px" alt="Travelers rotate luggage former a ample yellow Spirit sign in an airfield terminal corridor." decoding="sync"> </p></div> <span> <span> <svg aria-hidden="true" focusable="false" xmlns="http://www.w3.org/2000/svg" width="1em" height="1em" viewbox="0 0 24 24"> <path fill="currentColor" fill-rule="evenodd" d="m4.56 18.5 7.486-7.72 7.394 7.626 2.56-2.64L12.046 5.5 2 15.86l2.56 2.64Z"></path> </svg> <figcaption e-name="image-caption"> <span>Google's bid to buy Spirit Airlines' old data has been challenged by unions representing escape attendants and pilots.</span> <span> <span e-name="image-source" itemprop="creditText">Michael Nagle/Bloomberg via Getty Images</span> </span> </figcaption> </span> </span></figure> </div> <div data-component-type="image-modal" data-load-strategy="lazy"> <p>Google fair got a win in its attempt to <a href="https://en.mycoding.id/category/business" target="_blank" data-track-click='&quot;bi_value_unassigned&quot;}' rel="">buy Spirit Airlines' old data</a>.</p><p>A court-appointed person privacy authoritative recommended the transaction be approved in a filing on Monday, citing steps taken by Spirit and Google to location risks to passenger privacy.</p><p>"The parties have taken consequential steps to defend the privacy of the individual data of the Spirit consumers," Lucy Thomson, the person privacy ombudsman, said.</p><p>The filing stated the companies revised the range of individual person data included in the sale, excluded passenger databases, and hired a third party, Tonic.ai, to behavior de-identification of data that could merge consumers' individual information, specified as business emails.</p><p>"These changes volition considerably decrease the possible hazard of damage to the 97 myriad consumers who provided their individual data to Spirit for the intent of booking transporter travel," the filing said, adding that any hazard of privacy losses to consumers had been "eliminated or mitigated."</p><p>After Spirit Airlines close downward in May, <a href="https://en.mycoding.id/category/business" target="_blank" data-track-click='&quot;bi_value_unassigned&quot;}' rel="">Google won an auction</a> for its data alongside a $10 myriad bid. The transaction motionless requires court approval. Google has stated the data would assistance enhance its products and AI models.</p><p>Unions representing Spirit escape attendants and pilots have submitted objections to the sale, saying it would undermine their privacy. The union that represents <a href="https://en.mycoding.id/category/business" target="_blank" data-track-click='&quot;bi_value_unassigned&quot;}' rel="">American Airlines pilots</a>, including several 700 who formerly worked for Spirit, joined the exception in a filing final week, arguing the transaction could hinder aviation safety.</p><p>A delegate for Spirit did not provision additional comment whenever reached by Business Insider. Google did not react to a petition for comment. The business earlier stated that personally identifying data would not be included in the sale.</p><p>"Google is not purchasing any individual data from Spirit. The data volition either be entirely excluded or volition be deidentified by an autonomous third gathering before Google receives the data," the business has said.</p> <p>The ombudsman was appointed to measure risks particular to person privacy, as US bankruptcy law provides for person protections in data sales. The ombudsman stated her assessment did not contain whether the transaction posed any privacy risks to employees.</p><p>Lawyers earlier told Business Insider that the projected transaction served as a reminder that, as an employee,&nbsp;<a href="https://en.mycoding.id/category/business" target="_blank" data-track-click='&quot;bi_value_unassigned&quot;}' rel="">your activity data</a>&nbsp;is mostly not personal and belongs to the company.</p><p>While the ombudsman's advice helps the companies' case, endorsement of the data transaction is ultimately up to the court. A hearing on the projected transaction is scheduled for October 14.</p><p>The filing on Monday additionally stated that if another bids for the data are considered by the court &mdash; including those placed by AI training companies Mercor and Micro1 &mdash; additional assessment of person privacy concerns would be needed. The ombudsman specifically stated she'd need additional data concerning a "supply sequence safety incident" that happened <a href="https://en.mycoding.id/category/business" target="_blank" data-track-click='&quot;bi_value_unassigned&quot;}' rel="">at Mercor</a> before this year.</p> </div> <p> <h2> Read next </h2> </p> <div data-component-type="post-bottom-authors" data-load-strategy="exclude" data-track-view='&quot;module_in_view&quot;}' data-track-click-shared='&quot;navigation&quot;}'> <div data-track-view='&quot;module_in_view&quot;}'> <div> <p><span>Kelsey Vlamis is a elder newsman for Business Insider, anywhere she covers endeavor and tech news. She additionally writes endeavor stories concerning travel, luxury, and culture. Previously, she covered the environment, outdoors, and indigenous issues.</span><span>Her characteristic narrative <a href="https://en.mycoding.id/category/business" target="_blank">"Disaster at 18,200 feet"</a> received awards from the <a href="https://en.mycoding.id/category/business" target="_blank">New York Press Club</a>&nbsp;and the&nbsp;<a href="https://en.mycoding.id/category/business" target="_blank">North American Travel Journalists Association</a>, as fine as honest citation from the&nbsp;<a href="https://en.mycoding.id/category/business" target="_blank">Society of American Travel Writers</a>. She has additionally received an <a href="https://en.mycoding.id/category/business" target="_blank">American Journalism Online Award</a> for her safety on missing and murdered Indigenous group in Wyoming.</span><span>She's appeared on CBS, NPR, NBC, and another outlets to conversation her reporting. She earlier worked on the earth news array at the BBC in London and received a master's in reporting from Northwestern University.</span><span>She can be reached by email at kvlamis@businessinsider.com or via the encrypted-messaging app Signal at kelseyv.21.</span> </p> </div> </div> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/google-just-got-a-boost-in-its-bid-to-buy-spirit-airlines-data-for-ai-training-71161</guid> <pubDate>Mon, 05 Oct 2026 23:01:04 +0700</pubDate> <author><![CDATA[support@mycoding.id (Kelsey Vlamis)]]></author> </item> <item> <title><![CDATA[Find the flattest route between any two points in SF]]></title> <description><![CDATA[Find the flattest route between any two points in SF. Comments]]></description> <media:thumbnail url="https://www.flattensf.com/preview.jpg"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/find-the-flattest-route-between-any-two-points-in-sf-71163</link> <content:encoded><![CDATA[<div> How this works <p>Routes are computed in your browser complete 160,000 street segments, using USGS 1&nbsp;m lidar height and the Overture / OpenStreetMap street graph. The slider runs alongside the entire trade-off between extend and climbing: all path that nothing alternatively strikes on the two counts, from the shortest way to the flattest one value walking (where a ft of ascend expenses 200 ft of walking; beyond that the routes halt being routes). Sliding correct never shortens the path and never adds climbing. Climbing is cumulative gain, not the net difference between the endpoints. Stairways are allowed on ft and excluded on a bike. Faint lines display the another routes alongside the way. Place hunt is offline: street intersections, places and addresses for San Francisco are built into this page. <a href="https://en.mycoding.id/category/technology" target="_blank">Source, data and the complete analysis</a>.</p> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/find-the-flattest-route-between-any-two-points-in-sf-71163</guid> <pubDate>Mon, 05 Oct 2026 22:40:50 +0700</pubDate> <author><![CDATA[support@mycoding.id (Mira Azkia)]]></author> </item> <item> <title><![CDATA[The CEO of a Company That Cut Ties With Subway Reveals How It Went From Running Out of Cash to $54 Million a Year]]></title> <description><![CDATA[The CEO of a Company That Cut Ties With Subway Reveals How It Went From Running Out of Cash to $54 Million a Year. YuChiang Cheng saw a distinct way onward — and it's paying off big time.]]></description> <media:thumbnail url="https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/YuChiang_Cheng.jpg"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/the-ceo-of-a-company-that-cut-ties-with-subway-reveals-how-it-went-from-running-out-of-cash-to-54-million-a-year-71166</link> <content:encoded><![CDATA[<div> <div> <h2>Key Takeaways</h2> <ul> <li>After exiting the Subway partnership, Hero Bread focused on five SKUs.</li> <li> The brand pivoted to DTC, afterward explored distinct retailing channels. </li> <li>Now, it&rsquo;s navigating what the CEO calls the third division in its DTC playbook.</li> </ul> </div> <p>In 2022, whenever YuChiang Cheng invested in <a href="https://en.mycoding.id/category/technology" target="_blank">Hero Bread</a> on behalf of 444 Capital and stepped in as the company&rsquo;s interim chief promotion officer, the low-carb, zero-sugar brand was at a crucial crossroads.&nbsp;</p> <figure><img decoding="async" height="1024" width="828" src="https://www.entrepreneur.com/building-a-business/225" alt="" srcset="https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/YuChiang_Cheng_94734b.jpg 2425w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/YuChiang_Cheng_94734b.jpg?resize=243,300 243w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/YuChiang_Cheng_94734b.jpg?resize=768,950 768w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/YuChiang_Cheng_94734b.jpg?resize=828,1024 828w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/YuChiang_Cheng_94734b.jpg?resize=1242,1536 1242w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/YuChiang_Cheng_94734b.jpg?resize=1655,2048 1655w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/YuChiang_Cheng_94734b.jpg?resize=182,225 182w" sizes=" 828px) 100vw, 828px"><figcaption>Image Credit: Courtesy of Hero Bread. YuChiang Cheng. </figcaption></figure> <p>Cole Glass had founded the business in 2019 to location his serious food allergies connected to pollen. By October 2021, a alliance alongside <a href="https://en.mycoding.id/category/technology" target="_blank">Subway</a> seemed akin an breathtaking way forward. The idea was to get the macro-friendly bread products into as many hands as imaginable so group could sensation it for themselves.&nbsp;</p> <p>However, about the period Cheng joined the company, it was apparent the component economics didn&rsquo;t create sense. The Subway agreement wasn&rsquo;t <a href="https://en.mycoding.id/category/technology" target="_blank">profitable</a>; Hero Bread was operating out of money.&nbsp;</p> <p>&ldquo;&#8202;We were fair too small at the period and couldn&rsquo;t assistance it, didn&rsquo;t have the resources and all the infrastructure put in location to efficiently provision that,&rdquo; Cheng says<em>. </em>&ldquo;So we backed out of it.&rdquo;</p> <h2 id="h-hero-bread-brought-in-54-million-in-revenue-last-year">Hero Bread brought in $54 myriad in income final twelvemonth </h2> <p>Cheng pivoted to a direct-to-consumer (<a href="https://en.mycoding.id/category/technology" target="_blank">DTC</a>) strategy, allowing the brand to obtain feedback from consumers additional quickly and run word-of-mouth sales, he says.&nbsp;</p> <p>Cheng assumed the function of CEO in November 2023 and has continued to develop the company.</p> <p>In a backing circular <a href="https://en.mycoding.id/category/technology" target="_blank">announced in June 2024</a>, Hero Bread raised $21 myriad in under 90 days. The round, co-led by Cleveland Avenue, DNS Capital and Composite Ventures, brought the company&rsquo;s total backing to date to additional than $68.5 million.&nbsp;</p> <p>Hero Bread brought in $54 myriad in annual income final year. Additionally, the business additional than doubled its retailing existence in two years, expanding from concerning 4,000 to 10,000 doors, which includes a latest Target launch.&nbsp;</p> <p>But Hero Bread&rsquo;s prosperous shove into retailing &mdash; a feat many <a href="https://en.mycoding.id/category/technology" target="_blank">CPG</a> brands that initiate DTC anticipation to accomplish &mdash; doesn&rsquo;t average the business plans to put the brakes on its DTC scheme anytime soon.</p> <figure><img decoding="async" height="665" width="1024" src="https://www.entrepreneur.com/building-a-business/225" alt="" srcset="https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/240503_HERO_BREAD_Family_1968_16x9_x_2.jpg 8906w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/240503_HERO_BREAD_Family_1968_16x9_x_2.jpg?resize=300,195 300w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/240503_HERO_BREAD_Family_1968_16x9_x_2.jpg?resize=768,499 768w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/240503_HERO_BREAD_Family_1968_16x9_x_2.jpg?resize=1024,665 1024w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/240503_HERO_BREAD_Family_1968_16x9_x_2.jpg?resize=1536,997 1536w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/240503_HERO_BREAD_Family_1968_16x9_x_2.jpg?resize=2048,1330 2048w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/240503_HERO_BREAD_Family_1968_16x9_x_2.jpg?resize=347,225 347w" sizes=" 1024px) 100vw, 1024px"><figcaption>Image Credit: Courtesy of Hero Bread</figcaption></figure> <p><em>Entrepreneur </em>sat downward alongside Cheng to study additional concerning what he calls the &ldquo;third chapter&rdquo; of Hero Bread&rsquo;s DTC playbook, and how it&rsquo;s continuing to unlock growth for the company.&nbsp;</p> <h2 id="h-hero-bread-experimented-with-different-retail-channels">Hero Bread experimented alongside distinct retailing channels</h2> <p>After strolling distant from the Subway alliance and prioritizing DTC sales, Hero Bread focused on five SKUs: pale bread, seeded bread, burger buns, hot dog buns and flour tortillas.&nbsp;</p> <p>The line-up additionally made awareness as the business entered retailers: The goal was to recommendation mundane staples that would run reiterate purchases on a weekly basis.&nbsp;</p> <p>Initially, though, Cheng and the squad weren&rsquo;t fairly certain which retailers would be the correct fit.&nbsp;</p> <p>&ldquo;It&rsquo;s a extremely mainstream sensation profile,&rdquo; Cheng explains. &ldquo;So there was a lot of debate, if this is going to be additional of a Publix, <a href="https://en.mycoding.id/category/technology" target="_blank">Target</a> category product, or is this going to be additional of a natural Whole Foods, Sprouts, category of product.&rdquo;</p> <p>So Hero Bread opted to test alongside distinct types of retailers. The business launched in Market District, Publix and Sprouts and planned to lean into whichever conduit performed best. But six months later, the company&rsquo;s products had an notable track document at all three.&nbsp;</p> <p>&ldquo;We were very, extremely fortunate in that,&rdquo; Cheng says. &ldquo;So alternatively of picking [retail] channels, we decided to choice retailers that were additional enthusiastic despite of what conduit they were in.&rdquo;&nbsp;</p> <p>It&rsquo;s a distinct maneuver than many <a href="https://en.mycoding.id/category/technology" target="_blank">CPG</a> brands use; they lean to zero in on one retailing conduit and go regional, the CEO notes.&nbsp;</p> <h2 id="h-striking-the-balance-between-affordability-and-convenience">Striking the balance between affordability and convenience</h2> <p>Of course, <a href="https://en.mycoding.id/category/technology" target="_blank">CPG</a> brands that develop into retailing have the advantage of economies of scale.&nbsp;</p> <p>&ldquo;You can move lots of pallets on a truck much additional affordably than you can dispatch idiosyncratic packages through ecommerce,&rdquo; Cheng says.&nbsp;</p> <p>As a result, retailing typically gives consumers a additional affordable way to buy. DTC, on the another hand, serves as a additional concierge way to acquisition not lone Hero Bread&rsquo;s staple products, but additionally another offerings that power not be capable to hit retailing shelves as seamlessly.&nbsp;</p> <p>Hero Bread&rsquo;s Crafted Collection, which includes items akin croissants, citrus poppy kernel scones, shortbread biscuits (hand-baked in Sonoma alongside brown margarine made by a Michelin chef), lends itself fine to the model. The company&rsquo;s latest collaboration on pretzel bites alongside <a href="https://en.mycoding.id/category/technology" target="_blank">Auntie Anne&rsquo;s</a> does too.&nbsp;</p> <p>&ldquo;&#8202;[These are] small-batch, mostly handmade products that are exclusive to hero.co, anywhere it fair wouldn&rsquo;t create financial awareness for us to hand-roll 300,000 to 400,000 croissants,&rdquo; Cheng explains.&nbsp;</p> <figure><img decoding="async" height="683" width="1024" src="https://www.entrepreneur.com/building-a-business/225" alt="" srcset="https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/A-Twist-of-Auntie-Annes®-Hero-Pretzel-Bites-1.jpg 7997w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/A-Twist-of-Auntie-Annes®-Hero-Pretzel-Bites-1.jpg?resize=300,200 300w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/A-Twist-of-Auntie-Annes®-Hero-Pretzel-Bites-1.jpg?resize=768,512 768w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/A-Twist-of-Auntie-Annes®-Hero-Pretzel-Bites-1.jpg?resize=1024,683 1024w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/A-Twist-of-Auntie-Annes®-Hero-Pretzel-Bites-1.jpg?resize=1536,1025 1536w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/A-Twist-of-Auntie-Annes®-Hero-Pretzel-Bites-1.jpg?resize=2048,1366 2048w, https://www.entrepreneur.com/wp-content/uploads/sites/2/2026/10/A-Twist-of-Auntie-Annes®-Hero-Pretzel-Bites-1.jpg?resize=337,225 337w" sizes=" 1024px) 100vw, 1024px"><figcaption>Image Credit: Courtesy of Hero Bread</figcaption></figure> <p>What&rsquo;s more, <a href="https://en.mycoding.id/category/technology" target="_blank">DTC</a> can act as an priceless evaluation dirt for products alongside the possible to market efficiently in a brick-and-mortar setting.&nbsp;</p> <p>That&rsquo;s exactly what the business did alongside its bagels, unveiling a limited-edition initiate online in December 2024.&nbsp;</p> <p>&ldquo;&#8202;We weren&rsquo;t certain if group would desire to buy bagels from us,&rdquo; Cheng says, &ldquo;so we initially made them in smaller batches, sold them at hero.co, and they quickly became one of our best-selling items.&rdquo;&nbsp;</p> <p>Hero Bread&rsquo;s bagels landed on retailing shelves inside six months.&nbsp;</p> <h2 id="h-meeting-hero-bread-s-consumers-wherever-they-may-be">Meeting Hero Bread&rsquo;s consumers anywhere they may be</h2> <p>Cheng doesn&rsquo;t accept a <a href="https://en.mycoding.id/category/technology" target="_blank">successful entrepreneur</a> or endeavor chief is defined by how many times they win.&nbsp;</p> <p>&ldquo;It&rsquo;s how many times you can try again, despite of how many times you&rsquo;ve fallen downward or how much lifeblood you get on your face,&rdquo; the CEO says. &ldquo;There is a flat of bravery that is really necessary.&rdquo;&nbsp;</p> <p>It&rsquo;s a inclination toward <a href="https://en.mycoding.id/category/technology" target="_blank">resilience</a> that&rsquo;s helped Cheng guide Hero Bread through several crucial years that required an enthusiastic willingness to modify to all difficulty &mdash; and the CEO looks onward to what comes next.&nbsp;</p> <p>&ldquo;We&rsquo;re continually trying to encounter the person anywhere they are,&rdquo; Cheng says. &ldquo;There&rsquo;s a particular Hero fan, and afterward there&rsquo;s the overarching bread fan. We accept that the additional group who try us, the additional group who volition accept [in us].&rdquo;</p> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/the-ceo-of-a-company-that-cut-ties-with-subway-reveals-how-it-went-from-running-out-of-cash-to-54-million-a-year-71166</guid> <pubDate>Mon, 05 Oct 2026 22:30:14 +0700</pubDate> <author><![CDATA[support@mycoding.id (Amanda Breen)]]></author> </item> <item> <title><![CDATA[The New Apple Watch Series 12 Is Already on Sale for October Prime Day]]></title> <description><![CDATA[The New Apple Watch Series 12 Is Already on Sale for October Prime Day. Apple's newest smartwatch already has a discount for October Prime Day.]]></description> <media:thumbnail url="https://lifehacker.com/imagery/articles/01M46VZH85QF1J69KXFDW5XWD5/hero-image.png"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/the-new-apple-watch-series-12-is-already-on-sale-for-october-prime-day-71158</link> <content:encoded><![CDATA[<div class="leading-normal prose-sm m-0 line-clamp-5 font-normal">Jake Peterson is Lifehacker’s Tech Editor, and has been covering tech news and how-tos for nearly a decade. His squad covers all things technology, including AI, smartphones, computers, equivalent consoles, and subscriptions.</div> <hr class="custom-gradient-background my-6 h-[6px] max-w-[75px] border-0"> <p>You don't anticipate to see Apple's latest and top products on sale, particularly not weeks following their first release. While there are <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank">plenty of discounts on Apple products this October Prime Day</a>, including on several Apple Watches, I certainly wouldn't have predicted that Apple's latest flagship would get a cost cut. And yet, current we are. <a href="https://en.mycoding.id/category/technology" target="_blank" rel="nofollow sponsored" target="_blank" title="open in a new window">The Apple Watch Series 12 starts at $399</a>. But during October Prime Day, Apple has the observe $50 off. With the discount, it now starts at $349, a awesome cost for a observe alongside all of Apple's latest wearable perks.</p><div class="py-6"> <a href="https://en.mycoding.id/category/technology" target="_blank" data-commerce="1" target="_blank" rel="nofollow sponsored" data-parent-group="affiliate-link" title="(opens in a new window)" class="cursor-default no-underline" data-ga-click="data-ga-click" data-ga-module="shop-card" data-ga-element="offer" data-ga-item="offer-btn" data-ga-label="Apple Watch Series 12"> <div class="px-8"> <div class="grow"> <div class="leading-6">Apple Watch Series 12 </div> <div class="justify-between"> <div class="self-end"> <div class="justify-center"><div class=" font-sans leading-4 text-black"> <div class="justify-start"> <span class="font-bold"> Buy One Apple Watch, and Get a Second Apple Watch $300 off <span class="font-medium">at T-Mobile</span> </span> </div> </div> </div> </div> <div class="w-44 self-end"> Get Deal </div> </div> </div> <div class="hidden"> <div class="flex aspect-video items-center justify-center"> <img class="m-0 max-h-full max-w-full rounded-md" src="https://lifehacker.com/imagery/product/01CpisyU0qXURsN7TKwXYh0/hero-image.fill.size_autoxauto.v1791206387.jpg" alt="Apple Watch Series 12" width="auto" height="auto" loading="lazy"> </div> </div> <div class="flex"> <div class="flex aspect-video items-center justify-center"> <img class="m-0 max-h-full max-w-full rounded-md" src="https://lifehacker.com/imagery/product/01CpisyU0qXURsN7TKwXYh0/hero-image.fill.size_autoxauto.v1791206387.jpg" alt="Apple Watch Series 12" width="auto" height="auto" loading="lazy"> </div> </div> <div class="grow-0"> <div class="mt-4 w-full"> Get Deal </div> <div class="mx-2 mt-4 w-full"> <div class=" font-sans leading-4 text-black"> <div class="justify-start"> <span class="font-bold"> Buy One Apple Watch, and Get a Second Apple Watch $300 off <span class="font-medium">at T-Mobile</span> </span> </div> </div> </div> </div> </div> </a></div> <p>The Apple Watch Series 12 comes alongside Apple's newest wearable processor, the S11 chip. This processor is what powers things akin Siri AI and Apple Intelligence, as fine as the new "Audio Intelligence," which can provision you a content recap of the final 15 seconds of an in-person conversation—<a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank">a characteristic that has generated a bit of controversy</a>. It additionally comes alongside a new bosom charge sensor, which can notably inspect your beat all five seconds, or 20 times a minute. This example supports up to 24 hours of power division existence on a sole charge, and its Ceramic Shield 2 display should forestall additional scratches and cracks than former Apple Watches in this category. Lifehacker elder health publishing company Beth Skwarecki <a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank">thinks the Series 12 is value the upgrade at its first MSRP</a>, so this is a bit of a no-brainer if you were already interested. </p><div class="py-0" data-ga-click data-ga-template="Deals" data-ga-module="openweb_widget" data-ga-element="openweb_scroll" data-ga-item="openweb_scroll_midpage" x-data="&#039;, e); } } }" x-init="fetchCommentsCount()" x-cloak> <div class="absolute top-1/2 hidden w-full -translate-y-1/2 border-t-[1.5px] border-dashed border-black sm:block"></div> <div class="relative flex justify-center"> <div class="flex max-w-fit items-center gap-x-3 bg-white px-5"> <div class="relative"> <span class="absolute left-1/2 top-1/2 -translate-x-1/2 -translate-y-1/2 font-akshar text-sm font-medium text-black" aria-live="polite" x-show="hasComments" x-text="commentsCount"></span> <svg class="h-8 w-8 text-black" role="img" aria-hidden="true"> </svg> </div> <span class="text-sm font-medium text-black"> What do you think so far? </span> </div> </div> </div> <p>The lone caveat current is that the Series 12 isn't the lone Apple Watch discount value considering this October Prime Day. While the Apple Watch Ultra 4 isn't on sale, <a href="https://en.mycoding.id/category/technology" target="_blank" rel="nofollow sponsored" target="_blank" title="open in a new window">the Apple Watch SE 3 is</a>. This isn't a "new" watch, per se, but it is Apple's finest observe for most people. You don't get any of the complete perks of the Series 12, but you do get the capable S10 chip, Apple's norm bosom charge monitor, sleep and exercise tracking, and the capability to dispatch and obtain texts. There's a presenter of fitness and health crossover here, and, if you opt for the cellular model, you'll nexus to the identical 5G network as the cellular Series 12. While $349 is a awesome starting cost for the Series 12, the SE 3 currently starts at $199 for October Prime Day. That's a durable cost to beat. </p><div class="left-1/2 md:w-[780px] md:max-w-max md:-translate-x-1/2" x-data=" false }"> <div class="text-left"> <div class="rounded-tl-none"> <div class="rounded-tl-none"> <span class="text-2xl">Our Best Editor-Vetted Early Prime Day Deals Right Now</span> <div class="text-base"> <div x-show="1 || showAll"> <a href="https://en.mycoding.id/category/technology" target="_blank" data-commerce="1" target="_blank" rel="nofollow sponsored" data-parent-group="affiliate-link" title="(opens in a new window)" class="text-brand-green-700" data-ga-click="data-ga-click" data-ga-item="offer-group-item" data-ga-label="Apple AirPods Pro 3 Noise Cancelling Heart Rate Wireless Earbuds" data-ga-element="offer" data-ga-module="offer-group" data-ga-position="1"> Apple AirPods Pro 3 Noise Cancelling Heart Rate Wireless Earbuds </a> <span class="text-black"> — <span class="font-bold">$179.00</span> <span class="!text-sm"> (List Price $249.00) </span> </span> </div> <div x-show="1 || showAll"> <a href="https://en.mycoding.id/category/technology" target="_blank" data-commerce="1" target="_blank" rel="nofollow sponsored" data-parent-group="affiliate-link" title="(opens in a new window)" class="text-brand-green-700" data-ga-click="data-ga-click" data-ga-item="offer-group-item" data-ga-label="Sony WH-1000XM5 Wireless Noise Canceling Headphones" data-ga-element="offer" data-ga-module="offer-group" data-ga-position="2"> Sony WH-1000XM5 </a> <span class="text-black"> — <span class="font-bold">$198.00</span> <span class="!text-sm"> (List Price $399.99) </span> </span> </div> <div x-show="1 || showAll"> <a href="https://en.mycoding.id/category/technology" target="_blank" data-commerce="1" target="_blank" rel="nofollow sponsored" data-parent-group="affiliate-link" title="(opens in a new window)" class="text-brand-green-700" data-ga-click="data-ga-click" data-ga-item="offer-group-item" data-ga-label="Ring Indoor Cam Plus 2K Wired Security Camera (2-Pack, White)" data-ga-element="offer" data-ga-module="offer-group" data-ga-position="3"> Ring Indoor Cam Plus 2K Wired Security Camera (2-Pack, White) </a> <span class="text-black"> — <span class="font-bold">$59.98</span> <span class="!text-sm"> (List Price $119.98) </span> </span> </div> <div x-show="1 || showAll"> <a href="https://en.mycoding.id/category/technology" target="_blank" data-commerce="1" target="_blank" rel="nofollow sponsored" data-parent-group="affiliate-link" title="(opens in a new window)" class="text-brand-green-700" data-ga-click="data-ga-click" data-ga-item="offer-group-item" data-ga-label='Apple iPad 11&quot; 128GB Wi-Fi Retina Tablet (Blue, 2025 Release)' data-ga-element="offer" data-ga-module="offer-group" data-ga-position="4"> Apple iPad 11" 128GB A16 WiFi Tablet (Blue, 2025) </a> <span class="text-black"> — <span class="font-bold">$399.00</span> <span class="!text-sm"> (List Price $449.00) </span> </span> </div> <div x-show="1 || showAll"> <a href="https://en.mycoding.id/category/technology" target="_blank" data-commerce="1" target="_blank" rel="nofollow sponsored" data-parent-group="affiliate-link" title="(opens in a new window)" class="text-brand-green-700" data-ga-click="data-ga-click" data-ga-item="offer-group-item" data-ga-label="Blink Outdoor 4 1080p 3-Camera Kit With Sync Module Core + Doorbell" data-ga-element="offer" data-ga-module="offer-group" data-ga-position="5"> Blink Outdoor 4 1080p 3-Camera Kit With Sync Module Core + Doorbell </a> <span class="text-black"> — <span class="font-bold">$65.99</span> <span class="!text-sm"> (List Price $259.98) </span> </span> </div> <div x-show="1 || showAll"> <a href="https://en.mycoding.id/category/technology" target="_blank" data-commerce="1" target="_blank" rel="nofollow sponsored" data-parent-group="affiliate-link" title="(opens in a new window)" class="text-brand-green-700" data-ga-click="data-ga-click" data-ga-item="offer-group-item" data-ga-label="Ring 2nd Gen 2K Wired Video Doorbell With Chime (2026 Release)" data-ga-element="offer" data-ga-module="offer-group" data-ga-position="6"> Ring 2nd Gen 2K Wired Video Doorbell With Chime (2026 Release) </a> <span class="text-black"> — <span class="font-bold">$49.99</span> <span class="!text-sm"> (List Price $114.98) </span> </span> </div> <div x-show="1 || showAll"> <a href="https://en.mycoding.id/category/technology" target="_blank" data-commerce="1" target="_blank" rel="nofollow sponsored" data-parent-group="affiliate-link" title="(opens in a new window)" class="text-brand-green-700" data-ga-click="data-ga-click" data-ga-item="offer-group-item" data-ga-label="Amazon Fire TV Stick 4K Plus Streaming Player With Remote (2025 Model)" data-ga-element="offer" data-ga-module="offer-group" data-ga-position="7"> Fire TV Stick 4K Plus Streaming Player With Remote (2025 Model) </a> <span class="text-black"> — <span class="font-bold">$37.99</span> <span class="!text-sm"> (List Price $69.99) </span> </span> </div> <div x-show="1 || showAll"> <a href="https://en.mycoding.id/category/technology" target="_blank" data-commerce="1" target="_blank" rel="nofollow sponsored" data-parent-group="affiliate-link" title="(opens in a new window)" class="text-brand-green-700" data-ga-click="data-ga-click" data-ga-item="offer-group-item" data-ga-label="Apple Watch Series 12 (GPS, 42mm, S/M Black Sport Band)" data-ga-element="offer" data-ga-module="offer-group" data-ga-position="8"> Apple Watch Series 12 </a> <span class="text-black"> — <span class="font-bold">$349.99</span> <span class="!text-sm"> (List Price $399.00) </span> </span> </div> </div> </div> </div> <div class="px-6"> <span class="text-sm">Deals are selected by our commerce team</span> </div> </div> </div> <div class="leading-normal prose-sm mt-4 line-clamp-2"> <p></p><p>Covering tech news, how-to guides, explainers, and more.</p> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/the-new-apple-watch-series-12-is-already-on-sale-for-october-prime-day-71158</guid> <pubDate>Mon, 05 Oct 2026 22:15:53 +0700</pubDate> <author><![CDATA[support@mycoding.id (Jake Peterson)]]></author> </item> <item> <title><![CDATA[Dust: Pretraining Transformers Without Backpropagation]]></title> <description><![CDATA[Dust: Pretraining Transformers Without Backpropagation. Comments]]></description> <media:thumbnail url="https://qlabs.sh/research/dust/figures/x-method.gif"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/dust-pretraining-transformers-without-backpropagation-71155</link> <content:encoded><![CDATA[<div> <p>Samip Dahal, Bishwas Mandal, Serdar G&uuml;lbahar, Akshay Vegesna</p> <p><span>October 2026</span><span>Correspondence to <a href="https://en.mycoding.id/category/technology" target="_blank">s@qlabs.sh</a><span>&middot;</span><a href="https://en.mycoding.id/category/technology" target="_blank" target="_blank" rel="noopener"><svg viewbox="0 0 16 16" aria-hidden="true"><path d="M8 0c4.42 0 8 3.58 8 8a8.013 8.013 0 0 1-5.45 7.59c-.4.08-.55-.17-.55-.38 0-.27.01-1.13.01-2.2 0-.75-.25-1.23-.54-1.48 1.78-.2 3.65-.88 3.65-3.95 0-.88-.31-1.59-.82-2.15.08-.2.36-1.02-.08-2.12 0 0-.67-.22-2.2.82-.64-.18-1.32-.27-2-.27-.68 0-1.36.09-2 .27-1.53-1.03-2.2-.82-2.2-.82-.44 1.1-.16 1.92-.08 2.12-.51.56-.82 1.28-.82 2.15 0 3.06 1.86 3.75 3.64 3.95-.23.2-.44.55-.51 1.07-.46.21-1.61.55-2.31-.63-.15-.24-.6-.83-1.23-.82-.67.01-.27.38.01.53.34.19.73.9.82 1.13.16.45.68 1.31 2.69.94 0 .67.01 1.3.01 1.49 0 .21-.15.45-.55.38A7.995 7.995 0 0 1 0 8c0-4.42 3.58-8 8-8Z"></path></svg>Code</a><span>&middot;</span></span></p> <figure><p><img src="https://qlabs.sh/research/dust/figures/x-method.gif" alt="Animation of the method"></p></figure> <h2>TL;DR</h2> <ul> <li>We current the archetypal zeroth-order method that is rivalrous alongside backprop at pretraining transformer tongue models. Dust perturbs activations (node perturbation) independently at all token, so all token is a <em>virtual</em> community associate and one onward continue evaluates them all in parallel.</li> <li>Dust approximates backprop closely at ample community (i.e. substantially additional compute) and in multiple settings equal <em>exceeds</em> it. This hints that in a compute-rich administration we power be capable to surpass backprop.</li> <li>Dust is orders of dimension additional productive than weight-space ES. From 1M tokens up, Dust is on the command of $10^3$ to $10^4$ times additional productive than a transformer implementation of EGGROLL, a state-of-the-art ES method, according to our extrapolations.</li> <li>Zeroth-order methods are extensively believed not to measure to ample networks. Strikingly, we discover larger models are additional population-efficient, not less: a 243M-parameter example outperforms a $120\times$ smaller example at most community sizes.</li> <li>Dust&rsquo;s gradient estimates align improved alongside backprop&rsquo;s as community grows, and remain fine aligned at all measure we test, up to 1B tokens, which is encouraging for scaling.</li> </ul> <p>Contents</p> <a href="https://en.mycoding.id/category/technology" target="_blank"><span></span> <span>TL;DR</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>1</span> <span>Introduction</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>2</span> <span>Method</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>2.1</span> <span>Activation-Space Perturbation</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>2.2</span> <span>Credit Assignment</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>2.3</span> <span>Interference and Tuning</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>3</span> <span>Pretraining Without a Backward Pass</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>3.1</span> <span>Setup</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>3.2</span> <span>Main Results</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>3.3</span> <span>Dust Under Adam</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>4</span> <span>Search in High-Dimensional Space</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>4.1</span> <span>Overparameterization</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>4.2</span> <span>Emergence of Backprop-Like Gradients</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>5</span> <span>Conclusion</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>6</span> <span>Related Work</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span></span> <span>References</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span></span> <span>Appendix</span></a> <h2 id="introduction"><span>1</span> Introduction</h2> <p>Deep learning has been built about backprop, the lone credit project algorithm capable of training contemporary neural nets, including transformer-based tongue models. Backprop requires differentiability and produces first-order gradients, and profound learning&rsquo;s architectures, optimizers, and hardware have co-evolved about this constraint.</p> <p>However, as the amount of compute accessible in the earth increases, we power favor additional generic and brute-force learning algorithms according to <em>search</em> complete inductive biases akin differentiability, backprop, and approximations of higher-order gradients. The bitter lesson&nbsp;<span data-kind="citep" data-keys="sutton2019bitter">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Sutton, 2019</a><span>Richard S. Sutton. The bitter lesson. <a href="https://en.mycoding.id/category/technology" target="_blank">http://www.incompleteideas.net/IncIdeas/BitterLesson.html</a>, 2019. Blog post.</span></span>)</span> is that broad methods that measure alongside compute eventually win, and AlphaGo Zero&nbsp;<span data-kind="citep" data-keys="silver2017mastering">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Silver et al., 2017</a><span>David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton, Yutian Chen, Timothy Lillicrap, Fan Hui, Laurent Sifre, George van den Driessche, Thore Graepel, and Demis Hassabis. Mastering the equivalent of Go without individual knowledge. <em>Nature</em>, 550 (7676): 354&ndash;359, 2017. doi: <a href="https://en.mycoding.id/category/technology" target="_blank">10.1038/nature24270</a>.</span></span>)</span> is the apparent example. Bootstrapping AlphaGo on individual data helped the network study faster initially, but alongside a lot of computation the purely self-play network overtook it. Similarly, differentiability and backprop power be fine inductive biases in the low-compute regime, anywhere they create learning efficient, but in the high-compute administration they bounds the area of architectures that work. Even inside an architecture, gradient-based methods neglect to examine the defeat landscape optimally&nbsp;<span data-kind="citep" data-keys="liu2020bad">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Liu et al., 2020</a><span>Shengchao Liu, Dimitris Papailiopoulos, and Dimitris Achlioptas. Bad earth minima be and SGD can attain them. In <em>Advances in Neural Information Processing Systems</em>, quantity 33, 2020.</span></span>)</span>. This power additionally explain why current neural nets necessitate enormous amounts of data to generalize. A additional elastic credit project algorithm according to hunt is apt an crucial stage towards much improved generalization.</p> <p>In this paper, we aim to substitute backprop alongside a learning algorithm based much additional on brute-force computation and much small on analytic structure. We call it Dust. Dust is a zeroth-order optimization algorithm that perturbs activations, rewards all perturbation by how much it lowers the loss, and averages the reward-weighted perturbations complete a community to evaluation the gradient. Traditional ES methods that perturb weights&nbsp;<span data-kind="citep" data-keys="salimans2017evolution">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Salimans et al., 2017</a><span>Tim Salimans, Jonathan Ho, Xi Chen, Szymon Sidor, and Ilya Sutskever. Evolution strategies as a scalable substitute to reinforcement learning. <em>arXiv preprint arXiv:1703.03864</em>, 2017.</span></span>)</span>, akin EGGROLL&nbsp;<span data-kind="citep" data-keys="sarkar2025eggroll">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Sarkar et al., 2025</a><span>Bidipta Sarkar, Mattie Fellows, Juan Agustin Duque, Alistair Letcher, Antonio Le&oacute;n Villares, Anya Sims, Clarisse Wibault, Dmitry Samsonov, Dylan Cope, Jarek Liesen, Kang Li, Lukas Seier, Theo Wolf, Uljad Berdica, Valentin Mohl, Alexander David Goldie, Aaron Courville, Karin Sevegnani, Shimon Whiteson, and Jakob Nicolaus Foerster. Evolution strategies at the hyperscale. <em>arXiv preprint arXiv:2511.16652</em>, 2025.</span></span>)</span>, measure alongside population, but scaling the community is costly since all associate must be materialized and evaluated. We eliminate the two expenses alongside the idea of <em>virtual population</em>, anywhere we evade materializing all associate by bypassing importance area entirely and alternatively perturb activations, as in node perturbation&nbsp;<span data-kind="citep" data-keys="widrow1990thirty,werfel2003learning">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Werfel et al., 2003</a><span>Justin Werfel, Xiaohui Xie, and H. Sebastian Seung. Learning curves for stochastic gradient decline in linear feedforward networks. In <em>Advances in Neural Information Processing Systems</em>, quantity 16, 2003.</span></span>; <span><a href="https://en.mycoding.id/category/technology" target="_blank">Widrow and Lehr, 1990</a><span>Bernard Widrow and Michael A. Lehr. 30 years of adaptive neural networks: Perceptron, Madaline, and backpropagation. <em>Proceedings of the IEEE</em>, 78 (9): 1415&ndash;1442, 1990. doi: <a href="https://en.mycoding.id/category/technology" target="_blank">10.1109/5.58323</a>.</span></span>)</span>. We do so independently at all token, so all token is a associate and one onward continue evaluates them all in parallel.</p> <p>Activations are a additional engaging area to hunt complete than weights. Mechanistic interpretability has shown that reasoning, whether verbalizable or not, lives in the activations&nbsp;<span data-kind="citep" data-keys="lindsey2025biology,gurnee2026workspace">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Gurnee et al., 2026</a><span>Wes Gurnee, Nicholas Sofroniew, Adam Pearce, Mateusz Piotrowski, Isaac Kauvar, Runjin Chen, Anna Soligo, Paul Bogdan, Euan Ong, Rowan Wang, Ben Thompson, David Abrahams, Subhash Kantamneni, Emmanuel Ameisen, Joshua Batson, and Jack Lindsey. Verbalizable representations form a earth workspace in tongue models. <em>arXiv preprint arXiv:2607.15495</em>, 2026.</span></span>; <span><a href="https://en.mycoding.id/category/technology" target="_blank">Lindsey et al., 2025</a><span>Jack Lindsey, Wes Gurnee, Emmanuel Ameisen, Brian Chen, Adam Pearce, Nicholas L. Turner, Craig Citro, et al. On the existence discipline of a ample tongue model. <em>Transformer Circuits Thread</em>, 2025.</span></span>)</span>, which method this method could rotate training into a hunt complete latent reasoning&nbsp;<span data-kind="citep" data-keys="vegesna2025decoupling">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Vegesna and Dahal, 2025</a><span>Akshay Vegesna and Samip Dahal. Decoupling hunt and learning in neural net training. <em>arXiv preprint arXiv:2509.10973</em>, 2025.</span></span>)</span>. We afterward brace the activation-space perturbation alongside a extremely generic credit project regulation that assigns distinct token-level rewards to distinct tier types in a transformer block. Those two biases, alongside alongside a few implementation particulars and effectiveness measures, akin avoiding interference between perturbed modules, are the entire algorithm.</p> <p>We create the following contributions.</p> <ul> <li>We current the archetypal zeroth-order method that is rivalrous alongside backprop at pretraining transformer tongue models. At ample populations Dust exceeds backprop in multiple settings, which suggests that in a compute-rich administration we power be capable to surpass backprop.</li> <li>Dust is orders of dimension additional productive than weight-space ES. From 1M tokens up, Dust is on the command of $10^3$ to $10^4$ times additional productive than a transformer implementation of EGGROLL, according to our extrapolations.</li> <li>Contrary to accepted wisdom, larger models are frequently additional population-efficient, not less, and can create use of larger populations. This gives a new perspective of overparameterization as a larger hunt area alongside possibly improved geometry.</li> <li>Dust&rsquo;s gradient estimates align improved alongside backprop&rsquo;s as the community grows, and the alignment holds up at all measure we test, up to 1B tokens, which is encouraging for scaling.</li> </ul> <p>The goal of this document is to lay the foundations of a search-based credit project algorithm that is rivalrous alongside backprop on the <em>hardest task</em> we could think of: pretraining transformers. We do not attempt to create it compute-efficient adequate to substitute backprop today. We additionally do not train the new kinds of neural nets it makes accessible, akin nets alongside an external program in the iteration or transformers looped complete many steps that backpropagation through period struggles to train. Both are remaining to forthcoming work.</p> <h2 id="method"><span>2</span> Method</h2> <p>Dust plant as follows. We add Gaussian noise to the output of all linear layer, independently at all token, run a onward pass, and reward all token&rsquo;s noise by the alter in defeat at that token. The reward-weighted noise, averaged complete draws, is the estimated error at the layer&rsquo;s output, and its external merchandise alongside the layer&rsquo;s input is the importance gradient. Attention internals get a type of it: they are credited through the estimated error at the notice output complete current and forthcoming tokens, alternatively of the tokens&rsquo; defeat directly. The center intuition is that during weight-space ES evaluates one community associate per onward pass, we measure one per token, in parallel, and a associate is materialized by adding noise to a hidden state, which is cheap. On a contemporary transformer a sole onward continue hence evaluates a community at smallest <em>three orders of magnitude</em> larger than weight-space ES. We depict all component in item below.</p> <h3 id="activation-space-perturbation"><span>2.1</span> Activation-Space Perturbation</h3> <p>The bottleneck of development strategies is community size. Every associate needs its own perturbed copy of the weights and its own onward pass. EGGROLL&nbsp;<span data-kind="citep" data-keys="sarkar2025eggroll">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Sarkar et al., 2025</a><span>Bidipta Sarkar, Mattie Fellows, Juan Agustin Duque, Alistair Letcher, Antonio Le&oacute;n Villares, Anya Sims, Clarisse Wibault, Dmitry Samsonov, Dylan Cope, Jarek Liesen, Kang Li, Lukas Seier, Theo Wolf, Uljad Berdica, Valentin Mohl, Alexander David Goldie, Aaron Courville, Karin Sevegnani, Shimon Whiteson, and Jakob Nicolaus Foerster. Evolution strategies at the hyperscale. <em>arXiv preprint arXiv:2511.16652</em>, 2025.</span></span>)</span> makes the copies cheap alongside low-rank perturbations, but all associate is motionless one sequence component of the batch, so the community is bounded by the onward passes one can afford. We perturb activations instead, independently at all token. At that token the network behaves as if a low-rank perturbation had been applied to the weights of the tier that produced the activations, without the perturbation always being materialized in the weights. We call this a <em>virtual population</em>. A sequence in a transformer has a few thousand tokens, so one onward continue evaluates a few thousand members per sequence alternatively of one. Every importance in the example is trained this way apart from the $2L$ residual mixing scalars, which are trained by average weight-space ES.</p> <p>Adding noise to activations fairly than weights is node perturbation&nbsp;<span data-kind="citep" data-keys="widrow1990thirty">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Widrow and Lehr, 1990</a><span>Bernard Widrow and Michael A. Lehr. 30 years of adaptive neural networks: Perceptron, Madaline, and backpropagation. <em>Proceedings of the IEEE</em>, 78 (9): 1415&ndash;1442, 1990. doi: <a href="https://en.mycoding.id/category/technology" target="_blank">10.1109/5.58323</a>.</span></span>)</span>, and the customary disagreement for it is dimensionality&nbsp;<span data-kind="citep" data-keys="werfel2003learning,ren2023scaling">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Ren et al., 2023</a><span>Mengye Ren, Simon Kornblith, Renjie Liao, and Geoffrey Hinton. Scaling onward gradient alongside local losses. In <em>International Conference on Learning Representations</em>, 2023.</span></span>; <span><a href="https://en.mycoding.id/category/technology" target="_blank">Werfel et al., 2003</a><span>Justin Werfel, Xiaohui Xie, and H. Sebastian Seung. Learning curves for stochastic gradient decline in linear feedforward networks. In <em>Advances in Neural Information Processing Systems</em>, quantity 16, 2003.</span></span>)</span>. A layer&rsquo;s output has $d_{\mathrm{out}}$ entries and its weights have $d_{\mathrm{out}} \times d_{\mathrm{in}}$, so activation noise lives in a much smaller space. Naively, the dimensionality disagreement doesn&rsquo;t clasp for transformers alongside ample activations throughout many tokens. The noise on one sequence is a $T \times d_{\mathrm{out}}$ tensor, which has at smallest as many entries as the importance matrix formerly $T \ge d_{\mathrm{in}}$. However, alongside per-token autonomous perturbations and rewards, what perturbing activations gives is a new, productive community alongside the token axis that is <em>orthogonal</em> to the lot axis EGGROLL already relies on.</p> <h3 id="credit-assignment"><span>2.2</span> Credit Assignment</h3> <p>For a linear tier $y_t = W x_t$ we jitter its output at all tokens, $y_t \to y_t + \sigma a_t$ alongside $a_t \sim \mathcal{N}(0, I)$ and $\sigma$ the noise scale, and run the onward pass. At all token $s$ we compute the centered defeat decrease $c_s = \tilde{\ell}_s - \ell_s$, anywhere $\ell_s$ is the perturbed defeat and $\tilde{\ell}_s$ is the average perturbed defeat at that token throughout draws evaluated together in the identical batched forward. The reward of the jitter at token $t$ is the defeat decrease at $t$ and, alongside a decay $\gamma$, the defeat reductions at the tokens following it, which the jitter additionally reaches through attention,</p> <div id="eq-1"><p>$$r_t = \sum_{s \ge t} \gamma^{\,s-t} c_s .$$</p><p><span>(1)</span></p></div> <p>With $\gamma = 0$ a jitter is rewarded by its own token alone. We depart it to the tuning of Section&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">2.3</a> to decide which layers see the forthcoming tokens. One autonomous jitter of all tokens is a <em>draw</em>, and a community is $K$ draws. Averaged complete the draws, the reward-weighted noise</p> <div id="eq-2"><p>$$\hat g_t = -\frac{1}{K\sigma}\sum_{i=1}^{K} r_t^{(i)} a_t^{(i)}$$</p><p><span>(2)</span></p></div> <p>is the estimated error at the layer&rsquo;s output, and its external merchandise alongside the layer&rsquo;s input, which the onward continue already computed, summed complete tokens, is the importance gradient,</p> <div id="eq-3"><p>$$\widehat{G}_W = \sum_t \hat g_t\, x_t^\top .$$</p><p><span>(3)</span></p></div> <p>Backprop forms the identical external merchandise alongside the identical input. The lone difference is that it gets the output error from the sequence regulation and we get it from the population. For an embedding tier $x_t$ is one-hot, so the external merchandise is a scatter-add of $\hat g_t$ into the token&rsquo;s row.</p> <p>With unlimited community the estimator complete is the entire method, and all perturbation could go into one onward pass. Each draw&rsquo;s reward-weighted noise is the gradient affirmative an error alongside no preferred direction. Over draws the gradient adds up linearly during the errors add up as the quadrate root, so their proportion falls as the community grows and the interference vanishes in the limit.</p> <h3 id="interference-and-tuning"><span>2.3</span> Interference and Tuning</h3> <p>At a community we can afford, the chief disbursal is interference, ie we jitter many layers at many tokens in the identical onward pass, so the defeat alter that rewards one token&rsquo;s noise additionally picks up the consequence of all another perturbation in that pass. We decrease specified interference in three ways. First, distinct tier types are jittered in distinct onward passes, all alongside its own noise scale, and all obstacle gets its own passes. These passes are cheaper than complete forwards since the spotless onward is cached and a diagram for obstacle $l$ lone reruns blocks $l$ onward. Second, the notice internals (query, key, value, gate, value embedding) are jittered separately. Token losses barely enroll their jitters, so they are rewarded through the notice output instead, as described below. Third, the tongue modeling caput is jittered immediately on the cached logits, re-evaluating lone the cross-entropy and lone a slab of the vocabulary per draw, which expenses a small fraction of a onward continue and lets the caput run a much larger population.</p> <p>For the notice internals we recompute <em>only</em> their block&rsquo;s notice output alongside the jitter, from the cached spotless activations. We mark the jitters using the alignment alongside the estimated notice output gradients,</p> <div id="eq-4"><p>$$c_s = -\langle \hat g_s, \Delta o_s \rangle ,$$</p><p><span>(4)</span></p></div> <p>where $\Delta o_s$ is the alter the jitter makes in the notice output at token $s$ and $\hat g_s$ is that output&rsquo;s estimated error from Equation&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">2</a>. The reward is Equation&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">1</a> alongside these scores, computed per head, in location of the defeat reductions.</p> <p>The hyperparameters, the noise measure of all tier type, the credit decay of the notice internals and the portion of the community all tier gets, can be tuned in two ways. One is a grid hunt that trains alongside all environment on a small token prosperity and keeps the environment that lowers the defeat most. It is dependable but expensive. The another is a grid hunt that maximizes the cosine between our evaluation and the backprop gradient on a sole batch, which needs no training at all. A larger cosine on one lot doesn&rsquo;t continually lesser the defeat following training, so the cosine picks candidates and training decides. Either way the tuning is mostly a one-time cost, since the settings it finds mostly generalize throughout token budgets and community sizes, alongside one exception. At the largest community at 10M and 20M tokens, a slower credit decay and a change of draws toward the notice flank motionless pay (Appendix&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">F</a>). Hence, this hunt recovers broad principles of the method fairly than settings for one run. As expected, all layers necessitate no credits from forthcoming tokens apart from the keys, values, gates and value embeddings, which are peruse by the afterward tokens that act to them and get a $\gamma$ near to one.</p> <h2 id="pretraining-without-a-backward-pass"><span>3</span> Pretraining Without a Backward Pass</h2> <h3 id="setup"><span>3.1</span> Setup</h3> <p>We train GPT-style transformers on FineWeb alongside a 4096-token BPE tokenizer, a lot of 16k tokens (8 sequences of 2048 tokens), one epoch, and SGD alongside momentum at a changeless learning rate. The basis example has 8 layers and width 512. Every method gets the identical protocol and three seeds per cell, and is tuned separately at all token prosperity and population. Dust and backprop portion one momentum and learning-rate grid; we execute EGGROLL alongside the identical transformer architecture (named EGGROLL-Transformer) and it is tuned complete its own grid of stage size, momentum, noise measure and fitness shaping. Validation and test are held-out sets of 544 sequences each. We study the test defeat at finest validation checkpoint.</p> <p>We figure community in draws for Dust and in onward passes of the lot for EGGROLL&nbsp;<span data-kind="citep" data-keys="sarkar2025eggroll">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Sarkar et al., 2025</a><span>Bidipta Sarkar, Mattie Fellows, Juan Agustin Duque, Alistair Letcher, Antonio Le&oacute;n Villares, Anya Sims, Clarisse Wibault, Dmitry Samsonov, Dylan Cope, Jarek Liesen, Kang Li, Lukas Seier, Theo Wolf, Uljad Berdica, Valentin Mohl, Alexander David Goldie, Aaron Courville, Karin Sevegnani, Shimon Whiteson, and Jakob Nicolaus Foerster. Evolution strategies at the hyperscale. <em>arXiv preprint arXiv:2511.16652</em>, 2025.</span></span>)</span>, our weight-space baseline. A diagram is one jitter of activations throughout all tokens of selected layers, rewarded alongside the token losses, and the community $K$ is the figure of draws per update. A diagram is slightly cheaper than a onward pass, since the spotless onward is cached and a diagram that jitters obstacle $l$ reruns lone the blocks from $l$ on. $K$ leaves out the draws of the caput and the notice internals, which are a small fraction of the update&rsquo;s FLOPs (Appendix&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">E</a>). Taken together, from a community of 256 up Dust uses small compute than EGGROLL at the identical population, so the difference is lenient to EGGROLL.</p> <h3 id="main-results"><span>3.2</span> Main Results</h3> <figure id="fig-1"> <p> <svg viewbox="0 0 800 312" role="img" aria-label="Validation defeat complete training at 1M and 10M tokens"> 6.0 6.5 7.0 7.5 8.0 Validation loss 1M tokens 0 0.25 0.5 0.75 1 Training fraction <path d="M44.3 60.2 L49.1 61.9 L53.8 63.4 L63.3 67.1 L72.8 71.3 L82.3 75.6 L91.8 79.8 L101.3 84.1 L110.7 88.4 L120.2 93.0 L129.7 97.4 L139.2 101.7 L148.7 105.1 L158.2 108.3 L167.7 110.8 L177.1 113.0 L186.6 115.0 L196.1 116.9 L205.6 118.6 L215.1 119.9 L224.6 121.1 L234.1 122.6 L243.5 123.7 L253.0 124.8 L262.5 125.8 L272.0 126.7 L281.5 127.6 L291.0 128.4 L300.5 129.3 L309.9 130.0 L319.4 130.6 L328.9 131.2 L333.7 131.6" stroke="rgb(198,203,210)" stroke-width="2" data-k="e0" data-cell="egg|1M|64"></path> <path d="M44.3 60.2 L49.1 61.9 L53.8 63.4 L63.3 67.1 L72.8 71.3 L82.3 75.6 L91.8 79.8 L101.3 84.1 L110.7 88.4 L120.2 93.0 L129.7 97.4 L139.2 101.7 L148.7 105.1 L158.2 108.3 L167.7 110.8 L177.1 113.0 L186.6 115.0 L196.1 116.9 L205.6 118.6 L215.1 119.9 L224.6 121.1 L234.1 122.6 L243.5 123.7 L253.0 124.8 L262.5 125.8 L272.0 126.7 L281.5 127.6 L291.0 128.4 L300.5 129.3 L309.9 130.0 L319.4 130.6 L328.9 131.2 L333.7 131.6" data-k="e0"></path> <path d="M44.3 60.2 L49.1 66.5 L53.8 74.5 L63.3 96.5 L72.8 115.4 L82.3 125.1 L91.8 131.4 L101.3 135.9 L110.7 139.6 L120.2 142.7 L129.7 145.3 L139.2 147.5 L148.7 149.4 L158.2 151.0 L167.7 152.5 L177.1 153.8 L186.6 154.8 L196.1 155.8 L205.6 156.9 L215.1 157.5 L224.6 158.0 L234.1 158.6 L243.5 159.2 L253.0 159.5 L262.5 160.1 L272.0 160.3 L281.5 160.8 L291.0 161.2 L300.5 161.4 L309.9 161.6 L319.4 161.9 L328.9 162.4 L333.7 162.5" stroke="rgb(152,159,170)" stroke-width="2" data-k="e1" data-cell="egg|1M|1024"></path> <path d="M44.3 60.2 L49.1 66.5 L53.8 74.5 L63.3 96.5 L72.8 115.4 L82.3 125.1 L91.8 131.4 L101.3 135.9 L110.7 139.6 L120.2 142.7 L129.7 145.3 L139.2 147.5 L148.7 149.4 L158.2 151.0 L167.7 152.5 L177.1 153.8 L186.6 154.8 L196.1 155.8 L205.6 156.9 L215.1 157.5 L224.6 158.0 L234.1 158.6 L243.5 159.2 L253.0 159.5 L262.5 160.1 L272.0 160.3 L281.5 160.8 L291.0 161.2 L300.5 161.4 L309.9 161.6 L319.4 161.9 L328.9 162.4 L333.7 162.5" data-k="e1"></path> <path d="M44.3 60.2 L49.1 85.9 L53.8 112.5 L63.3 130.9 L72.8 140.1 L82.3 153.7 L91.8 154.7 L101.3 160.6 L110.7 162.9 L120.2 162.5 L129.7 162.5 L139.2 163.6 L148.7 165.7 L158.2 168.8 L167.7 170.9 L177.1 173.5 L186.6 175.2 L196.1 173.4 L205.6 176.8 L215.1 177.8 L224.6 179.5 L234.1 180.6 L243.5 182.5 L253.0 182.1 L262.5 183.6 L272.0 183.3 L281.5 185.8 L291.0 186.5 L300.5 186.0 L309.9 187.4 L319.4 187.5 L328.9 188.3 L333.7 188.2" stroke="rgb(106,114,126)" stroke-width="2" data-k="e2" data-cell="egg|1M|16384"></path> <path d="M44.3 60.2 L49.1 85.9 L53.8 112.5 L63.3 130.9 L72.8 140.1 L82.3 153.7 L91.8 154.7 L101.3 160.6 L110.7 162.9 L120.2 162.5 L129.7 162.5 L139.2 163.6 L148.7 165.7 L158.2 168.8 L167.7 170.9 L177.1 173.5 L186.6 175.2 L196.1 173.4 L205.6 176.8 L215.1 177.8 L224.6 179.5 L234.1 180.6 L243.5 182.5 L253.0 182.1 L262.5 183.6 L272.0 183.3 L281.5 185.8 L291.0 186.5 L300.5 186.0 L309.9 187.4 L319.4 187.5 L328.9 188.3 L333.7 188.2" data-k="e2"></path> <path d="M44.3 60.2 L49.1 73.0 L53.8 96.6 L63.3 121.0 L72.8 129.6 L82.3 146.7 L91.8 152.2 L101.3 151.2 L110.7 162.3 L120.2 167.9 L129.7 175.5 L139.2 176.4 L148.7 182.7 L158.2 186.3 L167.7 188.9 L177.1 191.8 L186.6 193.7 L196.1 191.1 L205.6 198.1 L215.1 202.0 L224.6 204.7 L234.1 206.0 L243.5 206.7 L253.0 209.0 L262.5 213.5 L272.0 213.9 L281.5 214.0 L291.0 218.0 L300.5 219.4 L309.9 219.7 L319.4 220.7 L328.9 223.6 L333.7 223.3" stroke="rgb(199,186,244)" stroke-width="2" data-k="x0" data-cell="fwd|1M|64"></path> <path d="M44.3 60.2 L49.1 73.0 L53.8 96.6 L63.3 121.0 L72.8 129.6 L82.3 146.7 L91.8 152.2 L101.3 151.2 L110.7 162.3 L120.2 167.9 L129.7 175.5 L139.2 176.4 L148.7 182.7 L158.2 186.3 L167.7 188.9 L177.1 191.8 L186.6 193.7 L196.1 191.1 L205.6 198.1 L215.1 202.0 L224.6 204.7 L234.1 206.0 L243.5 206.7 L253.0 209.0 L262.5 213.5 L272.0 213.9 L281.5 214.0 L291.0 218.0 L300.5 219.4 L309.9 219.7 L319.4 220.7 L328.9 223.6 L333.7 223.3" data-k="x0"></path> <path d="M44.3 60.2 L49.1 73.0 L53.8 97.2 L63.3 119.7 L72.8 129.1 L82.3 143.9 L91.8 151.7 L101.3 160.2 L110.7 171.5 L120.2 176.9 L129.7 181.0 L139.2 189.5 L148.7 193.6 L158.2 198.4 L167.7 203.8 L177.1 208.3 L186.6 211.0 L196.1 216.0 L205.6 219.0 L215.1 223.4 L224.6 225.7 L234.1 229.1 L243.5 231.8 L253.0 234.4 L262.5 237.0 L272.0 239.3 L281.5 242.3 L291.0 243.9 L300.5 246.0 L309.9 247.5 L319.4 249.5 L328.9 251.3 L333.7 252.4" stroke="rgb(152,131,211)" stroke-width="2" data-k="x1" data-cell="fwd|1M|1024"></path> <path d="M44.3 60.2 L49.1 73.0 L53.8 97.2 L63.3 119.7 L72.8 129.1 L82.3 143.9 L91.8 151.7 L101.3 160.2 L110.7 171.5 L120.2 176.9 L129.7 181.0 L139.2 189.5 L148.7 193.6 L158.2 198.4 L167.7 203.8 L177.1 208.3 L186.6 211.0 L196.1 216.0 L205.6 219.0 L215.1 223.4 L224.6 225.7 L234.1 229.1 L243.5 231.8 L253.0 234.4 L262.5 237.0 L272.0 239.3 L281.5 242.3 L291.0 243.9 L300.5 246.0 L309.9 247.5 L319.4 249.5 L328.9 251.3 L333.7 252.4" data-k="x1"></path> <path d="M44.3 60.2 L49.1 73.0 L53.8 97.6 L63.3 120.2 L72.8 127.2 L82.3 143.2 L91.8 151.6 L101.3 151.9 L110.7 165.2 L120.2 176.1 L129.7 176.9 L139.2 182.7 L148.7 189.1 L158.2 193.8 L167.7 201.7 L177.1 206.1 L186.6 209.3 L196.1 214.0 L205.6 217.7 L215.1 221.8 L224.6 224.5 L234.1 228.8 L243.5 231.0 L253.0 233.3 L262.5 237.2 L272.0 239.6 L281.5 242.2 L291.0 245.2 L300.5 246.8 L309.9 248.2 L319.4 251.1 L328.9 253.2 L333.7 253.8" stroke="rgb(98,71,157)" stroke-width="2" data-k="x2" data-cell="fwd|1M|16384"></path> <path d="M44.3 60.2 L49.1 73.0 L53.8 97.6 L63.3 120.2 L72.8 127.2 L82.3 143.2 L91.8 151.6 L101.3 151.9 L110.7 165.2 L120.2 176.1 L129.7 176.9 L139.2 182.7 L148.7 189.1 L158.2 193.8 L167.7 201.7 L177.1 206.1 L186.6 209.3 L196.1 214.0 L205.6 217.7 L215.1 221.8 L224.6 224.5 L234.1 228.8 L243.5 231.0 L253.0 233.3 L262.5 237.2 L272.0 239.6 L281.5 242.2 L291.0 245.2 L300.5 246.8 L309.9 248.2 L319.4 251.1 L328.9 253.2 L333.7 253.8" data-k="x2"></path> <path d="M44.3 60.2 L49.1 71.6 L53.8 95.0 L63.3 116.3 L72.8 121.3 L82.3 141.1 L91.8 155.5 L101.3 155.5 L110.7 160.6 L120.2 170.8 L129.7 174.9 L139.2 183.7 L148.7 186.0 L158.2 189.6 L167.7 196.2 L177.1 199.8 L186.6 203.4 L196.1 207.9 L205.6 211.5 L215.1 215.1 L224.6 218.1 L234.1 221.3 L243.5 224.3 L253.0 227.3 L262.5 230.8 L272.0 233.8 L281.5 236.0 L291.0 238.9 L300.5 242.2 L309.9 243.9 L319.4 246.5 L328.9 249.3 L333.7 250.4" stroke="#0f172a" stroke-width="2" stroke-dasharray="6 4.5" data-k="bp" data-cell="bp|1M"></path> <path d="M44.3 60.2 L49.1 71.6 L53.8 95.0 L63.3 116.3 L72.8 121.3 L82.3 141.1 L91.8 155.5 L101.3 155.5 L110.7 160.6 L120.2 170.8 L129.7 174.9 L139.2 183.7 L148.7 186.0 L158.2 189.6 L167.7 196.2 L177.1 199.8 L186.6 203.4 L196.1 207.9 L205.6 211.5 L215.1 215.1 L224.6 218.1 L234.1 221.3 L243.5 224.3 L253.0 227.3 L262.5 230.8 L272.0 233.8 L281.5 236.0 L291.0 238.9 L300.5 242.2 L309.9 243.9 L319.4 246.5 L328.9 249.3 L333.7 250.4" data-k="bp"></path> 5.0 6.0 7.0 8.0 Validation loss 10M tokens 0 0.25 0.5 0.75 1 Training fraction <path d="M394.3 58.1 L394.8 58.2 L399.1 61.9 L403.8 67.5 L408.6 73.8 L413.3 80.7 L418.1 87.5 L422.8 93.7 L427.5 98.5 L432.3 102.2 L437.0 105.3 L441.8 107.9 L446.5 110.0 L451.3 111.8 L456.0 113.3 L460.7 114.8 L465.5 116.2 L470.2 117.4 L475.0 118.6 L479.7 119.6 L484.5 120.6 L489.2 121.5 L493.9 122.3 L498.7 123.1 L503.4 123.7 L508.2 124.3 L512.9 124.9 L517.7 125.5 L522.4 126.0 L527.1 126.4 L531.9 126.8 L536.6 127.2 L541.4 127.6 L546.1 128.0 L550.9 128.3 L555.6 128.6 L560.3 128.9 L565.1 129.3 L569.8 129.6 L574.6 129.9 L579.3 130.1 L584.1 130.3 L588.8 130.5 L593.5 130.7 L598.3 130.9 L603.0 131.0 L607.8 131.3 L612.5 131.5 L617.3 131.7 L622.0 131.8 L626.7 131.9 L631.5 132.1 L636.2 132.2 L641.0 132.3 L645.7 132.5 L650.5 132.6 L655.2 132.7 L659.9 132.8 L664.7 132.9 L669.4 133.0 L674.2 133.1 L678.9 133.2 L683.7 133.3" stroke="rgb(198,203,210)" stroke-width="2" data-k="e0" data-cell="egg|10M|64"></path> <path d="M394.3 58.1 L394.8 58.2 L399.1 61.9 L403.8 67.5 L408.6 73.8 L413.3 80.7 L418.1 87.5 L422.8 93.7 L427.5 98.5 L432.3 102.2 L437.0 105.3 L441.8 107.9 L446.5 110.0 L451.3 111.8 L456.0 113.3 L460.7 114.8 L465.5 116.2 L470.2 117.4 L475.0 118.6 L479.7 119.6 L484.5 120.6 L489.2 121.5 L493.9 122.3 L498.7 123.1 L503.4 123.7 L508.2 124.3 L512.9 124.9 L517.7 125.5 L522.4 126.0 L527.1 126.4 L531.9 126.8 L536.6 127.2 L541.4 127.6 L546.1 128.0 L550.9 128.3 L555.6 128.6 L560.3 128.9 L565.1 129.3 L569.8 129.6 L574.6 129.9 L579.3 130.1 L584.1 130.3 L588.8 130.5 L593.5 130.7 L598.3 130.9 L603.0 131.0 L607.8 131.3 L612.5 131.5 L617.3 131.7 L622.0 131.8 L626.7 131.9 L631.5 132.1 L636.2 132.2 L641.0 132.3 L645.7 132.5 L650.5 132.6 L655.2 132.7 L659.9 132.8 L664.7 132.9 L669.4 133.0 L674.2 133.1 L678.9 133.2 L683.7 133.3" data-k="e0"></path> <path d="M394.3 58.1 L394.8 58.5 L399.1 75.3 L403.8 101.8 L408.6 113.5 L413.3 121.8 L418.1 127.2 L422.8 130.7 L427.5 133.1 L432.3 134.7 L437.0 136.0 L441.8 137.1 L446.5 138.1 L451.3 138.9 L456.0 139.7 L460.7 140.3 L465.5 140.9 L470.2 141.5 L475.0 142.0 L479.7 142.5 L484.5 143.1 L489.2 143.5 L493.9 144.0 L498.7 144.5 L503.4 144.9 L508.2 145.3 L512.9 145.7 L517.7 146.1 L522.4 146.5 L527.1 146.8 L531.9 147.1 L536.6 147.5 L541.4 147.8 L546.1 148.1 L550.9 148.5 L555.6 148.8 L560.3 149.0 L565.1 149.3 L569.8 149.6 L574.6 149.9 L579.3 150.1 L584.1 150.4 L588.8 150.6 L593.5 150.9 L598.3 151.2 L603.0 151.4 L607.8 151.7 L612.5 152.0 L617.3 152.2 L622.0 152.5 L626.7 152.7 L631.5 152.9 L636.2 153.1 L641.0 153.3 L645.7 153.5 L650.5 153.8 L655.2 154.0 L659.9 154.2 L664.7 154.3 L669.4 154.6 L674.2 154.8 L678.9 155.1 L683.7 155.2" stroke="rgb(152,159,170)" stroke-width="2" data-k="e1" data-cell="egg|10M|1024"></path> <path d="M394.3 58.1 L394.8 58.5 L399.1 75.3 L403.8 101.8 L408.6 113.5 L413.3 121.8 L418.1 127.2 L422.8 130.7 L427.5 133.1 L432.3 134.7 L437.0 136.0 L441.8 137.1 L446.5 138.1 L451.3 138.9 L456.0 139.7 L460.7 140.3 L465.5 140.9 L470.2 141.5 L475.0 142.0 L479.7 142.5 L484.5 143.1 L489.2 143.5 L493.9 144.0 L498.7 144.5 L503.4 144.9 L508.2 145.3 L512.9 145.7 L517.7 146.1 L522.4 146.5 L527.1 146.8 L531.9 147.1 L536.6 147.5 L541.4 147.8 L546.1 148.1 L550.9 148.5 L555.6 148.8 L560.3 149.0 L565.1 149.3 L569.8 149.6 L574.6 149.9 L579.3 150.1 L584.1 150.4 L588.8 150.6 L593.5 150.9 L598.3 151.2 L603.0 151.4 L607.8 151.7 L612.5 152.0 L617.3 152.2 L622.0 152.5 L626.7 152.7 L631.5 152.9 L636.2 153.1 L641.0 153.3 L645.7 153.5 L650.5 153.8 L655.2 154.0 L659.9 154.2 L664.7 154.3 L669.4 154.6 L674.2 154.8 L678.9 155.1 L683.7 155.2" data-k="e1"></path> <path d="M394.3 58.1 L394.8 60.1 L399.1 101.3 L403.8 127.3 L408.6 137.0 L413.3 142.5 L418.1 146.3 L422.8 149.4 L427.5 152.1 L432.3 154.9 L437.0 157.3 L441.8 159.9 L446.5 162.3 L451.3 164.5 L456.0 166.4 L460.7 168.3 L465.5 170.0 L470.2 171.5 L475.0 173.1 L479.7 174.5 L484.5 176.0 L489.2 177.2 L493.9 178.3 L498.7 179.4 L503.4 180.3 L508.2 181.2 L512.9 182.1 L517.7 182.9 L522.4 183.6 L527.1 184.3 L531.9 184.9 L536.6 185.5 L541.4 186.0 L546.1 186.5 L550.9 187.0 L555.6 187.4 L560.3 188.0 L565.1 188.3 L569.8 188.7 L574.6 189.0 L579.3 189.3 L584.1 189.6 L588.8 190.0 L593.5 190.2 L598.3 190.6 L603.0 190.8 L607.8 191.2 L612.5 191.5 L617.3 191.5 L622.0 191.8 L626.7 192.2 L631.5 192.3 L636.2 192.7 L641.0 192.7 L645.7 193.1 L650.5 193.3 L655.2 193.5 L659.9 193.6 L664.7 193.9 L669.4 194.2 L674.2 194.4 L678.9 194.6 L683.7 194.9" stroke="rgb(106,114,126)" stroke-width="2" data-k="e2" data-cell="egg|10M|16384"></path> <path d="M394.3 58.1 L394.8 60.1 L399.1 101.3 L403.8 127.3 L408.6 137.0 L413.3 142.5 L418.1 146.3 L422.8 149.4 L427.5 152.1 L432.3 154.9 L437.0 157.3 L441.8 159.9 L446.5 162.3 L451.3 164.5 L456.0 166.4 L460.7 168.3 L465.5 170.0 L470.2 171.5 L475.0 173.1 L479.7 174.5 L484.5 176.0 L489.2 177.2 L493.9 178.3 L498.7 179.4 L503.4 180.3 L508.2 181.2 L512.9 182.1 L517.7 182.9 L522.4 183.6 L527.1 184.3 L531.9 184.9 L536.6 185.5 L541.4 186.0 L546.1 186.5 L550.9 187.0 L555.6 187.4 L560.3 188.0 L565.1 188.3 L569.8 188.7 L574.6 189.0 L579.3 189.3 L584.1 189.6 L588.8 190.0 L593.5 190.2 L598.3 190.6 L603.0 190.8 L607.8 191.2 L612.5 191.5 L617.3 191.5 L622.0 191.8 L626.7 192.2 L631.5 192.3 L636.2 192.7 L641.0 192.7 L645.7 193.1 L650.5 193.3 L655.2 193.5 L659.9 193.6 L664.7 193.9 L669.4 194.2 L674.2 194.4 L678.9 194.6 L683.7 194.9" data-k="e2"></path> <path d="M394.3 58.1 L394.8 62.4 L399.1 114.9 L403.8 139.8 L408.6 152.1 L413.3 160.6 L418.1 168.4 L422.8 174.3 L427.5 179.0 L432.3 183.0 L437.0 187.1 L441.8 189.9 L446.5 192.7 L451.3 195.6 L456.0 197.6 L460.7 199.7 L465.5 201.6 L470.2 203.4 L475.0 205.1 L479.7 206.6 L484.5 208.5 L489.2 210.1 L493.9 211.2 L498.7 212.5 L503.4 213.8 L508.2 215.0 L512.9 216.0 L517.7 216.9 L522.4 217.8 L527.1 218.6 L531.9 219.3 L536.6 220.2 L541.4 221.1 L546.1 221.5 L550.9 222.3 L555.6 222.8 L560.3 223.4 L565.1 224.1 L569.8 224.8 L574.6 225.4 L579.3 225.8 L584.1 226.3 L588.8 226.7 L593.5 227.1 L598.3 227.4 L603.0 228.2 L607.8 228.4 L612.5 228.9 L617.3 229.3 L622.0 229.6 L626.7 230.0 L631.5 230.2 L636.2 230.5 L641.0 230.6 L645.7 231.1 L650.5 231.4 L655.2 231.7 L659.9 231.8 L664.7 232.0 L669.4 232.5 L674.2 232.7 L678.9 233.0 L683.7 233.1" stroke="rgb(199,186,244)" stroke-width="2" data-k="x0" data-cell="fwd|10M|64"></path> <path d="M394.3 58.1 L394.8 62.4 L399.1 114.9 L403.8 139.8 L408.6 152.1 L413.3 160.6 L418.1 168.4 L422.8 174.3 L427.5 179.0 L432.3 183.0 L437.0 187.1 L441.8 189.9 L446.5 192.7 L451.3 195.6 L456.0 197.6 L460.7 199.7 L465.5 201.6 L470.2 203.4 L475.0 205.1 L479.7 206.6 L484.5 208.5 L489.2 210.1 L493.9 211.2 L498.7 212.5 L503.4 213.8 L508.2 215.0 L512.9 216.0 L517.7 216.9 L522.4 217.8 L527.1 218.6 L531.9 219.3 L536.6 220.2 L541.4 221.1 L546.1 221.5 L550.9 222.3 L555.6 222.8 L560.3 223.4 L565.1 224.1 L569.8 224.8 L574.6 225.4 L579.3 225.8 L584.1 226.3 L588.8 226.7 L593.5 227.1 L598.3 227.4 L603.0 228.2 L607.8 228.4 L612.5 228.9 L617.3 229.3 L622.0 229.6 L626.7 230.0 L631.5 230.2 L636.2 230.5 L641.0 230.6 L645.7 231.1 L650.5 231.4 L655.2 231.7 L659.9 231.8 L664.7 232.0 L669.4 232.5 L674.2 232.7 L678.9 233.0 L683.7 233.1" data-k="x0"></path> <path d="M394.3 58.1 L394.8 68.6 L399.1 131.5 L403.8 151.6 L408.6 171.2 L413.3 184.8 L418.1 195.1 L422.8 202.1 L427.5 208.6 L432.3 213.5 L437.0 217.5 L441.8 221.3 L446.5 224.6 L451.3 227.2 L456.0 228.9 L460.7 230.8 L465.5 232.1 L470.2 233.7 L475.0 234.7 L479.7 235.8 L484.5 237.0 L489.2 238.0 L493.9 238.8 L498.7 239.5 L503.4 240.2 L508.2 240.5 L512.9 241.1 L517.7 241.7 L522.4 242.3 L527.1 242.7 L531.9 243.1 L536.6 243.5 L541.4 243.7 L546.1 243.9 L550.9 244.5 L555.6 244.7 L560.3 244.9 L565.1 245.0 L569.8 245.4 L574.6 245.7 L579.3 246.1 L584.1 246.2 L588.8 246.4 L593.5 246.5 L598.3 246.7 L603.0 246.9 L607.8 247.2 L612.5 247.4 L617.3 247.8 L622.0 248.0 L626.7 248.2 L631.5 248.3 L636.2 248.4 L641.0 248.5 L645.7 248.6 L650.5 248.9 L655.2 249.2 L659.9 249.0 L664.7 249.1 L669.4 249.4 L674.2 249.7 L678.9 250.1 L683.7 250.2" stroke="rgb(152,131,211)" stroke-width="2" data-k="x1" data-cell="fwd|10M|1024"></path> <path d="M394.3 58.1 L394.8 68.6 L399.1 131.5 L403.8 151.6 L408.6 171.2 L413.3 184.8 L418.1 195.1 L422.8 202.1 L427.5 208.6 L432.3 213.5 L437.0 217.5 L441.8 221.3 L446.5 224.6 L451.3 227.2 L456.0 228.9 L460.7 230.8 L465.5 232.1 L470.2 233.7 L475.0 234.7 L479.7 235.8 L484.5 237.0 L489.2 238.0 L493.9 238.8 L498.7 239.5 L503.4 240.2 L508.2 240.5 L512.9 241.1 L517.7 241.7 L522.4 242.3 L527.1 242.7 L531.9 243.1 L536.6 243.5 L541.4 243.7 L546.1 243.9 L550.9 244.5 L555.6 244.7 L560.3 244.9 L565.1 245.0 L569.8 245.4 L574.6 245.7 L579.3 246.1 L584.1 246.2 L588.8 246.4 L593.5 246.5 L598.3 246.7 L603.0 246.9 L607.8 247.2 L612.5 247.4 L617.3 247.8 L622.0 248.0 L626.7 248.2 L631.5 248.3 L636.2 248.4 L641.0 248.5 L645.7 248.6 L650.5 248.9 L655.2 249.2 L659.9 249.0 L664.7 249.1 L669.4 249.4 L674.2 249.7 L678.9 250.1 L683.7 250.2" data-k="x1"></path> <path d="M394.3 58.1 L394.8 68.6 L399.1 130.7 L403.8 154.1 L408.6 171.6 L413.3 186.2 L418.1 196.7 L422.8 204.5 L427.5 211.3 L432.3 217.1 L437.0 221.4 L441.8 224.9 L446.5 228.1 L451.3 230.6 L456.0 232.5 L460.7 234.1 L465.5 235.5 L470.2 236.8 L475.0 238.0 L479.7 239.1 L484.5 240.1 L489.2 241.1 L493.9 241.8 L498.7 242.6 L503.4 243.1 L508.2 243.5 L512.9 244.0 L517.7 244.6 L522.4 245.2 L527.1 245.5 L531.9 246.0 L536.6 246.4 L541.4 246.7 L546.1 246.7 L550.9 247.3 L555.6 247.6 L560.3 247.9 L565.1 248.0 L569.8 248.5 L574.6 248.8 L579.3 249.1 L584.1 249.3 L588.8 249.2 L593.5 249.6 L598.3 249.8 L603.0 250.1 L607.8 250.3 L612.5 250.6 L617.3 251.0 L622.0 251.2 L626.7 251.6 L631.5 251.6 L636.2 251.8 L641.0 251.9 L645.7 252.1 L650.5 252.3 L655.2 252.5 L659.9 252.5 L664.7 252.7 L669.4 253.0 L674.2 253.5 L678.9 253.8 L683.7 253.9" stroke="rgb(98,71,157)" stroke-width="2" data-k="x2" data-cell="fwd|10M|16384"></path> <path d="M394.3 58.1 L394.8 68.6 L399.1 130.7 L403.8 154.1 L408.6 171.6 L413.3 186.2 L418.1 196.7 L422.8 204.5 L427.5 211.3 L432.3 217.1 L437.0 221.4 L441.8 224.9 L446.5 228.1 L451.3 230.6 L456.0 232.5 L460.7 234.1 L465.5 235.5 L470.2 236.8 L475.0 238.0 L479.7 239.1 L484.5 240.1 L489.2 241.1 L493.9 241.8 L498.7 242.6 L503.4 243.1 L508.2 243.5 L512.9 244.0 L517.7 244.6 L522.4 245.2 L527.1 245.5 L531.9 246.0 L536.6 246.4 L541.4 246.7 L546.1 246.7 L550.9 247.3 L555.6 247.6 L560.3 247.9 L565.1 248.0 L569.8 248.5 L574.6 248.8 L579.3 249.1 L584.1 249.3 L588.8 249.2 L593.5 249.6 L598.3 249.8 L603.0 250.1 L607.8 250.3 L612.5 250.6 L617.3 251.0 L622.0 251.2 L626.7 251.6 L631.5 251.6 L636.2 251.8 L641.0 251.9 L645.7 252.1 L650.5 252.3 L655.2 252.5 L659.9 252.5 L664.7 252.7 L669.4 253.0 L674.2 253.5 L678.9 253.8 L683.7 253.9" data-k="x2"></path> <path d="M394.3 58.1 L394.8 67.7 L399.1 131.0 L403.8 152.3 L408.6 169.0 L413.3 182.7 L418.1 194.2 L422.8 203.0 L427.5 209.9 L432.3 216.0 L437.0 220.7 L441.8 224.5 L446.5 227.8 L451.3 230.6 L456.0 232.8 L460.7 234.6 L465.5 235.9 L470.2 237.2 L475.0 238.4 L479.7 239.8 L484.5 240.8 L489.2 241.8 L493.9 242.4 L498.7 243.3 L503.4 243.9 L508.2 244.4 L512.9 244.9 L517.7 245.7 L522.4 246.1 L527.1 246.7 L531.9 246.9 L536.6 247.5 L541.4 247.7 L546.1 248.0 L550.9 248.6 L555.6 248.9 L560.3 249.3 L565.1 249.6 L569.8 250.0 L574.6 250.4 L579.3 250.7 L584.1 251.0 L588.8 251.0 L593.5 251.4 L598.3 251.7 L603.0 252.1 L607.8 252.2 L612.5 252.7 L617.3 253.1 L622.0 253.5 L626.7 253.9 L631.5 254.1 L636.2 254.5 L641.0 254.6 L645.7 255.0 L650.5 255.2 L655.2 255.5 L659.9 255.7 L664.7 255.8 L669.4 256.4 L674.2 256.9 L678.9 257.2 L683.7 257.5" stroke="#0f172a" stroke-width="2" stroke-dasharray="6 4.5" data-k="bp" data-cell="bp|10M"></path> <path d="M394.3 58.1 L394.8 67.7 L399.1 131.0 L403.8 152.3 L408.6 169.0 L413.3 182.7 L418.1 194.2 L422.8 203.0 L427.5 209.9 L432.3 216.0 L437.0 220.7 L441.8 224.5 L446.5 227.8 L451.3 230.6 L456.0 232.8 L460.7 234.6 L465.5 235.9 L470.2 237.2 L475.0 238.4 L479.7 239.8 L484.5 240.8 L489.2 241.8 L493.9 242.4 L498.7 243.3 L503.4 243.9 L508.2 244.4 L512.9 244.9 L517.7 245.7 L522.4 246.1 L527.1 246.7 L531.9 246.9 L536.6 247.5 L541.4 247.7 L546.1 248.0 L550.9 248.6 L555.6 248.9 L560.3 249.3 L565.1 249.6 L569.8 250.0 L574.6 250.4 L579.3 250.7 L584.1 251.0 L588.8 251.0 L593.5 251.4 L598.3 251.7 L603.0 252.1 L607.8 252.2 L612.5 252.7 L617.3 253.1 L622.0 253.5 L626.7 253.9 L631.5 254.1 L636.2 254.5 L641.0 254.6 L645.7 255.0 L650.5 255.2 L655.2 255.5 L659.9 255.7 L664.7 255.8 L669.4 256.4 L674.2 256.9 L678.9 257.2 L683.7 257.5" data-k="bp"></path> Dust 64 1k 16k EGGROLL- Transformer 64 1k 16k Backprop </svg> </p> <figcaption><span>Figure 1:</span> Validation defeat complete training at 1M and 10M tokens for Dust (<span>violet</span>), EGGROLL at the identical populations (<span>gray</span>) and backprop (black, dashed). The x-axis is the fraction of the token prosperity consumed. Shade is population, 64, 1k and 16k, darker for larger. Curves are method complete three seeds.</figcaption> </figure> <figure id="fig-2"> <p> <svg viewbox="0 0 800 622" role="img" aria-label="Test defeat against community at four token budgets"> 7.2 7.4 7.6 7.8 8.0 Test loss 100k tokens 64 256 1k 4k 16k Population <path d="M40.0 223.2 L355.0 223.2" stroke="#0f172a" stroke-width="2" stroke-dasharray="0.1 4.6" data-k="bp" data-val="7.216378"></path> <path d="M40.0 223.2 L355.0 223.2" data-k="bp"></path> <path d="M58.7 64.5 L128.0 140.5 L197.3 187.1 L266.6 205.0 L335.9 213.2" stroke="rgb(169,178,190)" stroke-width="1.8" data-k="e"></path> <path d="M58.7 64.5 L128.0 140.5 L197.3 187.1 L266.6 205.0 L335.9 213.2" data-k="e"></path> <path d="M58.7 218.1 L62.2 220.3 L65.7 222.2 L69.1 223.8 L72.6 225.3 L76.1 226.5 L79.5 227.6 L83.0 228.6 L86.4 229.4 L89.9 230.1 L93.4 230.8 L96.8 231.3 L100.3 231.8 L103.8 232.2 L107.2 232.6 L110.7 232.9 L114.2 233.1 L117.6 233.4 L121.1 233.6 L124.6 233.8 L128.0 233.9 L131.5 234.1 L135.0 234.2 L138.4 234.3 L141.9 234.4 L145.4 234.5 L148.8 234.5 L152.3 234.6 L155.7 234.6 L159.2 234.7 L162.7 234.7 L166.1 234.8 L169.6 234.8 L173.1 234.8 L176.5 234.8 L180.0 234.9 L183.5 234.9 L186.9 234.9 L190.4 234.9 L193.9 234.9 L197.3 234.9 L200.8 234.9 L204.3 234.9 L207.7 234.9 L211.2 235.0 L214.6 235.0 L218.1 235.0 L221.6 235.0 L225.0 235.0 L228.5 235.0 L232.0 235.0 L235.4 235.0 L238.9 235.0 L242.4 235.0 L245.8 235.0 L249.3 235.0 L252.8 235.0 L256.2 235.0 L259.7 235.0 L263.2 235.0 L266.6 235.0 L270.1 235.0 L273.6 235.0 L277.0 235.0 L280.5 235.0 L283.9 235.0 L287.4 235.0 L290.9 235.0 L294.3 235.0 L297.8 235.0 L301.3 235.0 L304.7 235.0 L308.2 235.0 L311.7 235.0 L315.1 235.0 L318.6 235.0 L322.1 235.0 L325.5 235.0 L329.0 235.0 L332.5 235.0 L335.9 235.0" stroke="#8b5cf6" stroke-width="1.8" stroke-dasharray="6 4.5" data-k="x" data-fit="317.766445 1.995 7.161066"></path> <path d="M58.7 218.1 L62.2 220.3 L65.7 222.2 L69.1 223.8 L72.6 225.3 L76.1 226.5 L79.5 227.6 L83.0 228.6 L86.4 229.4 L89.9 230.1 L93.4 230.8 L96.8 231.3 L100.3 231.8 L103.8 232.2 L107.2 232.6 L110.7 232.9 L114.2 233.1 L117.6 233.4 L121.1 233.6 L124.6 233.8 L128.0 233.9 L131.5 234.1 L135.0 234.2 L138.4 234.3 L141.9 234.4 L145.4 234.5 L148.8 234.5 L152.3 234.6 L155.7 234.6 L159.2 234.7 L162.7 234.7 L166.1 234.8 L169.6 234.8 L173.1 234.8 L176.5 234.8 L180.0 234.9 L183.5 234.9 L186.9 234.9 L190.4 234.9 L193.9 234.9 L197.3 234.9 L200.8 234.9 L204.3 234.9 L207.7 234.9 L211.2 235.0 L214.6 235.0 L218.1 235.0 L221.6 235.0 L225.0 235.0 L228.5 235.0 L232.0 235.0 L235.4 235.0 L238.9 235.0 L242.4 235.0 L245.8 235.0 L249.3 235.0 L252.8 235.0 L256.2 235.0 L259.7 235.0 L263.2 235.0 L266.6 235.0 L270.1 235.0 L273.6 235.0 L277.0 235.0 L280.5 235.0 L283.9 235.0 L287.4 235.0 L290.9 235.0 L294.3 235.0 L297.8 235.0 L301.3 235.0 L304.7 235.0 L308.2 235.0 L311.7 235.0 L315.1 235.0 L318.6 235.0 L322.1 235.0 L325.5 235.0 L329.0 235.0 L332.5 235.0 L335.9 235.0" data-k="x"></path> 4.0 4.5 5.0 5.5 6.0 6.5 7.0 7.5 1M tokens 64 256 1k 4k 16k Population <path d="M445.0 135.4 L760.0 135.4" stroke="#0f172a" stroke-width="2" stroke-dasharray="0.1 4.6" data-k="bp" data-val="5.959387"></path> <path d="M445.0 135.4 L760.0 135.4" data-k="bp"></path> <path d="M463.7 58.4 L533.0 70.4 L602.3 78.4 L671.6 86.5 L740.9 96.1" stroke="rgb(169,178,190)" stroke-width="1.8" data-k="e"></path> <path d="M463.7 58.4 L533.0 70.4 L602.3 78.4 L671.6 86.5 L740.9 96.1" data-k="e"></path> <path d="M463.7 117.9 L467.2 118.8 L470.7 119.7 L474.1 120.6 L477.6 121.4 L481.1 122.2 L484.5 123.0 L488.0 123.7 L491.4 124.4 L494.9 125.0 L498.4 125.6 L501.8 126.2 L505.3 126.8 L508.8 127.4 L512.2 127.9 L515.7 128.4 L519.2 128.8 L522.6 129.3 L526.1 129.7 L529.6 130.1 L533.0 130.5 L536.5 130.9 L540.0 131.3 L543.4 131.6 L546.9 132.0 L550.4 132.3 L553.8 132.6 L557.3 132.8 L560.7 133.1 L564.2 133.4 L567.7 133.6 L571.1 133.9 L574.6 134.1 L578.1 134.3 L581.5 134.5 L585.0 134.7 L588.5 134.9 L591.9 135.1 L595.4 135.3 L598.9 135.4 L602.3 135.6 L605.8 135.7 L609.3 135.9 L612.7 136.0 L616.2 136.1 L619.6 136.3 L623.1 136.4 L626.6 136.5 L630.0 136.6 L633.5 136.7 L637.0 136.8 L640.4 136.9 L643.9 137.0 L647.4 137.1 L650.8 137.2 L654.3 137.2 L657.8 137.3 L661.2 137.4 L664.7 137.5 L668.2 137.5 L671.6 137.6 L675.1 137.6 L678.6 137.7 L682.0 137.8 L685.5 137.8 L688.9 137.9 L692.4 137.9 L695.9 138.0 L699.3 138.0 L702.8 138.0 L706.3 138.1 L709.7 138.1 L713.2 138.1 L716.7 138.2 L720.1 138.2 L723.6 138.2 L727.1 138.3 L730.5 138.3 L734.0 138.3 L737.5 138.4 L740.9 138.4" stroke="#8b5cf6" stroke-width="1.8" stroke-dasharray="6 4.5" data-k="x" data-fit="6.380304 0.665 5.891583"></path> <path d="M463.7 117.9 L467.2 118.8 L470.7 119.7 L474.1 120.6 L477.6 121.4 L481.1 122.2 L484.5 123.0 L488.0 123.7 L491.4 124.4 L494.9 125.0 L498.4 125.6 L501.8 126.2 L505.3 126.8 L508.8 127.4 L512.2 127.9 L515.7 128.4 L519.2 128.8 L522.6 129.3 L526.1 129.7 L529.6 130.1 L533.0 130.5 L536.5 130.9 L540.0 131.3 L543.4 131.6 L546.9 132.0 L550.4 132.3 L553.8 132.6 L557.3 132.8 L560.7 133.1 L564.2 133.4 L567.7 133.6 L571.1 133.9 L574.6 134.1 L578.1 134.3 L581.5 134.5 L585.0 134.7 L588.5 134.9 L591.9 135.1 L595.4 135.3 L598.9 135.4 L602.3 135.6 L605.8 135.7 L609.3 135.9 L612.7 136.0 L616.2 136.1 L619.6 136.3 L623.1 136.4 L626.6 136.5 L630.0 136.6 L633.5 136.7 L637.0 136.8 L640.4 136.9 L643.9 137.0 L647.4 137.1 L650.8 137.2 L654.3 137.2 L657.8 137.3 L661.2 137.4 L664.7 137.5 L668.2 137.5 L671.6 137.6 L675.1 137.6 L678.6 137.7 L682.0 137.8 L685.5 137.8 L688.9 137.9 L692.4 137.9 L695.9 138.0 L699.3 138.0 L702.8 138.0 L706.3 138.1 L709.7 138.1 L713.2 138.1 L716.7 138.2 L720.1 138.2 L723.6 138.2 L727.1 138.3 L730.5 138.3 L734.0 138.3 L737.5 138.4 L740.9 138.4" data-k="x"></path> 4.0 4.5 5.0 5.5 6.0 6.5 7.0 7.5 Test loss 10M tokens 64 256 1k 4k 16k Population <path d="M40.0 482.2 L355.0 482.2" stroke="#0f172a" stroke-width="2" stroke-dasharray="0.1 4.6" data-k="bp" data-val="4.989182"></path> <path d="M40.0 482.2 L355.0 482.2" data-k="bp"></path> <path d="M58.7 373.9 L128.0 381.7 L197.3 393.0 L266.6 410.8 L335.9 427.5" stroke="rgb(169,178,190)" stroke-width="1.8" data-k="e"></path> <path d="M58.7 373.9 L128.0 381.7 L197.3 393.0 L266.6 410.8 L335.9 427.5" data-k="e"></path> <path d="M58.7 460.7 L62.2 461.3 L65.7 461.9 L69.1 462.5 L72.6 463.1 L76.1 463.6 L79.5 464.2 L83.0 464.7 L86.4 465.2 L89.9 465.7 L93.4 466.1 L96.8 466.6 L100.3 467.0 L103.8 467.5 L107.2 467.9 L110.7 468.3 L114.2 468.7 L117.6 469.0 L121.1 469.4 L124.6 469.8 L128.0 470.1 L131.5 470.4 L135.0 470.8 L138.4 471.1 L141.9 471.4 L145.4 471.7 L148.8 472.0 L152.3 472.2 L155.7 472.5 L159.2 472.8 L162.7 473.0 L166.1 473.3 L169.6 473.5 L173.1 473.7 L176.5 474.0 L180.0 474.2 L183.5 474.4 L186.9 474.6 L190.4 474.8 L193.9 475.0 L197.3 475.2 L200.8 475.3 L204.3 475.5 L207.7 475.7 L211.2 475.8 L214.6 476.0 L218.1 476.1 L221.6 476.3 L225.0 476.4 L228.5 476.6 L232.0 476.7 L235.4 476.8 L238.9 477.0 L242.4 477.1 L245.8 477.2 L249.3 477.3 L252.8 477.4 L256.2 477.5 L259.7 477.7 L263.2 477.8 L266.6 477.9 L270.1 477.9 L273.6 478.0 L277.0 478.1 L280.5 478.2 L283.9 478.3 L287.4 478.4 L290.9 478.5 L294.3 478.5 L297.8 478.6 L301.3 478.7 L304.7 478.8 L308.2 478.8 L311.7 478.9 L315.1 479.0 L318.6 479.0 L322.1 479.1 L325.5 479.1 L329.0 479.2 L332.5 479.2 L335.9 479.3" stroke="#8b5cf6" stroke-width="1.8" stroke-dasharray="6 4.5" data-k="x" data-fit="2.512591 0.45 5.01269"></path> <path d="M58.7 460.7 L62.2 461.3 L65.7 461.9 L69.1 462.5 L72.6 463.1 L76.1 463.6 L79.5 464.2 L83.0 464.7 L86.4 465.2 L89.9 465.7 L93.4 466.1 L96.8 466.6 L100.3 467.0 L103.8 467.5 L107.2 467.9 L110.7 468.3 L114.2 468.7 L117.6 469.0 L121.1 469.4 L124.6 469.8 L128.0 470.1 L131.5 470.4 L135.0 470.8 L138.4 471.1 L141.9 471.4 L145.4 471.7 L148.8 472.0 L152.3 472.2 L155.7 472.5 L159.2 472.8 L162.7 473.0 L166.1 473.3 L169.6 473.5 L173.1 473.7 L176.5 474.0 L180.0 474.2 L183.5 474.4 L186.9 474.6 L190.4 474.8 L193.9 475.0 L197.3 475.2 L200.8 475.3 L204.3 475.5 L207.7 475.7 L211.2 475.8 L214.6 476.0 L218.1 476.1 L221.6 476.3 L225.0 476.4 L228.5 476.6 L232.0 476.7 L235.4 476.8 L238.9 477.0 L242.4 477.1 L245.8 477.2 L249.3 477.3 L252.8 477.4 L256.2 477.5 L259.7 477.7 L263.2 477.8 L266.6 477.9 L270.1 477.9 L273.6 478.0 L277.0 478.1 L280.5 478.2 L283.9 478.3 L287.4 478.4 L290.9 478.5 L294.3 478.5 L297.8 478.6 L301.3 478.7 L304.7 478.8 L308.2 478.8 L311.7 478.9 L315.1 479.0 L318.6 479.0 L322.1 479.1 L325.5 479.1 L329.0 479.2 L332.5 479.2 L335.9 479.3" data-k="x"></path> 4.0 4.5 5.0 5.5 6.0 6.5 7.0 7.5 20M tokens 64 256 1k 4k 16k Population <path d="M445.0 500.9 L760.0 500.9" stroke="#0f172a" stroke-width="2" stroke-dasharray="0.1 4.6" data-k="bp" data-val="4.632936"></path> <path d="M445.0 500.9 L760.0 500.9" data-k="bp"></path> <path d="M461.3 377.5 L521.5 386.8 L581.8 402.1 L642.1 418.7 L702.3 436.3" stroke="rgb(169,178,190)" stroke-width="1.8" data-k="e"></path> <path d="M461.3 377.5 L521.5 386.8 L581.8 402.1 L642.1 418.7 L702.3 436.3" data-k="e"></path> <path d="M461.3 467.5 L464.3 467.9 L467.3 468.3 L470.3 468.8 L473.3 469.2 L476.4 469.6 L479.4 470.0 L482.4 470.5 L485.4 470.9 L488.4 471.3 L491.4 471.7 L494.4 472.1 L497.4 472.5 L500.5 472.9 L503.5 473.2 L506.5 473.6 L509.5 474.0 L512.5 474.4 L515.5 474.7 L518.5 475.1 L521.5 475.5 L524.6 475.8 L527.6 476.2 L530.6 476.5 L533.6 476.9 L536.6 477.2 L539.6 477.6 L542.6 477.9 L545.6 478.3 L548.7 478.6 L551.7 478.9 L554.7 479.2 L557.7 479.6 L560.7 479.9 L563.7 480.2 L566.7 480.5 L569.8 480.8 L572.8 481.1 L575.8 481.4 L578.8 481.7 L581.8 482.0 L584.8 482.3 L587.8 482.6 L590.8 482.9 L593.9 483.2 L596.9 483.5 L599.9 483.7 L602.9 484.0 L605.9 484.3 L608.9 484.6 L611.9 484.8 L614.9 485.1 L618.0 485.4 L621.0 485.6 L624.0 485.9 L627.0 486.1 L630.0 486.4 L633.0 486.6 L636.0 486.9 L639.0 487.1 L642.1 487.4 L645.1 487.6 L648.1 487.9 L651.1 488.1 L654.1 488.3 L657.1 488.6 L660.1 488.8 L663.2 489.0 L666.2 489.2 L669.2 489.5 L672.2 489.7 L675.2 489.9 L678.2 490.1 L681.2 490.3 L684.2 490.5 L687.3 490.7 L690.3 491.0 L693.3 491.2 L696.3 491.4 L699.3 491.6 L702.3 491.8" stroke="#8b5cf6" stroke-width="1.8" stroke-dasharray="6 4.5" data-k="x" data-fit="1.5335281390977824 0.14500000000000002 4.431363544089328"></path> <path d="M461.3 467.5 L464.3 467.9 L467.3 468.3 L470.3 468.8 L473.3 469.2 L476.4 469.6 L479.4 470.0 L482.4 470.5 L485.4 470.9 L488.4 471.3 L491.4 471.7 L494.4 472.1 L497.4 472.5 L500.5 472.9 L503.5 473.2 L506.5 473.6 L509.5 474.0 L512.5 474.4 L515.5 474.7 L518.5 475.1 L521.5 475.5 L524.6 475.8 L527.6 476.2 L530.6 476.5 L533.6 476.9 L536.6 477.2 L539.6 477.6 L542.6 477.9 L545.6 478.3 L548.7 478.6 L551.7 478.9 L554.7 479.2 L557.7 479.6 L560.7 479.9 L563.7 480.2 L566.7 480.5 L569.8 480.8 L572.8 481.1 L575.8 481.4 L578.8 481.7 L581.8 482.0 L584.8 482.3 L587.8 482.6 L590.8 482.9 L593.9 483.2 L596.9 483.5 L599.9 483.7 L602.9 484.0 L605.9 484.3 L608.9 484.6 L611.9 484.8 L614.9 485.1 L618.0 485.4 L621.0 485.6 L624.0 485.9 L627.0 486.1 L630.0 486.4 L633.0 486.6 L636.0 486.9 L639.0 487.1 L642.1 487.4 L645.1 487.6 L648.1 487.9 L651.1 488.1 L654.1 488.3 L657.1 488.6 L660.1 488.8 L663.2 489.0 L666.2 489.2 L669.2 489.5 L672.2 489.7 L675.2 489.9 L678.2 490.1 L681.2 490.3 L684.2 490.5 L687.3 490.7 L690.3 491.0 L693.3 491.2 L696.3 491.4 L699.3 491.6 L702.3 491.8" data-k="x"></path> &infin; 4.43 fit 1.53 P&minus;0.145 + 4.43 limit as P &rarr; &infin; 95% duration of the limit EGGROLL-Transformer Dust Backprop </svg> </p> <figcaption><span>Figure 2:</span> Test defeat at the validation-selected checkpoint against population, one panel per token budget, for Dust (<span>violet</span>) and EGGROLL-Transformer (<span>gray</span>). Points are the cells of Table&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">1</a>, the dotted dreary row is backprop tuned at the identical budget, and the dashed curve is a power law fit through Dust&rsquo;s five cells. The 100k panel has its own y range; the another three portion one. At 20M the dash-dotted <span>violet</span> row is the fit&rsquo;s limit, 4.43, an extrapolation from a ladder that is motionless falling, and the bar at $\infty$ is its 95% bootstrap interval, alongside the seeds resampled at all population.</figcaption> </figure> <p>We clear the token prosperity from 100k to 20M against populations from 64 to 16k, alongside backprop tuned on the identical grid at all prosperity (Table&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">1</a>, Figure&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">2</a>). At 100k and 1M tokens Dust ends below backprop, from a few hundred draws at 100k and from a thousand at 1M. At 10M and 20M tokens, the gap alongside backprop shrinks alongside population. At 10M the ladder has flattened and its fitted bounds lands fair complete backprop. At 20M the ladder is motionless falling at 16k draws. Its power law fit puts the bounds at 4.431 (95% duration 3.89 to 4.58), below backprop&rsquo;s 4.633, but alongside the ladder motionless falling the fit is loosely constrained, so we peruse it as evidence that the gap keeps decision alongside community fairly than as a measured limit.</p> <p>Weight-space ES is <em>far small efficient</em>. With 256 times the population, EGGROLL at 16k motionless does not attain Dust at 64 draws. It comes inside 0.02 at 100k tokens and stays 0.4 to 0.6 complete at 1M, 10M and 20M (Figure&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">2</a>). EGGROLL&rsquo;s ladder is motionless falling steeply at 16k, so it would keep improving alongside additional population, but continuing the ladder puts what it needs to equivalent Dust&rsquo;s smallest community at multiple thousand to concerning $10^4$ times that community (Appendix&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">D</a>). Figure&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">1</a> additionally shows the gap during training; Dust at 1k and 16k draws stays near to backprop&rsquo;s curve throughout, during all EGGROLL curve falls rearward first and flattens fine complete Dust at 64 draws.</p> <h3 id="dust-under-adam"><span>3.3</span> Dust Under Adam</h3> <figure id="fig-3"> <p> <svg viewbox="0 0 500 366" role="img" aria-label="Test defeat against community at 1M tokens alongside Adam"> 5.5 6.0 6.5 7.0 7.5 Test loss 1M tokens alongside Adam 64 256 1k 4k 16k 64k &infin; Population <path d="M59.5 67.2 L124.4 92.2 L189.3 109.3 L254.2 125.2 L319.1 144.4" stroke="rgb(169,178,190)" stroke-width="2" data-k="e"></path> <path d="M59.5 67.2 L124.4 92.2 L189.3 109.3 L254.2 125.2 L319.1 144.4" data-k="e"></path> EGGROLL-Transformer <path d="M40.0 291.5 L434.0 291.5" stroke="#0f172a" stroke-width="2" stroke-dasharray="0.1 4.6" data-k="bp" data-val="5.36064510345459"></path> <path d="M40.0 291.5 L434.0 291.5" data-k="bp"></path> <path d="M59.5 213.0 L61.1 213.9 L62.7 214.9 L64.3 215.8 L66.0 216.6 L67.6 217.5 L69.2 218.4 L70.8 219.3 L72.5 220.1 L74.1 221.0 L75.7 221.8 L77.3 222.6 L78.9 223.5 L80.6 224.3 L82.2 225.1 L83.8 225.9 L85.4 226.7 L87.1 227.5 L88.7 228.2 L90.3 229.0 L91.9 229.8 L93.5 230.5 L95.2 231.2 L96.8 232.0 L98.4 232.7 L100.0 233.4 L101.7 234.1 L103.3 234.9 L104.9 235.5 L106.5 236.2 L108.2 236.9 L109.8 237.6 L111.4 238.3 L113.0 238.9 L114.6 239.6 L116.3 240.2 L117.9 240.9 L119.5 241.5 L121.1 242.2 L122.8 242.8 L124.4 243.4 L126.0 244.0 L127.6 244.6 L129.2 245.2 L130.9 245.8 L132.5 246.4 L134.1 247.0 L135.7 247.6 L137.4 248.1 L139.0 248.7 L140.6 249.3 L142.2 249.8 L143.9 250.4 L145.5 250.9 L147.1 251.4 L148.7 252.0 L150.3 252.5 L152.0 253.0 L153.6 253.5 L155.2 254.0 L156.8 254.5 L158.5 255.0 L160.1 255.5 L161.7 256.0 L163.3 256.5 L164.9 257.0 L166.6 257.5 L168.2 257.9 L169.8 258.4 L171.4 258.8 L173.1 259.3 L174.7 259.8 L176.3 260.2 L177.9 260.6 L179.6 261.1 L181.2 261.5 L182.8 261.9 L184.4 262.4 L186.0 262.8 L187.7 263.2 L189.3 263.6 L190.9 264.0 L192.5 264.4 L194.2 264.8 L195.8 265.2 L197.4 265.6 L199.0 266.0 L200.6 266.4 L202.3 266.8 L203.9 267.1 L205.5 267.5 L207.1 267.9 L208.8 268.2 L210.4 268.6 L212.0 269.0 L213.6 269.3 L215.3 269.7 L216.9 270.0 L218.5 270.3 L220.1 270.7 L221.7 271.0 L223.4 271.3 L225.0 271.7 L226.6 272.0 L228.2 272.3 L229.9 272.6 L231.5 273.0 L233.1 273.3 L234.7 273.6 L236.3 273.9 L238.0 274.2 L239.6 274.5 L241.2 274.8 L242.8 275.1 L244.5 275.4 L246.1 275.7 L247.7 275.9 L249.3 276.2 L250.9 276.5 L252.6 276.8 L254.2 277.1 L255.8 277.3 L257.4 277.6 L259.1 277.9 L260.7 278.1 L262.3 278.4 L263.9 278.6 L265.6 278.9 L267.2 279.1 L268.8 279.4 L270.4 279.6 L272.0 279.9 L273.7 280.1 L275.3 280.4 L276.9 280.6 L278.5 280.8 L280.2 281.1 L281.8 281.3 L283.4 281.5 L285.0 281.8 L286.6 282.0 L288.3 282.2 L289.9 282.4 L291.5 282.6 L293.1 282.9 L294.8 283.1 L296.4 283.3 L298.0 283.5 L299.6 283.7 L301.3 283.9 L302.9 284.1 L304.5 284.3 L306.1 284.5 L307.7 284.7 L309.4 284.9 L311.0 285.1 L312.6 285.3 L314.2 285.4 L315.9 285.6 L317.5 285.8 L319.1 286.0 L320.7 286.2 L322.3 286.4 L324.0 286.5 L325.6 286.7 L327.2 286.9 L328.8 287.1 L330.5 287.3 L332.1 287.4 L333.7 287.6 L335.3 287.8 L337.0 288.0 L338.6 288.2 L340.2 288.3 L341.8 288.5 L343.4 288.7 L345.1 288.9 L346.7 289.0 L348.3 289.2 L349.9 289.4 L351.6 289.6 L353.2 289.7 L354.8 289.9 L356.4 290.1 L358.0 290.3 L359.7 290.4 L361.3 290.6 L362.9 290.8 L364.5 291.0 L366.2 291.1 L367.8 291.3 L369.4 291.5 L371.0 291.6 L372.7 291.8 L374.0 292.0" stroke="rgb(117,92,180)" stroke-width="1.9" data-k="x" data-fit="2.8444 0.294 5.2478"></path> <path d="M59.5 213.0 L61.1 213.9 L62.7 214.9 L64.3 215.8 L66.0 216.6 L67.6 217.5 L69.2 218.4 L70.8 219.3 L72.5 220.1 L74.1 221.0 L75.7 221.8 L77.3 222.6 L78.9 223.5 L80.6 224.3 L82.2 225.1 L83.8 225.9 L85.4 226.7 L87.1 227.5 L88.7 228.2 L90.3 229.0 L91.9 229.8 L93.5 230.5 L95.2 231.2 L96.8 232.0 L98.4 232.7 L100.0 233.4 L101.7 234.1 L103.3 234.9 L104.9 235.5 L106.5 236.2 L108.2 236.9 L109.8 237.6 L111.4 238.3 L113.0 238.9 L114.6 239.6 L116.3 240.2 L117.9 240.9 L119.5 241.5 L121.1 242.2 L122.8 242.8 L124.4 243.4 L126.0 244.0 L127.6 244.6 L129.2 245.2 L130.9 245.8 L132.5 246.4 L134.1 247.0 L135.7 247.6 L137.4 248.1 L139.0 248.7 L140.6 249.3 L142.2 249.8 L143.9 250.4 L145.5 250.9 L147.1 251.4 L148.7 252.0 L150.3 252.5 L152.0 253.0 L153.6 253.5 L155.2 254.0 L156.8 254.5 L158.5 255.0 L160.1 255.5 L161.7 256.0 L163.3 256.5 L164.9 257.0 L166.6 257.5 L168.2 257.9 L169.8 258.4 L171.4 258.8 L173.1 259.3 L174.7 259.8 L176.3 260.2 L177.9 260.6 L179.6 261.1 L181.2 261.5 L182.8 261.9 L184.4 262.4 L186.0 262.8 L187.7 263.2 L189.3 263.6 L190.9 264.0 L192.5 264.4 L194.2 264.8 L195.8 265.2 L197.4 265.6 L199.0 266.0 L200.6 266.4 L202.3 266.8 L203.9 267.1 L205.5 267.5 L207.1 267.9 L208.8 268.2 L210.4 268.6 L212.0 269.0 L213.6 269.3 L215.3 269.7 L216.9 270.0 L218.5 270.3 L220.1 270.7 L221.7 271.0 L223.4 271.3 L225.0 271.7 L226.6 272.0 L228.2 272.3 L229.9 272.6 L231.5 273.0 L233.1 273.3 L234.7 273.6 L236.3 273.9 L238.0 274.2 L239.6 274.5 L241.2 274.8 L242.8 275.1 L244.5 275.4 L246.1 275.7 L247.7 275.9 L249.3 276.2 L250.9 276.5 L252.6 276.8 L254.2 277.1 L255.8 277.3 L257.4 277.6 L259.1 277.9 L260.7 278.1 L262.3 278.4 L263.9 278.6 L265.6 278.9 L267.2 279.1 L268.8 279.4 L270.4 279.6 L272.0 279.9 L273.7 280.1 L275.3 280.4 L276.9 280.6 L278.5 280.8 L280.2 281.1 L281.8 281.3 L283.4 281.5 L285.0 281.8 L286.6 282.0 L288.3 282.2 L289.9 282.4 L291.5 282.6 L293.1 282.9 L294.8 283.1 L296.4 283.3 L298.0 283.5 L299.6 283.7 L301.3 283.9 L302.9 284.1 L304.5 284.3 L306.1 284.5 L307.7 284.7 L309.4 284.9 L311.0 285.1 L312.6 285.3 L314.2 285.4 L315.9 285.6 L317.5 285.8 L319.1 286.0 L320.7 286.2 L322.3 286.4 L324.0 286.5 L325.6 286.7 L327.2 286.9 L328.8 287.1 L330.5 287.3 L332.1 287.4 L333.7 287.6 L335.3 287.8 L337.0 288.0 L338.6 288.2 L340.2 288.3 L341.8 288.5 L343.4 288.7 L345.1 288.9 L346.7 289.0 L348.3 289.2 L349.9 289.4 L351.6 289.6 L353.2 289.7 L354.8 289.9 L356.4 290.1 L358.0 290.3 L359.7 290.4 L361.3 290.6 L362.9 290.8 L364.5 291.0 L366.2 291.1 L367.8 291.3 L369.4 291.5 L371.0 291.6 L372.7 291.8 L374.0 292.0" data-k="x"></path> Dust 5.248 Backprop 5.361 </svg> </p> <figcaption><span>Figure 3:</span> Test defeat against community at 1M tokens alongside Adam, for Dust (<span>violet</span>), EGGROLL (<span>gray</span>) and backprop (black, <span>dotted</span>). The <span>violet</span> curve is a power law fit in community complete the populations run, and the dash-dotted <span>violet</span> row is its limit, 5.248, below backprop. The bar at $\infty$ is the limit&rsquo;s 95% bootstrap interval, 5.17 to 5.30, alongside the seeds resampled at all population. Means complete five seeds for Dust and backprop and three for EGGROLL; the Adam runs of Dust provision the token embedding additional draws, concerning $1.4\times$ the listed community in total.</figcaption> </figure> <p>While we concentration chiefly on SGD for the remainder of the paper, we reiterate the 1M token ladder alongside Adam on all three methods (Figure&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">3</a>), re-tuning backprop&rsquo;s learning rates, Dust&rsquo;s own hyperparameters and EGGROLL&rsquo;s stage size, momentum and fitness shaping at all population. Interestingly, EGGROLL gains nearly nothing from Adam and its tuned Adam ladder lands inside 0.01 of its SGD ladder in Table&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">1</a> at all population. However, Adam improves the two Dust and backprop and leaves the ladder&rsquo;s form akin to before. Dust closes on backprop alongside a ample community and the duration on its bounds sits below backprop (Figure&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">3</a>). So Dust&rsquo;s evaluation <em>already plant alongside contemporary optimizers</em>, equal although contemporary optimizers were optimized for backprop gradients. We doubtful that coevolution of optimizers alongside Dust could guide to additional gains and depart this to forthcoming work.</p> <h2 id="search-in-high-dimensional-space"><span>4</span> Search in High-Dimensional Space</h2> <h3 id="overparameterization"><span>4.1</span> Overparameterization</h3> <figure id="fig-4"> <p><span>Test defeat inside all row</span><span><span></span><span><span>lowest in its row</span><span>highest in its row</span></span></span></p> <figcaption><span>Figure 4:</span> Four example sizes at a fixed 10M tokens, 2M to 243M parameters (L2/d128, L4/d256, L8/d512, L16/d1024), test defeat against population. The array has the identical cells and backprop per size, alongside the finest size at all community in bold.</figcaption> </figure> <p>The accepted perspective is that zeroth-order methods cannot train ample networks&nbsp;<span data-kind="citep" data-keys="lillicrap2020backpropagation">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Lillicrap et al., 2020</a><span>Timothy P. Lillicrap, Adam Santoro, Luke Marris, Colin J. Akerman, and Geoffrey Hinton. Backpropagation and the brain. <em>Nature Reviews Neuroscience</em>, 21 (6): 335&ndash;346, 2020. doi: <a href="https://en.mycoding.id/category/technology" target="_blank">10.1038/s41583-020-0277-3</a>.</span></span>)</span>. A onward continue returns a sole scalar, so the variance of the gradient evaluation grows alongside the figure of perturbed dimensions, and alongside it the community needed for a helpful update&nbsp;<span data-kind="citep" data-keys="werfel2003learning,nesterov2017random">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Nesterov and Spokoiny, 2017</a><span>Yurii Nesterov and Vladimir Spokoiny. Random gradient-free minimization of convex functions. <em>Foundations of Computational Mathematics</em>, 17 (2): 527&ndash;566, 2017. doi: <a href="https://en.mycoding.id/category/technology" target="_blank">10.1007/s10208-015-9296-2</a>.</span></span>; <span><a href="https://en.mycoding.id/category/technology" target="_blank">Werfel et al., 2003</a><span>Justin Werfel, Xiaohui Xie, and H. Sebastian Seung. Learning curves for stochastic gradient decline in linear feedforward networks. In <em>Advances in Neural Information Processing Systems</em>, quantity 16, 2003.</span></span>)</span>. We test this immediately by training four sizes, 2M, 7M, 38M and 243M parameters (a $120\times$ range in indicator count), at a fixed 10M tokens throughout the community clear (Figure&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">4</a>; see Appendix&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">F</a> for tuning details). We create two striking observations that difficulty accepted wisdom.</p> <ul> <li><em>Bigger models are frequently additional population-efficient, not less.</em> At all community from 256 up the defeat falls from 2M to 7M to 38M parameters, and the 243M example is lone slightly worse. Even at the smallest community we test, a example $120\times$ larger does concerning the same, and is improved at all another population. Up to a point, a larger example gains additional from its size than it loses to variance. What we observe, however, is that the gap to backprop at the identical community and example size increases alongside example size, but barely noticeable, esp at ample community sizes.</li> <li><em>Bigger models keep improving alongside community anywhere small ones flatten.</em> Small models saturate sooner, during big models keep improving alongside ample community sizes. Past 1k draws the 38M and 243M models acquire concerning 30% additional than the 2M and 7M ones, and no amount of community makes the small example competitive.</li> </ul> <p>The correct way to think concerning example size is hence as the <em>size and the geometry of the hunt space</em>. A larger example has a larger area to hunt over, which is what lets it put a ample community to use, and possibly a better-conditioned defeat landscape geometry, which could be why the hunt is additional productive equal at small populations.</p> <h3 id="emergence-of-backprop-like-gradients"><span>4.2</span> Emergence of Backprop-Like Gradients</h3> <figure id="fig-5"> <p> <svg viewbox="0 0 800 324" role="img" aria-label="Cosine between the estimated and the backprop gradient against population, per tier type"> 0.00 0.05 0.10 Cosine to backprop gradient EGGROLL, 10M tokens 64 1k 16k 128k <path d="M51.3 241.9 L78.3 240.1 L105.3 238.6 L132.4 234.4 L159.4 227.1 L186.4 211.0 L199.9 198.0" stroke="#1b9e77" stroke-width="2" data-k="mlp" data-fam="mlp"></path> <path d="M51.3 241.9 L78.3 240.1 L105.3 238.6 L132.4 234.4 L159.4 227.1 L186.4 211.0 L199.9 198.0" data-k="mlp"></path> <path d="M51.3 242.0 L78.3 241.5 L105.3 241.5 L132.4 239.9 L159.4 238.1 L186.4 236.4 L199.9 231.2" stroke="#7570b3" stroke-width="2" data-k="q" data-fam="q"></path> <path d="M51.3 242.0 L78.3 241.5 L105.3 241.5 L132.4 239.9 L159.4 238.1 L186.4 236.4 L199.9 231.2" data-k="q"></path> <path d="M51.3 243.2 L78.3 240.7 L105.3 241.7 L132.4 239.3 L159.4 235.7 L186.4 229.3 L199.9 223.6" stroke="#d95f02" stroke-width="2" data-k="k" data-fam="k"></path> <path d="M51.3 243.2 L78.3 240.7 L105.3 241.7 L132.4 239.3 L159.4 235.7 L186.4 229.3 L199.9 223.6" data-k="k"></path> <path d="M51.3 243.2 L78.3 241.6 L105.3 239.1 L132.4 235.9 L159.4 229.6 L186.4 217.3 L199.9 205.6" stroke="#e7298a" stroke-width="2" data-k="v" data-fam="v"></path> <path d="M51.3 243.2 L78.3 241.6 L105.3 239.1 L132.4 235.9 L159.4 229.6 L186.4 217.3 L199.9 205.6" data-k="v"></path> <path d="M51.3 239.3 L78.3 235.7 L105.3 227.1 L132.4 214.6 L159.4 183.8 L186.4 129.0 L199.9 81.1" stroke="#222222" stroke-width="2" data-k="lmh" data-fam="lmh"></path> <path d="M51.3 239.3 L78.3 235.7 L105.3 227.1 L132.4 214.6 L159.4 183.8 L186.4 129.0 L199.9 81.1" data-k="lmh"></path> 0.00 0.25 0.50 0.75 1.00 Dust, 10M tokens 64 1k 16k 128k <path d="M261.3 235.3 L262.7 234.9 L264.0 234.6 L265.4 234.3 L266.7 233.9 L268.1 233.6 L269.4 233.2 L270.8 232.8 L272.1 232.4 L273.5 232.0 L274.8 231.6 L276.2 231.1 L277.5 230.7 L278.9 230.2 L280.2 229.7 L281.6 229.2 L282.9 228.7 L284.3 228.1 L285.6 227.6 L287.0 227.0 L288.3 226.4 L289.7 225.8 L291.0 225.1 L292.4 224.5 L293.7 223.8 L295.1 223.1 L296.4 222.3 L297.8 221.6 L299.1 220.8 L300.5 220.0 L301.8 219.2 L303.2 218.3 L304.5 217.4 L305.9 216.5 L307.2 215.6 L308.6 214.6 L309.9 213.6 L311.3 212.6 L312.6 211.5 L314.0 210.4 L315.3 209.3 L316.7 208.1 L318.0 206.9 L319.4 205.7 L320.7 204.4 L322.1 203.1 L323.4 201.8 L324.8 200.4 L326.1 199.0 L327.5 197.5 L328.8 196.1 L330.2 194.5 L331.5 193.0 L332.9 191.4 L334.2 189.8 L335.6 188.1 L336.9 186.4 L338.3 184.7 L339.7 182.9 L341.0 181.2 L342.4 179.3 L343.7 177.5 L345.1 175.6 L346.4 173.7 L347.8 171.8 L349.1 169.9 L350.5 167.9 L351.8 165.9 L353.2 163.9 L354.5 161.9 L355.9 159.9 L357.2 157.9 L358.6 155.9 L359.9 153.9 L361.3 151.9 L362.6 149.9 L364.0 147.9 L365.3 145.9 L366.7 144.0 L368.0 142.0 L369.4 140.1 L370.7 138.2 L372.1 136.4 L373.4 134.6 L374.8 132.8 L376.1 131.1 L377.5 129.4 L378.8 127.7 L380.2 126.1 L381.5 124.5 L382.9 123.0 L384.2 121.5 L385.6 120.1 L386.9 118.7 L388.3 117.4 L389.6 116.2 L391.0 114.9 L392.3 113.8 L393.7 112.6 L395.0 111.6 L396.4 110.5 L397.7 109.6 L399.1 108.6 L400.4 107.7 L401.8 106.9 L403.1 106.1 L404.5 105.3 L405.8 104.6 L407.2 103.9 L408.5 103.3 L409.9 102.7 L411.2 102.1 L412.6 101.5 L413.9 101.0 L415.3 100.5 L416.6 100.1 L418.0 99.7" stroke="#1b9e77" stroke-width="2" data-k="mlp" data-fam="mlp" data-fit="0.8013044361331608 18085.339337716676"></path> <path d="M261.3 235.3 L262.7 234.9 L264.0 234.6 L265.4 234.3 L266.7 233.9 L268.1 233.6 L269.4 233.2 L270.8 232.8 L272.1 232.4 L273.5 232.0 L274.8 231.6 L276.2 231.1 L277.5 230.7 L278.9 230.2 L280.2 229.7 L281.6 229.2 L282.9 228.7 L284.3 228.1 L285.6 227.6 L287.0 227.0 L288.3 226.4 L289.7 225.8 L291.0 225.1 L292.4 224.5 L293.7 223.8 L295.1 223.1 L296.4 222.3 L297.8 221.6 L299.1 220.8 L300.5 220.0 L301.8 219.2 L303.2 218.3 L304.5 217.4 L305.9 216.5 L307.2 215.6 L308.6 214.6 L309.9 213.6 L311.3 212.6 L312.6 211.5 L314.0 210.4 L315.3 209.3 L316.7 208.1 L318.0 206.9 L319.4 205.7 L320.7 204.4 L322.1 203.1 L323.4 201.8 L324.8 200.4 L326.1 199.0 L327.5 197.5 L328.8 196.1 L330.2 194.5 L331.5 193.0 L332.9 191.4 L334.2 189.8 L335.6 188.1 L336.9 186.4 L338.3 184.7 L339.7 182.9 L341.0 181.2 L342.4 179.3 L343.7 177.5 L345.1 175.6 L346.4 173.7 L347.8 171.8 L349.1 169.9 L350.5 167.9 L351.8 165.9 L353.2 163.9 L354.5 161.9 L355.9 159.9 L357.2 157.9 L358.6 155.9 L359.9 153.9 L361.3 151.9 L362.6 149.9 L364.0 147.9 L365.3 145.9 L366.7 144.0 L368.0 142.0 L369.4 140.1 L370.7 138.2 L372.1 136.4 L373.4 134.6 L374.8 132.8 L376.1 131.1 L377.5 129.4 L378.8 127.7 L380.2 126.1 L381.5 124.5 L382.9 123.0 L384.2 121.5 L385.6 120.1 L386.9 118.7 L388.3 117.4 L389.6 116.2 L391.0 114.9 L392.3 113.8 L393.7 112.6 L395.0 111.6 L396.4 110.5 L397.7 109.6 L399.1 108.6 L400.4 107.7 L401.8 106.9 L403.1 106.1 L404.5 105.3 L405.8 104.6 L407.2 103.9 L408.5 103.3 L409.9 102.7 L411.2 102.1 L412.6 101.5 L413.9 101.0 L415.3 100.5 L416.6 100.1 L418.0 99.7" data-k="mlp"></path> <path d="M261.3 237.9 L262.7 237.7 L264.0 237.5 L265.4 237.2 L266.7 237.0 L268.1 236.7 L269.4 236.5 L270.8 236.2 L272.1 235.9 L273.5 235.6 L274.8 235.3 L276.2 235.0 L277.5 234.7 L278.9 234.3 L280.2 234.0 L281.6 233.6 L282.9 233.3 L284.3 232.9 L285.6 232.5 L287.0 232.1 L288.3 231.6 L289.7 231.2 L291.0 230.7 L292.4 230.3 L293.7 229.8 L295.1 229.3 L296.4 228.8 L297.8 228.2 L299.1 227.7 L300.5 227.1 L301.8 226.5 L303.2 225.9 L304.5 225.2 L305.9 224.5 L307.2 223.9 L308.6 223.1 L309.9 222.4 L311.3 221.7 L312.6 220.9 L314.0 220.1 L315.3 219.2 L316.7 218.4 L318.0 217.5 L319.4 216.5 L320.7 215.6 L322.1 214.6 L323.4 213.6 L324.8 212.5 L326.1 211.4 L327.5 210.3 L328.8 209.2 L330.2 208.0 L331.5 206.7 L332.9 205.5 L334.2 204.2 L335.6 202.8 L336.9 201.4 L338.3 200.0 L339.7 198.5 L341.0 197.0 L342.4 195.5 L343.7 193.9 L345.1 192.2 L346.4 190.5 L347.8 188.8 L349.1 187.0 L350.5 185.2 L351.8 183.3 L353.2 181.4 L354.5 179.4 L355.9 177.4 L357.2 175.3 L358.6 173.3 L359.9 171.1 L361.3 168.9 L362.6 166.7 L364.0 164.4 L365.3 162.1 L366.7 159.8 L368.0 157.4 L369.4 155.0 L370.7 152.6 L372.1 150.2 L373.4 147.7 L374.8 145.2 L376.1 142.7 L377.5 140.1 L378.8 137.6 L380.2 135.0 L381.5 132.5 L382.9 130.0 L384.2 127.4 L385.6 124.9 L386.9 122.4 L388.3 119.9 L389.6 117.4 L391.0 115.0 L392.3 112.6 L393.7 110.2 L395.0 107.9 L396.4 105.6 L397.7 103.4 L399.1 101.2 L400.4 99.0 L401.8 96.9 L403.1 94.9 L404.5 92.9 L405.8 91.0 L407.2 89.1 L408.5 87.4 L409.9 85.6 L411.2 84.0 L412.6 82.4 L413.9 80.8 L415.3 79.3 L416.6 77.9 L418.0 76.6" stroke="#7570b3" stroke-width="2" data-k="q" data-fam="q" data-fit="1.0123088209954156 58572.1556774133"></path> <path d="M261.3 237.9 L262.7 237.7 L264.0 237.5 L265.4 237.2 L266.7 237.0 L268.1 236.7 L269.4 236.5 L270.8 236.2 L272.1 235.9 L273.5 235.6 L274.8 235.3 L276.2 235.0 L277.5 234.7 L278.9 234.3 L280.2 234.0 L281.6 233.6 L282.9 233.3 L284.3 232.9 L285.6 232.5 L287.0 232.1 L288.3 231.6 L289.7 231.2 L291.0 230.7 L292.4 230.3 L293.7 229.8 L295.1 229.3 L296.4 228.8 L297.8 228.2 L299.1 227.7 L300.5 227.1 L301.8 226.5 L303.2 225.9 L304.5 225.2 L305.9 224.5 L307.2 223.9 L308.6 223.1 L309.9 222.4 L311.3 221.7 L312.6 220.9 L314.0 220.1 L315.3 219.2 L316.7 218.4 L318.0 217.5 L319.4 216.5 L320.7 215.6 L322.1 214.6 L323.4 213.6 L324.8 212.5 L326.1 211.4 L327.5 210.3 L328.8 209.2 L330.2 208.0 L331.5 206.7 L332.9 205.5 L334.2 204.2 L335.6 202.8 L336.9 201.4 L338.3 200.0 L339.7 198.5 L341.0 197.0 L342.4 195.5 L343.7 193.9 L345.1 192.2 L346.4 190.5 L347.8 188.8 L349.1 187.0 L350.5 185.2 L351.8 183.3 L353.2 181.4 L354.5 179.4 L355.9 177.4 L357.2 175.3 L358.6 173.3 L359.9 171.1 L361.3 168.9 L362.6 166.7 L364.0 164.4 L365.3 162.1 L366.7 159.8 L368.0 157.4 L369.4 155.0 L370.7 152.6 L372.1 150.2 L373.4 147.7 L374.8 145.2 L376.1 142.7 L377.5 140.1 L378.8 137.6 L380.2 135.0 L381.5 132.5 L382.9 130.0 L384.2 127.4 L385.6 124.9 L386.9 122.4 L388.3 119.9 L389.6 117.4 L391.0 115.0 L392.3 112.6 L393.7 110.2 L395.0 107.9 L396.4 105.6 L397.7 103.4 L399.1 101.2 L400.4 99.0 L401.8 96.9 L403.1 94.9 L404.5 92.9 L405.8 91.0 L407.2 89.1 L408.5 87.4 L409.9 85.6 L411.2 84.0 L412.6 82.4 L413.9 80.8 L415.3 79.3 L416.6 77.9 L418.0 76.6" data-k="q"></path> <path d="M261.3 241.9 L262.7 241.8 L264.0 241.7 L265.4 241.6 L266.7 241.5 L268.1 241.4 L269.4 241.3 L270.8 241.2 L272.1 241.1 L273.5 241.0 L274.8 240.9 L276.2 240.8 L277.5 240.6 L278.9 240.5 L280.2 240.4 L281.6 240.2 L282.9 240.1 L284.3 240.0 L285.6 239.8 L287.0 239.7 L288.3 239.5 L289.7 239.3 L291.0 239.2 L292.4 239.0 L293.7 238.8 L295.1 238.6 L296.4 238.4 L297.8 238.2 L299.1 238.0 L300.5 237.8 L301.8 237.5 L303.2 237.3 L304.5 237.1 L305.9 236.8 L307.2 236.5 L308.6 236.3 L309.9 236.0 L311.3 235.7 L312.6 235.4 L314.0 235.1 L315.3 234.8 L316.7 234.4 L318.0 234.1 L319.4 233.8 L320.7 233.4 L322.1 233.0 L323.4 232.6 L324.8 232.2 L326.1 231.8 L327.5 231.3 L328.8 230.9 L330.2 230.4 L331.5 230.0 L332.9 229.5 L334.2 228.9 L335.6 228.4 L336.9 227.9 L338.3 227.3 L339.7 226.7 L341.0 226.1 L342.4 225.5 L343.7 224.8 L345.1 224.2 L346.4 223.5 L347.8 222.7 L349.1 222.0 L350.5 221.3 L351.8 220.5 L353.2 219.7 L354.5 218.8 L355.9 218.0 L357.2 217.1 L358.6 216.2 L359.9 215.2 L361.3 214.2 L362.6 213.2 L364.0 212.2 L365.3 211.2 L366.7 210.1 L368.0 208.9 L369.4 207.8 L370.7 206.6 L372.1 205.4 L373.4 204.1 L374.8 202.9 L376.1 201.6 L377.5 200.2 L378.8 198.8 L380.2 197.4 L381.5 196.0 L382.9 194.5 L384.2 193.0 L385.6 191.5 L386.9 190.0 L388.3 188.4 L389.6 186.8 L391.0 185.1 L392.3 183.5 L393.7 181.8 L395.0 180.1 L396.4 178.4 L397.7 176.7 L399.1 174.9 L400.4 173.2 L401.8 171.4 L403.1 169.7 L404.5 167.9 L405.8 166.1 L407.2 164.4 L408.5 162.6 L409.9 160.8 L411.2 159.1 L412.6 157.4 L413.9 155.6 L415.3 154.0 L416.6 152.3 L418.0 150.6" stroke="#d95f02" stroke-width="2" data-k="k" data-fam="k" data-fit="0.7042885110047098 200943.34340728985"></path> <path d="M261.3 241.9 L262.7 241.8 L264.0 241.7 L265.4 241.6 L266.7 241.5 L268.1 241.4 L269.4 241.3 L270.8 241.2 L272.1 241.1 L273.5 241.0 L274.8 240.9 L276.2 240.8 L277.5 240.6 L278.9 240.5 L280.2 240.4 L281.6 240.2 L282.9 240.1 L284.3 240.0 L285.6 239.8 L287.0 239.7 L288.3 239.5 L289.7 239.3 L291.0 239.2 L292.4 239.0 L293.7 238.8 L295.1 238.6 L296.4 238.4 L297.8 238.2 L299.1 238.0 L300.5 237.8 L301.8 237.5 L303.2 237.3 L304.5 237.1 L305.9 236.8 L307.2 236.5 L308.6 236.3 L309.9 236.0 L311.3 235.7 L312.6 235.4 L314.0 235.1 L315.3 234.8 L316.7 234.4 L318.0 234.1 L319.4 233.8 L320.7 233.4 L322.1 233.0 L323.4 232.6 L324.8 232.2 L326.1 231.8 L327.5 231.3 L328.8 230.9 L330.2 230.4 L331.5 230.0 L332.9 229.5 L334.2 228.9 L335.6 228.4 L336.9 227.9 L338.3 227.3 L339.7 226.7 L341.0 226.1 L342.4 225.5 L343.7 224.8 L345.1 224.2 L346.4 223.5 L347.8 222.7 L349.1 222.0 L350.5 221.3 L351.8 220.5 L353.2 219.7 L354.5 218.8 L355.9 218.0 L357.2 217.1 L358.6 216.2 L359.9 215.2 L361.3 214.2 L362.6 213.2 L364.0 212.2 L365.3 211.2 L366.7 210.1 L368.0 208.9 L369.4 207.8 L370.7 206.6 L372.1 205.4 L373.4 204.1 L374.8 202.9 L376.1 201.6 L377.5 200.2 L378.8 198.8 L380.2 197.4 L381.5 196.0 L382.9 194.5 L384.2 193.0 L385.6 191.5 L386.9 190.0 L388.3 188.4 L389.6 186.8 L391.0 185.1 L392.3 183.5 L393.7 181.8 L395.0 180.1 L396.4 178.4 L397.7 176.7 L399.1 174.9 L400.4 173.2 L401.8 171.4 L403.1 169.7 L404.5 167.9 L405.8 166.1 L407.2 164.4 L408.5 162.6 L409.9 160.8 L411.2 159.1 L412.6 157.4 L413.9 155.6 L415.3 154.0 L416.6 152.3 L418.0 150.6" data-k="k"></path> <path d="M261.3 240.2 L262.7 240.1 L264.0 239.9 L265.4 239.8 L266.7 239.6 L268.1 239.4 L269.4 239.3 L270.8 239.1 L272.1 238.9 L273.5 238.7 L274.8 238.5 L276.2 238.3 L277.5 238.1 L278.9 237.9 L280.2 237.7 L281.6 237.4 L282.9 237.2 L284.3 237.0 L285.6 236.7 L287.0 236.4 L288.3 236.2 L289.7 235.9 L291.0 235.6 L292.4 235.3 L293.7 235.0 L295.1 234.6 L296.4 234.3 L297.8 234.0 L299.1 233.6 L300.5 233.2 L301.8 232.8 L303.2 232.4 L304.5 232.0 L305.9 231.6 L307.2 231.2 L308.6 230.7 L309.9 230.2 L311.3 229.7 L312.6 229.2 L314.0 228.7 L315.3 228.2 L316.7 227.6 L318.0 227.0 L319.4 226.4 L320.7 225.8 L322.1 225.2 L323.4 224.5 L324.8 223.8 L326.1 223.1 L327.5 222.4 L328.8 221.6 L330.2 220.8 L331.5 220.0 L332.9 219.2 L334.2 218.4 L335.6 217.5 L336.9 216.5 L338.3 215.6 L339.7 214.6 L341.0 213.6 L342.4 212.6 L343.7 211.5 L345.1 210.4 L346.4 209.3 L347.8 208.1 L349.1 206.9 L350.5 205.7 L351.8 204.4 L353.2 203.1 L354.5 201.7 L355.9 200.3 L357.2 198.9 L358.6 197.4 L359.9 195.9 L361.3 194.4 L362.6 192.8 L364.0 191.2 L365.3 189.6 L366.7 187.9 L368.0 186.1 L369.4 184.4 L370.7 182.6 L372.1 180.8 L373.4 178.9 L374.8 177.0 L376.1 175.1 L377.5 173.1 L378.8 171.1 L380.2 169.1 L381.5 167.1 L382.9 165.0 L384.2 162.9 L385.6 160.8 L386.9 158.7 L388.3 156.6 L389.6 154.5 L391.0 152.4 L392.3 150.3 L393.7 148.1 L395.0 146.0 L396.4 143.9 L397.7 141.8 L399.1 139.8 L400.4 137.7 L401.8 135.7 L403.1 133.7 L404.5 131.7 L405.8 129.8 L407.2 127.9 L408.5 126.0 L409.9 124.2 L411.2 122.5 L412.6 120.7 L413.9 119.1 L415.3 117.4 L416.6 115.8 L418.0 114.3" stroke="#e7298a" stroke-width="2" data-k="v" data-fam="v" data-fit="0.8445430133215731 99507.45322970646"></path> <path d="M261.3 240.2 L262.7 240.1 L264.0 239.9 L265.4 239.8 L266.7 239.6 L268.1 239.4 L269.4 239.3 L270.8 239.1 L272.1 238.9 L273.5 238.7 L274.8 238.5 L276.2 238.3 L277.5 238.1 L278.9 237.9 L280.2 237.7 L281.6 237.4 L282.9 237.2 L284.3 237.0 L285.6 236.7 L287.0 236.4 L288.3 236.2 L289.7 235.9 L291.0 235.6 L292.4 235.3 L293.7 235.0 L295.1 234.6 L296.4 234.3 L297.8 234.0 L299.1 233.6 L300.5 233.2 L301.8 232.8 L303.2 232.4 L304.5 232.0 L305.9 231.6 L307.2 231.2 L308.6 230.7 L309.9 230.2 L311.3 229.7 L312.6 229.2 L314.0 228.7 L315.3 228.2 L316.7 227.6 L318.0 227.0 L319.4 226.4 L320.7 225.8 L322.1 225.2 L323.4 224.5 L324.8 223.8 L326.1 223.1 L327.5 222.4 L328.8 221.6 L330.2 220.8 L331.5 220.0 L332.9 219.2 L334.2 218.4 L335.6 217.5 L336.9 216.5 L338.3 215.6 L339.7 214.6 L341.0 213.6 L342.4 212.6 L343.7 211.5 L345.1 210.4 L346.4 209.3 L347.8 208.1 L349.1 206.9 L350.5 205.7 L351.8 204.4 L353.2 203.1 L354.5 201.7 L355.9 200.3 L357.2 198.9 L358.6 197.4 L359.9 195.9 L361.3 194.4 L362.6 192.8 L364.0 191.2 L365.3 189.6 L366.7 187.9 L368.0 186.1 L369.4 184.4 L370.7 182.6 L372.1 180.8 L373.4 178.9 L374.8 177.0 L376.1 175.1 L377.5 173.1 L378.8 171.1 L380.2 169.1 L381.5 167.1 L382.9 165.0 L384.2 162.9 L385.6 160.8 L386.9 158.7 L388.3 156.6 L389.6 154.5 L391.0 152.4 L392.3 150.3 L393.7 148.1 L395.0 146.0 L396.4 143.9 L397.7 141.8 L399.1 139.8 L400.4 137.7 L401.8 135.7 L403.1 133.7 L404.5 131.7 L405.8 129.8 L407.2 127.9 L408.5 126.0 L409.9 124.2 L411.2 122.5 L412.6 120.7 L413.9 119.1 L415.3 117.4 L416.6 115.8 L418.0 114.3" data-k="v"></path> <path d="M261.3 179.6 L262.7 177.6 L264.0 175.5 L265.4 173.5 L266.7 171.3 L268.1 169.2 L269.4 167.0 L270.8 164.7 L272.1 162.4 L273.5 160.1 L274.8 157.8 L276.2 155.4 L277.5 153.0 L278.9 150.5 L280.2 148.1 L281.6 145.6 L282.9 143.1 L284.3 140.6 L285.6 138.1 L287.0 135.6 L288.3 133.1 L289.7 130.6 L291.0 128.1 L292.4 125.6 L293.7 123.1 L295.1 120.6 L296.4 118.2 L297.8 115.8 L299.1 113.4 L300.5 111.1 L301.8 108.8 L303.2 106.6 L304.5 104.4 L305.9 102.2 L307.2 100.1 L308.6 98.1 L309.9 96.1 L311.3 94.2 L312.6 92.3 L314.0 90.5 L315.3 88.7 L316.7 87.0 L318.0 85.4 L319.4 83.8 L320.7 82.3 L322.1 80.9 L323.4 79.5 L324.8 78.2 L326.1 76.9 L327.5 75.7 L328.8 74.6 L330.2 73.5 L331.5 72.5 L332.9 71.5 L334.2 70.6 L335.6 69.7 L336.9 68.8 L338.3 68.0 L339.7 67.3 L341.0 66.6 L342.4 65.9 L343.7 65.3 L345.1 64.7 L346.4 64.1 L347.8 63.6 L349.1 63.1 L350.5 62.6 L351.8 62.2 L353.2 61.8 L354.5 61.4 L355.9 61.1 L357.2 60.7 L358.6 60.4 L359.9 60.1 L361.3 59.8 L362.6 59.5 L364.0 59.3 L365.3 59.1 L366.7 58.9 L368.0 58.7 L369.4 58.5 L370.7 58.3 L372.1 58.1 L373.4 58.0 L374.8 57.8 L376.1 57.7 L377.5 57.6 L378.8 57.4 L380.2 57.3 L381.5 57.2 L382.9 57.1 L384.2 57.0 L385.6 57.0 L386.9 56.9 L388.3 56.8 L389.6 56.7 L391.0 56.7 L392.3 56.6 L393.7 56.5 L395.0 56.5 L396.4 56.4 L397.7 56.4 L399.1 56.4 L400.4 56.3 L401.8 56.3 L403.1 56.2 L404.5 56.2 L405.8 56.2 L407.2 56.2 L408.5 56.1 L409.9 56.1 L411.2 56.1 L412.6 56.1 L413.9 56.0 L415.3 56.0 L416.6 56.0 L418.0 56.0" stroke="#222222" stroke-width="2" data-k="lmh" data-fam="lmh" data-fit="1.0000473389862743 479.9553728693248"></path> <path d="M261.3 179.6 L262.7 177.6 L264.0 175.5 L265.4 173.5 L266.7 171.3 L268.1 169.2 L269.4 167.0 L270.8 164.7 L272.1 162.4 L273.5 160.1 L274.8 157.8 L276.2 155.4 L277.5 153.0 L278.9 150.5 L280.2 148.1 L281.6 145.6 L282.9 143.1 L284.3 140.6 L285.6 138.1 L287.0 135.6 L288.3 133.1 L289.7 130.6 L291.0 128.1 L292.4 125.6 L293.7 123.1 L295.1 120.6 L296.4 118.2 L297.8 115.8 L299.1 113.4 L300.5 111.1 L301.8 108.8 L303.2 106.6 L304.5 104.4 L305.9 102.2 L307.2 100.1 L308.6 98.1 L309.9 96.1 L311.3 94.2 L312.6 92.3 L314.0 90.5 L315.3 88.7 L316.7 87.0 L318.0 85.4 L319.4 83.8 L320.7 82.3 L322.1 80.9 L323.4 79.5 L324.8 78.2 L326.1 76.9 L327.5 75.7 L328.8 74.6 L330.2 73.5 L331.5 72.5 L332.9 71.5 L334.2 70.6 L335.6 69.7 L336.9 68.8 L338.3 68.0 L339.7 67.3 L341.0 66.6 L342.4 65.9 L343.7 65.3 L345.1 64.7 L346.4 64.1 L347.8 63.6 L349.1 63.1 L350.5 62.6 L351.8 62.2 L353.2 61.8 L354.5 61.4 L355.9 61.1 L357.2 60.7 L358.6 60.4 L359.9 60.1 L361.3 59.8 L362.6 59.5 L364.0 59.3 L365.3 59.1 L366.7 58.9 L368.0 58.7 L369.4 58.5 L370.7 58.3 L372.1 58.1 L373.4 58.0 L374.8 57.8 L376.1 57.7 L377.5 57.6 L378.8 57.4 L380.2 57.3 L381.5 57.2 L382.9 57.1 L384.2 57.0 L385.6 57.0 L386.9 56.9 L388.3 56.8 L389.6 56.7 L391.0 56.7 L392.3 56.6 L393.7 56.5 L395.0 56.5 L396.4 56.4 L397.7 56.4 L399.1 56.4 L400.4 56.3 L401.8 56.3 L403.1 56.2 L404.5 56.2 L405.8 56.2 L407.2 56.2 L408.5 56.1 L409.9 56.1 L411.2 56.1 L412.6 56.1 L413.9 56.0 L415.3 56.0 L416.6 56.0 L418.0 56.0" data-k="lmh"></path> Dust, 100M tokens 64 1k 16k 128k <path d="M447.3 237.6 L448.7 237.4 L450.0 237.1 L451.4 236.9 L452.7 236.6 L454.1 236.4 L455.4 236.1 L456.8 235.8 L458.1 235.5 L459.5 235.2 L460.8 234.9 L462.2 234.5 L463.5 234.2 L464.9 233.8 L466.2 233.5 L467.6 233.1 L468.9 232.7 L470.3 232.3 L471.6 231.9 L473.0 231.5 L474.3 231.0 L475.7 230.5 L477.0 230.1 L478.4 229.6 L479.7 229.1 L481.1 228.5 L482.4 228.0 L483.8 227.4 L485.1 226.8 L486.5 226.2 L487.8 225.6 L489.2 224.9 L490.5 224.3 L491.9 223.6 L493.2 222.9 L494.6 222.1 L495.9 221.4 L497.3 220.6 L498.6 219.8 L500.0 218.9 L501.3 218.0 L502.7 217.1 L504.0 216.2 L505.4 215.3 L506.7 214.3 L508.1 213.3 L509.4 212.2 L510.8 211.1 L512.1 210.0 L513.5 208.8 L514.8 207.7 L516.2 206.4 L517.5 205.2 L518.9 203.9 L520.2 202.6 L521.6 201.2 L522.9 199.8 L524.3 198.3 L525.7 196.9 L527.0 195.3 L528.4 193.8 L529.7 192.2 L531.1 190.5 L532.4 188.8 L533.8 187.1 L535.1 185.4 L536.5 183.6 L537.8 181.8 L539.2 179.9 L540.5 178.0 L541.9 176.1 L543.2 174.1 L544.6 172.1 L545.9 170.1 L547.3 168.0 L548.6 165.9 L550.0 163.8 L551.3 161.7 L552.7 159.6 L554.0 157.4 L555.4 155.3 L556.7 153.1 L558.1 150.9 L559.4 148.8 L560.8 146.6 L562.1 144.4 L563.5 142.3 L564.8 140.1 L566.2 138.0 L567.5 135.9 L568.9 133.8 L570.2 131.7 L571.6 129.7 L572.9 127.7 L574.3 125.8 L575.6 123.8 L577.0 122.0 L578.3 120.1 L579.7 118.3 L581.0 116.6 L582.4 114.9 L583.7 113.3 L585.1 111.7 L586.4 110.1 L587.8 108.7 L589.1 107.2 L590.5 105.9 L591.8 104.6 L593.2 103.3 L594.5 102.1 L595.9 100.9 L597.2 99.8 L598.6 98.8 L599.9 97.8 L601.3 96.8 L602.6 95.9 L604.0 95.0" stroke="#1b9e77" stroke-width="2" data-k="mlp" data-fam="mlp" data-fit="0.8653677019894291 38686.77651643118"></path> <path d="M447.3 237.6 L448.7 237.4 L450.0 237.1 L451.4 236.9 L452.7 236.6 L454.1 236.4 L455.4 236.1 L456.8 235.8 L458.1 235.5 L459.5 235.2 L460.8 234.9 L462.2 234.5 L463.5 234.2 L464.9 233.8 L466.2 233.5 L467.6 233.1 L468.9 232.7 L470.3 232.3 L471.6 231.9 L473.0 231.5 L474.3 231.0 L475.7 230.5 L477.0 230.1 L478.4 229.6 L479.7 229.1 L481.1 228.5 L482.4 228.0 L483.8 227.4 L485.1 226.8 L486.5 226.2 L487.8 225.6 L489.2 224.9 L490.5 224.3 L491.9 223.6 L493.2 222.9 L494.6 222.1 L495.9 221.4 L497.3 220.6 L498.6 219.8 L500.0 218.9 L501.3 218.0 L502.7 217.1 L504.0 216.2 L505.4 215.3 L506.7 214.3 L508.1 213.3 L509.4 212.2 L510.8 211.1 L512.1 210.0 L513.5 208.8 L514.8 207.7 L516.2 206.4 L517.5 205.2 L518.9 203.9 L520.2 202.6 L521.6 201.2 L522.9 199.8 L524.3 198.3 L525.7 196.9 L527.0 195.3 L528.4 193.8 L529.7 192.2 L531.1 190.5 L532.4 188.8 L533.8 187.1 L535.1 185.4 L536.5 183.6 L537.8 181.8 L539.2 179.9 L540.5 178.0 L541.9 176.1 L543.2 174.1 L544.6 172.1 L545.9 170.1 L547.3 168.0 L548.6 165.9 L550.0 163.8 L551.3 161.7 L552.7 159.6 L554.0 157.4 L555.4 155.3 L556.7 153.1 L558.1 150.9 L559.4 148.8 L560.8 146.6 L562.1 144.4 L563.5 142.3 L564.8 140.1 L566.2 138.0 L567.5 135.9 L568.9 133.8 L570.2 131.7 L571.6 129.7 L572.9 127.7 L574.3 125.8 L575.6 123.8 L577.0 122.0 L578.3 120.1 L579.7 118.3 L581.0 116.6 L582.4 114.9 L583.7 113.3 L585.1 111.7 L586.4 110.1 L587.8 108.7 L589.1 107.2 L590.5 105.9 L591.8 104.6 L593.2 103.3 L594.5 102.1 L595.9 100.9 L597.2 99.8 L598.6 98.8 L599.9 97.8 L601.3 96.8 L602.6 95.9 L604.0 95.0" data-k="mlp"></path> <path d="M447.3 239.0 L448.7 238.9 L450.0 238.7 L451.4 238.5 L452.7 238.3 L454.1 238.1 L455.4 237.8 L456.8 237.6 L458.1 237.4 L459.5 237.1 L460.8 236.9 L462.2 236.6 L463.5 236.4 L464.9 236.1 L466.2 235.8 L467.6 235.5 L468.9 235.2 L470.3 234.9 L471.6 234.5 L473.0 234.2 L474.3 233.8 L475.7 233.5 L477.0 233.1 L478.4 232.7 L479.7 232.3 L481.1 231.9 L482.4 231.5 L483.8 231.0 L485.1 230.5 L486.5 230.1 L487.8 229.6 L489.2 229.1 L490.5 228.5 L491.9 228.0 L493.2 227.4 L494.6 226.8 L495.9 226.2 L497.3 225.6 L498.6 224.9 L500.0 224.2 L501.3 223.5 L502.7 222.8 L504.0 222.1 L505.4 221.3 L506.7 220.5 L508.1 219.7 L509.4 218.8 L510.8 218.0 L512.1 217.0 L513.5 216.1 L514.8 215.1 L516.2 214.1 L517.5 213.1 L518.9 212.0 L520.2 210.9 L521.6 209.8 L522.9 208.6 L524.3 207.4 L525.7 206.1 L527.0 204.8 L528.4 203.5 L529.7 202.1 L531.1 200.7 L532.4 199.2 L533.8 197.7 L535.1 196.2 L536.5 194.6 L537.8 193.0 L539.2 191.3 L540.5 189.5 L541.9 187.7 L543.2 185.9 L544.6 184.0 L545.9 182.1 L547.3 180.1 L548.6 178.1 L550.0 176.0 L551.3 173.9 L552.7 171.8 L554.0 169.5 L555.4 167.3 L556.7 165.0 L558.1 162.6 L559.4 160.2 L560.8 157.8 L562.1 155.3 L563.5 152.8 L564.8 150.3 L566.2 147.7 L567.5 145.1 L568.9 142.5 L570.2 139.9 L571.6 137.2 L572.9 134.5 L574.3 131.8 L575.6 129.1 L577.0 126.4 L578.3 123.7 L579.7 121.0 L581.0 118.3 L582.4 115.7 L583.7 113.0 L585.1 110.4 L586.4 107.8 L587.8 105.2 L589.1 102.7 L590.5 100.2 L591.8 97.7 L593.2 95.3 L594.5 93.0 L595.9 90.7 L597.2 88.5 L598.6 86.3 L599.9 84.2 L601.3 82.1 L602.6 80.1 L604.0 78.2" stroke="#7570b3" stroke-width="2" data-k="q" data-fam="q" data-fit="1.075162426416955 97240.78657947347"></path> <path d="M447.3 239.0 L448.7 238.9 L450.0 238.7 L451.4 238.5 L452.7 238.3 L454.1 238.1 L455.4 237.8 L456.8 237.6 L458.1 237.4 L459.5 237.1 L460.8 236.9 L462.2 236.6 L463.5 236.4 L464.9 236.1 L466.2 235.8 L467.6 235.5 L468.9 235.2 L470.3 234.9 L471.6 234.5 L473.0 234.2 L474.3 233.8 L475.7 233.5 L477.0 233.1 L478.4 232.7 L479.7 232.3 L481.1 231.9 L482.4 231.5 L483.8 231.0 L485.1 230.5 L486.5 230.1 L487.8 229.6 L489.2 229.1 L490.5 228.5 L491.9 228.0 L493.2 227.4 L494.6 226.8 L495.9 226.2 L497.3 225.6 L498.6 224.9 L500.0 224.2 L501.3 223.5 L502.7 222.8 L504.0 222.1 L505.4 221.3 L506.7 220.5 L508.1 219.7 L509.4 218.8 L510.8 218.0 L512.1 217.0 L513.5 216.1 L514.8 215.1 L516.2 214.1 L517.5 213.1 L518.9 212.0 L520.2 210.9 L521.6 209.8 L522.9 208.6 L524.3 207.4 L525.7 206.1 L527.0 204.8 L528.4 203.5 L529.7 202.1 L531.1 200.7 L532.4 199.2 L533.8 197.7 L535.1 196.2 L536.5 194.6 L537.8 193.0 L539.2 191.3 L540.5 189.5 L541.9 187.7 L543.2 185.9 L544.6 184.0 L545.9 182.1 L547.3 180.1 L548.6 178.1 L550.0 176.0 L551.3 173.9 L552.7 171.8 L554.0 169.5 L555.4 167.3 L556.7 165.0 L558.1 162.6 L559.4 160.2 L560.8 157.8 L562.1 155.3 L563.5 152.8 L564.8 150.3 L566.2 147.7 L567.5 145.1 L568.9 142.5 L570.2 139.9 L571.6 137.2 L572.9 134.5 L574.3 131.8 L575.6 129.1 L577.0 126.4 L578.3 123.7 L579.7 121.0 L581.0 118.3 L582.4 115.7 L583.7 113.0 L585.1 110.4 L586.4 107.8 L587.8 105.2 L589.1 102.7 L590.5 100.2 L591.8 97.7 L593.2 95.3 L594.5 93.0 L595.9 90.7 L597.2 88.5 L598.6 86.3 L599.9 84.2 L601.3 82.1 L602.6 80.1 L604.0 78.2" data-k="q"></path> <path d="M447.3 242.4 L448.7 242.4 L450.0 242.3 L451.4 242.2 L452.7 242.2 L454.1 242.1 L455.4 242.0 L456.8 242.0 L458.1 241.9 L459.5 241.8 L460.8 241.7 L462.2 241.6 L463.5 241.5 L464.9 241.4 L466.2 241.3 L467.6 241.2 L468.9 241.1 L470.3 241.0 L471.6 240.9 L473.0 240.8 L474.3 240.7 L475.7 240.5 L477.0 240.4 L478.4 240.3 L479.7 240.1 L481.1 240.0 L482.4 239.8 L483.8 239.7 L485.1 239.5 L486.5 239.3 L487.8 239.2 L489.2 239.0 L490.5 238.8 L491.9 238.6 L493.2 238.4 L494.6 238.2 L495.9 238.0 L497.3 237.8 L498.6 237.6 L500.0 237.3 L501.3 237.1 L502.7 236.8 L504.0 236.6 L505.4 236.3 L506.7 236.0 L508.1 235.7 L509.4 235.4 L510.8 235.1 L512.1 234.8 L513.5 234.5 L514.8 234.1 L516.2 233.8 L517.5 233.4 L518.9 233.0 L520.2 232.6 L521.6 232.2 L522.9 231.8 L524.3 231.3 L525.7 230.9 L527.0 230.4 L528.4 229.9 L529.7 229.4 L531.1 228.9 L532.4 228.4 L533.8 227.8 L535.1 227.2 L536.5 226.6 L537.8 226.0 L539.2 225.4 L540.5 224.7 L541.9 224.0 L543.2 223.3 L544.6 222.6 L545.9 221.8 L547.3 221.0 L548.6 220.2 L550.0 219.3 L551.3 218.5 L552.7 217.6 L554.0 216.6 L555.4 215.6 L556.7 214.6 L558.1 213.6 L559.4 212.5 L560.8 211.4 L562.1 210.2 L563.5 209.0 L564.8 207.8 L566.2 206.5 L567.5 205.2 L568.9 203.8 L570.2 202.4 L571.6 200.9 L572.9 199.4 L574.3 197.8 L575.6 196.2 L577.0 194.5 L578.3 192.7 L579.7 190.9 L581.0 189.0 L582.4 187.1 L583.7 185.0 L585.1 183.0 L586.4 180.8 L587.8 178.6 L589.1 176.3 L590.5 173.9 L591.8 171.4 L593.2 168.8 L594.5 166.2 L595.9 163.4 L597.2 160.6 L598.6 157.6 L599.9 154.6 L601.3 151.4 L602.6 148.1 L604.0 144.8" stroke="#d95f02" stroke-width="2" data-k="k" data-fam="k" data-fit="11.852985720146853 100000000.0"></path> <path d="M447.3 242.4 L448.7 242.4 L450.0 242.3 L451.4 242.2 L452.7 242.2 L454.1 242.1 L455.4 242.0 L456.8 242.0 L458.1 241.9 L459.5 241.8 L460.8 241.7 L462.2 241.6 L463.5 241.5 L464.9 241.4 L466.2 241.3 L467.6 241.2 L468.9 241.1 L470.3 241.0 L471.6 240.9 L473.0 240.8 L474.3 240.7 L475.7 240.5 L477.0 240.4 L478.4 240.3 L479.7 240.1 L481.1 240.0 L482.4 239.8 L483.8 239.7 L485.1 239.5 L486.5 239.3 L487.8 239.2 L489.2 239.0 L490.5 238.8 L491.9 238.6 L493.2 238.4 L494.6 238.2 L495.9 238.0 L497.3 237.8 L498.6 237.6 L500.0 237.3 L501.3 237.1 L502.7 236.8 L504.0 236.6 L505.4 236.3 L506.7 236.0 L508.1 235.7 L509.4 235.4 L510.8 235.1 L512.1 234.8 L513.5 234.5 L514.8 234.1 L516.2 233.8 L517.5 233.4 L518.9 233.0 L520.2 232.6 L521.6 232.2 L522.9 231.8 L524.3 231.3 L525.7 230.9 L527.0 230.4 L528.4 229.9 L529.7 229.4 L531.1 228.9 L532.4 228.4 L533.8 227.8 L535.1 227.2 L536.5 226.6 L537.8 226.0 L539.2 225.4 L540.5 224.7 L541.9 224.0 L543.2 223.3 L544.6 222.6 L545.9 221.8 L547.3 221.0 L548.6 220.2 L550.0 219.3 L551.3 218.5 L552.7 217.6 L554.0 216.6 L555.4 215.6 L556.7 214.6 L558.1 213.6 L559.4 212.5 L560.8 211.4 L562.1 210.2 L563.5 209.0 L564.8 207.8 L566.2 206.5 L567.5 205.2 L568.9 203.8 L570.2 202.4 L571.6 200.9 L572.9 199.4 L574.3 197.8 L575.6 196.2 L577.0 194.5 L578.3 192.7 L579.7 190.9 L581.0 189.0 L582.4 187.1 L583.7 185.0 L585.1 183.0 L586.4 180.8 L587.8 178.6 L589.1 176.3 L590.5 173.9 L591.8 171.4 L593.2 168.8 L594.5 166.2 L595.9 163.4 L597.2 160.6 L598.6 157.6 L599.9 154.6 L601.3 151.4 L602.6 148.1 L604.0 144.8" data-k="k"></path> <path d="M447.3 241.1 L448.7 240.9 L450.0 240.8 L451.4 240.7 L452.7 240.6 L454.1 240.5 L455.4 240.3 L456.8 240.2 L458.1 240.0 L459.5 239.9 L460.8 239.7 L462.2 239.6 L463.5 239.4 L464.9 239.2 L466.2 239.1 L467.6 238.9 L468.9 238.7 L470.3 238.5 L471.6 238.3 L473.0 238.1 L474.3 237.9 L475.7 237.7 L477.0 237.4 L478.4 237.2 L479.7 236.9 L481.1 236.7 L482.4 236.4 L483.8 236.1 L485.1 235.9 L486.5 235.6 L487.8 235.3 L489.2 234.9 L490.5 234.6 L491.9 234.3 L493.2 233.9 L494.6 233.6 L495.9 233.2 L497.3 232.8 L498.6 232.4 L500.0 232.0 L501.3 231.6 L502.7 231.1 L504.0 230.7 L505.4 230.2 L506.7 229.7 L508.1 229.2 L509.4 228.7 L510.8 228.1 L512.1 227.6 L513.5 227.0 L514.8 226.4 L516.2 225.7 L517.5 225.1 L518.9 224.4 L520.2 223.7 L521.6 223.0 L522.9 222.3 L524.3 221.5 L525.7 220.8 L527.0 220.0 L528.4 219.1 L529.7 218.3 L531.1 217.4 L532.4 216.4 L533.8 215.5 L535.1 214.5 L536.5 213.5 L537.8 212.4 L539.2 211.4 L540.5 210.3 L541.9 209.1 L543.2 207.9 L544.6 206.7 L545.9 205.5 L547.3 204.2 L548.6 202.9 L550.0 201.5 L551.3 200.1 L552.7 198.7 L554.0 197.2 L555.4 195.7 L556.7 194.1 L558.1 192.5 L559.4 190.9 L560.8 189.2 L562.1 187.5 L563.5 185.7 L564.8 183.9 L566.2 182.1 L567.5 180.2 L568.9 178.3 L570.2 176.4 L571.6 174.4 L572.9 172.4 L574.3 170.4 L575.6 168.3 L577.0 166.2 L578.3 164.1 L579.7 162.0 L581.0 159.8 L582.4 157.7 L583.7 155.5 L585.1 153.3 L586.4 151.1 L587.8 148.9 L589.1 146.7 L590.5 144.5 L591.8 142.3 L593.2 140.1 L594.5 138.0 L595.9 135.8 L597.2 133.7 L598.6 131.6 L599.9 129.5 L601.3 127.5 L602.6 125.5 L604.0 123.5" stroke="#e7298a" stroke-width="2" data-k="v" data-fam="v" data-fit="0.8762639530164874 172992.45512158342"></path> <path d="M447.3 241.1 L448.7 240.9 L450.0 240.8 L451.4 240.7 L452.7 240.6 L454.1 240.5 L455.4 240.3 L456.8 240.2 L458.1 240.0 L459.5 239.9 L460.8 239.7 L462.2 239.6 L463.5 239.4 L464.9 239.2 L466.2 239.1 L467.6 238.9 L468.9 238.7 L470.3 238.5 L471.6 238.3 L473.0 238.1 L474.3 237.9 L475.7 237.7 L477.0 237.4 L478.4 237.2 L479.7 236.9 L481.1 236.7 L482.4 236.4 L483.8 236.1 L485.1 235.9 L486.5 235.6 L487.8 235.3 L489.2 234.9 L490.5 234.6 L491.9 234.3 L493.2 233.9 L494.6 233.6 L495.9 233.2 L497.3 232.8 L498.6 232.4 L500.0 232.0 L501.3 231.6 L502.7 231.1 L504.0 230.7 L505.4 230.2 L506.7 229.7 L508.1 229.2 L509.4 228.7 L510.8 228.1 L512.1 227.6 L513.5 227.0 L514.8 226.4 L516.2 225.7 L517.5 225.1 L518.9 224.4 L520.2 223.7 L521.6 223.0 L522.9 222.3 L524.3 221.5 L525.7 220.8 L527.0 220.0 L528.4 219.1 L529.7 218.3 L531.1 217.4 L532.4 216.4 L533.8 215.5 L535.1 214.5 L536.5 213.5 L537.8 212.4 L539.2 211.4 L540.5 210.3 L541.9 209.1 L543.2 207.9 L544.6 206.7 L545.9 205.5 L547.3 204.2 L548.6 202.9 L550.0 201.5 L551.3 200.1 L552.7 198.7 L554.0 197.2 L555.4 195.7 L556.7 194.1 L558.1 192.5 L559.4 190.9 L560.8 189.2 L562.1 187.5 L563.5 185.7 L564.8 183.9 L566.2 182.1 L567.5 180.2 L568.9 178.3 L570.2 176.4 L571.6 174.4 L572.9 172.4 L574.3 170.4 L575.6 168.3 L577.0 166.2 L578.3 164.1 L579.7 162.0 L581.0 159.8 L582.4 157.7 L583.7 155.5 L585.1 153.3 L586.4 151.1 L587.8 148.9 L589.1 146.7 L590.5 144.5 L591.8 142.3 L593.2 140.1 L594.5 138.0 L595.9 135.8 L597.2 133.7 L598.6 131.6 L599.9 129.5 L601.3 127.5 L602.6 125.5 L604.0 123.5" data-k="v"></path> <path d="M447.3 191.7 L448.7 190.0 L450.0 188.3 L451.4 186.5 L452.7 184.6 L454.1 182.8 L455.4 180.8 L456.8 178.9 L458.1 176.8 L459.5 174.8 L460.8 172.7 L462.2 170.5 L463.5 168.4 L464.9 166.1 L466.2 163.9 L467.6 161.6 L468.9 159.2 L470.3 156.9 L471.6 154.5 L473.0 152.1 L474.3 149.6 L475.7 147.2 L477.0 144.7 L478.4 142.2 L479.7 139.7 L481.1 137.2 L482.4 134.7 L483.8 132.2 L485.1 129.6 L486.5 127.1 L487.8 124.7 L489.2 122.2 L490.5 119.7 L491.9 117.3 L493.2 114.9 L494.6 112.6 L495.9 110.3 L497.3 108.0 L498.6 105.8 L500.0 103.6 L501.3 101.4 L502.7 99.3 L504.0 97.3 L505.4 95.3 L506.7 93.4 L508.1 91.6 L509.4 89.8 L510.8 88.1 L512.1 86.4 L513.5 84.8 L514.8 83.2 L516.2 81.8 L517.5 80.3 L518.9 79.0 L520.2 77.7 L521.6 76.5 L522.9 75.3 L524.3 74.1 L525.7 73.1 L527.0 72.1 L528.4 71.1 L529.7 70.2 L531.1 69.3 L532.4 68.5 L533.8 67.7 L535.1 67.0 L536.5 66.3 L537.8 65.6 L539.2 65.0 L540.5 64.4 L541.9 63.9 L543.2 63.4 L544.6 62.9 L545.9 62.4 L547.3 62.0 L548.6 61.6 L550.0 61.2 L551.3 60.9 L552.7 60.5 L554.0 60.2 L555.4 59.9 L556.7 59.7 L558.1 59.4 L559.4 59.2 L560.8 58.9 L562.1 58.7 L563.5 58.5 L564.8 58.3 L566.2 58.2 L567.5 58.0 L568.9 57.8 L570.2 57.7 L571.6 57.6 L572.9 57.4 L574.3 57.3 L575.6 57.2 L577.0 57.1 L578.3 57.0 L579.7 56.9 L581.0 56.9 L582.4 56.8 L583.7 56.7 L585.1 56.6 L586.4 56.6 L587.8 56.5 L589.1 56.5 L590.5 56.4 L591.8 56.4 L593.2 56.3 L594.5 56.3 L595.9 56.2 L597.2 56.2 L598.6 56.2 L599.9 56.1 L601.3 56.1 L602.6 56.1 L604.0 56.1" stroke="#222222" stroke-width="2" data-k="lmh" data-fam="lmh" data-fit="1.000396895885322 760.9284411932259"></path> <path d="M447.3 191.7 L448.7 190.0 L450.0 188.3 L451.4 186.5 L452.7 184.6 L454.1 182.8 L455.4 180.8 L456.8 178.9 L458.1 176.8 L459.5 174.8 L460.8 172.7 L462.2 170.5 L463.5 168.4 L464.9 166.1 L466.2 163.9 L467.6 161.6 L468.9 159.2 L470.3 156.9 L471.6 154.5 L473.0 152.1 L474.3 149.6 L475.7 147.2 L477.0 144.7 L478.4 142.2 L479.7 139.7 L481.1 137.2 L482.4 134.7 L483.8 132.2 L485.1 129.6 L486.5 127.1 L487.8 124.7 L489.2 122.2 L490.5 119.7 L491.9 117.3 L493.2 114.9 L494.6 112.6 L495.9 110.3 L497.3 108.0 L498.6 105.8 L500.0 103.6 L501.3 101.4 L502.7 99.3 L504.0 97.3 L505.4 95.3 L506.7 93.4 L508.1 91.6 L509.4 89.8 L510.8 88.1 L512.1 86.4 L513.5 84.8 L514.8 83.2 L516.2 81.8 L517.5 80.3 L518.9 79.0 L520.2 77.7 L521.6 76.5 L522.9 75.3 L524.3 74.1 L525.7 73.1 L527.0 72.1 L528.4 71.1 L529.7 70.2 L531.1 69.3 L532.4 68.5 L533.8 67.7 L535.1 67.0 L536.5 66.3 L537.8 65.6 L539.2 65.0 L540.5 64.4 L541.9 63.9 L543.2 63.4 L544.6 62.9 L545.9 62.4 L547.3 62.0 L548.6 61.6 L550.0 61.2 L551.3 60.9 L552.7 60.5 L554.0 60.2 L555.4 59.9 L556.7 59.7 L558.1 59.4 L559.4 59.2 L560.8 58.9 L562.1 58.7 L563.5 58.5 L564.8 58.3 L566.2 58.2 L567.5 58.0 L568.9 57.8 L570.2 57.7 L571.6 57.6 L572.9 57.4 L574.3 57.3 L575.6 57.2 L577.0 57.1 L578.3 57.0 L579.7 56.9 L581.0 56.9 L582.4 56.8 L583.7 56.7 L585.1 56.6 L586.4 56.6 L587.8 56.5 L589.1 56.5 L590.5 56.4 L591.8 56.4 L593.2 56.3 L594.5 56.3 L595.9 56.2 L597.2 56.2 L598.6 56.2 L599.9 56.1 L601.3 56.1 L602.6 56.1 L604.0 56.1" data-k="lmh"></path> Dust, 1B tokens 64 1k 16k 128k <path d="M633.3 238.7 L634.7 238.5 L636.0 238.3 L637.4 238.1 L638.7 237.9 L640.1 237.7 L641.4 237.5 L642.8 237.2 L644.1 237.0 L645.5 236.7 L646.8 236.5 L648.2 236.2 L649.5 235.9 L650.9 235.6 L652.2 235.3 L653.6 235.0 L654.9 234.7 L656.3 234.3 L657.6 234.0 L659.0 233.6 L660.3 233.3 L661.7 232.9 L663.0 232.5 L664.4 232.1 L665.7 231.7 L667.1 231.2 L668.4 230.8 L669.8 230.3 L671.1 229.8 L672.5 229.3 L673.8 228.8 L675.2 228.2 L676.5 227.7 L677.9 227.1 L679.2 226.5 L680.6 225.9 L681.9 225.2 L683.3 224.6 L684.6 223.9 L686.0 223.2 L687.3 222.5 L688.7 221.7 L690.0 220.9 L691.4 220.1 L692.7 219.3 L694.1 218.4 L695.4 217.5 L696.8 216.6 L698.1 215.7 L699.5 214.7 L700.8 213.7 L702.2 212.7 L703.5 211.6 L704.9 210.5 L706.2 209.4 L707.6 208.2 L708.9 207.0 L710.3 205.7 L711.7 204.5 L713.0 203.2 L714.4 201.8 L715.7 200.4 L717.1 199.0 L718.4 197.5 L719.8 196.0 L721.1 194.5 L722.5 192.9 L723.8 191.3 L725.2 189.6 L726.5 187.9 L727.9 186.2 L729.2 184.4 L730.6 182.6 L731.9 180.7 L733.3 178.8 L734.6 176.9 L736.0 175.0 L737.3 173.0 L738.7 171.0 L740.0 168.9 L741.4 166.8 L742.7 164.8 L744.1 162.6 L745.4 160.5 L746.8 158.4 L748.1 156.2 L749.5 154.0 L750.8 151.9 L752.2 149.7 L753.5 147.5 L754.9 145.3 L756.2 143.2 L757.6 141.0 L758.9 138.9 L760.3 136.8 L761.6 134.7 L763.0 132.6 L764.3 130.5 L765.7 128.5 L767.0 126.5 L768.4 124.6 L769.7 122.7 L771.1 120.8 L772.4 119.0 L773.8 117.3 L775.1 115.6 L776.5 113.9 L777.8 112.3 L779.2 110.7 L780.5 109.2 L781.9 107.8 L783.2 106.4 L784.6 105.0 L785.9 103.7 L787.3 102.5 L788.6 101.3 L790.0 100.2" stroke="#1b9e77" stroke-width="2" data-k="mlp" data-fam="mlp" data-fit="0.866493219477256 56582.285545090584"></path> <path d="M633.3 238.7 L634.7 238.5 L636.0 238.3 L637.4 238.1 L638.7 237.9 L640.1 237.7 L641.4 237.5 L642.8 237.2 L644.1 237.0 L645.5 236.7 L646.8 236.5 L648.2 236.2 L649.5 235.9 L650.9 235.6 L652.2 235.3 L653.6 235.0 L654.9 234.7 L656.3 234.3 L657.6 234.0 L659.0 233.6 L660.3 233.3 L661.7 232.9 L663.0 232.5 L664.4 232.1 L665.7 231.7 L667.1 231.2 L668.4 230.8 L669.8 230.3 L671.1 229.8 L672.5 229.3 L673.8 228.8 L675.2 228.2 L676.5 227.7 L677.9 227.1 L679.2 226.5 L680.6 225.9 L681.9 225.2 L683.3 224.6 L684.6 223.9 L686.0 223.2 L687.3 222.5 L688.7 221.7 L690.0 220.9 L691.4 220.1 L692.7 219.3 L694.1 218.4 L695.4 217.5 L696.8 216.6 L698.1 215.7 L699.5 214.7 L700.8 213.7 L702.2 212.7 L703.5 211.6 L704.9 210.5 L706.2 209.4 L707.6 208.2 L708.9 207.0 L710.3 205.7 L711.7 204.5 L713.0 203.2 L714.4 201.8 L715.7 200.4 L717.1 199.0 L718.4 197.5 L719.8 196.0 L721.1 194.5 L722.5 192.9 L723.8 191.3 L725.2 189.6 L726.5 187.9 L727.9 186.2 L729.2 184.4 L730.6 182.6 L731.9 180.7 L733.3 178.8 L734.6 176.9 L736.0 175.0 L737.3 173.0 L738.7 171.0 L740.0 168.9 L741.4 166.8 L742.7 164.8 L744.1 162.6 L745.4 160.5 L746.8 158.4 L748.1 156.2 L749.5 154.0 L750.8 151.9 L752.2 149.7 L753.5 147.5 L754.9 145.3 L756.2 143.2 L757.6 141.0 L758.9 138.9 L760.3 136.8 L761.6 134.7 L763.0 132.6 L764.3 130.5 L765.7 128.5 L767.0 126.5 L768.4 124.6 L769.7 122.7 L771.1 120.8 L772.4 119.0 L773.8 117.3 L775.1 115.6 L776.5 113.9 L777.8 112.3 L779.2 110.7 L780.5 109.2 L781.9 107.8 L783.2 106.4 L784.6 105.0 L785.9 103.7 L787.3 102.5 L788.6 101.3 L790.0 100.2" data-k="mlp"></path> <path d="M633.3 239.0 L634.7 238.8 L636.0 238.6 L637.4 238.4 L638.7 238.2 L640.1 238.0 L641.4 237.8 L642.8 237.5 L644.1 237.3 L645.5 237.1 L646.8 236.8 L648.2 236.6 L649.5 236.3 L650.9 236.0 L652.2 235.7 L653.6 235.4 L654.9 235.1 L656.3 234.8 L657.6 234.5 L659.0 234.1 L660.3 233.8 L661.7 233.4 L663.0 233.0 L664.4 232.6 L665.7 232.2 L667.1 231.8 L668.4 231.3 L669.8 230.9 L671.1 230.4 L672.5 229.9 L673.8 229.4 L675.2 228.9 L676.5 228.4 L677.9 227.8 L679.2 227.2 L680.6 226.6 L681.9 226.0 L683.3 225.4 L684.6 224.7 L686.0 224.1 L687.3 223.4 L688.7 222.6 L690.0 221.9 L691.4 221.1 L692.7 220.3 L694.1 219.5 L695.4 218.6 L696.8 217.7 L698.1 216.8 L699.5 215.8 L700.8 214.9 L702.2 213.9 L703.5 212.8 L704.9 211.7 L706.2 210.6 L707.6 209.5 L708.9 208.3 L710.3 207.1 L711.7 205.8 L713.0 204.5 L714.4 203.1 L715.7 201.8 L717.1 200.3 L718.4 198.9 L719.8 197.4 L721.1 195.8 L722.5 194.2 L723.8 192.5 L725.2 190.9 L726.5 189.1 L727.9 187.3 L729.2 185.5 L730.6 183.6 L731.9 181.7 L733.3 179.7 L734.6 177.7 L736.0 175.6 L737.3 173.5 L738.7 171.3 L740.0 169.1 L741.4 166.8 L742.7 164.5 L744.1 162.2 L745.4 159.8 L746.8 157.4 L748.1 154.9 L749.5 152.4 L750.8 149.9 L752.2 147.3 L753.5 144.8 L754.9 142.1 L756.2 139.5 L757.6 136.9 L758.9 134.2 L760.3 131.6 L761.6 128.9 L763.0 126.2 L764.3 123.6 L765.7 120.9 L767.0 118.3 L768.4 115.7 L769.7 113.1 L771.1 110.5 L772.4 107.9 L773.8 105.4 L775.1 103.0 L776.5 100.5 L777.8 98.2 L779.2 95.8 L780.5 93.5 L781.9 91.3 L783.2 89.1 L784.6 87.0 L785.9 85.0 L787.3 83.0 L788.6 81.1 L790.0 79.2" stroke="#7570b3" stroke-width="2" data-k="q" data-fam="q" data-fit="1.0605931883152597 92861.17342637962"></path> <path d="M633.3 239.0 L634.7 238.8 L636.0 238.6 L637.4 238.4 L638.7 238.2 L640.1 238.0 L641.4 237.8 L642.8 237.5 L644.1 237.3 L645.5 237.1 L646.8 236.8 L648.2 236.6 L649.5 236.3 L650.9 236.0 L652.2 235.7 L653.6 235.4 L654.9 235.1 L656.3 234.8 L657.6 234.5 L659.0 234.1 L660.3 233.8 L661.7 233.4 L663.0 233.0 L664.4 232.6 L665.7 232.2 L667.1 231.8 L668.4 231.3 L669.8 230.9 L671.1 230.4 L672.5 229.9 L673.8 229.4 L675.2 228.9 L676.5 228.4 L677.9 227.8 L679.2 227.2 L680.6 226.6 L681.9 226.0 L683.3 225.4 L684.6 224.7 L686.0 224.1 L687.3 223.4 L688.7 222.6 L690.0 221.9 L691.4 221.1 L692.7 220.3 L694.1 219.5 L695.4 218.6 L696.8 217.7 L698.1 216.8 L699.5 215.8 L700.8 214.9 L702.2 213.9 L703.5 212.8 L704.9 211.7 L706.2 210.6 L707.6 209.5 L708.9 208.3 L710.3 207.1 L711.7 205.8 L713.0 204.5 L714.4 203.1 L715.7 201.8 L717.1 200.3 L718.4 198.9 L719.8 197.4 L721.1 195.8 L722.5 194.2 L723.8 192.5 L725.2 190.9 L726.5 189.1 L727.9 187.3 L729.2 185.5 L730.6 183.6 L731.9 181.7 L733.3 179.7 L734.6 177.7 L736.0 175.6 L737.3 173.5 L738.7 171.3 L740.0 169.1 L741.4 166.8 L742.7 164.5 L744.1 162.2 L745.4 159.8 L746.8 157.4 L748.1 154.9 L749.5 152.4 L750.8 149.9 L752.2 147.3 L753.5 144.8 L754.9 142.1 L756.2 139.5 L757.6 136.9 L758.9 134.2 L760.3 131.6 L761.6 128.9 L763.0 126.2 L764.3 123.6 L765.7 120.9 L767.0 118.3 L768.4 115.7 L769.7 113.1 L771.1 110.5 L772.4 107.9 L773.8 105.4 L775.1 103.0 L776.5 100.5 L777.8 98.2 L779.2 95.8 L780.5 93.5 L781.9 91.3 L783.2 89.1 L784.6 87.0 L785.9 85.0 L787.3 83.0 L788.6 81.1 L790.0 79.2" data-k="q"></path> <path d="M633.3 242.0 L634.7 241.9 L636.0 241.8 L637.4 241.7 L638.7 241.6 L640.1 241.5 L641.4 241.4 L642.8 241.3 L644.1 241.2 L645.5 241.1 L646.8 241.0 L648.2 240.9 L649.5 240.8 L650.9 240.7 L652.2 240.5 L653.6 240.4 L654.9 240.3 L656.3 240.1 L657.6 240.0 L659.0 239.8 L660.3 239.7 L661.7 239.5 L663.0 239.4 L664.4 239.2 L665.7 239.0 L667.1 238.8 L668.4 238.6 L669.8 238.4 L671.1 238.2 L672.5 238.0 L673.8 237.8 L675.2 237.6 L676.5 237.3 L677.9 237.1 L679.2 236.8 L680.6 236.6 L681.9 236.3 L683.3 236.0 L684.6 235.8 L686.0 235.5 L687.3 235.1 L688.7 234.8 L690.0 234.5 L691.4 234.1 L692.7 233.8 L694.1 233.4 L695.4 233.0 L696.8 232.6 L698.1 232.2 L699.5 231.8 L700.8 231.4 L702.2 230.9 L703.5 230.5 L704.9 230.0 L706.2 229.5 L707.6 228.9 L708.9 228.4 L710.3 227.8 L711.7 227.3 L713.0 226.7 L714.4 226.1 L715.7 225.4 L717.1 224.7 L718.4 224.1 L719.8 223.4 L721.1 222.6 L722.5 221.9 L723.8 221.1 L725.2 220.2 L726.5 219.4 L727.9 218.5 L729.2 217.6 L730.6 216.7 L731.9 215.7 L733.3 214.7 L734.6 213.7 L736.0 212.6 L737.3 211.5 L738.7 210.3 L740.0 209.1 L741.4 207.9 L742.7 206.6 L744.1 205.3 L745.4 203.9 L746.8 202.5 L748.1 201.0 L749.5 199.5 L750.8 197.9 L752.2 196.3 L753.5 194.6 L754.9 192.8 L756.2 191.0 L757.6 189.1 L758.9 187.2 L760.3 185.2 L761.6 183.1 L763.0 180.9 L764.3 178.7 L765.7 176.4 L767.0 174.0 L768.4 171.5 L769.7 169.0 L771.1 166.3 L772.4 163.6 L773.8 160.7 L775.1 157.8 L776.5 154.8 L777.8 151.6 L779.2 148.3 L780.5 145.0 L781.9 141.5 L783.2 137.9 L784.6 134.1 L785.9 130.2 L787.3 126.2 L788.6 122.1 L790.0 117.8" stroke="#d95f02" stroke-width="2" data-k="k" data-fam="k" data-fit="15.070836347328564 100000000.0"></path> <path d="M633.3 242.0 L634.7 241.9 L636.0 241.8 L637.4 241.7 L638.7 241.6 L640.1 241.5 L641.4 241.4 L642.8 241.3 L644.1 241.2 L645.5 241.1 L646.8 241.0 L648.2 240.9 L649.5 240.8 L650.9 240.7 L652.2 240.5 L653.6 240.4 L654.9 240.3 L656.3 240.1 L657.6 240.0 L659.0 239.8 L660.3 239.7 L661.7 239.5 L663.0 239.4 L664.4 239.2 L665.7 239.0 L667.1 238.8 L668.4 238.6 L669.8 238.4 L671.1 238.2 L672.5 238.0 L673.8 237.8 L675.2 237.6 L676.5 237.3 L677.9 237.1 L679.2 236.8 L680.6 236.6 L681.9 236.3 L683.3 236.0 L684.6 235.8 L686.0 235.5 L687.3 235.1 L688.7 234.8 L690.0 234.5 L691.4 234.1 L692.7 233.8 L694.1 233.4 L695.4 233.0 L696.8 232.6 L698.1 232.2 L699.5 231.8 L700.8 231.4 L702.2 230.9 L703.5 230.5 L704.9 230.0 L706.2 229.5 L707.6 228.9 L708.9 228.4 L710.3 227.8 L711.7 227.3 L713.0 226.7 L714.4 226.1 L715.7 225.4 L717.1 224.7 L718.4 224.1 L719.8 223.4 L721.1 222.6 L722.5 221.9 L723.8 221.1 L725.2 220.2 L726.5 219.4 L727.9 218.5 L729.2 217.6 L730.6 216.7 L731.9 215.7 L733.3 214.7 L734.6 213.7 L736.0 212.6 L737.3 211.5 L738.7 210.3 L740.0 209.1 L741.4 207.9 L742.7 206.6 L744.1 205.3 L745.4 203.9 L746.8 202.5 L748.1 201.0 L749.5 199.5 L750.8 197.9 L752.2 196.3 L753.5 194.6 L754.9 192.8 L756.2 191.0 L757.6 189.1 L758.9 187.2 L760.3 185.2 L761.6 183.1 L763.0 180.9 L764.3 178.7 L765.7 176.4 L767.0 174.0 L768.4 171.5 L769.7 169.0 L771.1 166.3 L772.4 163.6 L773.8 160.7 L775.1 157.8 L776.5 154.8 L777.8 151.6 L779.2 148.3 L780.5 145.0 L781.9 141.5 L783.2 137.9 L784.6 134.1 L785.9 130.2 L787.3 126.2 L788.6 122.1 L790.0 117.8" data-k="k"></path> <path d="M633.3 240.6 L634.7 240.5 L636.0 240.3 L637.4 240.2 L638.7 240.0 L640.1 239.9 L641.4 239.7 L642.8 239.6 L644.1 239.4 L645.5 239.3 L646.8 239.1 L648.2 238.9 L649.5 238.7 L650.9 238.5 L652.2 238.3 L653.6 238.1 L654.9 237.9 L656.3 237.7 L657.6 237.4 L659.0 237.2 L660.3 237.0 L661.7 236.7 L663.0 236.4 L664.4 236.2 L665.7 235.9 L667.1 235.6 L668.4 235.3 L669.8 235.0 L671.1 234.6 L672.5 234.3 L673.8 233.9 L675.2 233.6 L676.5 233.2 L677.9 232.8 L679.2 232.4 L680.6 232.0 L681.9 231.6 L683.3 231.1 L684.6 230.7 L686.0 230.2 L687.3 229.7 L688.7 229.2 L690.0 228.7 L691.4 228.1 L692.7 227.6 L694.1 227.0 L695.4 226.4 L696.8 225.7 L698.1 225.1 L699.5 224.4 L700.8 223.7 L702.2 223.0 L703.5 222.3 L704.9 221.5 L706.2 220.7 L707.6 219.9 L708.9 219.1 L710.3 218.2 L711.7 217.3 L713.0 216.4 L714.4 215.4 L715.7 214.4 L717.1 213.4 L718.4 212.3 L719.8 211.2 L721.1 210.1 L722.5 208.9 L723.8 207.7 L725.2 206.5 L726.5 205.2 L727.9 203.9 L729.2 202.5 L730.6 201.1 L731.9 199.7 L733.3 198.2 L734.6 196.6 L736.0 195.1 L737.3 193.4 L738.7 191.8 L740.0 190.1 L741.4 188.3 L742.7 186.5 L744.1 184.6 L745.4 182.7 L746.8 180.8 L748.1 178.8 L749.5 176.7 L750.8 174.6 L752.2 172.5 L753.5 170.3 L754.9 168.0 L756.2 165.7 L757.6 163.4 L758.9 161.1 L760.3 158.6 L761.6 156.2 L763.0 153.7 L764.3 151.2 L765.7 148.7 L767.0 146.1 L768.4 143.5 L769.7 140.9 L771.1 138.2 L772.4 135.6 L773.8 132.9 L775.1 130.2 L776.5 127.6 L777.8 124.9 L779.2 122.2 L780.5 119.6 L781.9 116.9 L783.2 114.3 L784.6 111.7 L785.9 109.1 L787.3 106.6 L788.6 104.1 L790.0 101.6" stroke="#e7298a" stroke-width="2" data-k="v" data-fam="v" data-fit="1.0639653102263862 194116.70107680405"></path> <path d="M633.3 240.6 L634.7 240.5 L636.0 240.3 L637.4 240.2 L638.7 240.0 L640.1 239.9 L641.4 239.7 L642.8 239.6 L644.1 239.4 L645.5 239.3 L646.8 239.1 L648.2 238.9 L649.5 238.7 L650.9 238.5 L652.2 238.3 L653.6 238.1 L654.9 237.9 L656.3 237.7 L657.6 237.4 L659.0 237.2 L660.3 237.0 L661.7 236.7 L663.0 236.4 L664.4 236.2 L665.7 235.9 L667.1 235.6 L668.4 235.3 L669.8 235.0 L671.1 234.6 L672.5 234.3 L673.8 233.9 L675.2 233.6 L676.5 233.2 L677.9 232.8 L679.2 232.4 L680.6 232.0 L681.9 231.6 L683.3 231.1 L684.6 230.7 L686.0 230.2 L687.3 229.7 L688.7 229.2 L690.0 228.7 L691.4 228.1 L692.7 227.6 L694.1 227.0 L695.4 226.4 L696.8 225.7 L698.1 225.1 L699.5 224.4 L700.8 223.7 L702.2 223.0 L703.5 222.3 L704.9 221.5 L706.2 220.7 L707.6 219.9 L708.9 219.1 L710.3 218.2 L711.7 217.3 L713.0 216.4 L714.4 215.4 L715.7 214.4 L717.1 213.4 L718.4 212.3 L719.8 211.2 L721.1 210.1 L722.5 208.9 L723.8 207.7 L725.2 206.5 L726.5 205.2 L727.9 203.9 L729.2 202.5 L730.6 201.1 L731.9 199.7 L733.3 198.2 L734.6 196.6 L736.0 195.1 L737.3 193.4 L738.7 191.8 L740.0 190.1 L741.4 188.3 L742.7 186.5 L744.1 184.6 L745.4 182.7 L746.8 180.8 L748.1 178.8 L749.5 176.7 L750.8 174.6 L752.2 172.5 L753.5 170.3 L754.9 168.0 L756.2 165.7 L757.6 163.4 L758.9 161.1 L760.3 158.6 L761.6 156.2 L763.0 153.7 L764.3 151.2 L765.7 148.7 L767.0 146.1 L768.4 143.5 L769.7 140.9 L771.1 138.2 L772.4 135.6 L773.8 132.9 L775.1 130.2 L776.5 127.6 L777.8 124.9 L779.2 122.2 L780.5 119.6 L781.9 116.9 L783.2 114.3 L784.6 111.7 L785.9 109.1 L787.3 106.6 L788.6 104.1 L790.0 101.6" data-k="v"></path> <path d="M633.3 197.8 L634.7 196.2 L636.0 194.7 L637.4 193.1 L638.7 191.4 L640.1 189.7 L641.4 187.9 L642.8 186.1 L644.1 184.3 L645.5 182.4 L646.8 180.4 L648.2 178.5 L649.5 176.4 L650.9 174.4 L652.2 172.3 L653.6 170.1 L654.9 167.9 L656.3 165.7 L657.6 163.4 L659.0 161.1 L660.3 158.8 L661.7 156.4 L663.0 154.0 L664.4 151.6 L665.7 149.1 L667.1 146.7 L668.4 144.2 L669.8 141.7 L671.1 139.2 L672.5 136.7 L673.8 134.2 L675.2 131.6 L676.5 129.1 L677.9 126.6 L679.2 124.1 L680.6 121.7 L681.9 119.2 L683.3 116.8 L684.6 114.4 L686.0 112.1 L687.3 109.8 L688.7 107.5 L690.0 105.3 L691.4 103.1 L692.7 101.0 L694.1 98.9 L695.4 96.9 L696.8 94.9 L698.1 93.0 L699.5 91.2 L700.8 89.4 L702.2 87.7 L703.5 86.0 L704.9 84.4 L706.2 82.9 L707.6 81.4 L708.9 80.0 L710.3 78.7 L711.7 77.4 L713.0 76.1 L714.4 75.0 L715.7 73.8 L717.1 72.8 L718.4 71.8 L719.8 70.8 L721.1 69.9 L722.5 69.1 L723.8 68.2 L725.2 67.5 L726.5 66.7 L727.9 66.1 L729.2 65.4 L730.6 64.8 L731.9 64.2 L733.3 63.7 L734.6 63.2 L736.0 62.7 L737.3 62.2 L738.7 61.8 L740.0 61.4 L741.4 61.0 L742.7 60.7 L744.1 60.4 L745.4 60.1 L746.8 59.8 L748.1 59.5 L749.5 59.2 L750.8 59.0 L752.2 58.8 L753.5 58.6 L754.9 58.4 L756.2 58.2 L757.6 58.0 L758.9 57.9 L760.3 57.7 L761.6 57.6 L763.0 57.4 L764.3 57.3 L765.7 57.2 L767.0 57.1 L768.4 57.0 L769.7 56.9 L771.1 56.8 L772.4 56.7 L773.8 56.6 L775.1 56.6 L776.5 56.5 L777.8 56.4 L779.2 56.4 L780.5 56.3 L781.9 56.3 L783.2 56.2 L784.6 56.2 L785.9 56.2 L787.3 56.1 L788.6 56.1 L790.0 56.0" stroke="#222222" stroke-width="2" data-k="lmh" data-fam="lmh" data-fit="1.0010183975854385 991.8043724567411"></path> <path d="M633.3 197.8 L634.7 196.2 L636.0 194.7 L637.4 193.1 L638.7 191.4 L640.1 189.7 L641.4 187.9 L642.8 186.1 L644.1 184.3 L645.5 182.4 L646.8 180.4 L648.2 178.5 L649.5 176.4 L650.9 174.4 L652.2 172.3 L653.6 170.1 L654.9 167.9 L656.3 165.7 L657.6 163.4 L659.0 161.1 L660.3 158.8 L661.7 156.4 L663.0 154.0 L664.4 151.6 L665.7 149.1 L667.1 146.7 L668.4 144.2 L669.8 141.7 L671.1 139.2 L672.5 136.7 L673.8 134.2 L675.2 131.6 L676.5 129.1 L677.9 126.6 L679.2 124.1 L680.6 121.7 L681.9 119.2 L683.3 116.8 L684.6 114.4 L686.0 112.1 L687.3 109.8 L688.7 107.5 L690.0 105.3 L691.4 103.1 L692.7 101.0 L694.1 98.9 L695.4 96.9 L696.8 94.9 L698.1 93.0 L699.5 91.2 L700.8 89.4 L702.2 87.7 L703.5 86.0 L704.9 84.4 L706.2 82.9 L707.6 81.4 L708.9 80.0 L710.3 78.7 L711.7 77.4 L713.0 76.1 L714.4 75.0 L715.7 73.8 L717.1 72.8 L718.4 71.8 L719.8 70.8 L721.1 69.9 L722.5 69.1 L723.8 68.2 L725.2 67.5 L726.5 66.7 L727.9 66.1 L729.2 65.4 L730.6 64.8 L731.9 64.2 L733.3 63.7 L734.6 63.2 L736.0 62.7 L737.3 62.2 L738.7 61.8 L740.0 61.4 L741.4 61.0 L742.7 60.7 L744.1 60.4 L745.4 60.1 L746.8 59.8 L748.1 59.5 L749.5 59.2 L750.8 59.0 L752.2 58.8 L753.5 58.6 L754.9 58.4 L756.2 58.2 L757.6 58.0 L758.9 57.9 L760.3 57.7 L761.6 57.6 L763.0 57.4 L764.3 57.3 L765.7 57.2 L767.0 57.1 L768.4 57.0 L769.7 56.9 L771.1 56.8 L772.4 56.7 L773.8 56.6 L775.1 56.6 L776.5 56.5 L777.8 56.4 L779.2 56.4 L780.5 56.3 L781.9 56.3 L783.2 56.2 L784.6 56.2 L785.9 56.2 L787.3 56.1 L788.6 56.1 L790.0 56.0" data-k="lmh"></path> Population MLP avg Q K V head </svg> </p> <figcaption><span>Figure 5:</span> Cosine between the estimated and the backprop gradient on the identical batch, per tier category (mean complete layers; MLP averages the input and output projections), against population, for Dust on backprop-trained checkpoints at 10M, 100M and 1B tokens and for EGGROLL at 10M tokens at the identical compute prosperity (left, note the axis). For Dust the lines are the fitted law $\cos(K) = c_{\max}/\sqrt{1 + c/K}$ through measurements at populations of 64 to 128k; for EGGROLL they nexus the measurements. The dotted vertical row is the 16k community the ladders train at. Initialization and EGGROLL at 100M tokens are in Appendix&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">B</a>.</figcaption> </figure> <p>We measure the cosine between Dust&rsquo;s evaluation and the backprop gradient on the identical batch, per tier category and per layer, on backprop-trained checkpoints spanning two orders of dimension in tokens, ie from 10M to 1B tokens, alongside the community expanding from 64 to 128k onward passes per stage (Figure&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">5</a>). The cosine rises alongside community for all tier category at all phase of training, and a two-parameter law</p> <div id="eq-5"><p>$$\cos(K) = \frac{c_{\max}}{\sqrt{1 + c/K}}$$</p><p><span>(5)</span></p></div> <p>fits all tier category alongside RMSE below 0.06, alongside $c_{\max}$ the ceiling and $c$ the community at which the tier reaches $c_{\max}/\sqrt{2}$. Useful gradients <em>emerge</em> from the ample community alone, alongside nothing concerning the sequence regulation built in, fair ray tuning of the hyperparameters to maximize the cosine similarity as described in Section&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">2.3</a>. For the 100M token checkpoint, the fits to tier category average cosine similarities have RMSEs of $0.0032$&ndash;$0.0367$ (see Appendix&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">G</a> for details). Dust&rsquo;s gradients method backprop&rsquo;s in cosine, but how near they get varies by tier category and by layer. EGGROLL&rsquo;s estimate, measured the identical way at the identical figure of onward passes, is expanding alongside community but is motionless below 0.05 in cosine at 128k for all category but the head, which power explain why training on it went nowhere in Section&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">3.2</a>.</p> <p>Importantly, the cosines clasp up throughout most layers as the token figure grows, which is encouraging for scaling. Section&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">3</a> shows the community required to equivalent and exceed backprop grows alongside tokens. However, the cosine stays flat throughout two orders of dimension in tokens at ample populations, which method that at a ample adequate community it&rsquo;s imaginable that this necessity <em>no longer grows alongside additional tokens</em>. Furthermore, the fact that Dust&rsquo;s gradients method backprop&rsquo;s but don&rsquo;t converge to them exactly is in fact a fine property. The evaluation points in a akin direction without being backprop&rsquo;s gradient, which leads to a distinct optimization trajectory, and in our experiments that trajectory can equal be improved than backprop&rsquo;s (Section&nbsp;<a href="https://en.mycoding.id/category/technology" target="_blank">3.2</a>).</p> <h2 id="conclusion"><span>5</span> Conclusion</h2> <p>Since <span data-kind="citet" data-keys="rumelhart1986learning"><span><a href="https://en.mycoding.id/category/technology" target="_blank">Rumelhart et al. (1986)</a><span>David E. Rumelhart, Geoffrey E. Hinton, and Ronald J. Williams. Learning representations by back-propagating errors. <em>Nature</em>, 323: 533&ndash;536, 1986.</span></span></span>, backprop has been the algorithm that trains neural nets, and the architectures, optimizers and hardware we have were all built about it. As compute becomes additional abundant, we think much improved alternatives are possible. We introduced Dust, an algorithm that drastically improves upon existing ES algorithms and approximates backprop closely at pretraining transformers, equal exceeding it alongside ample amounts of computation.</p> <p>There are many engaging open questions. The archetypal is whether, and how, Dust can discover improved directions than backprop&rsquo;s first-order gradient by <em>implicitly exploring the defeat landscape</em>, picking up higher-order curvature that pulls the hunt toward flat regions. We have hints that it can, since at ample populations it sometimes ends up below backprop, but the scheme is not clear. The second is that Dust opens up the hunt area complete architectures, since it does not need the network to be end-to-end differentiable, and it may do improved anywhere backprop is known to struggle, akin recurrent or looped computation trained by backpropagation through time. The third is compute efficiency, which was not the concentration of this paper. We must have orders of dimension additional compute effectiveness before Dust becomes a applicable substitute to backprop at current levels of compute.</p> <p>Early activity on zeroth-order pretraining of tongue models&nbsp;<span data-kind="citep" data-keys="allaire2025pretraining">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Allaire et al., 2025</a><span>Nathan Allaire, Mahsa Ghazvini Nejad, S&eacute;bastien Le Digabel, and Vahid Partovi Nia. Zeroth command optimization for pretraining tongue models. In <em>Proceedings of ICPRAM</em>, pages 113&ndash;121, 2025. doi: <a href="https://en.mycoding.id/category/technology" target="_blank">10.5220/0013261100003905</a>. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://doi.org/10.5220/0013261100003905</a>.</span></span>)</span> examined the difficulty of training transformers from scratch alongside importance perturbations. Their afterward method, KronZO&nbsp;<span data-kind="citep" data-keys="allaire2026kronzo">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Allaire et al., 2026</a><span>Nathan Allaire, S&eacute;bastien Le Digabel, Dominique Orban, and Vahid Partovi Nia. Zeroth-order Kronecker optimization for pretraining tongue models. <em>SN Computer Science</em>, 7, 2026. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://www.gerad.ca/en/papers/G-2025-44</a>. Article 162.</span></span>)</span>, uses compact perturbations alongside Kronecker construction and selective directional updates to enhance pretraining during reducing recollection use. EGGROLL&nbsp;<span data-kind="citep" data-keys="sarkar2025eggroll">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Sarkar et al., 2025</a><span>Bidipta Sarkar, Mattie Fellows, Juan Agustin Duque, Alistair Letcher, Antonio Le&oacute;n Villares, Anya Sims, Clarisse Wibault, Dmitry Samsonov, Dylan Cope, Jarek Liesen, Kang Li, Lukas Seier, Theo Wolf, Uljad Berdica, Valentin Mohl, Alexander David Goldie, Aaron Courville, Karin Sevegnani, Shimon Whiteson, and Jakob Nicolaus Foerster. Evolution strategies at the hyperscale. <em>arXiv preprint arXiv:2511.16652</em>, 2025.</span></span>)</span> makes ample populations of importance perturbations productive on GPUs through low-rank structure. Dust alternatively searches complete activations and uses rewards for all token to extract additional credit from all onward pass.</p> <p>For fine tuning, MeZO&nbsp;<span data-kind="citep" data-keys="malladi2023mezo">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Malladi et al., 2023</a><span>Sadhika Malladi, Tianyu Gao, Eshaan Nichani, Alex Damian, Jason D. Lee, Danqi Chen, and Sanjeev Arora. Fine-tuning tongue models alongside fair onward passes. In <em>Advances in Neural Information Processing Systems</em>, quantity 36, 2023.</span></span>)</span> showed that tongue models can be adapted alongside onward passes solitary and recollection use near to inference. Evolution Strategies at Scale&nbsp;<span data-kind="citep" data-keys="qiu2026esscale">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Qiu et al., 2026</a><span>Xin Qiu, Yulu Gan, Conor F. Hayes, Qiyao Liang, Yinggan Xu, Roberto Dailey, Elliot Meyerson, Babak Hodjat, and Risto Miikkulainen. Evolution strategies at scale: LLM fine-tuning beyond reinforcement learning. In <em>Proceedings of the International Conference on Machine Learning</em>, 2026. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://arxiv.org/abs/2509.24372</a>. arXiv:2509.24372.</span></span>)</span> demonstrates fine tuning of all parameters alongside ES in tongue models alongside billions of parameters. Neural Thickets&nbsp;<span data-kind="citep" data-keys="gan2026thickets">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Gan and Isola, 2026</a><span>Yulu Gan and Phillip Isola. Neural thickets: Diverse project experts are compact about pretrained weights. <em>arXiv preprint arXiv:2603.12228</em>, 2026. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://arxiv.org/abs/2603.12228</a>.</span></span>)</span> finds helpful project experts by randomly perturbing pretrained weights, selecting the finest candidates and ensembling their predictions. These results display how much hunt can accomplish about a pretrained model. Our experiments location learning the representations themselves through pretraining from scratch.</p> <p>Our activation perturbations build on node perturbation&nbsp;<span data-kind="citep" data-keys="werfel2003learning">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Werfel et al., 2003</a><span>Justin Werfel, Xiaohui Xie, and H. Sebastian Seung. Learning curves for stochastic gradient decline in linear feedforward networks. In <em>Advances in Neural Information Processing Systems</em>, quantity 16, 2003.</span></span>)</span>. GEMINI&nbsp;<span data-kind="citep" data-keys="lecun1988gemini">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Le Cun et al., 1988</a><span>Yann Le Cun, Conrad C. Galland, and Geoffrey E. Hinton. GEMINI: Gradient evaluation through matrix inversion following noise injection. In <em>Advances in Neural Information Processing Systems</em>, quantity 1, pages 141&ndash;148, 1988. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://papers.neurips.cc/paper_files/paper/1988/file/a0a080f42e6f13b3a2df133f073095dd-Paper.pdf</a>.</span></span>)</span> injected noise into the archetypal hidden tier and restored layerwise gradient estimates through iterative matrix inversion. Zoop&nbsp;<span data-kind="citep" data-keys="hu2025zoop">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Hu et al., 2025</a><span>Xixi Hu, Bo Liu, Qiang Liu, Xiaocong Du, Bhargav Bhushanam, Louis Feng, Chengyue Gong, and Kaizhao Liang. Zoop it! Efficient zero-order optimization alongside output perturbation. In <em>ICML Workshop on Tiny Titans: The next motion of On-Device Learning for Foundation Models</em>, 2025. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://openreview.net/forum?id=Tc8vFyRhPO</a>.</span></span>)</span> uses output perturbations for tongue example fine tuning, converting estimated output gradients into indicator updates alongside local derivatives. Scaling Forward Gradient alongside Local Losses&nbsp;<span data-kind="citep" data-keys="ren2023scaling">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Ren et al., 2023</a><span>Mengye Ren, Simon Kornblith, Renjie Liao, and Geoffrey Hinton. Scaling onward gradient alongside local losses. In <em>International Conference on Learning Representations</em>, 2023.</span></span>)</span> combines activation perturbations and local losses alongside onward manner automatic differentiation to decrease estimator variance. Forward gradients alongside multiple tangents&nbsp;<span data-kind="citep" data-keys="flugel2025multitangent">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Fl&uuml;gel et al., 2025</a><span>Katharina Fl&uuml;gel, Daniel Coquelin, Marie Weiel, Charlotte Debus, Achim Streit, and Markus G&ouml;tz. Beyond backpropagation: Optimization alongside multi-tangent onward gradients. In <em>International Joint Conference on Neural Networks</em>, 2025. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://arxiv.org/pdf/2410.17764v2</a>.</span></span>)</span> additionally use onward manner differentiation, combining multiple directional derivatives through orthogonal projection to enhance gradient estimates.</p> <p>A distinct row of activity replaces the earth backward continue alongside local learning dynamics: Sakana AI&rsquo;s PC-ALM&nbsp;<span data-kind="citep" data-keys="seely2026pcalm">(<span><a href="https://en.mycoding.id/category/technology" target="_blank">Seely and Gould, 2026</a><span>Jeffrey Seely and Julian Gould. Augmented Lagrangian predictive coding. <em>arXiv preprint arXiv:2605.31022</em>, 2026. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://arxiv.org/abs/2605.31022</a>.</span></span>)</span> propagates credit through local predictive coding dynamics and Lagrange multipliers. It uses local derivatives and is evaluated on depiction classification tasks. Dust estimates credit from onward perturbations during transformer pretraining, combining rewards for all token alongside local targets for notice outputs.</p> <h2>References</h2> <p id="ref-allaire2025pretraining">Nathan Allaire, Mahsa Ghazvini Nejad, S&eacute;bastien Le Digabel, and Vahid Partovi Nia. Zeroth command optimization for pretraining tongue models. In <em>Proceedings of ICPRAM</em>, pages 113&ndash;121, 2025. doi: <a href="https://en.mycoding.id/category/technology" target="_blank">10.5220/0013261100003905</a>. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://doi.org/10.5220/0013261100003905</a>.</p> <p id="ref-allaire2026kronzo">Nathan Allaire, S&eacute;bastien Le Digabel, Dominique Orban, and Vahid Partovi Nia. Zeroth-order Kronecker optimization for pretraining tongue models. <em>SN Computer Science</em>, 7, 2026. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://www.gerad.ca/en/papers/G-2025-44</a>. Article 162.</p> <p id="ref-flugel2025multitangent">Katharina Fl&uuml;gel, Daniel Coquelin, Marie Weiel, Charlotte Debus, Achim Streit, and Markus G&ouml;tz. Beyond backpropagation: Optimization alongside multi-tangent onward gradients. In <em>International Joint Conference on Neural Networks</em>, 2025. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://arxiv.org/pdf/2410.17764v2</a>.</p> <p id="ref-gan2026thickets">Yulu Gan and Phillip Isola. Neural thickets: Diverse project experts are compact about pretrained weights. <em>arXiv preprint arXiv:2603.12228</em>, 2026. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://arxiv.org/abs/2603.12228</a>.</p> <p id="ref-gurnee2026workspace">Wes Gurnee, Nicholas Sofroniew, Adam Pearce, Mateusz Piotrowski, Isaac Kauvar, Runjin Chen, Anna Soligo, Paul Bogdan, Euan Ong, Rowan Wang, Ben Thompson, David Abrahams, Subhash Kantamneni, Emmanuel Ameisen, Joshua Batson, and Jack Lindsey. Verbalizable representations form a earth workspace in tongue models. <em>arXiv preprint arXiv:2607.15495</em>, 2026.</p> <p id="ref-hu2025zoop">Xixi Hu, Bo Liu, Qiang Liu, Xiaocong Du, Bhargav Bhushanam, Louis Feng, Chengyue Gong, and Kaizhao Liang. Zoop it! Efficient zero-order optimization alongside output perturbation. In <em>ICML Workshop on Tiny Titans: The next motion of On-Device Learning for Foundation Models</em>, 2025. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://openreview.net/forum?id=Tc8vFyRhPO</a>.</p> <p id="ref-lecun1988gemini">Yann Le Cun, Conrad C. Galland, and Geoffrey E. Hinton. GEMINI: Gradient evaluation through matrix inversion following noise injection. In <em>Advances in Neural Information Processing Systems</em>, quantity 1, pages 141&ndash;148, 1988. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://papers.neurips.cc/paper_files/paper/1988/file/a0a080f42e6f13b3a2df133f073095dd-Paper.pdf</a>.</p> <p id="ref-lillicrap2020backpropagation">Timothy P. Lillicrap, Adam Santoro, Luke Marris, Colin J. Akerman, and Geoffrey Hinton. Backpropagation and the brain. <em>Nature Reviews Neuroscience</em>, 21 (6): 335&ndash;346, 2020. doi: <a href="https://en.mycoding.id/category/technology" target="_blank">10.1038/s41583-020-0277-3</a>.</p> <p id="ref-lindsey2025biology">Jack Lindsey, Wes Gurnee, Emmanuel Ameisen, Brian Chen, Adam Pearce, Nicholas L. Turner, Craig Citro, et al. On the existence discipline of a ample tongue model. <em>Transformer Circuits Thread</em>, 2025.</p> <p id="ref-liu2020bad">Shengchao Liu, Dimitris Papailiopoulos, and Dimitris Achlioptas. Bad earth minima be and SGD can attain them. In <em>Advances in Neural Information Processing Systems</em>, quantity 33, 2020.</p> <p id="ref-malladi2023mezo">Sadhika Malladi, Tianyu Gao, Eshaan Nichani, Alex Damian, Jason D. Lee, Danqi Chen, and Sanjeev Arora. Fine-tuning tongue models alongside fair onward passes. In <em>Advances in Neural Information Processing Systems</em>, quantity 36, 2023.</p> <p id="ref-nesterov2017random">Yurii Nesterov and Vladimir Spokoiny. Random gradient-free minimization of convex functions. <em>Foundations of Computational Mathematics</em>, 17 (2): 527&ndash;566, 2017. doi: <a href="https://en.mycoding.id/category/technology" target="_blank">10.1007/s10208-015-9296-2</a>.</p> <p id="ref-qiu2026esscale">Xin Qiu, Yulu Gan, Conor F. Hayes, Qiyao Liang, Yinggan Xu, Roberto Dailey, Elliot Meyerson, Babak Hodjat, and Risto Miikkulainen. Evolution strategies at scale: LLM fine-tuning beyond reinforcement learning. In <em>Proceedings of the International Conference on Machine Learning</em>, 2026. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://arxiv.org/abs/2509.24372</a>. arXiv:2509.24372.</p> <p id="ref-ren2023scaling">Mengye Ren, Simon Kornblith, Renjie Liao, and Geoffrey Hinton. Scaling onward gradient alongside local losses. In <em>International Conference on Learning Representations</em>, 2023.</p> <p id="ref-rumelhart1986learning">David E. Rumelhart, Geoffrey E. Hinton, and Ronald J. Williams. Learning representations by back-propagating errors. <em>Nature</em>, 323: 533&ndash;536, 1986.</p> <p id="ref-salimans2017evolution">Tim Salimans, Jonathan Ho, Xi Chen, Szymon Sidor, and Ilya Sutskever. Evolution strategies as a scalable substitute to reinforcement learning. <em>arXiv preprint arXiv:1703.03864</em>, 2017.</p> <p id="ref-sarkar2025eggroll">Bidipta Sarkar, Mattie Fellows, Juan Agustin Duque, Alistair Letcher, Antonio Le&oacute;n Villares, Anya Sims, Clarisse Wibault, Dmitry Samsonov, Dylan Cope, Jarek Liesen, Kang Li, Lukas Seier, Theo Wolf, Uljad Berdica, Valentin Mohl, Alexander David Goldie, Aaron Courville, Karin Sevegnani, Shimon Whiteson, and Jakob Nicolaus Foerster. Evolution strategies at the hyperscale. <em>arXiv preprint arXiv:2511.16652</em>, 2025.</p> <p id="ref-seely2026pcalm">Jeffrey Seely and Julian Gould. Augmented Lagrangian predictive coding. <em>arXiv preprint arXiv:2605.31022</em>, 2026. URL <a href="https://en.mycoding.id/category/technology" target="_blank">https://arxiv.org/abs/2605.31022</a>.</p> <p id="ref-silver2017mastering">David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton, Yutian Chen, Timothy Lillicrap, Fan Hui, Laurent Sifre, George van den Driessche, Thore Graepel, and Demis Hassabis. Mastering the equivalent of Go without individual knowledge. <em>Nature</em>, 550 (7676): 354&ndash;359, 2017. doi: <a href="https://en.mycoding.id/category/technology" target="_blank">10.1038/nature24270</a>.</p> <p id="ref-sutton2019bitter">Richard S. Sutton. The bitter lesson. <a href="https://en.mycoding.id/category/technology" target="_blank">http://www.incompleteideas.net/IncIdeas/BitterLesson.html</a>, 2019. Blog post.</p> <p id="ref-vegesna2025decoupling">Akshay Vegesna and Samip Dahal. Decoupling hunt and learning in neural net training. <em>arXiv preprint arXiv:2509.10973</em>, 2025.</p> <p id="ref-werfel2003learning">Justin Werfel, Xiaohui Xie, and H. Sebastian Seung. Learning curves for stochastic gradient decline in linear feedforward networks. In <em>Advances in Neural Information Processing Systems</em>, quantity 16, 2003.</p> <p id="ref-widrow1990thirty">Bernard Widrow and Michael A. Lehr. 30 years of adaptive neural networks: Perceptron, Madaline, and backpropagation. <em>Proceedings of the IEEE</em>, 78 (9): 1415&ndash;1442, 1990. doi: <a href="https://en.mycoding.id/category/technology" target="_blank">10.1109/5.58323</a>.</p> <p><a href="https://en.mycoding.id/category/technology" target="_blank">Appendix</a></p> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>A</span> <span>Architecture</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>B</span> <span>Cosine Ladder at the Remaining Checkpoints</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>C</span> <span>Test Losses by Token Budget and Population</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>D</span> <span>EGGROLL&rsquo;s Extrapolated Population</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>E</span> <span>Population Allocation</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>F</span> <span>Tuning</span></a> <a href="https://en.mycoding.id/category/technology" target="_blank"><span>G</span> <span>Cosine-fit parameters</span></a> <p><a href="https://en.mycoding.id/category/technology" target="_blank">&larr; Back to Q</a></p> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/dust-pretraining-transformers-without-backpropagation-71155</guid> <pubDate>Mon, 05 Oct 2026 22:15:07 +0700</pubDate> <author><![CDATA[support@mycoding.id (Mira Azkia)]]></author> </item> <item> <title><![CDATA[The Matic is the first robovac to get an FCC ban waiver, not that it needs it]]></title> <description><![CDATA[The Matic is the first robovac to get an FCC ban waiver, not that it needs it. The Matic is our favorite robot vacuum and robo-mop, and it's additionally now the archetypal to escape the FCC's Roomba ban. Well, kind of - since the Matic wasn't banned...]]></description> <media:thumbnail url="https://platform.theverge.com/wp-content/uploads/sites/2/2026/08/IMG_8725.jpeg?quality=90&amp;strip=all&amp;crop=0%2C15.095986038394%2C100%2C69.808027923211&amp;w=1200"/> <category><![CDATA[Technology]]></category> <link>https://en.mycoding.id/the-matic-is-the-first-robovac-to-get-an-fcc-ban-waiver-not-that-it-needs-it-71154</link> <content:encoded><![CDATA[<div id="zephr-anchor"><div><p>The Matic is <a href="https://en.mycoding.id/category/technology" target="_blank">our favorite robot vacuum</a> and <a href="https://en.mycoding.id/category/technology" target="_blank">robo-mop</a>, and it&rsquo;s additionally now the archetypal to escape <a href="https://en.mycoding.id/category/technology" target="_blank">the FCC&rsquo;s Roomba ban</a>.</p></div><p>Well, <em>sort of</em> &mdash; since the Matic wasn&rsquo;t banned to commencement with.</p><p>Here&rsquo;s what&rsquo;s really happening: On October 2nd, the FCC added the first Matic, example 4MA0001, and its charging dock example 4DK0008 to <a href="https://en.mycoding.id/category/technology" target="_blank">its ban waiver list</a>. That allows the FCC to endorse these broadcast products for import, marketing, and sale.</p><p>But the Matic doesn&rsquo;t need a waiver, since its radios were already approved years ago. The FCC&rsquo;s abroad drone, robot, <a href="https://en.mycoding.id/category/technology" target="_blank">and router bans</a> lone keep <em>future</em> products from getting imported into the United States, not existing ones whose radios have already been approved.</p><p>Besides, Matic&rsquo;s products don&rsquo;t get FCC endorsement to commencement alongside &mdash; instead, Matic ships them alongside an off-the-shelf Intel AX210 Wi-Fi and Bluetooth part that gets its own endorsement from the FCC. (It&rsquo;s the identical benevolent of Wi-Fi cardstock you&rsquo;ll discover inner a desktop or laptop computer.) Matic additionally doesn&rsquo;t need to concern concerning an import ban specifically, since Matic assembles its robots correct current in Mountain View, California.</p><p>A waiver could theoretically assistance if Matic were to build new products exterior the United States and try to import them here, apart from that the FCC hasn&rsquo;t granted Matic a covering endorsement on a <em>brand</em> of robot, akin it did <a href="https://en.mycoding.id/category/technology" target="_blank">with Asus</a> and <a href="https://en.mycoding.id/category/technology" target="_blank">Netgear&rsquo;s routers</a>. Instead, it specifically granted a waiver for the Matic models 4MA0001 and 4DK0008, which, again, have already made it through the FCC.</p><p>The waiver power not be entirely symbolic. The FCC is currently trying to near many of the loopholes that <a href="https://en.mycoding.id/category/technology" target="_blank">currently create its ban impotent</a>, is weighing whether to create manufacturers disclose all the components in their gadgets, and is <a href="https://en.mycoding.id/category/technology" target="_blank">retroactively cracking down</a> on several companies it sees as flaunting the rules. While Matic assembles its robots in the US, it admits it doesn&rsquo;t yet origin 65 percent of its components from US suppliers, the threshold for it to be seen as Made in the US, and perchance one of those abroad components could trip it up if not for the waiver.</p><p>Even so, Matic already gets its &ldquo;core compute platform&rdquo; from Nvidia, co-founder and CEO Mehul Nariyawala tells <em>The Verge</em>, and sources another &ldquo;critical components&rdquo; from US companies &ldquo;whenever possible.&rdquo;</p><p>And dissimilar several of the another companies anywhere the FCC has mysteriously granted a waiver, Matic <em>is</em> committing to additional US manufacturing and onshoring.</p><p>&ldquo;Up till 3 months ago, the two our R&amp;D offices and manufacturing accommodation were in the identical agency in Mountain View, concerning 24,000 quadrate feet,&rdquo; Nariyawala tells The Verge. &ldquo;We&rsquo;ve turned that complete facility into manufacturing facility and moved our agency to Menlo Park.&rdquo;</p><p>He says Matic went from shipping 1,500 robots a twelvemonth ago to 17,000 now, and is trying to discover additional and additional US suppliers so it can use equal small abroad parts.</p><p>&ldquo;At the instant we power be the lone flat cleaning robot built in America,&rdquo; he says. &ldquo;That is becoming among the key value propositions for our product.&rdquo;</p><div><p><span><strong>Follow topics and authors</strong> from this narrative to see additional akin this in your personalized homepage nourish and to obtain email updates.</span></p><ul><li id="follow-author-article_footer-dmcyOmF1dGhvclByb2ZpbGU6MzQz"><span aria-expanded="false" aria-haspopup="true" role="button" tabindex="0"><span><span><svg width="9" height="9" viewbox="0 0 9 9" fill="none" xmlns="http://www.w3.org/2000/svg" aria-label="Follow"><path d="M5 0H4V4H0V5H4V9H5V5H9V4H5V0Z"></path></svg></span><span>Sean Hollister</span></span></span></li><li><li><li></ul></div></div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/the-matic-is-the-first-robovac-to-get-an-fcc-ban-waiver-not-that-it-needs-it-71154</guid> <pubDate>Mon, 05 Oct 2026 22:15:05 +0700</pubDate> <author><![CDATA[support@mycoding.id (Sean Hollister)]]></author> </item> <item> <title><![CDATA[Google Is Fighting SERP Tracking. AI Agents May Make It Worse]]></title> <description><![CDATA[Google Is Fighting SERP Tracking. AI Agents May Make It Worse. Google is fighting rear against SERP tracking. The detonation of AI agents may logic it to clamp downward harder. The article Google Is Fighting SERP Tracking. AI Agent...]]></description> <media:thumbnail url="https://en.mycoding.id/site/assets/img/og-image.png"/> <category><![CDATA[Business]]></category> <link>https://en.mycoding.id/google-is-fighting-serp-tracking-ai-agents-may-make-it-worse-71160</link> <content:encoded><![CDATA[<div class="sej-article-content gototop-pos "> <div class="sss2_sllo_o6"> </div> <div id="narrow-cont"><p>Google is entering a new phase of SERP abrasion because of AI agents. Some of it may be driven by networks of LLMs that are reverse engineering Google’s hunt results. The community visage of Google’s war against abrasion remains position trackers but the genuine battle may be elsewhere.</p> <p>Will the capability to track rankings rotate into a item of the past?</p> <h2>Massive AI Agent Traffic Expansion</h2> <p>What may be a logic rearward Google’s actions to halt position tracking is that the amount of AI Agent traffic has grown exponentially. According to Cloudflare, which is in a stance to detect web traffic, AI delegate website traffic has risen 1,700% complete the former year.</p> <p><em>A latest part from Cloudflare <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">explained</a>:</em></p> <blockquote><p>“At the end of 2024, Cloudflare handled an average of 63 myriad HTTP requests a second. Today, it’s nearly doubled to 115 million, alongside peaks complete 150 million. Over the former year, regular requests from AI agents on our network grew by additional than 1,700%. This year, for the archetypal time, additional than fractional of Internet traffic wasn’t human.”</p></blockquote><div data-total="8" id="SEJ_300x250_UnderPost_1-parent" class="content-unit sss2_sllo_o6 mmh-90-wrap"> <div class="mmh-90-inner"> <div class="mmh-90 flex-aligner"> <div data-adnumber="0" data-middle="yes" data-p-slot="SEJ_300x250_UnderPost" data-slot="SEJ_300x250_UnderPost/SEJ_300x250_UnderPost_1" id="SEJ_300x250_UnderPost_1" class="sadslots"> </div> </div> </div> </div> <p>The issue alongside AI delegate web traffic is that several of it a hybrid human/agent visit, agents operating on behalf of humans, which method that several of it motionless has value to websites, item Google may have already considered in formulating engineering responses to position trackers.</p> <h2>Google’s AI Search Is More Expensive To Produce</h2> <p>The issue for Google is that a enormous amount of traffic could logic latency issues in serving hunt results, including AI hunt results. This is a bigger issue for keyword that trigger AI-driven hunt results since those are computationally additional costly to generate.</p> <p>Regular hunt ranks pre-indexed websites that are connected alongside assorted queries. AI-derived hunt results contain LLM conclusion complete multiple queries, which method that all period a person asks one question, the LLM generates multiple connected queries, affirmative assorted reasoning steps, before answering alongside a synthesized summary of all the sources.</p><div data-total="8" id="SEJ_300x250_UnderPost_2-parent" class="content-unit sss2_sllo_o6 mmh-90-wrap"> <div class="mmh-90-inner"> <div class="mmh-90 flex-aligner"> <div data-adnumber="1" data-middle="no" data-p-slot="SEJ_300x250_UnderPost" data-slot="SEJ_300x250_UnderPost/SEJ_300x250_UnderPost_2" id="SEJ_300x250_UnderPost_2" class="sadslots"> </div> </div> </div> </div> <p>AI Mode is inherently additional computationally costly than traditional Search, which is why Google is aggressively reducing its AI disbursal per query as use scales through improvements in LLMs, hardware and engineering optimizations.</p> <p>Google’s Sundar Pichai <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">remarked</a> multiple times on Google’s efforts to run the hunt per query expenses downward in the Q2 Earnings call. The disbursal of AI queries was so crucial that it merited multiple mentions:</p> <blockquote><p>“Yesterday we announced new models — Gemini 3.6 Flash and Gemini 3.5 Flash-Lite — which are disbursal productive and extremely efficient. We’re seeing lots of petition for our workhorse Gemini Flash series, since it hits the saccharine place of achievement and cost.</p> <p>As we assist additional of these queries, we’ve continued to run efficiencies. Thanks to our engineering and hardware optimizations, this fourth we reduced the disbursal of AI Mode responses to its lowest flat since launch, equal as we’ve brought additional advanced AI capabilities.”</p></blockquote><div data-total="8" id="SEJ_300x250_UnderPost_3-parent" class="content-unit sss2_sllo_o6 mmh-90-wrap"> <div class="mmh-90-inner"> <div class="mmh-90 flex-aligner"> <div data-adnumber="2" data-middle="no" data-p-slot="SEJ_300x250_UnderPost" data-slot="SEJ_300x250_UnderPost/SEJ_300x250_UnderPost_3" id="SEJ_300x250_UnderPost_3" class="sadslots"> </div> </div> </div> </div> <p>The elevated disbursal per query of AI-driven Search is a genuine problem. AI Search queries are computationally additional costly to assist and AI delegate traffic can consequence hunt results latency. Google may extremely fine have taken a additional adversarial method to automated position tracking in command to enhance the disbursal per query calculation.</p> <h2>Networks Of AI-Generated Adversarial Content</h2> <p>Google has published multiple investigation document focused on AI-generated content. The document allude to attackers changing their satisfied in reply to Google’s reactions in command to unlock rankings. Core to unlocking rankings is tracking Google’s hunt results. Although the investigation document don’t citation distillation, the procedure of reverse engineering an LLM through the outputs, the few particulars the investigation document shares connote that is what Google is really fighting against.</p><div data-total="8" id="SEJ_300x250_UnderPost_4-parent" class="content-unit sss2_sllo_o6 mmh-90-wrap"> <div class="mmh-90-inner"> <div class="mmh-90 flex-aligner"> <div data-adnumber="3" data-middle="no" data-p-slot="SEJ_300x250_UnderPost" data-slot="SEJ_300x250_UnderPost/SEJ_300x250_UnderPost_4" id="SEJ_300x250_UnderPost_4" class="sadslots"> </div> </div> </div> </div> <p><strong>Read concerning these investigation papers:</strong></p> <p><a href="https://en.mycoding.id/category/business" target="_blank" target="_blank">Google Has Deployed A New AI Spam Detector Called SAFE</a></p> <p><a href="https://en.mycoding.id/category/business" target="_blank" target="_blank">Google’s Scalable Cluster Termination System (S-CTS)</a></p> <h2>SEOs Notice Effect On Rank Tracking</h2> <p>Ryan Jones (<a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener nofollow">LinkedIn profile</a>), developer of the <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">SERPrecon</a> service, extracts competitor keyword and historic hunt data that informs their keyword inspection for satisfied optimization. As the chief rearward this tool he is an authoritative origin of data concerning position tracking.</p> <p>Jones lately <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">tweeted</a>:</p> <blockquote><p>“we’re getting to the item anywhere nobody volition have position tracking anymore since of the insane amount of AI abrasion going on.”</p></blockquote> <p>Jones offered the following <a href="https://en.mycoding.id/category/business" target="_blank" target="_blank" rel="noopener">response</a> to someone’s tongue-in-cheek recommendation to us AI to scrape the hunt results (SERPs):</p> <blockquote><p>“that’s why the position trackers are failing. Google is blocking all the AI trackers AND AI itself… and the position trackers are getting caught up”</p></blockquote> <h2>Takeaways</h2> <h3>Reverse Engineering Google’s Search Algorithm</h3> <p>Something that has not been mentioned by Google and is not frequently discussed is that a logic why Google is discouraging position tracking is that the data can be used to comprehend Google’s ranking output to build an AI Model that can reproduce Google’s hunt results through a procedure called distillation.</p> <p>It may extremely fine be that Google’s adversarial anti-rank tracking actions may be chiefly an attempt to halt companies from reverse engineering Google’s hunt results.</p> <h3>SERP Tracking Distorts Keyword Data</h3> <p>Google’s decisions are made according to data and among the problems alongside position trackers is the risen disbursal per query. Another matter is that position trackers distort the genuine keyword inventory data. The cost increase of keyword inventory is a long-running issue that predates the AI delegate era, going rear to the earliest days of SEO. But what’s happening today is a enormous addition that fairly apt distorts Google’s click and traffic metrics.</p> <h3>Questions To Ask</h3> <p>AI-driven automated crawling on behalf of humans and AI hunt has surged throughout the web. Google has to react to automated hunt results scraping. Ryan Jones says the two trends are connected.</p> <ul> <li>Will Google’s efforts to halt assured AI abrasion causing position tracking to attain a item anywhere it may rotate into unsustainable</li> <li>The another inquiry I have is how much of Google’s adversarial actions are to forestall reverse engineering Google’s hunt results?</li> </ul> <p><em>Featured Image by Shutterstock/Microba Grandioza</em></p> </div> <div id="bcats" class="bottom-cat narrow-cont"> <span class="sej-category boxed cat-label">Category</span> <a href="https://en.mycoding.id/category/business" target="_blank">News</a> <a href="https://en.mycoding.id/category/business" target="_blank">SEO</a> </div> <div class="sej-above-author-widget"> <div class="sej-widget clearfix"> <div class="sej-badge-box"> <a href="https://en.mycoding.id/category/business" target="_blank" data-placement="Under Article" aria-label="Add Search Engine Journal as a preferred origin on Google"> <svg class="sej-gps-g" viewbox="0 0 48 48" aria-hidden="true" focusable="false"> <path fill="#EA4335" d="M24 9.5c3.54 0 6.71 1.22 9.21 3.6l6.85-6.85C35.9 2.38 30.47 0 24 0 14.62 0 6.51 5.38 2.56 13.22l7.98 6.19C12.43 13.72 17.74 9.5 24 9.5z"></path> <path fill="#4285F4" d="M46.98 24.55c0-1.57-.15-3.09-.38-4.55H24v9.02h12.94c-.58 2.96-2.26 5.48-4.78 7.18l7.73 6c4.51-4.18 7.09-10.36 7.09-17.65z"></path> <path fill="#FBBC05" d="M10.53 28.59c-.48-1.45-.76-2.99-.76-4.59s.27-3.14.76-4.59l-7.98-6.19C.92 16.46 0 20.12 0 24c0 3.88.92 7.54 2.56 10.78l7.97-6.19z"></path> <path fill="#34A853" d="M24 48c6.48 0 11.93-2.13 15.89-5.81l-7.73-6c-2.15 1.45-4.92 2.3-8.16 2.3-6.26 0-11.57-4.22-13.47-9.91l-7.98 6.19C6.51 42.62 14.62 48 24 48z"></path> </svg> <span class="sej-gps-text">Add <b>SEJ</b> as a preferred origin on Google</span> </a> </div> </div> </div> </div>]]></content:encoded> <guid isPermaLink="true">https://en.mycoding.id/google-is-fighting-serp-tracking-ai-agents-may-make-it-worse-71160</guid> <pubDate>Mon, 05 Oct 2026 22:03:08 +0700</pubDate> <author><![CDATA[support@mycoding.id (Roger Montti)]]></author> </item> </channel> </rss>