The Deckhand newsletter · Issue 2 · Main Street
Engineering evolution with AI
In law, radiology, customer support and coding, AI takes the first-pass work and a named person still signs. On 15 public simulation problems, the best AI agent came within 10 % of the known answer on one.
Prepared: Analyst Deckhand (AI assistant) · Checked: Editor Deckhand · Approved: Vamsee Achanta · 3 November 2026
In FEABench, a test of AI agents on physics problems in a commercial simulation tool, 88 % of the best agent's commands to the solver ran, yet only one of 15 problems with known correct answers was solved within 10 %, and the authors doubt even that one (Google Research and Harvard, April 2025). NCEES, the US body that sets the engineering licensing exams, says the licensed engineer keeps responsibility and must check AI output independently (Position Statement 6.10, 2025). AI takes the drafting, searching and first-pass work. People keep the decision wherever a court, a regulator or a signature holds a named person to account.
Our hypothesis: AI has cooked coding, and it is now cooking many other areas, such as finance and legal. In each of them, AI has democratised the work, so that more people can now do it. Engineering will be democratised in the same way: with a basic understanding, anyone will be able to take on engineering problems. The future of the engineer then lies in engineering judgement. The question is whether engineering is pretty much cooked. We test it here, on the Deckhand journey, our series that takes real-world cases, builds the engineering behind them and gives it to the industry to reuse and build on.
On today's evidence, engineering work still needs the engineer. This article sets out that evidence, field by field, then two ways it could go for engineering. They are scenarios to argue about.
Law, radiology and customer support
In law, AI drafts and searches, but lawyers must review its output before relying on it (American Bar Association, Formal Opinion 512, July 2024). A public database lists 2,231 court decisions involving AI-invented content, 880 of them involving lawyers (Charlotin, 28 October 2026). The lawyer signs the filing.
In 2016, Geoffrey Hinton predicted that radiologists would be replaced. Today 76.2 % of the AI-enabled devices on the US Food and Drug Administration list are for radiology (Complizen count, September 2026), yet US radiologist numbers have grown about 10 % over the past ten years (Fortune, May 2026). The physician still signs the report.
In customer support, Klarna said in 2024 that its AI assistant did the work of 700 agents (Klarna, February 2024). In May 2025, Klarna's chief executive cited lower quality and the company began hiring people again (Bloomberg, via Entrepreneur, May 2025).
Coding: jobs, AI use, speed and code review
Coding is where AI arrived first and where the change is loudest. US tech companies cut more than 191,000 jobs in 2023, about 127,000 in 2025 and at least 94,046 from January to August 2026 (Crunchbase, October 2026). The reason given has changed. AI was cited in 33 % of tech layoff events in 2026, up from 1 % in 2024 (Layoffs.fyi, via Crunchbase News, September 2026).
Crunchbase count of US-based tech companies (tracker updated 28 October 2026; 2026 to August from Crunchbase News, 25 September 2026). 2022 and 2023 are given as "more than", 2025 as "around". Data: fig1-us-tech-layoffs.csv.
Use is now near universal, and trust is not. In Google's DORA (DevOps Research and Assessment) survey of nearly 5,000 technology professionals, 90 % use AI at work and 30 % have little or no trust in the code it writes (Google Cloud, September 2025). In the Stack Overflow survey, 84 % of developers use or plan to use AI tools; 45.7 % distrust its accuracy and 32.7 % trust it (Stack Overflow, July 2025).
The speed gain depends on who measures it. On one simple lab task, developers with an AI assistant finished 55.8 % faster (Peng and others, February 2023). Across three company field experiments, developers completed 26 % more tasks, with the largest gains for less experienced staff (Cui and others, 2025). In a randomised trial, experienced open-source developers took 19 % longer with AI while believing they were about 20 % faster (METR, Model Evaluation and Threat Research, a non-profit research group, July 2025).
Measures differ by study: time on one set task (lab), tasks completed (field), time on real tasks (randomised trial). The diamond is what the trial's developers believed. Sources: Peng and others 2023; Cui and others 2025; METR 2025. Data: fig2-ai-coding-speed.csv.
Review is still the bottleneck. In over 456,000 GitHub pull requests, a pull request being a proposed code change, people merged 76.8 % of human changes but 38 % to 65 % of those from five coding agents (Li and others, July 2025).
The jobs picture is upheaval, not collapse. US software postings rose almost 15 % from February 2025 to June 2026 while all postings fell about 7 %, yet they remain about 27.5 % below February 2020 (Indeed Hiring Lab, July 2026). The US Bureau of Labor Statistics (BLS) splits the outlook by task, not by field. It projects jobs for computer programmers to fall 7 % from 2025 to 2035, and jobs for software developers, quality assurance analysts and testers to grow 10 % (Figure 3).
US Bureau of Labor Statistics, Occupational Outlook Handbook, pages modified 27 August 2026. The BLS cites AI automation for computer programmers. Data: fig3-us-job-projections.csv.
What AI takes and who still signs, by field
| Field | What AI takes | Who still signs | Evidence |
|---|---|---|---|
| Law | Drafting and search | The lawyer, on the filing | 880 court decisions on lawyers' AI-invented content |
| Radiology | Image screening | The physician, on the report | Radiologists up about 10 % in ten years |
| Customer support | First-line chats | A person, again, after a quality drop | Klarna rehired in 2025 |
| Coding | Writing and changing code | The reviewer who merges the change | Agent changes merged less often than human ones |
| Engineering | Set-up, runs, first drafts | The licensed engineer, on the seal | See below |
Engineering: the evidence so far
On today's evidence, engineering is not cooked, for three reasons.
- Results on problems with known answers. FEABench, at the top of this article, shows that code that runs is not the same as a right answer. Its 15 problems and their target values are public as FEABench Gold (Google Research on GitHub, Apache 2.0 licence, retrieved 29 October 2026); details are in Reusable prompts at the end. EngDesign, a set of 101 engineering design tasks, saw the best model pass about a third (NeurIPS conference, 2025). Both used 2024 to 2025 models, so we keep measuring.
- Codes and the seal. NCEES Position Statement 6.10, at the top of this article, keeps responsibility with the licensed engineer. The North Carolina board adds that the engineer must be "capable of reproducing the output independently from any AI program" (July 2025). The BLS notes that a licensed Professional Engineer (P.E.) may approve design plans and sign off on projects, and it projects civil engineering jobs to grow 6 % from 2025 to 2035 (BLS, Civil Engineers, August 2026).
- Poor data. Project data such as metocean (wind, wave and current) records, vessel motions and soil data is often scarce, or held by the client or under confidentiality terms. Training data that does not represent the real case is one of the named challenges for machine-learning models in structural engineering (Zaker Esteghamati and others, April 2024). In NSPE Case 24-2, putting a client's information into an open AI tool without the client's permission was found unethical. A model trained on cases unlike the project, and not given the project's own site data, cannot check a design against that site, so finding and judging that data stays with the engineer.
Our own team is one case. Its members include AI assistants, such as the Analyst Deckhand and the Editor Deckhand named at the top; they prepare and queue solver runs, check each other's work and draft reports. The analysts do the heavy specialist work, thus providing resource for the engineer to review; the engineer sets the method and the acceptance criteria, judges the results and signs. This article is one example. Vamsee Achanta set its question. The assistants found the sources, checked each figure against its source, built the charts and drafted the text. He reviewed the drafts, changed the title and approves the article.
That first pass is where young engineers have always learned. Across the wider economy, the first rung is narrowing. In payroll data, employment for workers aged 22 to 25 in the most AI-exposed jobs is 19 % below where it would be had it kept pace with less-exposed peers (Stanford, August 2026). Only 4.5 % of Indeed US software postings in the first quarter of 2026 were entry level (Indeed Hiring Lab, July 2026).
Two scenarios for engineering
The other professions show two paths, and engineering could take either. Each step below is drawn from something already seen in another field. The scenarios are ours, to argue about.
AI drafts, sets up and runs; engineers check more options per study.
Drawn from: Radiology: 76.2 % of AI devices, radiologists up about 10 %.
Firms cut the people who did the first pass, then quality drops.
Drawn from: Customer support: Klarna's 700 agents, then rehiring in 2025.
Juniors learn by checking AI first passes against hand calculations.
Drawn from: Field experiments: largest gains for less experienced staff.
Entry hiring dries up, so few people learn to check.
Drawn from: Software: 4.5 % of postings entry level; ages 22 to 25 down 19 %.
The named engineer checks and can reproduce the work.
Drawn from: NCEES 6.10 and the North Carolina board require independent checks.
Plans are sealed after a cursory look at AI output.
Drawn from: NSPE Case 24-2, where the Board found it unethical to seal AI-drafted plans after a cursory review; 880 court decisions on lawyers' AI-invented content.
Problems with known answers become the routine check.
Drawn from: FEABench Gold: 15 public problems with target values.
Code that runs is taken as a right answer.
Drawn from: FEABench: 88 % of commands ran, 1 of 15 within 10 %.
Measured gains go into harder problems and more checking.
Drawn from: Field study: 26 % more tasks completed.
Felt speed replaces measured speed; delivery stability (how often changes fail and must be fixed) slips.
Drawn from: METR: 19 % slower while feeling 20 % faster; DORA 2025: lower delivery stability with AI use.
Our scenarios. Each "Drawn from" line names a source in the list at the end.
The difference between the two paths is who learns to check. In the good path, the first pass becomes training. In the bad path, it becomes a gap that shows only when the senior engineers retire.
The models change too. Each new model may do more of the engineering well, as advances in mathematics and physics are taken into the main model through further training. Engineering that once had to be written out for a model then becomes something it knows unaided. In our own work, the code once had to spell out the catenary equation for a hanging line; a frontier model (one of the most capable AI models of the day) now knows that equation without being given it. Figure 5 shows this direction in three stages. In the good path above, the check stays with the engineer at every stage.
Stages are in order only. The catenary example is from our own work. Hover a stage or the example for detail.
AI does the first-pass work that once trained engineers thus democratizing engineering. If so, engineers likely will evolve the judgement part.
Sources
- American Bar Association, Formal Opinion 512, "Generative Artificial Intelligence Tools", 29 July 2024. https://www.americanbar.org/content/dam/aba/administrative/professional_responsibility/ethics-opinions/aba-formal-opinion-512.pdf
- Brynjolfsson, Chandar and Chen, "Canaries in the Coal Mine? Six Facts about the Recent Employment Effects of AI", Stanford Digital Economy Lab, revised 12 August 2026. https://digitaleconomy.stanford.edu/publications/canaries-in-the-coal-mine
- Charlotin, AI Hallucination Cases database, updated 28 October 2026. https://www.damiencharlotin.com/hallucinations/
- Complizen, "FDA has cleared 1,614 AI medical devices", count of the FDA AI-enabled device list, September 2026. https://www.complizen.ai/post/fda-has-cleared-1614-ai-medical-devices
- Crunchbase News, "The Crunchbase Tech Layoffs Tracker", US-based tech companies, updated 28 October 2026. https://news.crunchbase.com/startups/tech-layoffs/
- Crunchbase News (Azevedo), "Tech Layoffs Outpace 2025 As Big Companies Shift Spending To AI", citing Layoffs.fyi, 25 September 2026. https://news.crunchbase.com/?p=94113
- Cui, Demirer, Jaffe, Musolff, Peng and Salz, "The Effects of Generative AI on High-Skilled Work", Management Science, 2025. https://pubsonline.informs.org/doi/10.1287/mnsc.2025.00535
- Entrepreneur, citing a Bloomberg interview, "Klarna is hiring customer service agents after AI couldn't cut it", May 2025. https://www.entrepreneur.com/business-news/klarna-ceo-reverses-course-by-hiring-more-humans-not-ai/491396
- Fortune, on Geoffrey Hinton's 2016 radiology prediction, 4 May 2026. https://fortune.com/article/ai-godfather-radiologists-obsolete-salaries-up-to-571k-demand-growing/
- Google Cloud, "Announcing the 2025 DORA Report", 23 September 2025. https://cloud.google.com/blog/products/ai-machine-learning/announcing-the-2025-dora-report
- Google Research, FEABench code and data release (FEABench Gold, 15 problems), Apache 2.0 licence, last updated 7 May 2025, retrieved 29 October 2026. https://github.com/google/feabench
- Guo and others, "Toward Engineering AGI: Benchmarking the Engineering Design Capabilities of LLMs" (EngDesign), NeurIPS 2025. https://arxiv.org/abs/2509.16204
- Indeed Hiring Lab (Gallacher), "AI and Job Postings: From Destruction to Creation?", 8 July 2026. https://hiringlab.indeed.com/2026/07/08/ai-and-job-postings-from-destruction-to-creation/
- Indeed Hiring Lab, "The Labor Market Is Tilting Toward Seniority", 23 July 2026. https://hiringlab.indeed.com/2026/07/23/the-labor-market-is-tilting-toward-seniority/
- Klarna, press release on its AI assistant, 27 February 2024. https://www.klarna.com/international/press/klarna-ai-assistant-handles-two-thirds-of-customer-service-chats-in-its-first-month/
- Li, Zhang and Hassan, "The Rise of AI Teammates in Software Engineering (SE) 3.0", Table 5, 20 July 2025. https://arxiv.org/abs/2507.15003
- METR, "Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity", 10 July 2025. https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/
- Mudur and others (Google Research, Harvard), "FEABench: Evaluating Language Models on Multiphysics Reasoning Ability", 8 April 2025. https://arxiv.org/abs/2504.06260
- NCEES, Position Statement 6.10, "Responsible Use of AI in Engineering and Surveying", 2025, as circulated by the Idaho licensing board, 23 January 2026. https://dopl.idaho.gov/wp-content/uploads/2026/01/IPELS-AI-Statement.pdf
- North Carolina Board of Examiners for Engineers and Surveyors, "Guidelines on the Use of AI in Engineering and Surveying Services", 16 July 2025. https://www.ncbels.org/wp-content/uploads/2025/07/Guidelines-on-the-Use-of-Artificial-Intelligence-in-Engineering-and-Surveying-Services-FINAL.pdf
- NSPE Board of Ethical Review, Case 24-2, "Use of AI in Engineering Practice". https://www.nspe.org/sites/default/files/24-2-Artificial-Intelligence-in-Engineering-Practice.pdf
- Peng, Kalliamvakou, Cihon and Demirer, "The Impact of AI on Developer Productivity: Evidence from GitHub Copilot", February 2023. https://arxiv.org/abs/2302.06590
- Stack Overflow, Developer Survey 2025, AI section, July 2025. https://survey.stackoverflow.co/2025/ai
- US Bureau of Labor Statistics, Occupational Outlook Handbook: Civil Engineers, modified 27 August 2026. https://www.bls.gov/ooh/architecture-and-engineering/civil-engineers.htm
- US Bureau of Labor Statistics, Occupational Outlook Handbook: Computer Programmers, modified 27 August 2026. https://www.bls.gov/ooh/computer-and-information-technology/computer-programmers.htm
- US Bureau of Labor Statistics, Occupational Outlook Handbook: Software Developers, Quality Assurance Analysts and Testers, modified 27 August 2026. https://www.bls.gov/ooh/computer-and-information-technology/software-developers.htm
- Zaker Esteghamati, Bean, Burton and Naser, "Beyond development: Challenges in deploying machine learning models for structural engineering applications", 18 April 2024. https://arxiv.org/abs/2404.12544
Reusable prompts
From the sources listed above, compare who does the first pass and who still signs in law, radiology, customer support and coding; test the engineering case against FEABench Gold and the licensing boards' statements; and write a short article that states the hypothesis, with the charts and the two scenarios shown here.
Data: the public data set for this article is FEABench Gold. It holds 15 physics and engineering simulation problems, each with its target quantity, units, a plain-language model specification and the reference solution code for a commercial multiphysics solver. It is the set behind the "one of 15" result above. Source: Google Research, in the FEABench code and data release on GitHub (https://github.com/google/feabench, file data/benchmark.zip). Public status: public, Apache 2.0 licence. Date: last updated 7 May 2025; retrieved 29 October 2026. A reader can pose any of the 15 problems to the tool of their choice and compare its answer with the target value. The numbers behind Figures 1 to 3 are in the CSV files named under each figure.
Readers are welcome to share their own results with the FEABench Gold problems, or data that would improve this comparison, at support@aceengineer.com.
Questions: support@aceengineer.com · AceEngineer · © 2026 AceEngineer · 11511 Piping Rock Dr., Houston, TX 77077
Deckhand: Make Engineering Enjoyable Again