Has AI taken over my job? A comparison of ChatGPT and DeepSeek for generating NONMEM scripts


Prompt: Develop a 1 compartment oral absorption PK model with linear elimination in NONMEM

I did a direct comparison of the script outputs in the table below. For the sake of brevity, only CL was discussed in the $PK block, as the other outputs are similar. You can leave a comment for the full script if you would like.

•For a very niche coding task, it is rather impressive for both ChatGPT and DeepSeek to get almost all components right

•A few typos were present, however, and this requires familiarity with NONMEM to spot and correct

•Both error models only gave proportional error models. Most modelers will test a combination of both additive and proportional errors.

•DeepSeek was missing the INTERACTION term in the $ESTIMATION block

•For basic PK modeling for beginners, using a standard template from NONMEM tutorial part 1 https://lnkd.in/g2-ujU4k might be easier than troubleshooting the errors from LLMs.

** As a side note, if you were wondering if NONMEM can actually write to csv, it works. However, this output still requires parsing to obtain proper rows and columns. While not wrong as well, INTERACTION as a term in $EST is generally recommended with METHOD=1 to allow for FOCE with INTERACTION, the classical method used for modeling in NONMEM.

Have you tried to use LLMs in your PK/PD modeling workflow too? Let me know in the comments!

Unknown's avatar

About janice goh

Dr. Janice Goh graduated from NUS Pharmacy and is a registered pharmacist with the Singapore Pharmacy Council. She recently completed her PhD in the lab of Professor Rada Savic at the University of California, San Francisco (UCSF) School of Pharmacy. She is currently a senior scientist at the Bioinformatics Institute, A*STAR. Her work focuses on using quantitative systems pharmacology using translational pharmacometrics tools by capitalising on preclinical data to predict clinical outcomes prior to actual trials.
This entry was posted in Uncategorized and tagged , , , , , , , , , . Bookmark the permalink.

Leave a comment