BEGIN:VCALENDAR VERSION:2.0 PRODID:-//51²è¹Ý - ECPv6.15.18//NONSGML v1.0//EN CALSCALE:GREGORIAN METHOD:PUBLISH X-WR-CALNAME:51²è¹Ý X-ORIGINAL-URL: X-WR-CALDESC:Events for 51²è¹Ý REFRESH-INTERVAL;VALUE=DURATION:PT1H X-Robots-Tag:noindex X-PUBLISHED-TTL:PT1H BEGIN:VTIMEZONE TZID:Asia/Kolkata BEGIN:STANDARD TZOFFSETFROM:+0530 TZOFFSETTO:+0530 TZNAME:IST DTSTART:20250101T000000 END:STANDARD END:VTIMEZONE BEGIN:VEVENT DTSTART;TZID=Asia/Kolkata:20260416T133000 DTEND;TZID=Asia/Kolkata:20260416T143000 DTSTAMP:20260417T062638 CREATED:20260331T091444Z LAST-MODIFIED:20260415T130836Z UID:91277-1776346200-1776349800@www.ashoka.edu.in SUMMARY:A model of errors in transformers - Suvrat Raju DESCRIPTION:Colloquium announcement\nA model of errors in transformers\nProf Suvrat Raju \nICTS-TIFR \n \n\nAbstract: We study the error rate of LLMs on tasks like arithmetic that require a deterministic output\, and repetitive processing of tokens drawn from a small set of alternatives. By analyzing the accumulation of errors in the attention mechanism\, we theoretically derive a quantitative two-parameter relationship between the accuracy and the complexity of the task. We empirically verify our formula across a range of tasks and state-of-the art LLMs find excellent agreement between the predicted and observed accuracy in many cases. We also identify deviations in some cases that lead us to interesting insights about the functioning of models. We show how this understanding helps to construct prompts to reduce the error rate. \nAbout the speaker: Suvrat Raju is an Indian physicist whose research focuses on quantum gravity and quantum field theory. Suvrat has worked on black holes\, focusing on the ‘information paradox’ around them. He has formulated the Papadodimas-Raju proposal for black holes. Suvrat studied physics at St. Stephen’s college in Delhi University and went on to complete his PhD at the Harvard University. He is currently a professor at the International Centre for Theoretical Sciences of the Tata Institute of Fundamental Research (TIFR). \n\nDate: Thursday\, April 16\, 2026Time: 1:30 PM – 2:30 PM\nVenue: AC-05-Lab-004Email: scdlds@ashoka.edu.in\nZoom: https://zoom.us/j/96228370831?pwd=kNg2lbqs5iBGGsdP21UkI54GO60Rjz.1Website: https://scdlds.ashoka.edu.in/ URL:/event/scdlds-coll14/ LOCATION:AC-05 Ramachandran Hall ATTACH;FMTTYPE=image/png:/wp-content/uploads/2026/03/SCDLDS_COLL14-Prof-Suvrat-Raju.png ORGANIZER;CN="SCDLDS":MAILTO:ashoka-cdlds@ashoka.edu.in END:VEVENT END:VCALENDAR