Top suggestions for Language Models and Reasoning SkillsExplore more searches like Language Models and Reasoning SkillsPeople interested in Language Models and Reasoning Skills also searched for |
Related Products
- 827×1169
- 827×1169
Explore more searches like
Language Models andReasoning Skills
+to+automate+decisions%252C+studying+their+causal+reasoning+capabilities+becomes+crucial.+A+recent+line+of+work+evaluates+LLMs+ability+to+retrieve+commonsense+causal+facts%252C+but+these+evaluations+do+not+sufficiently+assess+how+LLMs+reason+about+interventions.+Motivated+by+the+role+that+interventions+play+in+causal+inference%252C+in+this+paper%252C+we+conduct+empirical+analyses+to+evaluate+whether+LLMs+can+accurately+update+their+knowledge+of+a+data-generating+process+in+response+to+an+intervention.+We+create+benchmarks+that+span+diverse+causal+graphs+(e.g.%252C+confounding%252C+mediation)+and+variable+types%252C+and+enable+a+study+of+intervention-based+reasoning.+These+benchmarks+allow+us+to+isolate+the+ability+of+LLMs+to+accurately+predict+changes+resulting+from+their+ability+to+memorize+facts+or+find+other+shortcuts.+Our+analysis+on+four+LLMs+highlights+that+while+GPT-+4+models+show+promising+accuracy+at+predicting+the+intervention+effects%252C+they+remain+sensitive+to+distracting+factors+in+the+prompts.&cdnurl=https%3a%2f%2fth.bing.com%2fth%2fid%2fR.fc22ba9e194d8dc3ec3340084aa775d9%3frik%3dDOg00ux65qsb9g%26pid%3dImgRaw%26r%3d0&exph=630&expw=1200&q=Language+Models+and+Reasoning+Skills&FORM=IRPRST&ck=DC118A45C8F16B5A552FA272C1A0B928&selectedIndex=26&itb=0)
Some results have been hidden because they may be inaccessible to you.Show inaccessible results
Feedback