In this paper, we study how generative AI and specifically large language models (LLMs) impact learning in coding classes. We show across three studies that LLM usage can have positive and negative effects on learning outcomes. Using observational data from … Continued
This pedagogical toolkit complements the competency framework entitled “AI Ethics Training in Higher Education: Competency Framework”, which we produced thanks to the “Pôle montréalais d’enseignement supérieur en intelligence artificielle” (PIA). In this pedagogical toolkit, we provide concrete ways of carrying … Continued
Interactive feedback, where feedback flows in both directions between teacher and student, is more effective than traditional one-way feedback. However, it is often too time-consuming for widespread use in educational practice. While Large Language Models (LLMs) have potential for automating … Continued
arxiv.org/pdf/2409.04109 Recent advancements in large language models (LLMs) have sparked optimism about their potential to accelerate scientific discovery, with a growing number of works proposing research agents that autonomously generate and validate new ideas. Despite this, no evaluations have shown … Continued
arxiv.org/pdf/2409.04109 Recent advancements in large language models (LLMs) have sparked optimism about their potential to accelerate scientific discovery, with a growing number of works proposing research agents that autonomously generate and validate new ideas. Despite this, no evaluations have shown … Continued
While language model (LM)-powered chatbots and generative search engines excel at answering concrete queries, discovering information in the terrain of unknown unknowns remains challenging for users. To emulate the common educational scenario where children/students learn by listening to and participating … Continued
Abstract Generative artificial intelligence (AI) is poised to revolutionize how humans work, and has already demonstrated promise in significantly improving human productivity. However, a key remaining question is how generative AI affects learning, namely, how humans acquire new skills as they … Continued
osf.io/preprints/socarxiv/z74e8 Abstract: Open Science programs are structured educational, research and technical projects that support the application of Open Science practices in universities. While previous research on Open Science has focused on topics such as Open Access, data sharing and data … Continued
Knowing the magnitude and standard error of an empirical estimate is much more important than simply knowing the estimate’s sign and whether it is statistically significant. Yet, we find that even in top journals, when empirical social scientists choose their … Continued
AI is becoming increasingly common across different domains. However, as sophisticated AI-based systems are often black-boxed, rendering the decision-making logic opaque, users find it challenging to comply with their recommendations. Although researchers are investigating Explainable AI (XAI) to increase the … Continued