The Learning Analytics in STEM Education Research (LASER) Institute is a professional development program for early and mid-career researchers and funded by the National Science Foundation (ECR: BCSER).
As the use of digital teaching and learning resources continues to expand, the volume and variety of data available to researchers presents new opportunities for understanding and improving STEM education. In response, learning analytics has emerged over the past decade as an interdisciplinary field and is proving to be a powerful approach for examining persistent problems in STEM education. The LASER Institute aims to increase the capacity of early and mid-career scholars to leverage new data sources and apply computational methods (e.g., network analysis, text mining and machine learning) to support their existing research and develop new lines of inquiry. Located at the Friday Institute for Educational Innovation, the LASER Institute is a collaborative effort between North Carolina State University, Old Dominion University and the University of Tennessee, Knoxville.
The LASER Institute is a year-long program consisting of two core capacity building activities: 1) a week-long intensive summer training program and 2) an online community of practice for continued professional network building and follow-up support throughout and beyond the length of the project. The weeklong intensive program will be conducted at the Friday Institute in Raleigh, North Carolina. However, anticipating that disruptions related to the COVID-19 pandemic will continue through summer, we will shift planned in-person activities for the 2021 summer training program to an interactive virtual setting. Dates for the summer component of the program are TBD.
Program activities are designed to prepare researchers with the knowledge, skills and resources necessary for more advanced study of LA and for collaborating with researchers and practitioners from different backgrounds, especially those from advanced data analytics. By the end of the program, participants will be able to:
- Describe STEM education questions/issues addressed by LA and associated analytical approaches/applications;
- Identify relevant and appropriate STEM educational data sources for computational analyses;
- Apply computational techniques (e.g. machine learning and text mining) using R and RStudio to prepare, explore and model STEM education data;
- Evaluate both the technical feasibility and ethical issues in using analytics to support STEM teaching and learning, and school and district-level decision-making; and
- Develop a collaborative research agenda in STEM education that seeks to address challenges in STEM education from a Learning Analytics lens.
Learning Labs during the summer program are designed to provide participants hands-on experience with R to apply learning techniques, including text mining, data visualization, social network analysis and machine learning. Students will gain hands-on experience in analyzing educational data from STEM contexts, preparing them to solve practical problems in cutting-edge STEM education research and practice. Data for learning labs will come from Friday Institute Online Professional Learning courses (in particular Technology and Math Educators), social media posts, ASSISTments math practice tool, the CODAP data exploration tool, and other digital teaching and learning platforms used in STEM education. Curriculum for the LASER Learning Labs will address the following areas:
- Introduction to Learning Analytics is designed to provide participants an overview of the field of Learning Analytics and prepare students for using tidy data principles and producing replicable research using R, RStudio and GitHub.
- Visualizing STEM Learning will focus on the use of R packages such as ggplot2 and shiny for plotting learner data, creating attractive and informative charts, and developing interactive web apps and dashboards.
- Machine Learning in STEM Ed will introduce researchers to applications of Machine Learning in STEM educational settings and prepare them to conceptualize educational problems, build and evaluate models, and work with a wide range of algorithms and methods to address those problems.
- Text Mining in Education will provide an introduction to text mining concepts, applications in STEM Ed contexts, and applied experience with widely adopted tools and techniques such as tf-idf and sentiment analysis, topic modeling and classification.
- Analyzing Learning Networks will introduce students to social network theory and how network analysis can be applied in online and blended learning environments. Students will learn to calculate network statistics, visualize network properties and use modeling to discover underlying structures and factors impacting their development.
In support of the NSF’s broad goal of building individuals’ capacity to conduct high-quality STEM education research, participants will receive daily support during the Summer Session in developing a research topic that could be investigated further. To maximize time, presentations and panels will be combined with a working lunch. To help provide a personalized learning experience, participants will be initially put into one of the two following groups based on their responses to the needs assessment administered prior to the Institute:
- Technical Assistance will be aimed at participants who have a solid research idea but need support with specific techniques or packages in R. Technical assistance needs may have commonalities between participants or may be participant specific. To determine the most effective response to participant needs, the participants will respond to an online poll each day that allows for up/down voting. In real-time, participants will see technical issues that others are having and may vote issues up/down. This will allow for subgrouping of participants and also identify common problems that can be addressed.
- Research Planning is for participants that need help developing a research idea. For this group, we will make use of low stakes writing activities (Bean, 2011) followed by peer sharing. Our goal is for these participants to have a research idea and plan of action by the end of the week.
During the Summer Workshop, broader topics related to disciplinary knowledge will be addressed at the end of each day through presentations, guest speakers and panel discussions. Speakers will consist of institute instructors, invited guests, advisory board members and past participants with topics including, but are not limited to:
- Digital Data in Education will introduce participants to three types of digital data that frame the analytical approaches addressed by this Institute, as well as three types of educational technologies in which these data are captured and stored. Specifically, this presentation will cover structured data, unstructured text data, and network data obtained from digital learning environments, administrative data systems, and sensors and recording devices.
- Frameworks and Workflows will introduce participants to general approaches to conceptualizing processes associated with LA, including data collection, storage, cleaning, exploring, and modeling. These frameworks and workflows will help illustrate LA’s emphasis on actionable insight to better target instructional, curricular and support resources and interventions.
- Researcher-Practitioner Partnerships will highlight the value of interdisciplinary collaborations with educational organizations to help them learn from their own data and identify new ways to support students. This presentation will include examples from the field and discuss the conditions necessary for developing and sustaining these partnerships.
- Legal and Ethical Issues will address considerations for researchers that are unique to working with data in these new types of STEM learning environments. Topics will include issues such as explicit and implicit bias embedded in big data and algorithms, adequately protecting data, and appropriately addressing privacy concerns.
A core component of the LASER Institute will be an online community of practice to provide follow-up support to the Summer Workshop and continued professional learning, mentoring, and networking opportunities throughout the year. The LASER online community will include monthly activities and regularly updated resources.
- Facilitated discussions will be hosted on our learning and social media platforms. Facilitated discussions will focus on shared problems of practice such as reproducible research along with community forums for topic areas such as R-related Help, general announcements, specific methods.
- Zoom Webinars will be led by instructors, guest speakers and past participants designed to extend topics introduced at the Summer , address critical issues raised in the community, and provide deeper dives into learning analytics methods.
- Peer review activities will be coordinated by the project team so participants can receive timely formative feedback on research products (e.g., code, analyses, presentations, manuscripts or proposals) before a more formal review by the broader academic community.
- A resource repository consisting of both instructor and member-generated content will be hosted in our Professional Learning and Collaborative Environment (PLACE) platform and accessible through modern tools such as GitHub to model and support participant engagement with modeling best practices in learning analytics research.
Applicants must be U.S. citizens or permanent residents and must have obtained a Ph.D. or Ed.D. degree by the end of May 2021. Early-career scholars are typically under seven years after obtaining a doctoral degree; mid-career scholars are typically within their first 15 years of academic or other research-related employment. Priority will be given to previous EHR-IID recipients, faculty from minority-serving institutions, and researchers who are addressing pressing local education problems.