Performance and Skill Competency

As role competencies were embedded within Amazon’s internal hiring software and required to be included in hiring processes for multiple job families, Amazon needed to identify fidelity of implementation and related processes used. Dr. Bauer was the lead research scientist for this evaluation research. She leveraged internal data to determine the extent to which required competencies were included in hiring for each included role. Dr. Bauer performed interviews with individuals in key roles throughout the recruitment and hiring pipeline (e.g., recruiting coordinators, recruiters, hiring managers) to identify key factors that facilitated or inhibited required competency inclusion [specific factors are confidential]. She worked in partnership with the product, user experience, and leadership teams to identify and recommend modifications to software, policy, and process to facilitate greater fidelity of implementation. These findings were presented to the Vice President level.

Amazon’s People Experience and Technology (PXT) organization is engaged in a multi-year effort to define core competencies and expertise standards for job roles across corporate hiring. Dr. Bauer was the lead research scientist for 5 major job families [specific families are confidential]. She led a series of competency identification and standard setting sessions using a modified Angoff method with subject matter experts across corporate departments. Output from this research resulted in finalized required and recommended competencies along with performance standards for each of the 5 job families.

In 2022, Amazon was seeking to define the characteristics and core competencies for successful managers of internal corporate teams. With more than 100,000 managers, manager quality was frequently cited as a reason for employees leaving their teams and leaving Amazon. Dr. Bauer led research to understand the experiences and perspectives of direct reports, managers, managers of managers, and senior leadership. In partnership with other Amazon researchers, she facilitated and oversaw facilitation of and analysis of transcripts from more than 150 interviews and focus groups. Using these findings, Dr. Bauer co-authored recommendations for hiring, talent development and management, systems changes, and other organizational development changes. These findings were presented to leadership teams up to the Senior Vice President level. Findings and recommendations from this research are Amazon confidential. 

Dr. Bauer assisted with modification of the National Postdoctoral Association’s Core Competencies to align with the mission and strategic goals of the Johns Hopkins University School of Medicine. Her primary role was to elicit and report on feedback and suggested changes from current faculty and research fellows. Dr. Martha Zeiger, Johns Hopkins University.

Public Sentiment

In 2017, Gallup began a multi-year research study with West Health to learn about Americans’ attitudes about and experiences with healthcare in the United States. Dr. Bauer was the account lead for the project. In this role, she partnered with West Health and leads the Gallup team to shape strategic focus for multiple, nationally representative surveys that drive national discussion about issues in the U.S. healthcare system. Dr. Bauer was responsible for managing the development, fielding, and reporting for each survey. She was also responsible for overall project administration and direction, including managing budgets and the project team’s activities.

Beginning in 2019, Gallup began an innovative partnership with the Department of Mental Health (DMH) of Los Angeles County to develop and field a customized tool to measure wellbeing in the county on an ongoing basis. As the account lead, Dr. Bauer led a team in partnership with DMH leadership, program staff, and clinicians to ensure alignment of the tool with DMH mission and vision, facilitate county-wide fielding of surveys and subsequent reporting, and providing targeted advice to DMH to enable use of the findings to inform clinical mental health treatment and community interventions. She was also responsible for overall project administration and direction, including managing budgets and the project team’s activities.

The Franklin Templeton-Gallup Economics of Recovery Study used a series of nationally representative surveys, fielded monthly, along with big data to capture Americans’ readiness to resume pre-COVID-19 behaviors with the goal of better informing the path to recovery. Dr. Bauer served as a researcher for the project. In this role she engaged in survey development, analysis planning, execution, and reporting.

Designed an affordable intervention to improve attitudes about lesbians and gay men by refuting commonly held misconceptions about lesbians and gay men. The intervention effectively improved male students’ attitudes. Dr. Lisa Carlstrom, California State University, Stanislaus.

Conducted literature review to examine previously used interventions. Conducted focus groups with 4th and 6th grade students to determine health behaviors and activity interests of youth. Trained research assistants in proper data collection techniques. Coordinated pilot data collection. Assisted in final program development. Drs. Harold Stanislaw and Jamie McCreary, California State University, Stanislaus.

Conducted focus groups with Stanislaus County high school and college students to assess youth drinking behavior and reasons for alcohol use and abuse. Assisted in final program and evaluation survey development. Drs. Harold Stanislaw and Jamie McCreary, California State University, Stanislaus.

Assisted in the development of a questionnaire designed to measure the relationship between emotion contagion, mood, and supportive interactions with dating partners. Conducted two-part data collection, including follow up with participants to obtain the full questionnaire. Assisted in preparation of findings for professional presentation. Dr. Jamie McCreary, California State University, Stanislaus.

Student and Learner Experiences

In 2020 Gallup began partnering with the Lumina Foundation to identify and evaluate the many barriers that challenge students in their pursuit of a credential or degree. Particular emphasis is on non-traditional and historically underrepresented college and technical training students. Through a nationally representative survey, Gallup helps the Foundation and other leaders to identify interventions that target the academic, social and financial needs student have in completing these programs. Dr. Bauer served as a researcher for the project. In this role she supported survey development and was responsible for all aspects of analysis planning, execution, and reporting.

Since 2014, Gallup has partnered with the National Collegiate Athletic Association (NCAA) to understand key collegiate experiences and outcomes for former student athletes through the Gallup Alumni Survey. As the lead researcher, Dr. Bauer was responsible for identifying important areas of NCAA interest and developing an analysis strategy to address these areas. Additionally, she identified additional sources of data for enhancing understanding of former student athlete outcomes and needs. She was responsible for all aspects of analysis planning, execution, and reporting.

Dr. Bauer led the development and implementation of an initiative across the School of Medicine focused on addressing gaps in data related to learner mistreatment. Facilitated 22 focus groups with learners (medical students, residents, biomedical graduate students, clinical and research fellows) to understand behaviors perceived as mistreatment, impediments to reporting, and strategies for gathering accurate information about experienced or observed mistreatment. Led discussions with leadership about findings and strategic planning for addressing concerns raised through the groups. Led the development, implementation, and reporting for school-wide data collection to identify specific areas for improvement. Dr. Roy Ziegelstein, Johns Hopkins University.

Lead the development, implementation, and reporting of an annual mixed-methods survey of applicants to biomedical graduate programs at the Johns Hopkins University School of Medicine. Identify elements of the application and interview process that work particularly well and areas for improvement. Identify factors and attitudes that predict accepted applicants’ attendance at the university. Lead strategic planning conversations with leadership and program directors based on findings. Dr. Peter Espenshade, Johns Hopkins University

Led a needs assessment to determine current and gaps in interprofessional education and collaborative practice among graduate training programs for residents and clinical fellows. Methods included interviews with alumni and faculty, mixed-methods surveys, and document review. Dr. Rachel Salas, Johns Hopkins University.

Led an initiative to identify and review efficacy and utility of multiple mechanisms available for medical students and Undergraduate Medical Education faculty to provide feedback regarding their experiences receiving or delivering medical education. Methods included document review, mixed-method surveys, focus groups, and interviews. Led strategic planning conversations with leadership regarding approaches for improving the feedback system. Drs. Nancy Hueppchen and Henry Fessler, Johns Hopkins University.

Learning and Education Program Evaluation

Professional Development

In 2025 eta College, a private higher education and training college with 11 campuses based in South Africa, began expanding their work to incorporate a greater focus on research and evaluation. Their instructional and educational design team had novice to intermediate levels of experience with adult learning principles and no experience with formal curricular and program evaluation. Dr. Bauer developed and presented two interactive, hybrid workshops to build the team’s knowledge and skills in designing curricula for learning, principles of evaluation, and embedding evaluation in educational systems. Additionally, she developed just-in-time (JIT) resources and guides on topics such as Bloom’s Taxonomy, Backwards Design for Learning, Accessibility and Accommodations, Backwards Design for Evaluation, and Assessment Mapping. Materials and JIT resources were disseminated across campuses to instructors and support staff.

During 2020 and 2021 during the COVID-19 pandemic, Amazon experienced an influx of [# confidential] newly hired Software Development Engineers while also needing to pivot to virtual, adaptive onboarding for these new hires. Dr. Bauer led research to evaluate the effectiveness of the virtual onboarding relative to the effectiveness of the previously used in-person and virtual, synchronous onboarding models. This project used an internal consultant model. Dr. Bauer was responsible for client management, mid-cycle project re-scoping, outcome measure identification and definition, dataset construction, data analysis, report editing, and client presentation. Findings and recommendations were presented to the Director level. Findings and recommendations from this research are Amazon confidential.

Pfizer-funded project to develop, test, and implement an app-based knowledge guide to menopause for medical providers. Provide consultation related to instructional strategies, research design, assessment, and program evaluation strategies. Perform test and item analysis on learner assessments. Develop, implement, and report on evaluation of the curriculum, including evaluation of the curriculum’s usefulness and feedback related to the app and platform. Dr. Wen Chen, Johns Hopkins University.

Graduate and Post-Graduate Education

Lead the development, implementation, and reporting on an annual program evaluation of residency and clinical fellowship programs accredited through the American Council for Graduate Medical Education (ACGME). Specific areas of focus are identifying areas for improvement, documenting progress across years, and other areas as required by the ACGME. Dr. Jessica Bienstock, Johns Hopkins University.

Led the evaluation of the Johns Hopkins University Masters of Education in Health Professions program. Methods included interviews with alumni and faculty, mixed-methods surveys, and document review. Dr. Toni Ungarretti, Johns Hopkins University.

Serve as a representative of the Office of Assessment and Evaluation for the Student Assessment and Program Evaluation (SAPE) Committee. SAPE Committee is responsible for regular evaluation of courses in the Undergraduate Medical Education curriculum. Primary role is to examine elements related to course objectives, learner assessment, and instructional strategies. Dr. Pam Lipsett, Johns Hopkins University.

Analysis of and reporting on scoring patterns for Medical Schools Admissions Committee members. Purpose of the project was to identify patterns of ratings across years, as well as examining differences in scoring patterns between the two standing admissions sub-committees. Findings were used to make improvements to the application scoring rubric, committee instructions, and training provided for committee members. Paul White, Johns Hopkins University. 

Assisted in the evaluation of AMSTI Summer Institutes. The vision of AMSTI is “that all students will develop a knowledge base for science, mathematics, and technology literacy for successful participation in society, continuing education, and expansion of the STEM workforce.”  At the Summer Institutes, teachers receive grade and subject specific professional development delivered by master teachers who have been certified as AMSTI trainers. Drs. Andre Green and James P. Van Haneghan, University of South Alabama.

Undergraduate Education

NIH National Institute of General Medical Sciences grant – T32GM008752-16. Program to provide career exploration and professional development opportunities for PhD students in Cellular and Molecular Medicine. Particular emphasis on non-academic careers, creating communities, and building transferable career skills. Primary role is to evaluate program effectiveness. Original funding expired in 2017; ongoing support from the institution. Dr. Rajini Rao and Patricia Phelps, Johns Hopkins University.

Investigated the relationship between current reading experiences, sustained silent reading, and reading maturity. Primary role on the project was data analysis and examination of the psychometric properties of the measurement tool, including reliability, content validity, and construct validity. Dr. Karen Tunks, University of South Alabama.

PreK-12 Education

NSF Award DRL- 0918769. Responsible for day-to-day management of the program evaluation portion of the EYE curriculum-integrated engineering design modules for middle grades. Developed, tested, and scored quantitative and qualitative evaluation tools to assess attitudes, knowledge, and skills. Conducted quantitative and qualitative data analysis. Developed reports and communicated findings to school administrators, teachers, program managers, and curriculum developers. Supervised other graduate assistants working on the evaluation team. Prepared findings for professional and academic presentation. Dr. James P. Van Haneghan, University of South Alabama.

Assisted in research and evaluation of the Stanislaus County School Readiness (SR) program. The SR program was funded through First 5 California and aimed to provide services to families with children from birth to 5 years of age in seven unique school districts in Stanislaus County. The aim of the program was to help increase the school readiness of children in high poverty, high minority school districts. This included academic, social, and emotional readiness. The study involved a longitudinal investigation of program impact, as well as a comparison of best practices across school districts. Drs. Jamie McCreary, Harold Stanislaw, and Jennifer Esterly, California State University, Stanislaus.