Prof. Dr. Steffi Pohl

IMG_hp

Methods and Evaluation / Quality Assurance

Professor

Address Habelschwerdter Allee 45
14195 Berlin
Telephone +49 (0)30 838 - 62 926
Email steffi.pohl@fu-berlin.de

Office hours

Thursday: 3 pm - 5 pm.

To register, please email.

Professional career

  • 2014 (September-October): Visiting Scientist at the Educational Testing Service, Princeton, NJ, USA
  • Since October 2013: Junior Professor of Methods and Evaluation/Quality Assurance, Department of Education and Psychology, Freie Universität Berlin
  • 2009-2013: Research Associate, Professorship of Psychology Focusing on Methods of Empirical Education Research (Dr. Claus Carstensen, Professor), National Education Panel Study (NEPS) project, Otto-Friedrich-Universität Bamberg 
  • 2005-2009: Research Associate, Department of Methodology and Evaluation Research (Dr. Rolf Steyer, Professor), Friedrich-Schiller Universität Jena
  • 2008 (September-Oktober): research stay working with Thomas D. Cook, Northwestern University, Evanston, IL, USA
  • 2007: Research Associate, kompetenztest.de project (Dr. Christof Nachtigall), Friedrich-Schiller-Universität Jena
  • 2004-2005: Research Associate, SPSSinteraktiv e-learning project (Dr. Renate Soellner, Professor), Freie Universität Berlin
  • 2004: Research Associate (substitute) at the Methods of Psychology Division (Dr. Albrecht Iseler, Professor), Freie Universität Berlin

Education

  • 2005-2010: Doctorate, dissertation topic “Modeling Method Effects,” Friedrich-Schiller-Universität Jena (advisor: Rolf Steyer)
  • 2002-2003: Study program, “MSc Research Methods in Psychology,” University of Hertfordshire, UK
  • 1998-2004: Study program toward the degree of Diplom in psychology at Freie Universität Berlin  

Awards and Distinctions

  • 2011: Gustav A. Lienert Dissertation Award from the Methods and Evaluation Group of the German Psychological Society (DGPs)

Memberships

Treasurer of the Board of the Methods and Evaluation Group of the German Psychological Society (DGPs) (since September 22, 2011)

European Association of Methodology (EAM)

German Psychological Society (DGPs)    

National Council on Measurement in Education (NCME)

Institute for longitudinal educational research (INBIL)

Lectures

  • SS 2016 Lecture "Research Methods II" (FU Berlin)

  • SS 2016 Seminar "Quantitative Research Methods II" (FU Berlin)

  • WS 15/16 Lecture "Research Methods" (FU Berlin)

  • WS 15/16 Seminar "Introduction to Quantitativ Research Methods" (FU Berlin)

  • SS 2015 Lecture "Research Methods II" (FU Berlin)

  • SS 2015 Seminar "Statistics using R II" (FU Berlin)

  • WS 14/15 Lecture "Research Methods" (FU Berlin)

  • WS 14/15 Advanced Quantitative research methods using R (FU Berlin)

  • WS 14/15 Quantitative research methods using R (FU Berlin)

  • SS 2014 Seminar "Quantitative research methods using R" (FU Berlin)

  • SS 2014 Statistics II (FU Berlin)

  • WS 13/14 Quantitative research methods using R (FU Berlin)

  • SS 2013 Seminar "Latent variable modeling" (together with C. Carstensen, University of Bamberg)

  • WS11/12  Seminar "Multivariate statistics" (University of Bamberg)

  • SS 2011  Seminar "Structural equation modeling" (University of Bamberg)

  • WS 10/11 Seminar "Multivariate statistics" (University of Bamberg)

  • SS 2010  Seminar "Structural equation modeling" (University of Bamberg)

  • SS 2009  Seminar "Adjustment with propensity-score matching II" (University of Jena)

  • WS 08/09  Seminar "Adjustment with propensity-score matching I" (University of Jena)

  • WS 07/08  Lecture "Methodology" (University of Jena)

  • WS 06/07  Lecture "Methodology" (together with S. Hartenstein, University of Jena)

  • SS 2006  Lecture " Multivariate statistics" (together with S. Hartenstein, University of Jena)

  • WS 05/06  Lecture "Methodology" (together with S. Hartenstein, University of Jena)

  • SS 2005  Seminar "Structural equation models" (University Jena)

  • SS 2004  Seminar "Structural equation models" (Freie Univeristät Berlin)

Workshops

  • 2013, July: Workshop "Längsschnittanalysen und Mehrgruppenmodelle in Mplus ", Higher Education Information System, Hannover
  • 2013, June: Workshop "Einführung in Strukturgleichungsmodellierung mit Mplus ", Vienna University of Economics and Business, Austria
  • 2013, March: Workshop "Causal inference in nonrandomized studies", Spring School on Educational Measurement, Jena (with Marie-Ann Sengewald)
  • 2013, March: Workshop „Längsschnittanalysen in Mplus “, Institute for Educational Quality Improvement (IQB), Berlin
  • 2013, March: Workshop „Strukturgleichungsmodellierung in Mplus“, Institute for Educational Quality Improvement (IQB), Berlin
  • 2012, November: Workshop "Strukturgleichungsmodellierung in Mplus ", Higher Education Information System, Hannover
  • 2012, May: Workshop „Multi-Stage Testing“ for the Graduate School "Education and Capabilities", Institute for School Development Research, Dortmund
  • 2012, March: Workshop „Longitudinal analyses in Mplus “, Institute for Educational Quality Improvement, Berlin
  • 2012, March: Workshop „Strukturgleichungsmodellierung in Mplus“, Institute for Educational Quality Improvement (IQB), Berlin
  • 2012, February: Workshop „Einführung in SEM & Längsschnittanalysen in Mplus“, department for Methods and Evaluation, Hildesheim
  • 2012, January: Workshop „ Mplus für Fortgeschrittene“, Institute for Educational Quality Improvement (IQB), Berlin
  • 2011, September: Workshop "Modeling longitudinal data with Mplus ", conference of the department "Methods and Evaluation", Bamberg
  • 2011, September: Workshop "Structural equation modeling with Mplus Institute for Educational Quality Improvement (IQB), Berlin
  • 2011, January: Workshop "Structural equation modeling with Mplus ", Institute for Educational Quality Improvement (IQB), Berlin
  • 2010, October: Workshop "Modeling longitudinal data with HLM", Summer School on methods of empirical teaching and learning research, Zentralinstitut für Lehr-Lernforschung (ZiLL), Nürnberg
  • 2010, July: Workshop "Structural equation modeling for advanced users" for the research group and graduate college of science education (nwu), University Duisburg-Essen.
  • 2010, May: Workshop " Structural equation modeling with Mplus ", Geographic Institute, Humboldt Universität zu Berlin
  • 2010, February: Workshop "Structural Equation Modeling with Mplus ", Project week of the DGP priority program "Competence Models for Assessing Individual Learning Outcomes and Evaluating Processes ", Berlin
  • 2010: Workshop "Scaling with ConQuest", Institute for Science and Mathematics Education (IPN), Kiel (with C. Carstensen)
  • 2009, November: Workshop "Structural equation modeling", colloquium for Ph.D. students of biological psychology, Otto-Friedrich-University Bamberg
  • 2006: Workshop "Introduction to the analysis of causal effects", Friedrich-Schiller-University Jena (with R. Steyer and U. Kröhne)

Research interests

  • Latent variable modeling (models of Item Response Theory, structural equation modeling)
  • Longitudinal analyses
  • Causal inference

Research Projects

Head of Project: Steffi Pohl

Project Staff: tba

Funding: Deutsche Forschungsgemeinschaft (DFG; German Research Foundation) (PO1655/3-1)

Duration: 2016-2019

Head of project: Steffi Pohl, Claus H. Carstensen, Christian Assmann

Project Staff FU Berlin: Eric Stets

Fundingng: Deutsche Forschungsgemeinschaft (DFG; German Research Foundation) within the priority programme "Education as a Lifelong Process" (PO1655/2-1)

Duration: 2015-2018

Subproject TP5: Qualificatory programm for young academics in teacher education

Heads of Subproject: Rainer Watermann, Steffi Pohl

Project Staff: Johanna Hildebrandt

Funding: As part of the national and federal project „Qualitätsoffensive Lehrerbildung“, funded by the Federal Ministry of Education and Research

Duration: 2015-2018

Completed Projects

Heads of project: Steffi Pohl, Claus H. Carstensen

Funding: Deutsche Forschungsgemeinschaft (DFG; German Research Foundation) within the priority programme "Education as a Lifelong Process" (PO1655/1-1)

Duration: 2012-2015

Publications

Journal Articles

  • Pohl, S., Südkamp, A., Hardt, K., Carstensen, C. H., & Weinert, S. (2016). Testing Students with Special Educational Needs in Large-Scale Assessments – Psychometric Properties of Test Scores and Associations with Test Taking Behavior. Frontiers in Psychology 7:154. doi: 10.3389/fpsyg.2016.00154
  • Aßmann, C., Gaasch, C., Pohl, S., & Carstensen, C. H. (2015). Bayesian estimation in IRT models with missing values in background variables. Psychological Test and Assessment Modeling, 57, 595-618.

  • Köhler, C., Pohl, S., & Carstensen, C. H. (2015). Investigating mechanisms for missing responses in competence tests. Psychological Test and Assessment Modeling, 57, 499-522.

  • Südkamp, A., Pohl, S., & Weinert, S. (2015). Competence assessment of students with special educational needs - Identification of appropriate testing accommodations. Frontline Learning Research, 3 (2), 1-25. doi:10.14786/flr.v3i2.130

  • Köhler, C., Pohl, S., & Carstensen, C. H. (2014). Taking the missing propensity into account when estimating competence scores – Evaluation of IRT models for non-ignorable omissions. Educational and Psychological Measurement, 1, 1-25. doi: 10.1177/0013164414561785
  • Haberkorn, K., Lockl, K., Pohl, S., Ebert, S., & Weinert, S. (2014). Metacognitive knowledge in children at early elementary school. Metacognition and Learning. 9, 239-263. doi:10.1007/s11409-014-9115-1

  • Pohl, S., Gräfe, L., & Rose, N. (2014). Dealing with omitted and not reached items in competence tests - Evaluating approaches accounting for missing responses in IRT models. Educational and Psychological Measurement, 74, 423-452.

  • Pohl, S. (2014).  Longitudinal multi-stage testing. Journal of Educational Measurement, 50, 447-468.

  • Pohl, S., & Carstensen, C. (2013). Scaling the competence tests in the National Educational Panel Study – Many questions, some answers, and further challenges. Journal of Educational Research Online, 5, 189-216.

  • Raykov, T., & Pohl, S. (2013). Essential unidimensionality examination for multi-component scales: An interrelationship decomposition approach. Educational and Psychological Measurement, 73, 581-600.

  • Raykov, T., & Pohl, S. (2013). On studying common factor variance in multiple component measuring instruments. Educational and Psychological Measurement, 73, 191-209.

  • Cook, T. D., Pohl, S., & Steiner, P. M. (2011). Die relative Bedeutung der Kovariatenwahl, Reliabilität und Art der Datenanalyse für die Schätzung kausaler Effekte aus Beobachtungsdaten. Zeitschrift für Evaluation, 10, 203-224.

  • Cook, T. D., Steiner, P. M., & Pohl, S. (2010). Assessing how bias reduction is influenced by covariate choice, unreliability and data analytic mode: An analysis of different kinds of within-study comparisons in different substantive domains. Multivariate Behavioral Research, 44, 828-847.

  • Pohl, S., & Steyer, R. (2010). Modelling common traits and method effects in multitrait-multimethod analysis. Multivariate Behavioral Research, 45, 1-28.

  • Pohl, S., Steiner, P. M., Eisermann, J., Soellner, R., & Cook, T. D. (2009). Unbiased causal inference from an observational study: Results of a within-study comparison. Educational Evaluation and Policy Analysis, 31, 463-479.

  • Vautier, S., & Pohl, S. (2009). Bipolarity of latent change in STAI scores. Psychological Assessment, 21, 187-193.

  • Pohl, S., Steyer, R., & Kraus, K. (2008). Modelling method effects as individual causal effects. Journal of the Royal Statistical Society, Series A, 171, 41-63.

Guest Editing

  • Pohl, S., & Aßmann, C. (2015). Missing values in large scale assessment studies [Special issue]. Psychological Test and Assessment Modeling, 57.

Book Chapters

  • Aßmann, C., Carstensen, C. H., Gaasch, C., & Pohl, S. (2016). Estimation of plausible values considering partially missing background information: A data augmented MCMC approach. In H.-P. Blossfeld, J. von Maurice, M. Bayer, J. Skopek (Eds.), Methodological Issues of Longitudinal Surveys (pp. 503-521). Wiesbaden: Springer VS
  • Südkamp, A., Pohl, S., Heydrich, J., & Weinert, S. (2016). Including students with special educational needs in the competence assessment – Results on the comparability of test scores in reading. In H.-P. Blossfeld, J. von Maurice, M. Bayer, J. Skopek (Eds.), Methodological Issues of Longitudinal Surveys (pp. 485-501). Wiesbaden: Springer VS
  • Haberkorn, K., Pohl, S., Carstensen, C., & Wiegand, E. (2015). Scoring of complex multiple choice items in NEPS competence tests. In H.-P. Blossfeld, J. von Maurice, M. Bayer, J. Skopek (Eds.), Methodological Issues of Longitudinal Surveys (pp. 523-540). Wiesbaden: Springer VS.
  • Pohl, S., & Steyer, R. (2012). Modeling traits and method effects as latent variables. In Salzborn, S., Davidov, E., & Reinecke, J. (Eds.). Methods, theories, and empirical applications in the social sciences – Festschrift for Peter Schmidt (pp. 57-65). Wiesbaden: Springer VS.
  • Rose, N., Pohl, S., Böhme, H. F., & Steyer, R. (2010). Strukturgleichungsmodelle. In H. Holling & B. Schmitz (Hrsg.), Handbuch Statistik, Methoden und Evaluation (pp. 600-611). Göttingen: Hogrefe.
  • Nachtigall, N., Pohl, S., & Hartenstein, S. (2010). Univariate deskriptive Statistik. In H. Holling & B. Schmitz (Hrsg.), Handbuch Statistik, Methoden und Evaluation (pp. 275-287). Göttingen: Hogrefe.

Technical Reports

  • Aßmann, C., Carstensen, C. H., Gaasch, C., & Pohl, S. (2014). Estimation of plausible values using background variables with missing values: A data augmented MCMC approach. (NEPS Working Paper No. 38). Bamberg: Leibniz Institute for Educational Trajectories, National Educational Panel Study.
  • Pohl, S., Haberkorn, K.,& Hardt, K., (2014). NEPS Technical Report for Reading – Scaling results of starting cohort 5 for first-year students in main study 2010/11. (NEPS Working Paper No. 34). Bamberg: Leibniz Institute for Educational Trajectories, National Educational Panel Study.

  • Hardt, K., Pohl, S., Haberkorn, K., & Wiegand, E. (2013). NEPS Technical Report for Reading – Scaling results of Starting Cohort 6 for adults in main study 2010/11 (NEPS Working Paper No. 25). Bamberg: Otto-Friedrich-Universität, Nationales Bildungspanel.

  • Haberkorn, K., Pohl, S., Hardt, K., & Wiegand, E. (2012). NEPS Technical Report for Reading – Scaling results of starting cohort 4 in ninth grade(NEPS Working Paper No. 16). Bamberg: Otto-Friedrich-Universität, Nationales Bildungspanel.
  • Pohl, S., Haberkorn, K., Hardt, K., & Wiegand, E. (2012). NEPS Technical Report for Reading – Scaling results of starting cohort 3 in fifth grade (NEPS Working Paper No. 15). Bamberg: Otto-Friedrich-Universität, Nationales Bildungspanel.
  • Pohl, S. & Carstensen, C. (2012). NEPS Technical Report  – Scaling the data of the competence tests (NEPS Working Paper No. 14). Bamberg: Otto-Friedrich-Universität, Nationales Bildungspanel.