Data Collection Guide

Checking Your Study and Data During Data Collection

  1. When your study is on production, you will receive an email from Rick Klein. At that time, test your study from start to finish on dev1. The dev1 link for your study is exactly the same as the dev2 link you were using to test before, except the https is http. Email Rick Klein immediately if errors are detected.
  2. Watch completion rates using https://app-dev-01.implicit.harvard.edu/implicit/research/pitracker/PITr... to detect any unusual patterns suggesting errors in the study. Simply replace "YourStudy with the name of your study.
  3. After a couple of days, download data from production and analyze it.  Confirm that all variables are present as expected.  Email Andy immediately if errors are detected

Managing Participants

  1. You are responsible for responding to participant questions and comments. Read here for the expectations about these responses, and some templates for frequently asked questions.
  2. Participants may request the results of your study. Read here for recommendations on how to communicate your findings to participants.
  3. You can also track participant pool completion.

When Your Study is Taken Down

Your study will be taken down when it fulfills one of the following conditions:

  1. Your study reaches its planned sample size.
  2. If the completion rate is < 10% and the number of sessions started is >= 30 but < 50.
  3. If the completion rate is < 33% and the number of sessions started is >= 50 but < 100.
  4. If the completion rate is < 50% and the number of sessions started is >= 100 but < 400.
  5. If the completion rate is < 60% and the number of sessions started is >= 400.

If your study fulfills #1:

  • When this happens, please submit a study removal request.
  • If you fulfill #1 but would like more participants, please email studysubmission@projectimplicit.net with a rationale for why you'd like to collect more participants. If Calvin approves, please submit a study change request to indicate what files you changed and to request that the study be run again. In that case, please remember to indicate your new target number of participants.
  • If you fulfill #1 but it appears to be an error (e.g., due to typing in target N = 40 instead of 400 in the study submission form), please email Rick Klein at raklein@ufl.edu to add additional participants. 

If your study fulfills #2 - #5:

  • When this happens, please submit a study removal request.
  • If you would like to put the study up again, you will need to modify it to improve retention rates. If you do so, inform studysubmission@projectimplicit.net  about your modifications and request his review. When you have approval, submit a study change request to indicate what files you changed and to request that the study run again. In that case, please remember to indicate your new target number of participants.
  • Resubmit your study under the Change Request and be sure to also change the study id (For example, yourstudy could be changed to yourstudyb). If you do not change the study id for your revised study, the completion rates for your study will continue to account for prior incomplete sessions resulting in an inaccurate measure of your study's performance.

 When Your Study is Done Collecting Data

  1. Please submit a study removal request.
  2. You will then want to go to the Data Access & Analysis page to learn what to do next.