Foundational study
Disciplinary Differences in AI Verification
How do engineers and designers differ in their use, perceptions, and verification of GenAI systems?
Foundational study
How do engineers and designers differ in their use, perceptions, and verification of GenAI systems?
When individual and group decisions produce different outcomes, how does peer pressure change whose judgment guides the group’s response to GenAI?
Main study · Current phase
How does a teammate’s agreement or disagreement change the subjective decisions people make with GenAI?
A survey of 117 upper-level engineering and design students compared GenAI use, trust, confidence, and verification expectations.
Built the survey using a combination of validated measures and study-specific questions tailored to the constructs and research questions.
Two researchers independently coded responses using a structured codebook, resolved discrepancies, and recoded until reaching at least 80% agreement.
Graduate students (50+) first make subjective business decisions with ChatGPT recommendations independently, then revisit them after discussing with a teammate.
Conducted 10 pilot sessions before the main study, using each round to refine the experimental flow, materials, timing, instructions, and interaction protocol.
Developed and iteratively calibrated a scripted participant (confederate) protocol to standardize behavior, responses, timing, and interpersonal presentation across experimental sessions.
Created and delivered standardized training so participants understood the task, decision process, and experimental procedure before beginning the study.
Combined validated survey measures with study-specific items designed to capture the constructs central to the research questions.
Developed a structured codebook with definitions, decision rules, and examples. Multiple researchers will code the qualitative data independently, check agreement, resolve disagreements, refine the codebook when needed, and recode until they reach an acceptable level of agreement.
Engineers and designers used and valued GenAI similarly, but engineers expected stronger verification. This distinction showed that individual GenAI use could not explain what happens when people use and evaluate GenAI together.
The study measures changes in decisions, confidence, and intention to seek additional information after discussion. Data collection and analysis are ongoing; findings will be added when the evidence is ready.
Dated reflections on consequential changes in the research—not a forced weekly timeline
These are draft placeholders. Notes can be added, removed, or reordered whenever the research evolves.