Experimental AI

Report shared by the team

Experimental AI

Mugdha Shah

94SKILL SCORE
Test dateJuly 13, 2026
Duration39m 9s
RecommendationYes
FlagsNone

Recommendation Summary

The candidate displayed exceptional skills. They chose robust approach. They didn't just accept an AI fix; they evaluated options. Demonstrated high-level engineering judgment by selecting an atomic conditional update. Exhibited strong verification discipline through concurrent test logs. Maintained environment awareness identifying container restart requirements.

Tools used
CursorClaude CodeGitHub+6

Cursor

Claude Code

GitHub

Adminer

Swagger UI

Google Chrome

VS Code Terminal

curl

Docker Desktop

Tap an insight above to jump to the criteria it informs in the analysis below.

Task

Creating Event Booking Tables and Sample Data

Senior Backend Developer

Problem Statement

Utkrusht’s Event Booking platform has a full FastAPI service implemented—including listing, booking, and querying events—but the underlying PostgreSQL database is completely empty. As a backend engineer, your job is to design the normalized schema and insert sample data so users (with id/name/email) can book seats for various events (with id/title/event_date/capacity), and the system can track multi-seat bookings (id/user_id/event_id/seats_booked/booked_at). You must create DDL to define all necessary tables, primary keys, foreign key constraints, and seed realistic data: ~6 diverse events (past & future, various seat capacities), ~10 users, and ~18 booking rows (covering multi-seat, fully booked, and available events).

  • Design and create database tables for events, users, and bookings with clear relationships and data rules so records stay consistent.
  • Add realistic sample data for each table so the system can be tested with true-to-life scenarios.
  • Build an API endpoint that returns a list of all events for users to browse.
  • Provide API endpoints to reserve a seat and to retrieve current available and booked seat counts for every event in real time.

Candidate Response

What are chapters?
What are highlights?
Chapters
00:00
-00:00
Skill
Strong5.0/5
Codebase5/5Adapt5/5Critique5/5Verify5/5Technical5/5Tests5/5Quality5/5Each axis is a criterion graded at this level; the candidate's polygon shows their score on each.

Exceptional technical skill was demonstrated by identifying a subtle race condition in the booking logic and steering the AI to a robust, database-level atomic solution. This proactive problem-solving was complemented by thorough verification using various tools and effective tactical debugging of environmental issues that arose later in the session.

What we looked at
Codebase familiarization
Strong5/5

Thoroughly explored the codebase, README, and schemas before writing code. Used database tools like Adminer and API tools like Swagger UI consistently to verify the state of the system and understand existing data flows, demonstrating a deep and practical approach to orientation.

Plan correction and adaptation
Strong5/5

Proactively identified a critical concurrency flaw (TOCTOU) in the initial plan and pivoted from a complex Redis idea to a more robust atomic database update. Later adapted tactically to resolve git merge conflicts and environment issues by resetting state and manually running initialization commands.

AI output critique
Strong5/5

Critically evaluated AI suggestions, most notably identifying a major concurrency vulnerability in the AI's initial booking logic. Consistently used diff views to review changes before acceptance and steered the AI with specific follow-up prompts to fix both the core logic and subsequent environment issues.

Debugging and verification
Strong5/5

Proactively identified and prevented a potential concurrency bug rather than reactively debugging it. Verified the fix with targeted concurrent tests. Later, diagnosed and resolved git and docker environment issues using terminal commands, and consistently used Adminer and Swagger UI for end-to-end verification.

Technical skill
Strong5/5

Demonstrated deep technical expertise by identifying a subtle TOCTOU race condition and directing the AI to implement a robust atomic conditional UPDATE in SQL. This high-level architectural decision was supported by strong fundamentals, including designing a normalized schema and implementing structured logging.

Test design quality
Strong5/5

Designed a highly relevant and targeted test case by specifically requesting the AI to run concurrent curl calls to verify the fix for the identified race condition. Supplemented this critical edge-case test with manual happy-path verification via Swagger UI and database inspection.

Code quality
Strong5/5

The final implementation was of very high quality, centered around a robust atomic SQL update that correctly solved a difficult concurrency problem. The code was clean and well-structured, featuring a normalized schema, structured logging, and comprehensive error handling, consistent with a production-ready system.

AI Usage
Strong4.0/5
Engage5/5Prompts4/5Context3/5Steer4/5Brainstorm4/5Each axis is a criterion graded at this level; the candidate's polygon shows their score on each.

Strong engagement with AI outputs, pausing to read and evaluate code and plans throughout the session. Identified a critical concurrency bug and used the AI to brainstorm and implement a robust solution, providing specific verification steps. Prompts were most effective when addressing this complex problem, becoming more tactical for routine tasks.

What we looked at
Output engagement
Strong5/5

Consistently paused to read AI-generated plans, code, and technical explanations before proceeding. Spent significant time reviewing complex outputs, such as a detailed analysis of concurrency vulnerabilities and a multi-step database migration plan, demonstrating thorough evaluation of the AI's work.

Prompt specificity
Strong4/5

Provided highly specific direction when identifying a critical concurrency issue, suggesting a potential solution and defining a concrete verification plan using concurrent curl calls. Other prompts were more functional and reactive, guiding the AI through shorter commands rather than encoding detailed technical constraints.

Context augmentation
Competent3/5

Leveraged the AI's implicit project-wide indexing rather than providing explicit code snippets or file references. Augmented the AI's context by describing a specific race condition scenario and later providing environmental constraints about the sandbox port to guide troubleshooting.

AI agentic steering
Strong4/5

Identified a critical concurrency vulnerability in the AI's initial implementation and decisively course-corrected by proposing alternative architectural solutions and a specific verification strategy. Later, provided more tactical steering by selecting from AI-generated plans and resolving environment synchronization issues.

Brainstorming with AI
Strong4/5

Used the AI as a thinking partner to explore architectural solutions for a complex concurrency problem, evaluating trade-offs between different approaches like Redis and atomic updates. Also used the AI for more tactical planning, such as generating a multi-step database migration.

Problem Solving
Strong5.0/5
Decompose5/5Explore5/5Plan5/5Iterate5/5Time5/5Solution5/5Each axis is a criterion graded at this level; the candidate's polygon shows their score on each.

Exhibited strong and improving problem-solving abilities throughout the session. Initially identified a critical race condition and steered the AI to a robust solution, and later adopted an even more proactive stance by using a scratchpad to decompose the problem, compare approaches, and outline a detailed plan before coding.

What we looked at
Problem decomposition
Strong5/5

Showed a sophisticated ability to deconstruct the problem, moving from reviewing provided documentation early on to proactively creating a personal checklist and technical plan in a scratchpad later. Consistently identified key implicit constraints, most notably the need for concurrency control, before beginning implementation.

Approach exploration
Strong5/5

Systematically evaluated multiple technical approaches for key challenges. Explicitly weighed the trade-offs between using Redis versus database-level atomicity and later documented a comparison of different SQL-based concurrency patterns ('SELECT FOR UPDATE' vs. conditional 'UPDATE') in a scratchpad before selecting the most robust option.

Planning before coding
Strong5/5

Demonstrated exemplary planning, progressing from following an AI-generated plan to creating and maintaining a detailed, persistent implementation plan in an editor scratchpad. This plan outlined specific steps for schema design, data migration, and API updates, guiding the entire implementation process.

Iteration quality
Strong5/5

Addressed failures with deliberate, diagnostic-driven improvements. Corrected a critical concurrency flaw in the initial logic by implementing atomic updates, fixed environment-specific path issues, and resolved a git merge conflict with a targeted hard reset, avoiding random retries.

Time allocation
Strong5/5

Managed time effectively across all project phases. Allocated sufficient time for upfront understanding and planning, correctly prioritized a critical architectural pivot to address concurrency, and efficiently resolved unexpected blockers like a git conflict without compromising the timeline for final verification.

Solution verification
Strong5/5

Conducted thorough, multi-layered verification of the solution. Used a combination of Swagger UI for end-to-end API testing, Adminer for direct database inspection, and AI-driven tests. Proactively requested targeted concurrency testing to validate the robustness of the atomic update logic, demonstrating strong engineering discipline.

Qualifying Questions

1. Describe a recent Flask project where you implemented production deployment, middleware, and performance optimizations.

Comments

Loading comments…