Survey Tips: Implementing a Successful Pop-Up Survey

R
Rachel Kumar , Survey Optimization Writer

You know the scenario: you visit a website, and within seconds, a pop-up appears asking for your feedback. Your first instinct? Click that X button as fast as possible. But here’s the paradox—when done right, pop-up surveys are one of the most effective ways to capture valuable customer insights, boasting response rates of 10-30% compared to 2-5% for more passive feedback methods.

The key difference between an annoying interruption and a valuable engagement tool comes down to strategy. In this comprehensive guide, we’ll explore how to implement pop-up surveys that collect actionable feedback without frustrating your website visitors.

What Are Pop-Up Surveys?

A pop-up survey (also called an on-site survey, on-page survey, or survey widget) is a type of customer feedback survey that appears as a pop-up window or overlay on a webpage or within a mobile application. Unlike traditional surveys sent via email or SMS, pop-up surveys capture feedback in real-time while visitors are actively engaged with your site or product.

Key characteristics:

  • Appear directly on your website or app
  • Triggered by specific user behaviors
  • Typically short (1-3 questions)
  • Provide immediate, contextual feedback
  • Don’t require email addresses or leaving the page

Why Pop-Up Surveys Work (When Done Right)

Despite their reputation for being annoying, pop-up surveys offer unique advantages that make them invaluable for collecting customer feedback.

Real-Time Insights

Pop-up surveys capture feedback exactly when customers are engaged with your product, providing businesses with real-time insights into customer opinions, preferences, and pain points. This in-the-moment feedback is more accurate than asking customers to recall their experience days later via email.

Superior Response Rates

Pop-up surveys generate far higher engagement than other feedback methods. Their positioning and unique placement make them difficult to ignore, resulting in response rates that easily reach 10-30%, compared to 20-30% for email surveys (which most people never open) and just 2-5% for passive feedback buttons.

Cost-Effective and Scalable

Pop-up surveys cost much less than conventional forms or questionnaires in both labor and money. Once implemented, survey pop-ups work without any extra effort from your end—visitors don’t need to communicate with anyone from your office to complete the survey.

Contextual Relevance

You can trigger different pop-up surveys to different visitors based on pages visited, actions performed, traffic source, language, demographics, and more. This ensures you collect exactly the insights you need from the people who have those insights.

Universal Reach

Pop-ups have the ability to reach all visitors to your site, not just those who have visited your physical store or who are in your email database. This significantly expands your potential feedback pool.

No Interruption to User Flow

Unlike intercept surveys that redirect users to another page, pop-up surveys keep respondents on your page as they answer questions. More time on your page means more conversions.

The Critical Success Factors

1. Define Clear Objectives First

Before creating a single pop-up, know exactly what you want to learn. The clarity of your objective determines everything else—from question design to trigger timing.

Ask yourself:

  • What specific question am I trying to answer?
  • Have I identified a bottleneck where visitors start leaving?
  • Am I trying to understand why cart abandonment happens?
  • Do I need to gauge satisfaction with a new feature?
  • Am I unsure about the seamlessness of my onboarding?

Common use cases:

  • Measure user satisfaction (NPS, CSAT, CES surveys)
  • Understand cart abandonment reasons
  • Identify website usability issues
  • Prioritize feature development
  • Collect product feedback
  • Understand visitor demographics and goals
  • Gauge content relevance
  • Identify support documentation gaps

2. Master the Art of Timing

Timing is everything with pop-up surveys. A pop-up that triggers too soon can feel disruptive and may even reduce engagement. The goal is to display the survey while visitors are still engaged, but not when it could disturb them from their current course of action.

The 15-30 Second Rule: Wait until visitors have scrolled at least halfway or stayed for 15-30 seconds before triggering a survey. The average website visitor spends less than 15 seconds on a page initially, so give them time to engage with your content first.

Strategic Trigger Types

Time-Based Triggers

After page load with delay: The popup appears after the page load completes with a set time delay (e.g., 20-30 seconds), ensuring it doesn’t disrupt the initial user experience.

Best for: General website feedback, satisfaction surveys Optimal timing: 20-30 seconds after page load Example: “How would you rate your experience on our site today?”

Scroll Depth Triggers

Scroll percentage: Trigger when a visitor scrolls 50%, 75%, or to the bottom of a page.

Best for: Content engagement surveys, article feedback Optimal timing: After 50-75% scroll depth Example: “Did you find this article helpful?”

Why this works: Users who scroll this far are genuinely engaged with your content and more likely to provide thoughtful feedback.

Exit-Intent Triggers

Exit-intent pop-ups appear when the system detects that a user is leaving the page. On desktop, the technology monitors cursor movements—when it detects the cursor moving toward the browser’s back button or close button, the survey triggers.

Best for:

  • Understanding cart abandonment
  • Identifying conversion barriers
  • Capturing last-minute feedback before visitors leave

Desktop indicators:

  • Cursor moves toward the ‘X’ button
  • Cursor moves toward the back button
  • Cursor moves to the URL bar

Mobile indicators (different from desktop):

  • Scrolling up (brings back the URL bar)
  • Pressing the back button
  • Switching tabs
  • Idle timeout (no action for a set period)

Example questions:

  • “What stopped you from completing your purchase today?”
  • “Why are you leaving? We’d love to improve!”
  • “What were you looking for that you couldn’t find?”

Pro tip: Exit-intent surveys are most effective on high-stakes pages like checkout, pricing pages, or key landing pages.

Action-Based Triggers

After specific actions: Trigger surveys after users complete particular actions like making a purchase, using a search bar, adding items to cart, or using specific features.

Best for: Post-purchase feedback, feature satisfaction Examples:

  • After purchase: “How satisfied are you with your checkout experience?”
  • After search: “Did you find what you were looking for?”
  • After feature use: “How helpful was this feature?”

Page-Specific Triggers

Target specific pages: Display surveys only on certain pages like product pages, checkout, blog posts, or pricing pages.

Best for: Page-specific feedback, conversion optimization Example: On a pricing page: “Do you have any questions about our pricing?”

Segment-Based Triggers

User characteristics: Target based on visitor type (new vs. returning), purchase history, device type, geographic location, or traffic source.

Best for: Personalized feedback, targeted insights Examples:

  • New visitors: “What brought you to our site today?”
  • Returning customers: “What keeps you coming back?”
  • Mobile users: “How is your mobile experience?”

Design Principles for Non-Annoying Pop-Ups

Keep It Short and Sweet

Pop-up surveys should be composed of only one or two questions. Users expect survey pop-ups to be short—this is a key factor in reaching high response rates.

Guidelines:

  • 1 question: Ideal for most pop-ups
  • 2-3 questions: Maximum before users lose interest
  • 5 minutes total: Never exceed this time commitment

Make the Close Button Obvious

One of the fastest ways to annoy visitors is making it difficult to dismiss your pop-up. Always provide a clearly visible and accessible close button so users can opt-out without feeling trapped.

Best practices:

  • Place X button in top-right corner (standard location)
  • Make it large enough to click easily (especially on mobile)
  • Use high-contrast colors so it’s visible
  • Don’t hide it or make it tiny
  • Consider adding a “No thanks” or “Maybe later” text option

Choose the Right Placement

Bottom corner (recommended): Appears in the bottom-left or bottom-right corner of the screen. This placement attracts attention without blocking important content.

Side pop-up: Slides in from the side. Less intrusive than full overlays.

Modal overlay (use sparingly): Centers on the page with a dimmed background. More attention-grabbing but also more disruptive—reserve for critical surveys only.

Avoid: Full-screen takeovers unless absolutely necessary (exit-intent offers can work here).

Design for Visibility Without Obstruction

Your pop-up should be easily visible but shouldn’t intercept what a customer can do on your website. Annoying and obtrusive designs can lead to inaccurate data or website exits.

Design tips:

  • Use contrasting colors that stand out from your site
  • Avoid making the entire pop-up white if your site is white
  • Include your logo for brand trust
  • Use clear, readable fonts
  • Ensure mobile responsiveness
  • Test on multiple devices and screen sizes

Use Conversational Language

Your pop-up survey should use simple, friendly words that feel natural to read and answer. Visitors respond more honestly when questions sound conversational rather than like a corporate interrogation.

Good: “Did you find what you were looking for today?” Bad: “Evaluate your navigational success rate.”

Tips:

  • Avoid jargon and technical phrases
  • Use second person (“you,” “your”)
  • Ask questions you would ask face-to-face
  • Keep tone friendly and approachable
  • Be specific, not vague

Add Visual Appeal

Use visuals with two-step pop-up surveys to make them more engaging. With visuals, you can also add important CTAs to capture quality leads while collecting customer feedback.

Visual elements to consider:

  • Brand colors and styling
  • Icons or emojis for rating scales
  • Images related to your question
  • Progress indicators for multi-question surveys
  • Highlighted CTA buttons

Crafting Effective Survey Questions

Question Type Selection

Multiple choice: Quick to answer, easy to analyze, great for specific options.

  • “How did you hear about us?” (with preset options)

Single choice (radio buttons): Forces a clear decision, good for preferences.

  • “Which feature is most important to you?”

Rating scales: Excellent for satisfaction and likelihood metrics.

  • 1-5 stars: “How would you rate your experience?”
  • 0-10 scale: “How likely are you to recommend us?” (NPS)

Open-ended text: Provides rich, qualitative insights but harder to analyze.

  • “What stopped you from completing your purchase?”
  • “What could we improve?”

Yes/No: Simple binary questions for clear answers.

  • “Did you find what you were looking for?”

Pro tip: While open-ended questions provide the most interesting insights, they have lower response rates. Consider starting with multiple choice and adding an optional “Other (please specify)” field.

Timing-Specific Questions

Welcome/Early Visit (0-10 seconds on site):

  • “What brings you to our site today?”
  • “What are you hoping to accomplish?”

Mid-Visit (30-60 seconds, after engagement):

  • “Are you finding what you need?”
  • “How would you rate your experience so far?”

Post-Purchase (right after checkout):

  • “How satisfied are you with your checkout experience?”
  • “On a scale of 0-10, how likely are you to recommend us?”
  • “What could we improve about the buying process?”

Exit Intent (about to leave):

  • “What stopped you from completing your purchase?”
  • “What were you looking for that you couldn’t find?”
  • “Before you go, can you tell us why you’re leaving?”

Post-Search (after using search function):

  • “Did you find what you were searching for?”

Feature-Specific (after using a feature):

  • “How helpful was this feature?”
  • “What would make this feature more useful?”

Avoiding Survey Fatigue: Frequency Best Practices

Nothing destroys goodwill faster than bombarding visitors with multiple pop-ups. Implement strict frequency controls to maintain a positive user experience.

The One-Per-Visit Rule

Limit frequency: Present only one popup per visit. This is the golden rule of pop-up surveys.

Implementation:

  • Use cookies or local storage to track survey displays
  • Never show the same survey twice to the same user in one session
  • Don’t show multiple different surveys during a single visit
  • Set a minimum time between survey appearances (e.g., 30 days)

Respecting Previous Respondents

Don’t spam people who have already completed your survey. Track who has responded and exclude them from seeing the same survey again.

Advanced approach: Allow users to set their own preferences for survey frequency or opt out entirely.

Segmentation Prevents Over-Surveying

If you’re running multiple surveys, use segmentation to ensure users see only the most relevant survey for them:

  • New visitors see welcome surveys
  • Cart abandoners see exit-intent surveys
  • Post-purchase customers see satisfaction surveys
  • Feature users see feature feedback surveys

Mobile Optimization

With the majority of web traffic coming from mobile devices, ensuring your pop-up survey works perfectly on smartphones is non-negotiable.

Mobile-Specific Considerations

Screen size matters: A pop-up that works on desktop may overwhelm a mobile screen. Create separate versions or use responsive design that adapts.

Touch-friendly elements:

  • Make buttons large enough for fingers (minimum 44x44 pixels)
  • Ensure adequate spacing between clickable elements
  • Make the close button easy to tap

Mobile exit-intent triggers are different:

  • Scroll up (to reveal URL bar)
  • Back button press
  • Tab switching
  • Idle timeout

Page load speed: Heavy pop-ups can slow down mobile loading. Keep file sizes small and optimize images.

Testing is crucial: Always test your pop-ups on actual mobile devices, not just emulators.

Incentives: To Offer or Not to Offer?

Nothing comes free, especially not your visitors’ time and efforts. Offering incentives can significantly boost response rates, but they must be implemented thoughtfully.

Types of Incentives

Monetary rewards:

  • Discount codes (10-20% off)
  • Gift cards or vouchers
  • Free shipping

Value-based incentives:

  • Free resources (ebooks, templates, guides)
  • Early access to new features
  • Entry into a prize draw
  • Exclusive content

Reciprocity-based:

  • “Help us improve your experience”
  • “Your feedback shapes our product”

Best Practices for Incentives

Match incentive to effort: A one-question survey needs less incentive than a five-question survey.

Be authentic: Don’t offer incentives you can’t deliver.

Don’t over-incentivize: You want genuine feedback, not people racing through for the reward.

Test with and without: A/B test incentivized vs. non-incentivized surveys to see what works for your audience.

A/B Testing Your Pop-Ups

Never settle for your first design. A/B testing helps you optimize every element of your pop-up survey for maximum engagement and valuable feedback.

Elements to Test

Timing:

  • Exit-intent vs. 20 seconds vs. 50% scroll depth
  • Immediate vs. delayed triggers

Design:

  • Full-screen modal vs. corner pop-up vs. slide-in
  • Color schemes and contrast
  • With images vs. text-only

Wording:

  • Short questions vs. detailed questions
  • Casual vs. formal tone
  • Different question phrasings

Placement:

  • Bottom-left vs. bottom-right
  • Side vs. center

Incentives:

  • With discount vs. without
  • Different incentive amounts

Question type:

  • Open-ended vs. multiple choice
  • Rating scales (1-5 vs. 1-10)

Measuring Success

Key metrics to track:

  • Response rate (percentage of users who see and complete the survey)
  • Completion rate (percentage who start and finish)
  • Survey views (how many people see it)
  • Close rate (how quickly people dismiss it)
  • Quality of responses (for open-ended questions)
  • Impact on bounce rate and time on site

Advanced Segmentation Strategies

Generic pop-ups shown to everyone get generic results. Advanced segmentation ensures you ask the right people the right questions at the right time.

Behavioral Segmentation

By page visited: Survey visitors on specific pages about that content

  • Pricing page: “Do you have questions about our plans?”
  • Blog post: “Was this article helpful?”
  • Product page: “Do you need more information?”

By action taken: Trigger based on what users do

  • Added to cart but didn’t purchase: Exit survey about concerns
  • Used search: “Did you find what you were looking for?”
  • Watched video: “Was this video helpful?”
  • Downloaded resource: “What topics would you like to learn about?”

Demographic Segmentation

By visitor type:

  • New visitors: Welcome surveys and intent questions
  • Returning visitors: Experience improvement questions
  • Customers: Satisfaction and loyalty surveys
  • Free trial users: Conversion barrier questions

By device:

  • Mobile users: Mobile experience feedback
  • Desktop users: Feature-specific questions
  • Tablet users: Different UX considerations

By location: Localize questions based on geography or language

By traffic source:

  • Organic search: Content relevance questions
  • Social media: Campaign-specific feedback
  • Paid ads: Ad expectation vs. reality
  • Direct traffic: Likely returning customers

Psychographic Segmentation

By engagement level:

  • Highly engaged (multiple page views, long time on site): Detailed feedback surveys
  • Low engagement (bounce risk): Quick exit-intent questions

By purchase history:

  • First-time buyers: Checkout experience
  • Repeat customers: Loyalty and satisfaction
  • High-value customers: Premium feedback on advanced features

Common Mistakes to Avoid

1. Triggering Too Soon

Showing a pop-up immediately when someone lands on your page is one of the fastest ways to annoy visitors. They haven’t had time to evaluate your site yet.

Solution: Wait at least 15-30 seconds or until meaningful engagement (scroll, click).

2. Making Surveys Too Long

Users expect pop-up surveys to be quick. More than 2-3 questions leads to abandonment.

Solution: Focus on your single most important question. If you need more data, use follow-up emails.

3. Difficult to Close

Hidden or tiny X buttons frustrate users and damage trust.

Solution: Make the close button obvious, large, and in the standard location (top-right).

4. Asking the Same Person Repeatedly

Nothing annoys users more than seeing the same survey multiple times after they’ve already completed it—or dismissed it.

Solution: Use cookies to track who has seen/completed surveys. Implement frequency caps.

5. Poor Mobile Experience

Pop-ups that work on desktop often fail on mobile due to size and touch interface differences.

Solution: Test extensively on mobile devices. Create mobile-specific versions if needed.

6. Blocking Critical Content

Pop-ups that cover important information (like CTAs, navigation, or key content) hurt user experience and conversions.

Solution: Use corner or side placements. If using modals, ensure they appear at natural breaking points.

7. Vague or Leading Questions

Questions like “Don’t you think our site is great?” or “How was your experience?” are too vague or biased.

Solution: Ask specific, neutral questions. “What were you hoping to find on this page?” or “On a scale of 1-5, how easy was it to find what you needed?”

8. Ignoring Survey Results

Collecting feedback without acting on it wastes everyone’s time and misses opportunities for improvement.

Solution: Analyze responses regularly. Create action items. Close the feedback loop by implementing changes and telling customers you listened.

9. No Clear Call-to-Action

Users need to know what you want them to do. Unclear buttons or instructions reduce completion.

Solution: Use clear, action-oriented button text like “Submit Feedback,” “Share Your Thoughts,” or “Send.”

10. Forgetting to Say Thank You

After someone takes time to give you feedback, acknowledge it.

Solution: Show a brief thank-you message after submission. Consider explaining how their feedback will be used.

Implementation: Technical Steps

Choosing Your Platform

Dedicated survey tools:

  • Qualaroo
  • Survicate
  • Refiner
  • Zonka Feedback
  • SurveySparrow
  • Userpilot
  • ProProfs Survey Maker

Full-featured marketing platforms:

  • HubSpot (exit-intent forms)
  • Wisepops
  • OptinMonster
  • OptiMonk

Basic options:

  • SurveyMonkey (with web embed)
  • Google Forms (with custom code)
  • Typeform (popup embed)

Basic Implementation Process

Step 1: Select your survey platform and create an account

Step 2: Design your survey

  • Write your questions
  • Choose question types
  • Design the visual appearance
  • Add your branding

Step 3: Set up triggers

  • Choose trigger type (time, scroll, exit-intent, etc.)
  • Set timing parameters
  • Define frequency caps

Step 4: Configure targeting

  • Select pages to display on
  • Set audience segments
  • Choose devices (desktop/mobile/both)

Step 5: Get your embed code

  • Most platforms provide JavaScript code
  • Copy the code snippet

Step 6: Add code to your website

  • Paste in your website’s HTML (usually in the footer)
  • Or use a tag manager (Google Tag Manager)
  • Or use a WordPress plugin

Step 7: Test thoroughly

  • Test on multiple browsers
  • Test on mobile devices
  • Ensure triggers work correctly
  • Verify data collection

Step 8: Launch and monitor

  • Start with a small percentage of traffic
  • Monitor response rates
  • Check for technical issues
  • Gradually increase exposure

Analyzing and Acting on Feedback

Collecting survey data is only the beginning. The real value comes from analysis and action.

Analyzing Quantitative Data

For rating scale questions:

  • Calculate average scores
  • Track trends over time
  • Compare across segments
  • Identify outliers

For multiple choice:

  • Calculate percentages for each option
  • Identify most common responses
  • Look for unexpected patterns

Key metrics:

  • Response rate
  • Net Promoter Score (NPS)
  • Customer Satisfaction Score (CSAT)
  • Customer Effort Score (CES)

Analyzing Qualitative Data

For open-ended responses:

  • Look for recurring themes and patterns
  • Use word clouds to identify common terms
  • Categorize responses into topics
  • Note surprising or unexpected feedback
  • Identify specific, actionable suggestions

Tools to help:

  • Sentiment analysis features
  • Word cloud generators
  • Manual categorization and tagging
  • AI-powered text analysis

Taking Action

Prioritize findings:

  1. Critical issues affecting many users
  2. Quick wins (easy to fix, high impact)
  3. Long-term improvements
  4. Nice-to-have enhancements

Create an action plan:

  • Assign ownership for each issue
  • Set timelines for implementation
  • Track progress
  • Measure impact of changes

Close the feedback loop:

  • Communicate changes to users
  • Update your website/product
  • Thank participants
  • Show how feedback led to improvements

Example: “Based on your feedback, we’ve simplified our checkout process. Thank you for helping us improve!”

Real-World Examples That Work

Example 1: Post-Purchase Satisfaction (E-commerce)

Trigger: Immediately after purchase confirmation Placement: Center modal Question: “How satisfied are you with your checkout experience?” (5-star rating) Follow-up: “What could we improve?” (optional open-ended) Why it works: Captures feedback while experience is fresh, short and easy, appears at natural completion point

Example 2: Exit-Intent Cart Abandonment (E-commerce)

Trigger: Exit intent on cart page Placement: Center modal Question: “What stopped you from completing your purchase today?” Options: “Shipping cost too high,” “Need to compare prices,” “Just browsing,” “Payment options limited,” “Other” Why it works: Captures specific reasons for abandonment, can inform immediate improvements like free shipping thresholds

Example 3: Content Feedback (Blog/Content Sites)

Trigger: 75% scroll depth on blog posts Placement: Bottom-right corner Question: “Did you find this article helpful?” Options: Yes/No, with optional “What could we improve?” Why it works: Only shown to engaged readers, doesn’t interrupt reading, helps identify valuable vs. unhelpful content

Example 4: Feature Feedback (SaaS Products)

Trigger: After using specific feature for third time Placement: Bottom-left corner Question: “How would you rate the [Feature Name]?” (1-5 scale) Follow-up: “What would make it more useful?” Why it works: User has enough experience with feature to provide meaningful feedback, improves product roadmap prioritization

Example 5: New Visitor Intent (All Sites)

Trigger: 20 seconds on homepage for first-time visitors Placement: Side slide-in Question: “What brings you to our site today?” Options: “Looking for information,” “Ready to buy,” “Comparing options,” “Other” Why it works: Helps understand visitor intent, can inform personalization, appears after user has basic orientation

Pop-Up Surveys Checklist

Use this checklist before launching your next pop-up survey:

Strategy:

  • Clear objective defined
  • Specific question identified
  • Target audience determined
  • Success metrics established

Question Design:

  • 1-2 questions maximum
  • Conversational, clear language
  • Specific, not vague
  • Unbiased wording
  • Appropriate question type selected

Timing and Triggers:

  • Optimal trigger type chosen
  • Delay set (15-30 seconds minimum)
  • Trigger tested and working
  • Frequency cap implemented (one per visit)
  • Excludes previous respondents

Design:

  • Matches brand styling
  • Close button clearly visible
  • Placement doesn’t block content
  • Mobile-responsive
  • Visually appealing without being distracting

Technical:

  • Tested on multiple browsers
  • Tested on mobile devices
  • Page load speed checked
  • Data collection verified
  • Analytics tracking set up

User Experience:

  • Easy to dismiss
  • Doesn’t interrupt critical actions
  • Thank you message included
  • Incentive (if used) clearly stated
  • Privacy respected

Post-Launch:

  • Monitor response rates
  • Review feedback regularly
  • Create action plans for findings
  • A/B test variations
  • Close the feedback loop with users

Conclusion: The Balance Between Insights and Experience

Pop-up surveys are powerful tools for capturing valuable feedback—when implemented thoughtfully. The key is respecting your visitors’ time and attention while strategically collecting the insights you need to improve.

Remember these core principles:

  1. Timing is everything: Wait for engagement before displaying surveys. 15-30 seconds minimum, or use behavioral triggers like scroll depth and exit intent.

  2. Keep it short: One to two questions maximum. Users expect pop-ups to be quick.

  3. Make closing easy: Always provide a clear, obvious way to dismiss the survey.

  4. Show once per visit: Never bombard users with multiple pop-ups or repeated surveys.

  5. Be mobile-friendly: Test extensively on mobile devices where most traffic originates.

  6. Ask specific questions: Vague questions get vague answers. Be precise about what you want to know.

  7. Target strategically: Show the right survey to the right person at the right time through segmentation.

  8. Act on feedback: Analysis and implementation are where real value emerges. Close the feedback loop.

  9. Test continuously: A/B test everything—timing, design, wording, placement—to optimize results.

  10. Respect the experience: Your goal is insights, not interruptions. When in doubt, err on the side of less intrusive.

The difference between an annoying pop-up and a valuable feedback tool comes down to respect—respect for your visitors’ time, attention, and experience. Master these principles, and you’ll capture the insights you need to improve while maintaining the positive user experience that keeps visitors coming back.

Now it’s time to put these strategies into practice. Start with one well-targeted, thoughtfully designed pop-up survey. Monitor the results. Refine your approach. And watch as the valuable insights start flowing in—without the frustrated clicks on that X button.