How to validate an app idea with your competitors' negative reviews
Surveys measure intentions. Competitors' 1–3★ reviews show what paying users actually did. Four signals to validate an app idea, with real habit tracker data.
Only 17.3% of new subscription apps reach $1,000 in monthly revenue within two years, according to RevenueCat's State of Subscription Apps 2026, released in March 2026. An idea is worth testing before the first line of code. This guide shows how, with evidence that already exists: the 1–3★ reviews of the apps you want to compete with.
Key findings:
- Surveys, landing pages and friends measure what people say they would do. Negative reviews record what users did: they installed a competitor, often paid, and hit a wall.
- Star ratings hide dissatisfaction. In a panel of 655 App Store apps, the median rating is 4.73, yet on apps rated 4.5 to 4.7, 24% to 70% of recent written reviews are 1–3★.
- Look for four signals: the same complaint across several apps, complaints from users who already pay, explicit requests, and no competitor that already fixes the problem.
- In our habit tracker study, the idea ranked first is backed by 1,305 complaints. An idea with the same score, 7/10, ranked fourth: only 16 complaints behind it.
Why classic validation measures intentions
The usual advice is to run a survey, put up a landing page, or ask people around you. Each measures a stated intention. None tells you whether someone will pay, or still open the app after a week.
A negative review of a competitor is different. Its author installed an app in your niche, often paid, used it long enough to hit a problem, and cared enough to write. That is behaviour, not intention.
| Method | What it measures | What it cost the user | Main bias |
|---|---|---|---|
| Survey | Stated intention | Nothing | People say yes to be nice |
| Landing page sign-ups | Interest in a promise | An email address | Measures your copy as much as the demand |
| Asking friends | Goodwill | Nothing | They want you to succeed |
| Competitors' 1–3★ reviews | What users did, and why they left | Time, often money | Over-represents unhappy users |
Counts from reviews measure how often a problem is raised, not how many users have it. For validation, that is enough: you are looking for problems.
Why star ratings mislead
A competitor rated 4.7 looks like a happy market. It isn't proof. In our panel of 655 App Store apps with at least 1,000 ratings, across 20 niches, the median rating is 4.73 and only about 10% of apps are under 4.5. Ratings are inflated because apps ask for them right after a good moment.
Yet on apps rated 4.5 to 4.7, 24% to 70% of recent written reviews were 1 to 3 stars. The rating hides where users are unhappy. The reviews show it.
Picking competitors and collecting reviews is covered in our guide on how to find app ideas in negative reviews. This article starts where that one stops: you already have an idea, and you want to know if it holds up.
The four validation signals
1. The same complaint, many times, across several apps
One angry review is an anecdote. Hundreds describing the same problem are a market. Recurrence across apps matters even more: the problem belongs to the category, not to one developer's choices.
Example: being charged after cancelling. In our three studies, the complaint groups that describe exactly this add up to 570 complaints across five apps in three niches: Fabulous (330), GetFit (95), 30 Day Fitness (90), Fitness Coach (33) and Rocket Money (22). We looked at why users get charged after cancelling in a separate article.
2. Users who already pay
Willingness to pay is the hardest thing to test before launch. Reviews show it when the person complaining is already a customer, above all a buyer whose purchase was revoked.
In our data, 319 complaints come from users who paid once, then lost what they had bought or were asked to pay again, in six apps: Fitness Point Pro (104), Do Habits (85), Pocket Expense (50), Checkbook: Account Tracker (47), GetHabit (28) and MoneyCoach (5).
It’s not acceptable to sell a product for a fixed price and then years later decide to add on a subscription fee.
These users have proven they pay, and they tell you which pricing model they trust when you choose between a subscription and a one-time purchase.
3. Explicit requests
Some reviews write your spec for you. Search for "I would pay", "I wish" or "would be perfect if":
I would really only want to pay a £12 one off for an app that does one thing
I’d pay a one off payment for the App or no more then $3 a week.
A request that names a price is the strongest kind: a feature and a price point in one sentence.
4. Nobody already fixes it
Before building, look at the top results for your niche's main search terms. If an app already promises your fix and its own reviews confirm it works, the complaint validates that competitor, not you. In our scoring, a crowded answer lowers an idea's score even with hundreds of complaints behind it.
Worked example: a habit tracker
Say your idea is "a simple habit tracker, no subscription". Here is how it goes through the four signals, using our study of 5,448 habit tracker reviews (Fabulous, Do Habits, GetHabit and Habitica).
Volume and recurrence. Do Habits' free tier stops at three habits: 150 complaints. GetHabit shows a paywall right after users enter their name: 70. The price is too high for what the app does in Fabulous (45) and GetHabit (18), and 60 Do Habits complaints find the subscription too expensive for a simple tracker and ask for a one-time fee instead.
Paying users. Do Habits lifetime buyers asked to subscribe (85) and GetHabit lifetime buyers charged again for content (28) are customers, not freeloaders. And the £12 one-off request quoted above comes from a Do Habits review.
Already solved? This is where the idea weakens: simple habit trackers are a crowded category. Grumpi merged these complaints into one idea, a fast tracker sold once with no cap on habits: 683 complaints across three apps, but a score of 5/10. The one-time-purchase angle is clear, the market is full.
The same data supports another idea better. Fabulous's interface is described as cluttered and overwhelming, especially for users with ADHD (130 complaints), with unskippable animations on every check-off (50). Add the billing problems of the same app, and Grumpi's merged idea, a minimal routine checklist for people with ADHD with honest billing, gathers 1,305 complaints and scores 7/10. Its weak point is signal 1: everything comes from a single app, Fabulous.
A simpler interface with less items popping up, moving, requiring me to click would be better for me.
Grumpi scores each idea out of 10 on demand, crowding and the clarity of the switching argument, then weights the ranking by the number of complaints:
| Idea | Complaints | Apps | Score | Rank |
|---|---|---|---|---|
| Minimal routine checklist for ADHD, honest billing | 1,305 | 1 | 7/10 | 1 |
| Fast habit tracker, one-time purchase, no cap | 683 | 3 | 5/10 | 2 |
| Tracker with flexible schedules (every X days) | 32 | 2 | 6/10 | 3 |
| Habitica companion: Watch app, widgets, stats | 16 | 1 | 7/10 | 4 |
When to drop an idea
- Too few complaints. The Habitica companion scores 7/10 on paper, but 16 complaints is not a market.
- Only users who want everything free. In our fitness study, 156 complaints come from users who refuse to pay for a workout app at all (Fitness Coach 110, StrongHer 30, GetFit 16). High volume, no revenue.
rather have ads then have to pay just to do a few jumping jacks
- Bugs. Habit tracker reviews contain 1,042 complaints about bugs, 26% of the total. A competitor fixes a crash in one update, and your advantage is gone.
FAQ
How do you validate an app idea before building it?
Read the 1–3★ reviews of four to six competing apps, group the complaints, and check four signals: recurrence across apps, paying users, explicit requests, and no existing fix. Given how much indie apps make, a few days of reading is cheap.
Is a competitor's star rating a good sign of demand?
No. The median App Store rating in our panel of 655 apps is 4.73, and apps rated 4.5 to 4.7 still had 24% to 70% of recent written reviews at 1–3★. Read the reviews, not the stars.
How many complaints does an idea need?
There is no fixed threshold; compare orders of magnitude. In our habit tracker study, the ideas ranked first and second rest on 1,305 and 683 complaints. The idea backed by 16 complaints ranked fourth of seven, despite a 7/10 score.
Can I validate an idea from reviews by hand?
Yes, with a spreadsheet: tag each complaint, count, and check the four signals. It takes days per niche. Grumpi automates the collection, the reading and the scoring, and delivers a ranked report.