Why review-site star ratings can't rank support tools

When every support tool scores high, the star average stops separating contenders.

Star averages on software directories cannot rank support tools, because nearly every credible product earns a high one. That matters more than it sounds. In 2026, 74% of B2B buyers used reviews to inform a purchase decision, and 63% used AI somewhere in the buying journey, with 94% of that group fact-checking the AI's answers at least some of the time. Reviews are still the check buyers run before they commit.

The directories hosting those reviews are commercial platforms, though. Review researchers at B2B SaaS Reviews estimated in April 2024 that only 3% of website visitors fill out a form to identify themselves, which leaves vendors in the dark about everyone else who is shopping. Platform rules differ too. Some sites ban incentivized reviews (reviews written in exchange for a reward) and reviews from anyone connected to the seller, while others allow both with a disclosure. Two directories can therefore show the same star for very different reasons.

My position is plain. Consider where many listings start: in a September 2025 r/SaaS thread, a founder of a "small start up with a couple customers" weighed listing on G2 "to showcase our happy customers," so judge a young profile against tested buying criteria for support tools rather than its star count. The research section below walks through these findings.

How narrow is the star-rating band for B2B software?

Narrow enough that a high score rarely separates credible products. Public ratings drift toward the ceiling over time, so the gap between two established tools often reflects noise rather than quality.

Before you compare two averages, run four checks:

1. Note how many reviews sit behind each score.
2. Check the date range of the reviews feeding the average.
3. See how the directory orders its category page by default.
4. Ask whether the gap is wider than the gap between tools you already know are different.

Perfect 5-star ratings grew from 33% to 85% of all evaluations over six years on one online labor marketplace, according to a 2021 study of that platform. The cause was social, not technical. Ratings inflated once they became public rather than private, because raters feared retaliation from the people they rated. eBay shows the same flattening: the median seller holds a 100% positive rating, and the bottom 10th percentile holds 98%. On a food delivery platform, researchers found that as average ratings rose, the variance across restaurants fell, and sales concentrated among sellers that were already popular.

B2B software follows the same shape. A 2019 Business of Business analysis of 41,000 TrustRadius reviews found that the highest-rated of the 25 most-reviewed products, Airtable, scored 95.8%, while HubSpot and Zoom tied at 94.0% and ConnectWise Control posted 93.0%. A marketing suite, a video platform and a remote access support tool sat within a few points of each other. In 2019, even the lowest scorers in that group, Brightpearl and ADP Workforce Now, came in at 74.1% and 76.9%.

A comparison of 5 sources shows that compression is the norm on mature review platforms, not an exception. Zazachat's editorial and disclosure policy explains how its own reviews keep paid placement out of the picture. The research section below walks through why scores pile up there. It is not a distinction.

The conventional wisdom treats a higher average as evidence of a better product. On a compressed scale, that inference breaks down, because a few tenths of a star can come from review timing, sample size or campaign activity rather than from anything the software does differently. No published study isolates support tools across directories, so the exact width of their band remains unmeasured, but the direction of the pressure is clear.

Stale benchmarks make it worse. Joe Kevens of B2B SaaS Reviews noted in a January 2024 post that most "online review stats" search results "link back to studies done years ago," which leaves many buyers anchoring on numbers that no longer describe the market. I would not build a shortlist on any single average for that reason alone.

At Zazachat, our reviews are written and edited by our editorial team, led by Michael Kansky. Whether you start from a directory or from our live chat software rankings, read a star average as context rather than a verdict.

Sorting adds another layer. As of 2022, the default order on Capterra and GetApp category pages was "Sponsored Vendors," with vendors bidding for placement and non-bidders listed after the lowest bidder. "Highest Rated" was only an alternative sort, so on two of the largest directories the score was not even what decided which tool a buyer saw first.

Can you trust G2 and Capterra reviews when choosing support software?

Partly. Major directories do moderate submissions, but federal rules place no screening duty on review hosts, so manufactured or incentivized praise can still reach the average you see.

Compression is one problem. The second is that some of the reviews inside that narrow band may not be organic at all. One marketer auditing brand profiles on G2 described "wild spikes in reviews over the summer" and said many of them "look like they were written by a marketing intern with a checklist, not real users sharing real experiences." The same poster added that G2 "doesn't seem to have strong filters" for that kind of content. The account is anecdotal. It still matches the incentives on both sides of a listing.

The directories answer with their own moderation figures. For fall 2026, G2 reported that of 230,998 reviews submitted, 8.9% (20,671) were removed as fake or incentive abuse before publication, and a further 20.9% were rejected for guideline problems. Those numbers show real filtering effort. A platform grading its own filter, however, is not an independent check.

Regulation moved too. On August 14, 2024, the Federal Trade Commission announced a final rule, approved by a 5-0 vote, that bans the sale or purchase of fake reviews and lets the agency seek civil penalties against knowing violators. It also bans incentives conditioned on a review expressing a particular sentiment, and it prohibits insider reviews by officers or managers that fail to disclose the connection.

The common assumption is that this rule cleaned up software ratings. It did not reach the directories themselves. The agency's own question-and-answer guidance explains that Section 465.2(d) exempts businesses doing "nothing more than hosting consumer reviews," and that the exemption holds even when a site prompts submissions or aggregates star ratings. Asked whether a host must investigate reviews for fakes, the FTC staff answer was direct: "There is no such requirement or obligation under the rule." The rule also provides no private right of action, so a buyer misled by an inflated average has no claim under it.

Earlier guidance for marketers fills in the remaining lines. It warns that some comparison sites sell better ratings, reviews and placement for a fee, and it treats taking part as deceptive advertising. It also discourages review gating, which means asking for reviews only from customers you expect to be happy. Gating breaks no single review. It quietly skews the whole average upward.

None of this makes a directory dishonest by default. It does mean the score carries no legal guarantee of being organic. My working rule is to treat any profile with a sudden burst of glowing reviews as unproven until older, more detailed reviews say the same thing. If you are comparing help desks, read our best help desk software with live chat picks alongside the directory pages, not instead of them.

The practical question then becomes which reviews inside a profile still deserve weight, and that turns on when they were written and by whom.

How should you weight software reviews to compare support tools more accurately?

Weight recent reviews from teams your size, read post-sale comments apart from pre-sale praise, and require enough reviews to see patterns. The star average becomes a tiebreaker, not the ranking.

The reason is lifecycle. Thin samples are a known weakness of rating sites in general: a 2017 JAMA study of 28 physician-rating sites, reported by Reuters, found that doctors with at least one review were likely to have only three or four. One sales-intelligence vendor, analyzing 47 G2 reviews of a competing sales engagement platform, reported that pre-sale experience was consistently rated 4-5 stars while post-sale dropped to 2-3. By that vendor's count, 19 of the 47 reviews described customers who loved the product during the pilot and felt abandoned once the contract was signed. The research section above walks through these findings.

For a support tool, the post-sale phase is the product. Here is the order I would apply:

1. Filter by recency. Read the newest reviews first, and set aside anything written before the vendor's last major product or pricing change.
2. Match team size. Keep reviews from companies close to your own headcount and discount the rest.
3. Split the timeline. Sort comments into onboarding, early use and renewal, then compare the tone across them.
4. Count recurring complaints. Tally how often implementation delays and support slowdowns come up, instead of judging single reviews.
5. Check the sample. Treat a profile with only a handful of matching reviews as unproven.

Team size matters because problems scale. The same vendor analysis reported that 8 of the 47 reviews showed small-team praise turning into enterprise-scale complaints past a certain user threshold, and 14 described implementation running 2-4x longer than promised. Directory coverage also tilts by segment: B2B SaaS Reviews observed in an October 2023 overview that far fewer review sites are designed for enterprise buyers than for SMB and mid-market buyers, so a large support organization may find few true peers in the pool. If you run a smaller team, our live chat picks for small businesses sit closer to your situation than an all-company average does.

On sample size, that vendor sets 30 reviews as its minimum before drawing conclusions, warning: "Below that, you're looking at anecdotes, not intelligence." It also cautions that review data "skews negative by nature," because unhappy customers are more motivated to write. Both points help the buyer. Volume protects you from one angry outlier and from one glowing campaign alike.

Some critics go further. One B2B trade marketplace, arguing for its own vetting process, claims that a perfect five-star rating on a global B2B directory "usually means the rating is fake" and tells buyers to "ignore the stars. Look at the process." I would not discard stars for support software. I would demote them. No published study yet shows which exact weights best predict renewal, so the order of these steps matters more than any precise formula.

Start with the newest reviews from companies your size, and see whether the story they tell matches the headline score.

Will directory star ratings get better at separating support tools?

Probably not soon. Directories earn from vendors as well as buyers, so their incentive is to keep review volume high, not to spread scores apart.

The business model explains the forecast. Writing in 2019, Frank Strong of Sword and the Script recorded that G2 had announced an integration in October of that year feeding buyer intent data (signals that a company is researching a software category) to SalesLoft. He also noted that Capterra sold pay-per-click ads after Gartner bought it for $206.2 million in 2015. Neither fact makes a rating dishonest. Both show who pays.

A scale on which perfect scores went from a minority of ratings to the large majority will keep bunching near the ceiling, and I expect support tools to bunch with it. One caution of my own: distrust can overshoot. Rival directories already sell trust as a feature: in a September 2025 r/SaaS thread, one commenter called a G2 alternative "way more trustworthy" while linking to it, so ask who benefits from any site's claim to be the honest one.

So before the next vendor call, ask whether the vendor pays any directory for placement or review collection, and how those reviews are labeled.