AI search

Is ChatGPT citing your clinic?

One check cannot tell you. I asked three AI engines the same six patient questions, 126 answers in all.

commasandchaos.com

The main finding

One check missed 37%.

If an engine cited a clinic in any of five identical runs, a single check still missed it 37% of the time.

commasandchaos.com

Same question, five times

27 of 97 came back every time.

Only 27 of 97 clinic and question pairings were linked in all five runs. 19 appeared once and never again.

commasandchaos.com

By engine

ChatGPT was the least consistent.

Chance one check misses a cited clinic: ChatGPT 44%, Claude 41%, Perplexity 24%. On ChatGPT, only 5 of 39 pairings appeared in every run.

commasandchaos.com
Read the full method

What counts

Count the links in the answer.

Perplexity returned 810 sources and referred to only 307 in its answers. One source it returned every time was a podiatrist in Hobart, Indiana.

commasandchaos.com

Across engines

29 of 62 on one engine only.

Almost half the clinic websites linked in answers were linked by one engine and absent on the other two. Check each engine separately.

commasandchaos.com

How many checks

Three checks, at least.

Three checks found about 90% of what five found on ChatGPT and Claude. One check found under 60%. Reword each question too.

commasandchaos.com

The method

Score it out of five.

Write questions first. Ask each three to five times per engine, in a new chat. Count only links in the answer. Track the count out of five each quarter.

Tap for the full ten-step method

commasandchaos.com
Read the full method