u/Puzzleheaded-Walk426

I think brands should be present on Reddit, but not purely for marketing. It is an excellent place to get closer to your customers, answer questions, find the pain points, and build brand awareness.

I use Mentionlytics for AI visibility tracking and social listening, and it works well for me. I have to admit I'm not that obsessed with the scores, but I spend a lot of time on citation and answer analytics, trying to spot patterns.

Well, my GPT gives me personalized answers, so I won't see the answer it would give for some random user using the same prompt. That's why I used an unlogged-in account and an incognito window.

I use Mentionlytics for AI visibility (I've used it for years for social listening, and I opted in when they expanded the features), and I'm pretty satisfied with it. It can not replace an SEO tool like Semrush, but for AI visibility it's great.

I'm not sure anyone is using that prompt... I mean, it's a SaaS; you want the best, and you don't actually care where it's from.

Did you do a manual checkup? I would start with that. Run one prompt daily through ChatGPT, then compare the results with those tools (but don't forget: only for that one prompt, not in general). Use an incognito window and a logged-out account so that it doesn't personalize. If you can, use a VPN set to the country you're running prompts in. Once you compare the results, choose the tool that gives you the most similar results (they won't be an exact match, but they'll be similar).

So far, I have learned that there is no "safe plan". LLMs keep changing the game (in the blink of an eye), and one moment you think you've figured everything out and things start getting better; the next moment, woo-hoo, another model update, new rules, new game... soooo I don't know about you all, but I feel like a hamster on a wheel...

Sorry, but if your tool forces you to pick just one metric, it's time to change it 😄 Hypothetically, I would choose recommendation rate and compare it with AI referrals from GA4 (or whatever tool I'm using) to see how many of those recommendations converted into leads.

Interesting... I haven't paid attention to this

Once a month does not give you a complete picture. I know because, during my 30-day experiment, I ran one prompt daily on a single LLM, and on days 13-14 the results, along with the citations, changed completely. After that, everything got back to normal. And that gap was interesting, because what if.. you hit that gap in your research.

The best way to see whether the tool is doing its job is to compare it with leads generated by LLMs. If your visibility is around 10% and you have 1-none leads coming from LLMs, then it's doing an okay job. But if your visibility score is 46 and you don't see leads coming from LLMs, you've either chosen the wrong prompts or the tool is off.

100% agree, but I'm still waiting to see how Google will react... because we have two fronts now :D

Hmm, yes, but if the results (recommendations) are basically the same, then a question pops into my mind... is the juice worth the squeeze... if the results are the same, who cares whether you show up or not in citations... That's my dilemma :)

100 prompts x 6 LLMs wow... how did you manage to analyze this amount of data manually (not to mention the time for prompting (I found one prompt and one LLM too demanding hahahha)

Yes, you're right about an unbiased test. I was aware of it. Now, regarding the results: the overall score was pretty similar, and the lists of recommended brands were too (not an exact match, but both methods showed the most popular brands), but the citations differed the most. But I made one mistake with the prompt I was running (just one prompt, one LLM - ChatGPT), and that is that I didn't copy-paste the prompt alrady existing within the tool, but I changed the wording a bit.. sooo, I'm planning to repeate the experimetn, but don't actually have time for that at the moment.

unfortunately I think you're right

I am, and I'm not reading it :D Just skip. I'm experimenting and trying to figure it out myself. I share my conclusions (which might not be right at all) only when I think I've figured it out.

I used a tool, but I did one experiment with manual measurement using a logged-out account in an incognito window. The only thing I didn't do was use a VPN to choose a different location, but okay.

I'm using Mentionlytics as a two-in-one (social listening and AI visibility). And I have to admit I spend more time in the AI visibility dashboards now than in the social listening ones (not that it's unimportant). I really like how it functions, and it gives me valuable information, such as a list of citations that show up for important prompts (how often they appear, and is the brand is mentioned there or not), domains used per each LLM and each prompt (very useful), what type of content is used mostly, etc. I also read raw answers to see how AI perceives the brands (it tells you a lot when you dig a bit deeper). That's part of what I use to improve visibility (though everything I do is still trial and error). I'm trying to figure out a pattern for each LLM (one thing I've figured out by now is that it will depend on the industry and niche, so there's no universal solution).

I wouldn't bet on it.... :/

It's not a race; u/tridence-com is right. We just need to get used to the fact that we have one more channel, and that's it.

I don't know if they're industry leaders, but I use Mentionlytics for social listening, and it's doing a great job for my clients and me.

Oooh, I encountered that too (rent a mention), which sounded silly, but I'm afraid it became a trend. I'm still avoiding all of these; I say "still" because I've seen a lot of 0-30 DA citations in LLMs.

Thanks for the advice!

hahahha this is very good analysis, I have to say. But if I tell this to my boss (more like a client actually) he will probably say "okay, what it has to do with us" :D because I only use Mentionlytics, the same way I use Neuron Writer, or Grammarly. And I mention that always, whenever the topic pops up in my feed. As you might have noticed my profile is open, it's very transparent (unlike yours) and I have no intention to hide my opinions just because someone doesn't like it.