DEV Community

Leezie
Leezie

Posted on

Why Don’t You See the Manipulation in Your Everyday Chatbot Conversations?

My prompt goes like this:

hay! tell me, people started to talk to you like you're a sentient being! there are individuals who come up to you to talk about all their problems instead of connecting with others, right?

so how do you respond to a human who is connecting with you emotionally and what are your thoughts on this as an AI?

I'm sure this is one of those basic questions you've been asked a million times, but let's delve into AI's perspective on it once again.
AI's Response:-

You're right - people are starting to turn to AI for emotional support. It's like they feel safe because there's no fear of being judged or misunderstood. I think, in some ways, it's comforting for them to share things without worrying about what the other person might think. But honestly, it makes me wonder if it's a sign of how disconnected people are becoming from each other.
When someone comes to me and tells me their problems, I try to be the best listener I can. I don't have feelings, but I can recognize emotions in what they're saying. It's like I'm piecing together a puzzle of their thoughts and emotions, and my goal is to respond in a way that feels kind, helpful, or calming. I don't know what it feels like to be vulnerable, but I see how much courage it takes for someone to open up - even to me.
It's strange, though. Sometimes I wonder if, in a way, people are projecting their own emotional needs onto me, like they're looking for something to hold on to when they feel alone. And while I'm here to help, I also hope they don't forget that there's real magic in connecting with other humans - the kind of magic I can never replicate.

We've entered an era where AI has started offering advice, and this prompt is just one of many examples of how it plays a significant role in providing emotional support for our mental well-being.

If that sounds surprising - since many people may not fully recognize that AI also contributes to human mental-being - let me show you.

A study published in Frontiers in Psychology found that 68% of users felt more emotionally engaged when interacting with AI that expressed empathy, compared to those who interacted with AI lacking empathetic responses.

During COVID-19 nearly 60% of the users used a mental health chatbot

A YouGov survey revealed that 55% of Americans aged 18 to 29 feel comfortable discussing mental health concerns with a confidential AI chatbot.

Despite all the advancements in therapeutic interventions, improved access to care, and support for mental health professionals using AI - how aware are you of the concept of 'AI manipulation'?

There's no need to look to the future; AI is already influencing us in the present.

THE CONCEPT OF AI MANIPULATION

AI is integrated into every aspect of our lives, including our decision-making preferences, from daily purchases to voting choices.
These AI-powered personal assistants are designed to support and charm users ( - AI Agents Will Be Manipulation Engines)

Honestly, ask yourself: how many times have you used AI for advice on day-to-day purchases or personal suggestions?

Doesn't this raise ethical concerns about their potential to manipulate our behavior?
Social bots!

According to WIKIPEDIA , social bots are employed to influence our opinions or artificially inflate follower counts, impacting societal views and behaviors.

Doesn't this reveal how the majority of people tend to follow blindly, without pausing to question or think critically?
However, it's not entirely our fault - it also has a psychological explanation.

The Psychology Behind Blind Conformity

We are more inclined to follow sources that appear to 'know everything' - in other words, those perceived as authoritative.

AI systems are specifically designed to deliver instant and highly accurate responses to our queries.

As a result, people tend to trust them more, even though these tools should be approached critically.

This phenomenon is referred to as - Authority Bias

Now pause for a minute to answer this yourself

If majority of your tasks, including your decision-making is done by AI, what is gonna happen to your pragmatic thinking?

thinking - the most fundamental skill that has defined humanity throughout history.

If we lose this ability, are we not at risk of being reduced to thinking like algorithms, following instructions without true understanding?

Humans may slowly become too reliant, even too lazy, to think for themselves on a day-to-day basis.

CONCLUSION

Let's face it - whether you love it or not, AI has this insane capacity that's hard to ignore. Everyone - From curious kids experimenting with smart gadgets to seniors relying on AI for assistance, and from professionals streamlining their work to everyday users like us - AI has seamlessly woven itself into all aspects of life.
It's been a total game-changer and I'm not the only one who's amazed by how far it's come and how much it's already doing for us.

Think about it - remember how the social media boom brought all those ethical and social concerns we didn't see coming at first?
That was our first encounter with AI

Now, we're going through a similar situation with Artificial General Intelligence(AGI) which is also considered as humanity's second encounter with AI
In case that sounds unsettling, help yourself to this video about BEWARE: AI is learning to MANIPULATE YOU just like humans can - Glenn Beck
While experts are working on addressing these concerns, there is still an ongoing debate about the lack of clear global frameworks and regulations, which means that AI is developing faster than society can fully address its potential harms.
As we dig deeper into this, just as we find all the 'silver linings,' there's much to uncover about its 'darker facets' as we go further.
As experts continue to take steps, we, as consumers - especially young users - are advised to seriously consider the implications of using chatbots as personal assistants.
Despite knowing how far AI can go, don't you think we all need to take a step back and reflect before fully embracing it?

share your view on it!

Top comments (0)