Recent research on AI customer interactions reveals consumers trust AI agents less than humans but share more detailed information with them. Lei Gao, CTO of SleekFlow, highlights significant implications: businesses gain deeper insights yet face infrastructure challenges. Gao advises optimising data capture, governance, security protocols, and responsibly leveraging AI-collected insights, turning this paradox into a strategic advantage.
Recent research published in the Journal of Retailing highlights a curious contradiction in consumer behaviour: although customers inherently trust AI agents less than human representatives, they are more likely to share detailed, sensitive information with these systems. This paradox has significant implications for companies utilising AI in customer service operations.
Lei Gao, Chief Technology Officer at conversational AI platform SleekFlow, sheds light on the implications of these findings from a technical implementation viewpoint. According to Lei, the revelations from this study mirror what SleekFlow has observed in its own analytics.
“This research validates what we’ve been seeing in our data analytics,” says Lei. “Customers are sharing more detailed information with AI systems whilst simultaneously trusting them less, and most companies have no idea this is happening from a data collection standpoint.”
AI perceived as less powerful, encourages greater information disclosure
The study uncovers a key factor behind the trend: customers perceive AI agents as possessing less authority or power compared to human representatives. Consequently, individuals feel more comfortable divulging personal or business-critical information, creating an unprecedented flow of detailed business intelligence.
“Think about a procurement manager chatting with an AI about budget constraints, or a logistics coordinator sharing shipment details,” Lei explains. “Our systems are capturing far more granular business intelligence than traditional human-led conversations, but most companies aren’t built to handle or analyse this data responsibly.”
Technical recommendations to harness data responsibly
To responsibly navigate this shift, Lei emphasises the importance of adapting data collection and governance strategies. Businesses must optimise their technical infrastructure to effectively manage the detailed information volunteered by customers:
Optimising Data Capture Systems:
- Systematically configure AI conversations to capture specific business challenges and preferences.
- Implement structured data collection directly integrated into Customer Relationship Management (CRM) and analytics systems.
- Establish automated tagging mechanisms distinguishing voluntary disclosures from direct responses.
Strengthening Data Governance Infrastructure:
- Clearly define data retention and deletion protocols.
- Maintain comprehensive audit trails tracking data collection and processing.
- Develop advanced consent management systems to manage granular permissions effectively.
Addressing Technical and Trust Challenges:
- Design AI interactions transparently, explicitly stating system limitations upfront.
- Create efficient handoff protocols to human agents, providing full conversational context.
- Implement feedback loops demonstrating the tangible value derived from shared data.
Unlocking competitive advantages from AI insights
From an operational perspective, leveraging the technical insights gathered from AI systems can lead to substantial competitive advantages for businesses. Lei suggests companies:
- Utilise machine learning algorithms to detect patterns in unsolicited customer disclosures.
- Integrate real-time analytics to swiftly identify emerging business trends.
- Establish automated personalisation engines that proactively use voluntary customer insights.
“The biggest technical challenge I see is companies treating this increased data sharing as a storage problem rather than an intelligence opportunity,” notes Lei. “The infrastructure requirements are completely different when customers are volunteering business-critical information versus just answering scripted questions.”
Implementing robust security and compliance safeguards
To mitigate potential security and compliance risks arising from increased information sharing, Lei recommends comprehensive technical safeguards:
- Conduct regular automated audits of data collection practices.
- Enforce encryption and stringent access controls on sensitive business information.
- Ensure seamless integration protocols enabling human agents to effectively leverage AI-derived insights.
“From a technical architecture standpoint, B2B companies are sitting on a goldmine of customer intelligence they didn’t design their systems to capture,” Lei concludes. “But without proper data infrastructure and governance protocols, they’re also creating massive security and compliance risks. The businesses that will dominate are those that architect their AI systems to turn this data opportunity into a competitive advantage.”
Himani Verma is a seasoned content writer and SEO expert, with experience in digital media. She has held various senior writing positions at enterprises like CloudTDMS (Synthetic Data Factory), Barrownz Group, and ATZA. Himani has also been Editorial Writer at Hindustan Time, a leading Indian English language news platform. She excels in content creation, proofreading, and editing, ensuring that every piece is polished and impactful. Her expertise in crafting SEO-friendly content for multiple verticals of businesses, including technology, healthcare, finance, sports, innovation, and more.
