Voice technology can capture more digital information than language: Study
New York, US: In an era where customers have taken to cyberspace to frequently interact with internet-enabled instruments, whether searching online, making online transactions, or watching videos, information about customers gets disclosed. This disclosure of information has been frequently monetized or used for marketing research and activities by technological companies.
Researchers from the University of Miami and New York University published a new Journal of Marketing article that examines how voice technology can affect what consumers reveal about themselves.
The study, forthcoming in the Journal of Marketing, is titled "Information Disclosure in the Era of Voice Technology" and is authored by Johann Melzner, Andrea Bonezzi, and Tom Meyvis.
Until recently, consumers interacted with technology largely through manual communication, which entails typing or selecting options by clicks or touches. Voice technology (brought about by artificial intelligence) has enabled interactions to also occur through oral communication and consumers increasingly engage with their phones, tables and other devices using their voices.
Melzner explains that "The rapid propagation of voice technology raises a vital question: Do consumers disclose more or less information about themselves when they interact with technology orally rather than manually? To answer this question, one needs to consider that consumers can disclose information about themselves both verbally, that is, by voluntarily providing information through language, as well as non-verbally, that is, by involuntarily revealing information through vocal paralanguage and ambient sound."
The researchers also identify mechanisms that arise from fundamental differences between oral and manual communication. They integrate these mechanisms into a verbal disclosure decision-making framework illustrating the complex ways in which communication modality can affect consumers' likelihood to disclose information. This modality-dependent framework not only provides impetus for future research, but can be used as a tool by marketers to gauge when and how oral versus manual communication may increase or decrease consumers' likelihood to disclose information verbally.
Oral communication with connected technologies allows one to capture information beyond language in the form of nonverbal disclosures, which are largely absent in manual communication. When consumers speak to connected devices, vocal paralanguage (e.g., the sound of their voice or how something is said) and ambient sounds (e.g., sounds in the current environment and from activities) are inherently captured and reveal information about consumers. The article provides an overview of marketing relevant information around consumer states (e.g., emotions, health conditions, current activities) and traits (habits, ethnicity, personality, identity) that can be inferred from such auditory nonverbal disclosures. Additionally, it provides an overview of industry patents attesting both to the wide range of information about consumers that can be extracted from audio data and to industry interest in leveraging such data.
"Our analysis suggests that voice technology can increase, but also decrease, disclosure. From our research, policy makers can gain a better understanding of how to regulate the collection and use of information disclosed to voice-technology in the interest of consumer welfare. In particular, our analysis calls for higher privacy protections for information disclosed in oral interactions with technology," says Bonezzi.
