| Title: | Inferring a Mobile User’s Valence and Arousal through On-Screen Text Analysis |
|---|
| Authors: | ID Džubur, Edita (Author)
ID Pejović, Veljko (Author) |
|---|
| Files: |  ZUP_Dzubur_Edita_2025.pdf (350,11 KB)
MD5: 8FC8D7BBAF9843573AB55EB5288C0659
|
|---|
| Language: | English |
|---|
| Work type: | Not categorized |
|---|
| Typology: | 1.16 - Independent Scientific Component Part or a Chapter in a Monograph |
|---|
| Organization: | ZUP - University of Primorska Press
|
|---|
| Abstract: | Understanding a user’s emotional state is critical for building adaptive and intelligent mobile applications. In this paper we investigate the feasibility of inferring valence and arousal from the text displayed on smartphone screens. We developed AV-Sense, a mobile application that combines the Experience Sampling Method, a technique that prompts users to report their feelings in the moment, with passive screentext logging. In a two-week study with 12 participants, we collected 787 ESM responses and over 650,000 screentext entries. Data analysis revealed meaningful temporal and individual patterns in reported affect. We then explored the use of large language models to predict valence and arousal from screentext, but results indicated limited predictive power in this setting. Our findings highlight both the potential and current challenges of screentext-based affect inference, laying the groundwork for future research on emotion-aware applications and naturalistic psychological studies. |
|---|
| Keywords: | text analysis, experience sampling method, screentext sensing, valence, arousal, large language models |
|---|
| Publication status: | Published |
|---|
| Publication version: | Version of Record |
|---|
| Place of publishing: | Koper |
|---|
| Publisher: | Založba Univerze na Primorskem |
|---|
| Year of publishing: | 2025 |
|---|
| Number of pages: | Str. 171-180 |
|---|
| PID: | 20.500.12556/RUP-22574  |
|---|
| ISBN: | 9789612935597 |
|---|
| DOI: | https://doi.org/10.26493/978-961-293-559-7.16 |
|---|
| Publication date in RUP: | 30.01.2026 |
|---|
| Views: | 64 |
|---|
| Downloads: | 0 |
|---|
| Metadata: |    |
|---|
|
:
|
Copy citation |
|---|
| | | | Average score: | (0 votes) |
|---|
| Your score: | Voting is allowed only for logged in users. |
|---|
| Share: |  |
|---|
Hover the mouse pointer over a document title to show the abstract or click
on the title to get all document metadata. |
