Recent research based on the needs of the autistic community has explored the frequent social misunderstandings that arise between autistic and non-autistic people, known as the double empathy problem. Double empathy understandings require both groups to respect neurodiversity by focussing on individuality across groups. This study aimed to explore how literature, through its ability to uncover nuanced emotional response differences between readers, could facilitate double empathy understandings within pairs of autistic and non-autistic adults. A longitudinal, qualitative design was used, with 4 gender-matched pairs. Participants read for 1 week, whilst completing a structured, reflective diary. This was followed by 4 one-hour paired reading sessions, where pairs discussed the book and their reflections in depth. Participants were then invited to a final one-on-one interview to discuss their thoughts and experiences of the paired reading sessions. Thematic and literary analysis of the session and interview data revealed four themes (1) The Book as Social Oil; (2) From a World of Difference to a World of Affinity; (3) Emotional Intelligence: From Thinking About to Feeling with; and (4) From Overwhelming to Overcoming. All participants reported having achieved an individualised view of one another to explore their nuanced differences. The non-autistic group reported a more sensitive understanding of what it means to be autistic, while the autistic group overcame concerns about non-autistic people stereotyping autism, and instead reported feeling valued and accommodated by their non-autistic partners.