MSI+

Generative AI for Multispectral Image Enhancement

Revealing hidden texts in historical documents through spectral-aware generative reconstruction

Project Introduction

Context

Palimpsests are historical manuscripts in which earlier text has been deliberately erased or scraped away to make room for new writing, a common practice in antiquity and the Middle Ages due to the high cost and scarcity of writing materials such as parchment. This reuse often leaves faint traces of the original (undertext) beneath the later (overtext), creating complex, overlapping layers that are extremely difficult to decipher with the naked eye or conventional imaging. Paleographers and historians face major challenges in recovering these hidden layers, as natural degradation, including ink fading, parchment discoloration, surface damage, and domain-specific noise, further obscures the original content. Traditional methods struggle to separate the intertwined layers non-invasively while preserving paleographic authenticity, limiting access to invaluable cultural and historical knowledge embedded in these manuscripts.

Objective

The primary objective of the MSI+ project is to develop an advanced generative AI framework that integrates multispectral imaging (MSI) data across ultraviolet, visible, and near-infrared bands to enhance and reconstruct hidden undertext in palimpsests. By leveraging modern AI techniques, the project aims to produce clearer, more readable images of the original erased text and enable more accurate subsequent text extraction. The approach focuses on transforming raw, degraded multispectral data into high-fidelity enhanced representations suitable for paleographic analysis, while emphasizing data efficiency and robustness in the face of limited real-world training samples typical of historical manuscripts.

Knowledge Gain

This project seeks to bridge the longstanding gap between black-box deep learning models and the interpretability requirements of the interpretive humanities. By incorporating domain-informed inductive biases and physically grounded representations of spectral properties, MSI+ aims to make AI-driven analysis more transparent and verifiable by experts in manuscript studies. The resulting methodological advances will contribute to computational paleography and digital humanities, offering new tools for non-invasive cultural heritage preservation. Ultimately, the work will facilitate broader access to previously inaccessible historical texts, supporting global efforts to safeguard and study our shared written heritage in a sustainable and scientifically rigorous manner.

Research Roadmap

MSI+ overall diagram by Mahdi Jampour

Phase 1 — Generative MSI Enhancement & Reconstruction


Work Package 1a: Spectral Signature Learning

Coming Soon

Parametric decomposition of ink vs. parchment spectral profiles.

Work Package 1b: Multi-Stage Character Reconstruction

Coming Soon

Coarse-to-fine inpainting guided by typographic shape priors.

Phase 2 — Cross-Modal Text Extraction


Work Package 2a: Cross-Modal Alignment & Completion

Coming Soon

Vision Transformers for aligning degraded strokes with character templates.

Work Package 2b: Synthetic-to-Real Transfer

Coming Soon

Adversarial domain adaptation tailored for low-resource historical scripts.

Deliverables & Open Science

Datasets

Source Code & Models

Dissemination & Impact

Related Publications

  • M. Jampour, "Character Localization in Degraded Historical Documents via Heatmap-Guided UNet3+ with Application on Palimpsests," 2025 12th International Conference on Soft Computing & Machine Intelligence (ISCMI), Rio de Janeiro, Brazil, 2025, pp. 70-76.[Excellent Oral Presentation Award].[PDF]
  • M. Jampour, "Revealing Palimpsests with Latent Diffusion Models: A Generative Approach to Image Inpainting and Handwriting Reconstruction," in 2025 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW), 2025 [PDF]
  • H. A. Mohammed, M. Jampour, and J. Gippert, "Inpainting with Generative AI: A Significant Step towards Automatically Deciphering Palimpsests," in Palimpsests and Related Phenomena across Languages and Cultures, J. Gippert, J. Maksimczuk, and H. Sargsyan, Eds. Berlin, Germany: De Gruyter, 2025, pp. 535–545. [PDF]
  • M. Jampour, "Enhancing the Readability of Palimpsests Using Generative Image Inpainting," International Conference on Pattern Recognition Applications and Methods (2024) pp. 687-694. [PDF]

Workshops & Talks

Announcements of CSMC seminars, conference presentations and invited talks will appear here.

Funding & Acknowledgments

Funded by the [Founder Name]
Project Number: [###]

We express our gratitude to the [###] for supporting this research into safeguarding global cultural heritage.

Team & Colleagues

Principal Investigator: Dr. Mahdi Champour (Jampour)

PhD Student: Coming soon

Research Assistants: Coming soon

Cooperation Partners: Prof. Dr. Jost Gippert, | Dr. Alba Fedeli, | Prof. Ralf Möller, | Prof. Xiaoyi Jiang, | Prof. Ekta Vats, | Prof. Malihe Javidi |

Affiliation: Universität Hamburg | Centre for the Study of Manuscript Cultures (CSMC)