Analysis of Diplomatic Texts with LLMs: A Hybrid Approach in Computational Social Sciences

This paper presents the practical application of big language models in text mining and topic modeling processes using texts shared online by the Ministry of Foreign Affairs of the Republic of Turkiye. The research describes an iterative and hybrid algorithm in which domain experts and large language models work together. The findings indicate that well-defined themes play a critical role in model success. It is emphasized that in social sciences, topic modeling processes should be handled with a tailor-made approach that includes the contextual interpretations of the researcher in the data evaluation processes, rather than being evaluated only through numerical outputs. In conclusion, the proposed algorithm offers a comprehensive and flexible analysis opportunity in social scientific research by generating topic labels suitable for qualitative or quantitative analysis of texts.