Advanced search
Publication Cover
Journal of Quantitative Linguistics Volume 31, 2024 - Issue 1
Submit an article Journal homepage
160
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Text Segmentation Via Processes that Count the Number of Different Words Forward and Backward

Berhane Abebea Department of Mathematics and Mechanics, Novosibirsk State University, Novosibirsk, Russia;b Department of Mathematics, Mainefhi College of Science, Mainefhi, EritreaORCID Iconhttps://orcid.org/0000-0003-3161-9271View further author information
ORCID Icon,
Mikhail Chebunina Department of Mathematics and Mechanics, Novosibirsk State University, Novosibirsk, Russia;c Karlsruhe institute of technology, Institute of Stochastics, Karlsruhe, GermanyORCID Iconhttps://orcid.org/0000-0003-2666-1088View further author information
ORCID Icon &
Artyom Kovalevskiia Department of Mathematics and Mechanics, Novosibirsk State University, Novosibirsk, Russia;d Department of Probability Theory and Mathematical Statistics, Sobolev Institute of Mathematics, Novosibirsk, Russia;e Department of Applied Mathematics and Computer Science, Novosibirsk State Technical University, Novosibirsk, RussiaCorrespondence[email protected]
ORCID Iconhttps://orcid.org/0000-0001-5808-3134View further author information
ORCID Icon
Pages 1-18 | Published online: 12 Nov 2023

References

  • Abebe, B., Chebunin, M., Kovalevskii, A., & Zakrevskaya, N. (2022). Statistical tests for text homogeneity: Using forward and backward processes of numbers of different words. Glottometrics, 53(1), 42–58. https://doi.org/10.53482/2022_53_401
  • Beeferman, D., Berger, A., & Lafferty, J. D. (1999). Statistical models for text segmentation. Machine Learning, 34(1–3), 177–210. https://doi.org/10.1023/A:1007506220214
  • Bosc, M., Heitz, F., Armspach, J.-P., Namer, I., Gounot, D., & Rumbach, L. (2003). Automatic change detection in multimodal serial mri: application to multiple sclerosis lesion evolution. NeuroImage, 20(2), 643–656. https://doi.org/10.1016/S1053-8119(03)00406-3
  • Choi, F. Y. (2000). Advances in domain independent linear text segmentation. arXiv preprint cs/0003083.
  • Ferrer i Cancho, R., & Solé, R. V. (2001). Two regimes in the frequency of words and the origins of complex lexicons: Zipf’s law revisited. Journal of Quantitative Linguistics, 8(3), 165–173. https://doi.org/10.1076/jqul.8.3.165.4101
  • Hearst, M. A. (1997). Text tiling: Segmenting text into multi-paragraph subtopic passages. Computational Linguistics, 23(1), 33–64.
  • Itoh, N., & Kurths, J. (2010). Change-point detection of climate time series by nonparametric method. In Proceedings of the world congress on engineering and computer science (Vol. 1, pp. 445–448).
  • Karlin, S. (1975). Central limit theorems for certain infinite urn schemes. Journal of Mathematics and Mechanics, 17(4), 373–401. https://doi.org/10.1512/iumj.1968.17.17020
  • Kingsley Zipf, G. (1935). The psycho-biology of language. Houghton-Mifflin.
  • Kubát, M., & Milička, J. (2013). Vocabulary Richness Measure in Genres. Journal of Quantitative Linguistics, 20(4), 339–349. https://doi.org/10.1080/09296174.2013.830552
  • Kyong Joo, O. and Han, I. (2001). An intelligent clustering forecasting system based on change-point detection and artificial neural networks: Application to financial economics. In Proceedings of the 34th Annual Hawaii International Conference on System Sciences, Maui, HI, USA.
  • Mandelbrot, B. (1965). Information theory and psycholinguistics. In B. B. Wolman (Ed.), Scientific psychology. (pp. Xv, 620). Basic Books .
  • Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. In C. J. Burges, L. Bottou, M. Welling, Z. Ghahramani, & K. Q. Weinberger (Eds.), Advances in neural information processing systems (Vol. 26, pp. 1–9). Curran Associates, Inc.
  • Nanni Goran Glavas, F. and Paolo Ponzetto, S. (2016, 11-12 August) Unsupervised text segmentation using semantic relatedness graphs. In Proceedings of the Fifth Joint Conference on Lexical and Computational Semantics, *SEM@ACL 2016, Berlin, Germany. The *SEM 2016 Organizing Committee, 2016.
  • Pevzner, L., & Hearst, M. A. (2002). A critique and improvement of an evaluation metric for text segmentation. Computational Linguistics, 28(1), 19–36. https://doi.org/10.1162/089120102317341756
  • Reza, H. (2021). Bayesian online change point detection in finance. Financial Internet Quarterly (Formerly E-Finanse), 17(4), 27–33. https://doi.org/10.2478/fiqf-2021-0025
  • Sieg, M., Katrin Sciesielski, L., Michaela Kirschner, K., & Kruppa, J. (2022). Change point detection for clustered expression data. BMC Genomics, 23(1), 491. https://doi.org/10.1186/s12864-022-08680-9

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.