NLP Research Project – Long-Range Context Modeling Analysis
Research project analyzing long-range context modeling in NLP using Transformer-based models and XLSTMs.
Project Duration: Feb 2025 – Apr 2025
Description:
Investigated models’ ability to capture long-range context in natural language processing through next-token prediction and question answering tasks.
Compared performance of Transformer-based models and XLSTMs on extended sequence inputs.