'Western Qwen': IBM wows with Granite 4 LLM launch and hybrid Mamba/Transformer architecture

The Qwen family from Alibaba remains a dense, decoder-only Transformer architecture, with no Mamba or SSM layers in its mainline models. However, experimental offshoots like Vamba-Qwen2-VL-7B show ...
GitHub

Timber-Gu/Transformer_And_Decoder_Only

Vanilla Transformer: A complete implementation of the original transformer architecture as described in the "Attention Is All You Need" paper. This includes both the encoder and decoder components.
IEEE

DTrOCR: Decoder-only Transformer for Optical Character Recognition

Abstract: Typical text recognition methods rely on an encoder-decoder structure, in which the encoder extracts features from an image, and the decoder produces recognized text from these features. In ...
IEEE

Transformer-Based Online Speech Recognition With Decoder-End Adaptive Computation Steps

"IEEE.tv is an excellent step by IEEE. This will pave a new way in knowledge-sharing and spreading ideas across the globe." ...
GitHub

Transformer-Based Architectures for Temporal Forecasting: A Study on Financial Time Series Data

This study examines the effectiveness of transformer-based models for financial time series forecasting, specifically focusing on log returns derived from daily closing prices of the DAX40 index. We ...