Skip to content

Mabdelaziz/ArSarcasT

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

10 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

ArSarcasT Corpus

The ArSarcasT corpus is a dataset of Arabic tweets created to detect sarcasm. It includes tweets from previous benchmarking datasets and new tweets related to social and political issues from 2020 to 2022. Native Arabic speakers from Egypt manually annotated the dataset, and the final labels were determined using majority voting. To ensure consistency, the annotators re-annotated the examples from the benchmark datasets, resulting in some differences from the original labels. The dataset consists of 26,014 tweets, of which 28% are sarcastic. It was split into 80/20 for training and testing, with 21,017 tweets in the training split and 5,821 sarcastic tweets. The ArSarcasT corpus is a valuable resource for researchers and real-world applications due to its manual annotation by native speakers and the inclusion of new tweets related to social and political issues.

๐Ÿš€ Quick Start

Clone the repository and run the EDA script:

git clone <repo-url>
cd ArSarcasT
pip install pandas
python dataset_eda.py

๐Ÿ“Š Exploratory Data Analysis (EDA)

The EDA script provides:

  • Label distribution (%)
  • Text length statistics:
    • Max length
    • Min length
    • Average length
  • Summary per label and overall dataset
  • Sample preview (first 5 rows)

All results are displayed directly in the console.

๐Ÿ–ฅ๏ธ Output

The script prints:

  • Dataset summaries (Train & Test)
  • Label distribution
  • Sample rows from the training dataset

Dataset Citation

If you use this dataset, please cite the following publication:

Galal, M. A., Yousef, A. H., Zayed, H. H., & Medhat, W. (2024). Arabic sarcasm detection: An enhanced fine-tuned language model approach. Ain Shams Engineering Journal, 15(6), 102736. https://doi.org/10.1016/j.asej.2024.102736 (https://www.sciencedirect.com/science/article/pii/S2090447924001114)

Note: This citation refers to the paper describing the dataset and its development. If you use this dataset, please cite the above work.

Releases

No releases published

Packages

 
 
 

Contributors

Languages