Publications
Journal Papers
- [TMLR 2024] Md. Mahadi Hassan, Alex Knipper, Shubhra Kanti Karmaker Santu. "Introducing 'Forecast Utterance' for Conversational Data Science." In Transactions on Machine Learning Research (To appear). Paper
- [IP&M 2023] Dongji Feng and Shubhra Kanti Karmaker Santu. "Joint upper & expected value normalization for evaluation of retrieval systems: A case study with Learning-to-Rank methods". In Information Processing and Management, Volume 60, Issue 4, 2023, ISSN 0306-4573. Paper
- [ACM TIST 2022] Souvika Sarkar, Biddut Sarker Bijoy, Syeda Jannatus Saba, Dongji Feng, Yash Mahajan, Sheikh Rabiul Islam, Md. Ruhul Amin and Shubhra Kanti Karmaker Santu. "Ad-Hoc Monitoring of COVID-19 Global Research Trends for Well-Informed Policy Making". In ACM Transactions on Intelligent Systems and Technology. Paper
- [ACM CSUR 2022] Shubhra Kanti Karmaker Santu, Md. Mahadi Hassan, Micah J. Smith, Lei Xu, Chengxiang Zhai, Kalyan Veeramachaneni. "AutoML to Date and Beyond: Challenges and Opportunities." In ACM Computing Surveys, 54(8): 175:1-175:36 (2022). Paper
- [SIGKDD Explorations 2018] Shubhra Kanti Karmaker Santu, C. Geigle, D. C. Ferguson, W. Cope, M. Kalantzis, D. Searsmith, Chengxiang Zhai. "SOFSAT: Towards a Setlike Operator based Framework for Semantic Analysis of Text". In ACM SIGKDD Explorations [Position Paper]"> Paper
Conference Papers
- [EMNLP 2024 (Findings)] Yash Mahajan, Naman Bansal, Eduardo Blanco, Santu Karmaker." ALIGN-SIM: A Task-Free Test Bed for Evaluating and Interpreting Sentence Embeddings through Semantic Similarity Alignment." In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 7393–7428, Miami, Florida, USA. Paper
- [FSE 2024] Md. Mahadi Hassan, John Salvador, Shubhra Kanti Karmaker Santu, Akond Rahman. "State Reconciliation Defects in Infrastructure as Code." In ACM International Conference on the Foundations of Software Engineering (FSE), 2024. Paper
- [L@S 2024] Effat Farhana, Souvika Sarkar, Ralph Knipper, Indrani Dey, Hari Narayanan, Sadhana Puntambekar, Shubhra (Santu) K. Karmaker. "SimPal: Towards a Meta-Conversational Framework to Understand Teacher's Instructional Goals for K-12 Physics." In ACM Learning@Scale 2024: 461-465. Paper
- [KONVENS 2024] Mousumi Akter, Shubhra Kanti Karmaker. "Redundancy Aware Multiple Reference Based Gainwise Evaluation of Extractive Summarization". In Proceedings of the 20th Conference on Natural Language Processing (KONVENS 2024): 182-195. Paper
- [ICPE 2024] Souvika Sarkar, Mohammad Fakhruddin Babar, Md Mahadi Hassan, Monowar Hasan, Shubhra Kanti Karmaker Santu. "Processing Natural Language on Embedded Devices: How Well Do Modern Models Perform?" In International Conference on Performance Engineering (ICPE), 2024. Paper
- [EMNLP 2023] Souvika Sarkar, Dongji Feng, Shubhra Kanti Karmaker Santu. "Zero-Shot Multi-Label Topic Inference with Sentence Encoders." In EMNLP, 2023. Paper
- [EMNLP 2023] Mousumi Akter, Souvika Sarkar, Shubhra Kanti Karmaker Santu. "On Evaluation of Bangla Word Analogies." In EMNLP, 2023. Paper
- [EMNLP 2023 (Findings)] Shubhra Kanti Karmaker Santu, Dongji Feng. "TELeR: A General Taxonomy of LLM Prompts for Benchmarking Complex Tasks." In Findings of EMNLP, 2023. Paper
- [ACL 2022 (Findings)] Mousumi Akter, Naman Bansal, Shubhra Kanti Karmaker. "Revisiting Automatic Evaluation of Extractive Summarization Task: Can We Do Better than ROUGE? " In Findings of ACL, 2022. Paper
- [EMNLP 2022] Naman Bansal, Mousumi Akter, Shubhra Kanti Karmaker. "Learning to Generate Overlap Summaries through Noisy Synthetic Data". In EMNLP, 2022. Paper Dataset
- [EMNLP 2022] Naman Bansal, Mousumi Akter, Shubhra Kanti Karmaker. "SEM-F1: an Automatic Way for Semantic Evaluation of Multi-Narrative Overlap Summaries at Scale". In EMNLP, 2022. Paper Dataset
- [COLING 2022] Naman Bansal, Mousumi Akter, Shubhra Kanti Karmaker. "Semantic Overlap Summarization among Multiple Alternative Narratives: an Exploratory Study". In COLING, 2022. Paper Dataset
- [AACL 2022] Ralph (Alex) Knipper, Md. Mahadi Hassan, Mehdi Sadi, Shubhra Kanti Karmaker. "Analogy-Guided Evolutionary Pretraining of Binary Word Embeddings". In AACL/IJCNLP, 2022. Paper
- [AACL 2022] Souvika Sarkar, Dongji Feng, Shubhra Kanti Karmaker. "Exploring Universal Sentence Encoders for Zero-shot Text Classification". In AACL/IJCNLP, 2022. Paper
- [BigData 2022] Yash Mahajan, Sheikh Rabiul Islam, Md. Ruhul Amin, Shubhra Kanti Karmaker. "Data-Driven Estimation of Effectiveness of COVID-19 Non-pharmaceutical Intervention Policies". In IEEE BigData, 2022. Paper
- [IUI 2021] Biddut Sarker Bijoy, Syeda Jannatus Saba, Souvika Sarkar, Md Saiful Islam, Sheikh Rabiul Islam, Md. Ruhul Amin and Shubhra Kanti Karmaker. "COVID19𝛼: Interactive Spatio-Temporal Visualization of COVID-19 Symptoms through Tweet Analysis". In ACM IUI 2021. Paper Demo Video Tutorial
- [CIKM 2020] [**Best Poster Nomination**] Shubhra Kanti Karmaker Santu, Parikshit Sondhi and ChengXiang Zhai. "Empirical Analysis of Impact of Query-Specific Customization of nDCG: A Case-Study with Learning-to-Rank Methods". In ACM CIKM, 2020. Paper Presentation
- [ICWSM 2020] Naeemul Hassan, Amrit Poudel, Jason Hale, Claire Hubacek, Khandakar Tasnim Huq, Shubhra Kanti Karmaker Santu, Syed Ishtiaque Ahmed. "Towards Automated Sexual Violence Report Tracking". In ICWSM 2020. Paper
- [CoNLL 2019] Shubhra Kanti Karmaker Santu, Kalyan Veeramachaneni, ChengXiang Zhai. "Neural Language Models with Evolving Topical Influence". In ACL SIGNLL CoNLL 2019. Paper
- [CIKM 2019] Saar Kuzi, Sahiti Labhishetty, Shubhra Kanti Karmaker Santu, Prasad Pradip Joshi and ChengXiang Zhai. "Analysis of Adaptive Training for Learning to Rank in Information Retrieval". In ACM CIKM 2019. Paper
- [CIKM 2018] Shubhra Kanti Karmaker Santu, Liangda Li, Yi Chang, ChengXiang Zhai. "JIM: Joint Influence Modeling for Collective Search Behavior". In ACM CIKM 2018. Paper Presentation
- [CIKM 2017] Yiren Wang, Dominic Seyler, Shubhra Kanti Karmaker Santu, ChengXiang Zhai. "A Study of Feature Construction for Text-based Forecasting of Time Series Variables". In ACM CIKM 2017 [Short Paper]. Paper Presentation
- [SIGIR 2017] Shubhra Kanti Karmaker Santu, Parikshit Sondhi, ChengXiang Zhai . "On Application of Learning to Rank for E-Commerce Search". In ACM SIGIR 2017. Paper Presentation
- [WWW 2017] Shubhra Kanti Karmaker Santu, Liangda Li, Dae Hoon Park, Yi Chang, ChengXiang Zhai . "Modeling the Influence of Popular Trending Events on User Search Behavior". In WWW 2017. Paper Presentation
- [CIKM 2016] Shubhra Kanti Karmaker Santu, Parikshit Sondhi, ChengXiang Zhai . "Generative Feature Language Models for Mining Implicit Features from Customer Reviews". In ACM CIKM 2016. Paper Presentation
- [IJCNN 2014] Md. Mustafizur Rahman, Shubhra Kanti Karmaker Santu, Md. Monirul Islam, Kazuyuki Murase. "Forecasting time series - A layered ensemble architecture". In IJCNN 2014. Paper
- [CEC 2014] Shubhra Kanti Karmaker Santu, Md. Mustafizur Rahman, Md. Monirul Islam, Kazuyuki Murase. "Towards better generalization in Pittsburgh learning classifier systems". In IEEE CEC (Congress on Evolutionary Computation) 2014. Paper Presentation
Peer-Reviewed Workshop Papers
- [UserNLP@WWW 2022] Souvika Sarkar and Shubhra Kanti Karmaker Santu. "Concept Annotation from Users Perspective: A New Challenge". In UserNLP@WWW 2022. Paper
- [WPES@CCS 2018] Shubhra Kanti Karmaker Santu, Vincent Bindschaedler, ChengXiang Zhai, Carl A. Gunter. "NRF: A Naive Re-identification Framework". In WPES@ACM CCS 2018. Paper Presentation
Arxiv Pre-prints
- [Arxiv 2023] Mousumi Akter, Shubhra Kanti Karmaker Santu. "FaNS: a Facet-based Narrative Similarity Metric." In CoRR abs/2309.04823 (2023). Paper
- [Arxiv 2023] Md. Mahadi Hassan, Alex Knipper, Shubhra Kanti Karmaker Santu. "ChatGPT as your Personal Data Scientist." In CoRR abs/2305.13657 (2023). Paper
- [RWDS 2023] Alex Knipper, Naman Bansal, Jingyi Zheng, Wenying Li, Shubhra Kanti Karmaker Santu "Food for Thought: First place winners – Auburn Big Data." In Real World Data Science, August 21, 2023. Report
- [Arxiv 2019] Lei Xu, Shubhra Kanti Karmaker Santu, Kalyan Veeramachaneni. "MLFriend: Interactive Prediction Task Recommendation for Event-Driven Time-Series Data." In CoRR abs/1906.12348 (2019). Paper