The Ethics of Web Scraping In Research: A Review: Investigating the Boundaries, Legal Implications, and Societal Acceptance of Web Scraping As a Data Collection Method
Abstract
This study provides a comprehensive review of the ethical, legal, and societal aspects of web scraping as a data collection method in modern research. The primary objective is to explore the boundaries, legal implications, and societal acceptance of web scraping, aiming to guide its responsible and sustainable use. Employing a systematic literature review methodology, the study analyzes peer-reviewed articles published between 2010 and 2023, focusing on interdisciplinary perspectives. The methodology involves a detailed search strategy, strict inclusion and exclusion criteria, and a thematic synthesis of the selected literature. Key findings reveal that ethical concerns in web scraping predominantly revolve around privacy, consent, and data ownership, while legal challenges are characterized by the ambiguity of international laws and regulations. Societal acceptance varies, influenced by the perceived benefits and risks of web scraping, with public opinion playing a significant role. The future outlook suggests evolving practices and norms in web scraping, driven by advancements in AI and machine learning, yet accompanied by emerging ethical and legal complexities. The study concludes with a call for responsible and ethical web scraping practices, emphasizing the need for a balanced approach that respects privacy, adheres to legal standards, and aligns with societal values. Future research directions are identified, focusing on filling gaps in understanding the ethical, legal, and societal implications of web scraping. This study contributes to the development of informed guidelines and practices in the evolving field of web scraping, ensuring its alignment with ethical standards, legal requirements, and societal expectations.
How to Cite This Article
Iboro Akpan Essien, Ayobami Oluwadamilola Adebayo, Afeez A Afuwape, Bukky Okojie Eboseremen, Farid Oladega, Olabode Michael Soneye (2023). The Ethics of Web Scraping In Research: A Review: Investigating the Boundaries, Legal Implications, and Societal Acceptance of Web Scraping As a Data Collection Method . Journal of Frontiers in Multidisciplinary Research (JFMR), 4(1), 529-538. DOI: https://doi.org/10.54660/.JFMR.2023.4.1.529-538