Introduction
In my role as a software testing intern at HNG TECH LIMITED, I recently got the chance to assess and try out ScrapeAnyWebsite, a Python tool created for simplifying web scraping tasks.
This post summarizes my discoveries, points out a major issue, and proposes enhancements to improve the application's performance. My aim is to offer useful insights that can benefit both ScrapeAnyWebsite users, testers, and developers.
Summary of ScrapeAnyWebsite
ScrapeAnyWebsite is software for desktop computers that enables you to effortlessly extract data from any website. You have the option to input either a single url or multiple urls, and then quickly extract data from those websites to your device. The tool abides by all limitations on downloading from websites as determined by the website owner.
Key Features
Easy-to-use interface: Streamlines web scraping complexities, enabling users to concentrate on extracting data.
Flexibility: Ability to accommodate multiple URLs.
Integration: Seamlessly gives speedy results, improving its usefulness for data analysis.
Headless mode: The user has the option to operate in headless mode or not.
Testing Process
My testing process involved the following steps:
Installation and configuration of ScrapeAnyWebsite for testing on my Mac via the Parallels Desktop application on the AppStore. Note: ScrapeAnyWebsite is not available on the App Store.
Assessing the application features.
I then tried to understand the main aim of the application and how to carry out my test plan.
Evaluating the desktop tool's efficiency and stability in different scenarios.
Assess the performance and robustness of the tool under various conditions, such as OS.
Test Report
While testing, so many inconsistencies, functional, performance, and usability issues were encountered, which I have noted down here for the development team to work on in order to provide a great user experience for our users.
Below are the reports of the tests carried out:
A user is not able to add a scrape name since the user cannot see what is being typed. This can lead to the error of typing the wrong name.
The user cannot save a scrape name because there's nothing showing in the "enter scrape name" field.
The user was unable to scrape a website even after adding the URL.
The user was able to scrape a website.
The user is unable to edit the details via the edit button. If the user is not allowed to edit input details, the functionality shouldn't be there. Please see the screenshot.
The "stop scraping" button takes time to stop. It lingered for about 10 seconds even after several clicks before stopping. See screenshot.
The user was able to edit the scrape job name successfully.
No new URL was added after toggling on the "Discover new URLs" button for several minutes. If no new URLs were found, they should be communicated.
The user was able to successfully delete a scraped job name at the first attempt.
The "stop scraping" function did not respond at all. It got stuck for about three minutes; even after exiting the said scrape job name, clicking, and trying to stop it, nothing changed. See screenshots.
While scrolling down over 2,000 URLs, it jumps back to the top, leaving the user clueless and incapable of scrolling to a desired URL.
Information for Installation:
Below is the information you might need for a successful installation:
OS: Windows 10 version 17763.0 or higher.
Installed version: 1.1.19.0
Link to the website: Scrape Any Website
Link to the download page: Scrape Any Website
Bug Report: Bug Report
Summary
Trying out ScrapeAnyWebsite has proven to be a beneficial learning opportunity. The tool shows potential for web scraping, but enhancements are required for efficient handling and a great user experience. By tackling these problems and improving the tool's features, ScrapeAnyWebsite can evolve into a more robust tool for extracting data.
Call to Action
I urge users and developers to take part in enhancing ScrapeAnyWebsite's growth. Provide feedback, propose improvements, and engage in the community to assist in enhancing this tool. Collaboratively, we can enhance the accessibility and effectiveness of web scraping for all individuals.
Stay Tuned
Follow my blog for additional information and updates on software testing and tech products. We will look into ethical web scraping practices in upcoming posts and delve into advanced data extraction methods. Enjoy scraping!
Happy Testing and Improving!😎👍
Motunrayo Joseph | Product Tribe.
Top comments (4)
Thank you for sharing your knowledge about ScrapeAnyWebsite software. You did great!
Thank you so much Umar.
This is great Rayo! Keep it up.
Thank you!