DEV Community

Cover image for Join us for the Bright Data Web Scraping Challenge: $3,000 in Prizes!

Join us for the Bright Data Web Scraping Challenge: $3,000 in Prizes!

dev.to staff on December 11, 2024

We are excited to team up with Bright Data to bring the community a new challenge. Running through December 29, the Bright Data Web Scraping Chall...
Collapse
 
b-d055 profile image
Bryan Doss

This one was fun, thanks @noahbrinker @thepracticaldev!

Collapse
 
noahbrinker profile image
Noah Brinker

Can't wait to see everyone's submissions!

Collapse
 
manchicken profile image
Mike Stemle

I wish this also had guidance on ethical approaches to scraping. Just because we can scrape and train AI doesn't entitle us to disregard the hard work that authors, journalists, and artists produce by scraping and deriving from their work without consent or compensation.

But Bright Data's terms of service and license are to be respected.

This all just seems so wildly unethical.

Collapse
 
sarahokolo profile image
sahra 💫 • Edited

@thepracticaldev @jess For the second prompt, at the heading, it states "Build a web scraper API..." and at the start of the text below it says "Use a Web Scraper API..." This has me a bit confused. Are we supposed to build an API that returns data scraped by Bright's web scraper API?

Collapse
 
ciju_8aec3adcdb79f5e678db profile image
CIJU

I think they are trying to say to use bright data api to solve any business problem. This will probably be judged based on the novelty of the business problem and the complexity of the sources being scraped… IG.

Collapse
 
sarahokolo profile image
sahra 💫

Thankss

Collapse
 
delaaja profile image
Dela • Edited

For the third prompt, do we need to submit a running, working AI model fine tuned with the data (which would require us to host the model at our own expense), or can we submit just the data normalization pipeline, up to the point where the normalized data is about to be fed into the model?

Collapse
 
jess profile image
Jess Lee

Hey @delaaja, you can just submit the pipeline and not the fully tuned model.

Collapse
 
srbhr profile image
Saurabh Rai

This sounds like a nice idea to work with!

Collapse
 
fahminlb33 profile image
Fahmi Noor Fiqri

Cool hackathon! Can't wait to submit my project idea.

One problem, I didn't get the $15 credit after signing up using the provided link, I only get $2 trial credits. I signed up using Google login.

Collapse
 
jess profile image
Jess Lee

Hey @fahminlb33, if you haven't already please email noah@brightdata.com for support!

Collapse
 
alexanie_ profile image
Alex Anie

So I have a question. Is it compulsory we include the GitHub repo of the project or just the project live Demo @noahbrinker @thepracticaldev

Collapse
 
benndora1 profile image
Ben Ndora

Lets do this guys

Collapse
 
sarahokolo profile image
sahra 💫

This should be fun : )

Collapse
 
trixsec profile image
Trix Cyrus

Gonna be fun let's do this

Collapse
 
ivansing profile image
IvanDev

Hum, this is the one I will finally deep into!