Or you could’ve used xpath and bs4 and have been done in an hour or two and have... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		isatty 6 months ago \| parent \| context \| favorite \| on: AWS CEO says using AI to replace junior staff is '... Or you could’ve used xpath and bs4 and have been done in an hour or two and have more understandable code.

demirbey05 6 months ago [–]

it is not that easy, there is lazy loading in the page that is triggered by scroll of specific sections. You need to find clever way, no way to scrape with bs4, so tough with even selenium.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact