All Questions
Tagged with selenium-webdriver web-scraping
8,434
questions
0
votes
0
answers
8
views
Can't found item in scrapy in dynamic content
i'm webscraping a page using selenium and scrapy, the page is dynamic so i want until the item is full loaded then i extract it, the problem is that selenium can find the item but when i extract it ...
0
votes
1
answer
45
views
Can't scrape all the data from a lazy-loading table using Selenium
I'm trying to scrape three fields (player, logo, dkprice) from a table located in the middle of a webpage. To see all the data in that table, it is necessary to scroll down to the bottom of it.
I've ...
- 187
0
votes
0
answers
32
views
Selenium Web Scraping on Google Maps: Clicking on all markers/points in view
I'm fairly new to Selenium and am looking to learn how to use it to click on all the markers or points on Google Maps in my view only. I’ve tried following some examples, but they either only work ...
0
votes
0
answers
15
views
What is the easiest way to save an captcha image from a .php page?
I've been trying to extract captcha images from a .php page but have had no luck so far, is there a simple(ish) way to do this? I've been trying with python with selenium so far and would like to keep ...
- 1
-2
votes
0
answers
176
views
Scraping captcha from a website using selenium but the code won't produce an actual image
I'm trying to edit the code to save captchas in the hopes to eventually write a bot for automation. The following python code results in the subsequent error.
import requests
from selenium import ...
- 1
0
votes
2
answers
53
views
findAll() returning empty outputs
I'm trying to scrape the title, date, rating and actual review of each reviews form mouthshut.
But I'm unable to extract anything under the title of page.
The review is in tag under class 'more ...
- 11
-2
votes
0
answers
32
views
bypass API key requirement
I'm trying to communicate to income tax portal (this website https://eportal.incometax.gov.in/iec/foservices/#/login) via Selenium-Python-Firefox and getting struck at this on opening
API Key Required
...
- 1
0
votes
0
answers
21
views
Selenium don't find class
I'm trying to obtain a value from Google Shopping and have attempted to use CSS, className, and XPath.
However, nothing seems to work and it always returns an empty value. As you can see from the ...
0
votes
0
answers
23
views
Selenium unable to click on element
I am working on a web scraping project using Selenium in Python and am encountering an issue while interacting with the Lufthansa homepage. My goal is to click a specific element (the Departure field) ...
1
vote
1
answer
34
views
Scraping Collapsible Table in R
I am using R Selenium to collect data from a collapsible table. I have been successful in scraping the main table, but I would also like to collect the sub-table data for each company.
library(...
- 11
0
votes
1
answer
43
views
Why is my Selenium script only scraping data for 7 matches on F O R E B E T?
I'm working on a web scraping project using Selenium to scrape football match data from a sports prediction website ( lets use EXAMPLE for F O R E B E T) . However, my script only retrieves data for 7 ...
-1
votes
0
answers
26
views
Trying to scrap this web page that contents this type of authentication
I need help, I am trying to scrap a web page but I need log, the problem is this type of authentication. The authentication form shown in the screenshot is a basic browser authentication popup, which ...
0
votes
3
answers
52
views
How to obtain data from an IFRAME with Python and Selenium
I am trying to obtain a value from this page: https://www.bbva.com.co/personas/productos/inversion/fondos/pais.html
I the imagen, I show you what I need to obtain.
Inspected page
The first thing that ...
- 3
-3
votes
1
answer
61
views
Selenium webscraping recaptcha [closed]
I want to scrape a website but before that there is a recaptcha and I even got the data using api,and i also injected it into the website as the webpage has no submit button I couldn't submit. the ...
-4
votes
1
answer
38
views
Best approach to simulate purchases for stock level information using Python and Selenium [closed]
I'm developing a web scraping service, primarily focusing on the fashion industry. My goal is to provide comprehensive data about products, including their stock levels. To achieve this, I need to ...
