Octoparse Proxy Integration
What is Octoparse?
Octoparse is an easy-to-use tool that turns web pages into organized data without needing any coding. It’s perfect for everyone, from beginners to big companies, making web data collection simple for all.
Key Features of Octoparse
Octoparse stands out with its intuitive and user-friendly interface, making web scraping a breeze for anyone. Leverage the power of AI for seamless scraper configurations, and immerse yourself in a visual workflow tailored for ease and efficiency. Benefit from continuous 24/7 cloud scraping and timely data extraction. Overcome web scraping hurdles with features like IP rotation and CAPTCHA handling. And with pre-configured templates for popular sites, alongside customizable tasks for specific requirements, all the web data you need is just a click away.
Steps to integrate Octopase with Bright Data proxies
Sign up to Bright Data:
After signing up, in the Bright Data dashboard, navigate to the “Proxy & Scraping Infrastructure” section and Add a new designated Zone for your proxy usage.
Select proxy type:
In this example, we will show how to set up ISP proxies.
Name proxy solution:
Set the desired IP type, shared IPs, dedicated IPs, or premium IPs.
Select IP count:
Fill in the number of IPs you need.
Country & city selection:
Choose your desired country and city for the IP location.
Choose domain:
Use specific domains or use ‘All domains’ for one IP to target websites using the same IP.
Add zone:
Click the “Add” button to create the Zone.
Access parameters:
Click on the name of your Zone, navigate to the “Access Parameters” tab, and note down the proxy credentials:
- host
- port
- username
- password
Setting up Octoparse with Bright Data proxies:
- Sign up for a free Octoparse account.
- Download Octoparse as per your OS.
- Go to settings on the login panel
Proxy configuration:
Choose Manual proxy configurations.
Proxy credentials:
Retrieve the required proxy details from your previously set up Bright Data zone:
- IP address
- Port
- Username
- Password
Input proxy details:
Fill in your proxy details
- IP Address: brd.superproxy.io
- Port: 22225
- Username: [Your Bright Data username]
- Password: [Your Bright Data password]
Test connection:
Confirm the setup
How to configure rotating proxies
Open task for setup:
Open the task you would like to set up proxies for and go to the task settings.
Anti-blocking section:
Go to the Anti-blocking section.
Check Access websites via proxies.
Now, choose the ‘Access websites via proxies’ option.
Select Use my own proxies:
Select Use my own proxies and click configure.
Bright Data zone configuration:
Go back to the Bright Data zone configuration section and download IP’s list.
Paste the IP’s in Octoparse:
Save the setup.
Event log:
To confirm the use of your Bright Data proxy, refer to the Event Log section in your
Proxies & Scraping Infrastructure dashboard.
Ready to get started?
Angetrieben von einem preisgekrönten Residential-Proxy-Netzwerk
Über 72 Millionen residential IPs, erstklassige Technologie und die Fähigkeit jedes Land, jede Stadt, jeden Anbieter und jede ASN zu erreichen, machen unsere Premium-Proxy-Dienste zur ersten Wahl für Entwickler
Proxy-Arten für jeden Bedarf
Residential Proxys
- 72,000,000+ IPs
- Verfügbar in 195 Ländern
- Das größte rotierende Real-Peer-IP-Netz
- Zugriff auf und Crawlen durch alle anspruchsvollen Websites
Datacenter Proxys
- 770,000+ IPs
- Verfügbar in 195 Ländern
- Geteilte und dedizierte IP-Pools verfügbar
- Schneller Zugriff auf nicht komplexe Websites
ISP-Proxys
- 700,000+ IPs
- Verfügbar in 35 Ländern
- Echte statische private IPs ohne IP-Rotation
- Optimal für die Anmeldung an mehreren Konten
Mobile Proxies
- 7,000,000+ IPs
- Verfügbar in 195 Ländern
- Größtes echtes Peer-3G/4G-IP-Netz der Welt
- Mobil-Anzeigen überprüfen und durch Mobil-Websites crawlen