Help! Dooplay imdb ttcode scraper

Started by Videospider, 01-27-2020

1053
7
Help! Dooplay imdb ttcode scraper
  01-27-2020, 04:22 PM
#1
Help how to auto scrape imdb ttcode in website and auto post to dooplay dbmovies.

  01-27-2020, 07:17 PM
#2
Hi, you can try to program your own script with python selenium and automate that kind of stuff, python and selenium is kind of easy to learn just watch a couple of videos and if the html is consistent on the website it will be a piece of cake to scrape

  01-28-2020, 12:19 PM
#3
(01-27-2020, 07:17 PM)emrekaymak Wrote:
Hi, you can try to program your own script with python selenium and automate that kind of stuff, python and selenium is kind of easy to learn just watch a couple of videos and if the html is consistent on the website it will be a piece of cake to scrape

I dont know how to code, that would be a problem.

  01-28-2020, 06:59 PM (Updated: 01-28-2020, 07:52 PM by emrekaymak.)
#4
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
import time

chrome_options = Options()
chrome_options.add_argument("--headless")
chrome_options.add_argument("--window-size=1920x1080")

chrome_driver = "C:\chromedriver.exe"
#browser = webdriver.Firefox(executable_path=r"C:\\geckodriver.exe")
browser = webdriver.Chrome(chrome_options=chrome_options, executable_path=chrome_driver)

z = 1
x = 1
y = 1
k = 1
browser.get('https://www.imdb.com/search/title/?genres=comedy&view=simple&start=1&explore=title_type,genres&ref_=adv_nxt')


while y <= 999:

if x == 51:
# Variable I is for the next page
y = x + 1
# reset x to first div again
browser.find_element_by_class_name('next-page').click()
time.sleep(2)
x = 1


splitingURL = browser.find_element_by_xpath('//*[@id="main"]/div/div[3]/div/div[' + str(x) + ']/div[2]/div/div[1]/span/span[2]/a').get_attribute('href')
ttcode = splitingURL.split('/', 5)[4]

# this is the ttcode i dont know what you want to do with it store it on textfile you can search google for it :)
print(ttcode)
x = x + 1
k = k + 1

=================================================================================
This is basically what you need to code(this is for collecting ttcode you can implement a way to make it add it to dooplay automatically) nothing to difficult bro if you need help you can ask me, if you try to research and cannot find I can help you maybe but my code will not be 100% perfect


You can install any python ides I prefer pycharm, create a project use the terminal to install selenium (pip install selenium) and then copy paste this code to a .py file you create

  01-30-2020, 07:36 PM
#5
(01-28-2020, 06:59 PM)emrekaymak Wrote:
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
import time

chrome_options = Options()
chrome_options.add_argument("--headless")
chrome_options.add_argument("--window-size=1920x1080")

chrome_driver = "C:\chromedriver.exe"
#browser = webdriver.Firefox(executable_path=r"C:\\geckodriver.exe")
browser = webdriver.Chrome(chrome_options=chrome_options, executable_path=chrome_driver)

z = 1
x = 1
y = 1
k = 1
browser.get('https://www.imdb.com/search/title/?genres=comedy&view=simple&start=1&explore=title_type,genres&ref_=adv_nxt')


while y <= 999:

    if x == 51:
        # Variable I is for the next page
        y = x + 1
        # reset x to first div again
        browser.find_element_by_class_name('next-page').click()
        time.sleep(2)
        x = 1


    splitingURL = browser.find_element_by_xpath('//*[@id="main"]/div/div[3]/div/div[' + str(x) + ']/div[2]/div/div[1]/span/span[2]/a').get_attribute('href')
    ttcode = splitingURL.split('/', 5)[4]

    # this is the ttcode i dont know what you want to do with it store it on textfile you can search google for it :)
    print(ttcode)
    x = x + 1
    k = k + 1

=================================================================================
This is basically what you need to code(this is for collecting ttcode you can implement a way to make it add it to dooplay automatically) nothing to difficult bro if you need help you can ask me, if you try to research and cannot find I can help you maybe but my code will not be 100% perfect


You can install any python ides I prefer pycharm, create a project use the terminal to install selenium (pip install selenium) and then copy paste this code to a .py file you create

Saved for later use.
Thanks for sharing my man!

  01-31-2020, 02:59 AM
#6
(01-30-2020, 07:36 PM)PotatoG Wrote:
Saved for later use.
Thanks for sharing my man!
No problem, glad if I helped

  02-12-2020, 09:04 AM
#7
(01-30-2020, 07:36 PM)PotatoG Wrote:
Saved for later use.
Thanks for sharing my man!

Can i also auto import all the imdb ttcode collected from scraping to dooplay dbmovies?

  02-19-2020, 03:46 PM
#8
Hello , i tried the code but it wont work its give me that error
if x == 51:
# Variable I is for the next page

« Next Oldest | Next Newest »


Possibly Related Threads…
Thread Author Replies Views Last Post
Astra Pro Help psvialli 1 168 11-29-2022, 11:05 AM
Last Post: vengence
Elementor pro 3.5.2 blocked. HELP! najiji 3 928 09-19-2022, 08:36 PM
Last Post: Vesnapancic
Help viter7960 0 306 03-08-2022, 04:41 AM
Last Post: viter7960
Dooplay 2.5.5. vntsps3 1 974 01-31-2022, 04:09 AM
Last Post: benja123
Dooplay help using 2 diffrent players. LordFenixNC 0 446 12-28-2021, 03:12 PM
Last Post: LordFenixNC
help with vBullitin 5.6.4 barzi 0 371 12-13-2021, 01:52 PM
Last Post: barzi
Need help nulling WP Review Slider Pro rubixvi 7 1,820 09-26-2021, 09:07 PM
Last Post: Brittayla93
Dooplay auto embed without pop ads moerrrmoe 0 655 09-23-2021, 06:15 PM
Last Post: moerrrmoe
Help in Creating Custom Image Xenforo Badges arjoe_ajfc 0 290 09-09-2021, 09:02 PM
Last Post: arjoe_ajfc
Auto Embed Player Api for Dooplay Themes with Magnet (Torrent) and Subtitles Search! redehaka 24 6,633 09-01-2021, 04:30 PM
Last Post: achillecotone



1 Guest(s)