I am in need of a sk...scraping tool for me. The purpose of this tool is to download JPEG product images from a specified URL that increments numerically. Key Requirements: - Scrape images from a continuously changing URL (i.e., www.****/asdasd/1234 then 1235, and so on). - Ability to tweak URL structure according to my needs. - Images must be saved in JPEG format. The ideal candidate for this task: - Has experience in web scraping and dealing with dynamic URLs. - Understands how to name files after the URL page number. Please note that the key goal is to download product images, not data extraction or process automation. Hence, your proposal should focus on delivering this specific requirement. Your understanding of this project and relevant skills will be evident in your det...
I am seeking a proficient Python programmer who can create a web scraper for Lazada. Key Responsibilities Include: - Develop a Python program that will enter query in search box and scrape Lazada for the following data: product name, images, price, description, seller, and URL. - The scraper should be able to handle pagination plus also bypass captcha using 2captcha api Ideal Skills and Experience: - Proficiency in Python and web scraping frameworks. - Familiarity with the Lazada's web structure and data extraction. - Experience creating scrapers for e-commerce platforms. Website lazada .
I'm looking to build a custom scraper for DeFi exchanges. The main features I'm interested in are: - Historical data analysis: This is crucial for me to make well-informed decisions about the market trends. - Real-time data updates: Although not explicitly stated in the questions, the bot will need to be able to update data in real-time. This will help me stay ahead of the market. I currently prefer the output in CSV format, as it is easy and widely used. Given the nature of the DeFi space, experience in cryptocurrency scraping bots is a must. It would be ideal to have experience with DeFi exchanges particularly. This project will require strong skills in programming languages such as Python, R, or JavaScript, as well as experience in data scraping and an...
I'm in need of a skilled professional that can create a Power Automate Flow to synchronize data between Microsoft Forms and SharePoint in real-time. Key Requirements: ...professional that can create a Power Automate Flow to synchronize data between Microsoft Forms and SharePoint in real-time. Key Requirements: - Set up a Power Automate Flow for real-time data synchronization between Microsoft Form and SharePoint including lookup column from one dataset to be linked to the main dataset - Ensure seamless and reliable synchronization of data without any loss or delay. Ideal Skills and Experience: - Proficiency in Power Automate and its functionalities. - Expertise in data synchronization between Microsoft Forms and SharePoint. - Experience in working with real-time synchroniz...
I'm looking for a skilled data scraper who can help me extract contact information from Website 1 and deliver it in Google Sheets. Key Requirements: - Scraping: The primary task is to scrape contact information from Website 1. - Data Delivery: I prefer the scraped data to be delivered in Google Sheets. Ideal Skillset: - Web Scraping: A strong understanding of web scraping techniques and tools is essential. - Data Handling: Proficiency in handling and organizing data in Google Sheets is preferred. Please ensure that you have prior experience with similar projects and can provide a sample of your work for review.
...to my own channel. Key Results: - Extract or scrape customer data from specified Telegram channels or Groups. - The type of data required is mainly (phone number - user) - Extracting data from private channels or groups - Provides a complete list of extracted customers - Ensure customer data is ready to easily import into my channels for invitations Ideal Skills & Experience: - Proficiency in web scraping tools and techniques - Experience with Telegram algorithms - Experience with Telegram API or similar platforms - Proven track record in handling and managing large amounts of data - Strong communication skills to provide detailed project proposals Please ensure that your application contains a detailed project proposal. Note: I'm not an admin in groups or channels, ...
...Escalation Matrix to be shared with our team. • Bidder will facilitate the Bug Reporting mechanism for our team. • Bidder will acknowledge the issue with resolution time & root cause analysis via Email as per agreed timelines. • We may ask Bidder resources to visit our premises as per requirement. • The Bidder must accurately acknowledge/resolve all issues within the agreed timelines. In case of delay in Acknowledgment/Resolution of issues. • The bidder team will provide a Training Manual, user training, and administrative. Manpower Cost (Offsite, Optional Change Management Cost) Bidder is needed to provide the per Day Cost of Change Manpower to perform the Change Management that may be required in the future by us and not included in Parts A...
I am looking for a data scraper to extract information from the JazzCash agent locator list available on their website (). Key Requirements: - I need the data to be delivered in an Excel spreadsheet format. - The specific details that I require for each Jazz locator are the Name and Address, along with the Services offered. - The scraping needs to be done only once; it will not be recurring. Ideal Skills and Experience: - Proficiency in web scraping, particularly using tools like Python's Beautiful Soup or Scrapy. - Experience in extracting data from websites with dynamic content. - Strong attention to detail to ensure accurate data extraction. - Previous experience with similar data scraping projects will be an advantage. I am particularly interested
I require a professional data scraper to scrape multiple websites. Key tasks include: - No limitation on type of data scraped as this was not specified. - Scraping must be done across multiple websites, specifics will be provided upon project commencement. - All data should be delivered in Excel spreadsheet format. Ideal skills and experience: - Prior experience in web scraping across multiple diverse websites. - Proficient in using different scraping tools. - Strong understanding of Excel and data parsing. - Attention to detail and commitment to high quality, error-free work.
I'm in need of an experienced data scraper to scrape and collect text data from multiple websites including social media platforms. It's a high-volume job with an emphasis on accuracy and efficiency. Ideal Skills and Experience: - Proficiency in data scraping tools and software - Experience with scraping text data from multiple sources - Familiarity with various types of websites and social media platforms - Fast turnaround time, without compromising the quality of work - Attention to detail is paramount - Previous experience in similar projects would be a plus Please bear in mind, I need someone capable of navigating multiple websites for meaningful extraction, we're not just talking surface-level data scraping. This project requires depth and precision.
Hello I am looking for a python code to scrape a large number pages and save them as html. In order to get to the page to save, you must click a radio button, submit, and then enter a string of numbers, then submit and then save the html. If the string entered provides an error then you must skip to the next iteration. There is no human verification. I already have a version I made myself that works with Selenium, however I need to increase the speed, so I am looking for someone to see if its possible to do this without even opening a browser and possibly using direct call methods (get, request, cURL, response, JSON?). It should be a simply project for someone who knows how to do this. Please enter the result of 3+2 for your message to be received.
I require a professional data scraper to scrape multiple websites. Key tasks include: - No limitation on type of data scraped as this was not specified. - Scraping must be done across multiple websites, specifics will be provided upon project commencement. - All data should be delivered in Excel spreadsheet format. Ideal skills and experience: - Prior experience in web scraping across multiple diverse websites. - Proficient in using different scraping tools. - Strong understanding of Excel and data parsing. - Attention to detail and commitment to high quality, error-free work.
We are in search of an experienced Web Scraper to uncover price points across multiple websites and categories for us. Key Requirements: * Compile pricing information from the following platforms: Amazon, , , , , , , , , , nykaaman.com. * The scraping project should cater to several products and categories rather than specific ones. * Implement scraped data directly into the backend of our website using PHP. Ideal Skills: * Proficiency in web scraping scripts and tools * Deep knowledge and experience in PHP programming * Familiarity with the aforementioned websites' structures and processes * Ability to handle data scraping projects from a wide range of product categories
...Insights score. My Laravel 10 blade code currently supports the following functionalities: - User authentication - Database integration - API integration The Core Web Vitals that need improvement are: - Excessive Dom - Largest Contentful Paint (LCP) - First Input Delay (FID) - Cumulative Layout Shift (CLS) - First Contentful Paint A critical aspect requiring attention is that the fixed menu across the site should not reload with every page change. Skills and experience required: - Proven track record in Laravel10 blade code performance enhancement - In-depth understanding and experience addressing Google PageSpeed and Core Web Vitals issues - Proficiency in Laravel 10 blade coding with User Authentication, Database, and API integration know-how - Strong pro...
I'm looking for a skilled developer to create a one-time scraper for the TruePeopleSearch website. The scraper should focus on extracting addresses and phone numbers, and the output should be in CSV format. Key Requirements: - Develop a scraper for TruePeopleSearch - Extract addresses and phone numbers - Output the data in CSV format Ideal skills and experience for this project: - Proficient in web scraping - Experience with scraping tools and techniques - Proficient in CSV formatting - Understanding of data extraction from websites
I'm after a website that I'm hoping can be built with WordPress + Elementor. The website will scrape data from a website called PriceCharting which tracks prices for video game. There are existing scripts for this. The website will showcase 3 random video games from within a category to the user. The users task is to click on the video game that they think is the most expensive. If they're right, it says they're correct. If they're wrong, it says they're incorrect. They then move onto the next item. I've created a mockup that I can show you. Landing page: After selecting a platform, currency and condition: After choosing the correct answer: After choosing the wrong answer: Happy to talk more. Will ignore any copy and paste proposals. I'll p...
...skilled Python developer to create a scraper for me. The primary task of this scraper will be to extract website content. Here are the specifics of the project: - Data Extraction: The scraper should be able to collect data from a specific website. This data will be in the form of text and images. - Update Frequency: I require the data to be updated once. This means that the scraper should be designed to pull the data once and not re-visit for updates. - Data Format: The extracted data should be saved in a CSV file. This is the preferred format for the end result of the scraping process. Ideal Skills and Experience: - Proficiency in Python: A strong background in Python programming is essential. - Web Scraping Experience: Previous experience with ...
python chrom headless script which will visit given list of URLs/websites aftear each config delay in seconds. script will use different ip in each iteration of list urls visit. it will keep running untill ip list end and start from 1 again. You will suggest from where i will buy rotating ip proxies which not blocked by the urls. Purpose of this script. visit given list of urls with different ip proxies. rotating ip proxies will be fine these are example urls: one is this link :
python chrom headless script which will visit given list of URLs/websites aftear each config delay in seconds. script will use different ip in each iteration of list urls visit. it will keep running untill ip list end and start from 1 again. You will suggest from where i will buy rotating ip proxies which not blocked by the urls. Purpose of this script. visit given list of urls with different ip proxies. rotating ip proxies will be fine these are example urls: one is this link :
I'm in need of an experienced web scraper, proficient in Python, to gather pricing data from a range of websites. Key Requirements: - The scraper must specifically target and extract pricing information. - The project involves scraping data from a moderate amount of websites (between 1 to 5), so the ability to efficiently manage multiple sources is a must. - The final delivery should be not just raw data, but organized and cleaned data. Ideal Skillset: - Proficient in web scraping tools and techniques, especially with Python. - Experience with handling and cleaning data. - Ability to manage multiple sources of data effectively. - Experience in working with pricing data is a plus. Please bid if you meet these requirements and can deliver efficient and w...
I'm looking for a professional who can develop a standalone web scraper for Envato Requirements as provided here - Looking for someone who can begin immediately and finish this within 24 hours. Please only bid, if you're able to finish this in 24 hours
I would like a chrome or extension. The extension should be able to retrieve keywords from a given text or excel file and perform one by one google search at a time (line by line). Google AD results will be extracted to a file (the URLs).
I am in need of a developer who can create: -A web scrapping process extract text content from (initially) a single ecommerce website. -A web/mobile application that read the extracted data and inform on data change. This app will have: -A control panel to administer the pages to be scrapped and the details (like filters). -A page to display the extracted that with action buttons to discard the element or to add new filters (based on this element). - The task involves scraping text content and related images. - The scraping process should be automated to run every X minutes (to be configured) Ideal skills for this job include: - Proficient in web scraping techniques and tools. - Ability to create and maintain an automated scraping process. - Ability to create cus...
I need a Vissim expert to simulate a signalized intersect...follow specific conditions based on data from queue counters. - The simulation will need to adjust signal times and states in response to average queue length. This means that the traffic lights should change based on the average number of vehicles waiting at the intersection. - The primary expected output of the simulation is a detailed traffic simulation report. This report should provide delay, queue length dissipation time. Ideal skills and experience for this job: - Proficient in Vissim and working with COM server. - Experienced in traffic simulation and intersection management. - Ability to interpret data from queue counters and translate it into Vissim parameters. - Skilled in creating detailed traffic simulatio...
Please start your proposal by saying "hello MBA student" I am looking for a skilled data scraper who can efficiently extract specific data from a football website (). and one more for average age of squad. Extraction will need to go CSV Key Tasks: - Extracting 'Average Age of Squad' information - Extracting 'Net Spend' data Ideal Skills: - Proficiency in data scraping - Understanding of football statistics - Experience with similar projects or websites is a plus I trust your expertise to advise if additional information is needed for successful execution. Experience and accurate, meticulous work is what this project calls for.
I'd like a plugin designed that will delay the display of some of the content such as an order button on your WordPress site. The plugin needs to work with the Gutenberg editor and the Classic Editor. The user should be able to select an area of their post/page and specify a number of seconds (between 1 and 9,999 seconds) before that selected area shows on screen.
...is suffering from slow queries leading to suboptimal performance. Your task will include: 1. Identifying: Look into the current system and detect the exact spots causing delay. 2. Rectifying: Once detected, your task will be to rectify the problems and rewrite the slow queries. Skills and Experience • Strong knowledge of MongoDB, Node.js, and Socket-IO • Proven experience in optimizing database queries • Proficient in real-time applications, specifically dealing with data display and retrieval Please note that there's no maximum limit to the amount of data that should be retrieved and displayed without significant delay, so your solutions should cater to an expansive data scale. This task requires immediate attention and I need it resolved at the e...
I'm in need of a Python script that can crawl through a list of websites provided in an Excel file and export all the webpages it finds into a new Excel file. This task is aimed at scraping the entire content of the websites, not just a specific piece of information. Key Requirements: - The script must be able to read a list of websites fr...natural crawling mechanisms, not sitemap, to find all the webpages on each website. - All the webpages found on the websites should be exported into a new Excel file. The purpose of this script is to aid in analyzing the content of these websites, so it's crucial that all pages are scraped. Ideal Skills: - Proficiency in Python programming, particularly web scraping. - Knowledge of Excel file handling in Python. - Experience with ...
I'm seeking an expert data scraper to compile a comprehensive list of small to medium enterprises (SMEs) across Victoria, NSW, North Queensland, and South Australia. The scope of businesses should focus on restaurants and retail stores. The information needed for each business is as follows: - Business Name - Address - Phone Number - Website - Email Ideal candidate should have robust experience in data collection and validation to ensure the information provided is current and accurate. Proficiency in navigating Australian business directories and databases will be a valuable asset. Your scrupulous attention to detail and commitment to data integrity are critical for this task.
Seeking an Android developer with expertise in Kotlin and XML for a video display app project. Must integrate a specific HLS video stream (":ktvaq.stream.smil/chunklist_b350000_t64MjQwcA==.m3u8") into an XML fragment. Key functionalities needed: Play/Pause, volume control, and adjustable video speed. Autoplay after a delay. Full screen and landscape mode support. Requirements: Profound experience in Android development, especially in handling video playback and media controls.
...flexible data scraper tools. These tools will be deployed to capture data and screenshots from a variety of popularly visited websites such as e-commerce platforms, directories, social media and news sites which includes but not limited to eBay and clinicaltrials.gov. Key functionalities should include: - Capturing various data types such as product details, pricing information, ratings, reviews, and any other elements visible in a full-page screenshot. - Organizing the captured data and screenshots in a clear, easy-to-navigate folder structure. - Being adaptive enough to scrape data from a widely diverse set of websites. To be successful in this role, you should have a solid knowledge of Python and possess considerable experience with the Playwright toolset. A background in...
I have a list of 80 directories that require data extraction. I'm looking for an experienced web scraper who can handle this task using Python, Selenium, Php, Puppeteer (JavaScript) and Node.js.
I'm looking for an experienced data scraper who can extract text data from marketing websites for subsequent data analysis.
Title: Expert Web Scraper Needed for Advanced Sales Lead Generation Description: We're in search of an expert web scraper proficient in niche database search techniques and advanced web scraping beyond Google and mainstream platforms. The ideal candidate will specialize in extracting company information from platforms like LinkedIn, focusing on contact details for sales lead generation. Key Details: Target Data: Company Information on LinkedIn Purpose: Sales Lead Generation Responsibilities: Utilize advanced web scraping tools and niche database search techniques to extract company information, emphasizing contact details. Ensure accuracy and reliability in gathering and organizing contact information from various sources. Collaborate on ...
... Ideal Expertise: - Expert in iOS and Android development - Experience with integrating third-party messaging and email services - Strong graphic design skills to create a professional and corporate aesthetic. Requirements: - app starts with system / smartphone start and runs in background - app listens to the incoming messages - on incoming message the forwarding is done by a configurable delay in milliseconds milestones: MS1: implement a basic hardcoded forwarder which detects new SMS (event) and forwards them via e-mail to a hardcoded e-mail address (android and ios) MS2: design & implement a UI, which has a settings dialog for the rules: - add/delete/update/display (CRUD) operations on rules - user can choose a regex pattern to detect specific phone numbers (from) ...
I'm looking for a skilled React N...profile photo and write a bio. - Pay for parking. QR code to scan at park location for paid parking access. - Domestic flight departures/arrival – display on-time or delayed schedule (updates provided by airlines?) - Pay for baggage trolleys at airports? – QR code for confirmed payment - Where to shop and dine at airports (paid marketing)- - - - Expedited access to security screening (avoid delay from lines) - Advance book business lounge at airport Ideal skills and experience: - Extensive experience with React Native. - Previous work on e-commerce apps is highly desirable. - Understanding of mobile UI/UX best practices. - Proficiency in developing for both iOS and Android platforms. - Ability to create a user-friendly and vi...
I'm in need of a proficient data scraper to pull a list of specific job titles for my list of Property management companies. I already have the Company name, state, street address, and zip code for these firms, but now I need someone to mine the contacts within them. I would like to start with 150 companies but I will need thousands very soon. This will be an ongoing relationship. Specifics include, but are not limited to: - Facility Managers - Construction Managers - Building Managers - Maintenance Managers You should have experience in data mining and web scraping, showcasing a solid understanding of how to extract specific information from given sources. A background in extracting information specifically for real estate industry firms would be a significant advant...
I need an experienced developer for building a Gmail email scraper/notifier. The ideal candidate should have a strong understanding of data scraping and email handling. The aim of the project is to: - Extract and display specific emails from Gmail in a user-friendly card format within an application grid. - The information to display on each card will include part of email body, phone numbers and web links. The phone numbers should be displayed in a clickable link format so that they seamlessly work with a soft phone application like RingCentral without need to use their API. Emails containing web link will have the option to automatically open the link in new tab in default browser. Skills required: - Proficiency in data scraping - Experience with Gmail API - Excel...
You must live in Eastern Europe or Latin America. If you apply I will send you the complete specifications for this project. This project consists of two independent parts: the web scraper and the form filler The Web Scraper and The Form Filler can be used independent of one another. The Web Scraper will perform a Google Search based on the search such as Home inspectors in Portland, Oregon, and then scrape the search results, and then save the search results to… The Form Filler will fill in The Contact Form on each company’s website listed in Range_of_companies_to_contact_in_Companies_which_The_Code_has_not_contacted_which_have_a_contact_form_on_their_website.csv.
...code. I have all the hardware including an Arduino Uno R4, a NEMA 17 stepper motor, an A4988 stepper motor controller, an RC522 RFID antenna, a 1602IIC LCD display, and push buttons. All of these components need to be connected to the same arduino. I need this system function as follows: - When the push button is pressed, the stepper motor will be moved X amount of steps in one direction after a delay of 1 second. At this time, the LCD display should display "Scan ID to Unlock". - When a registered and accepted RFID tag is scanned, the LCD will display "Tool Unlocked". When this happens, the stepper motor should be moved X amount of steps BACK to where it came from. - If an RFID card which is NOT registered (ie not valid) is scanned, the stepper motor sho...
I'm searching for a highly knowledgeable Python developer who can work on enhancing and adjusting my current API client. Key tasks will include: - Review and modify the existing code to include a 2-second time delay after every 10 POST http requests to REST APIs. - Embed an error handling process for situations where the response does not equal 200 or if there is no response within 5 seconds, and provide the means to continue on to the next API call. Those bidding should have: - Strong proficiency in Python programming. - Clear understanding and experience with POST Http requests. - Experience working with REST APIs. Please provide examples of similar tasks you've accomplished with http requests and handling APIs in Python. This will help me understand your skills an...
I require a skilled developer to re-design my website, with an emphasis on showcasing my products/services. The updated website needs to have a fresh look while maintaining its initial design consistency. Key tasks include: - Removing obsolete website links and replacing them with relevant ones - Incorporating API scraping for better data handling and integration - Developing a built-in scraper for efficient data extraction - Implementing an escort application form to expand our service offerings - Ensuring rigorous testing and deployment for a seamless user experience The ideal candidate should have comprehensive skills in HTML/CSS, JavaScript frameworks, and CMS like WordPress or Joomla. They should also be proficient in API scraping. A keen eye for design consistency and exper...
Bonjour, Je recherche quelqu'un pour m'aider à créer des workflows pour scraper des sites français réputés pour être difficiles en scraping. Je démarre une nouvelle entreprise et je recherche donc des tarifs compétitifs pour créer ces workflows. Je recherche également une personne sachant travailler sur Octoparse et Python. Si vous avez l'expérience et les compétences pour ce projet, n'hésitez pas à me contacter. Merci d'avance pour votre attention et votre réponse. Cordialement,
I am currently experiencing a critical issue with my domain - my emails related to the domain are not functioning as they should be. Despite my website being accessible, this email malfunction is causing significant problems. I need solutions to this issue, urgently. The individual or company that takes on this task should be highly proficient in handling DNS-related issues, especially those r... Skills and experiences required: - Expertise in DNS management - Experience dealing with domain-related email issues - Ability to work promptly, as this project is time-sensitive. Immediate availability is highly desired. The goal is to have my domain-related email functionalities restored as soon as possible. Please only bid on this project if you are capable of fixing this issue without ...
I'm i...sine wave generation with ready made library as follows: Code for wave generation --->>> analogWave wave(DAC); int freq = 10; // in hertz, change accordingly void setup() { } void loop() { (freq); delay(10); } Challenge - during every loop, next integer stored in SD card should be called & saved in 'freq' variable. (untill all 10,000 integers are executed for (freq) function) Ideal Skills and Experience: - Proficiency in Arduino programming - Familiarity with FSK modulation - Experience in parsing SD card data - Message m...
...background must be transparent (!!) - Video must be web-optimized - Video must run in a loop - Video must contain transparent gradient on left/right side - Video sequence 03 must contain transition animation Please check the individual sequences for more details: Sequence 01 - Smartphone - Take animation from 00:09 - 00:15 - Take screenshot - Add animation transparency at left and right corner - Do not change screens while animation - Add 0.5 seconds delay before next animation Sequence 02 - Laptop - Take animation from 00:14 - 00:19 - Take screenshot - Add animation transparency at left and right corner - Do not change screens while animation - Add 0.5 seconds delay before next animation Sequence 03 - Multi Device
I need a professional who can scrape videos. I'm looking for someone who can download videos at its maximum size from websites.
...background must be transparent (!!) - Video must be web-optimized - Video must run in a loop - Video must contain transparent gradient on left/right side - Video sequence 03 must contain transition animation Please check the individual sequences for more details: Sequence 01 - Smartphone - Take animation from 00:09 - 00:15 - Take screenshot - Add animation transparency at left and right corner - Do not change screens while animation - Add 0.5 seconds delay before next animation Sequence 02 - Laptop - Take animation from 00:14 - 00:19 - Take screenshot - Add animation transparency at left and right corner - Do not change screens while animation - Add 0.5 seconds delay before next animation Sequence 03 - Multi Device
I'm looking for a freelancer who's great at web scraping to help with a project involving a specific website initially, with potential for more. I'll give you the specific data fields to extract. It'd be great if you: Are really good at web scraping and or Python. Know your way around MS SQL Server databases, not essential but definately an advantage. Understand how to extract data effectively. Understand the need for security and captcha integration if needed. Can work quickly since this project is a priority and needs to be done ASAP. Ultimately, I want to be able to manage the code with your ongoing help, so this could lead to a long-term partnership. I'll share the full details when needed. You will provide source code, documentation and deployme...
I'm seeking a skilled Java developer to create a (Web Scraper and Analyzer) for my project. 1- i need it to work on eclipse 2- i need the program written in a (GENERIC code) 3- you must use data structure 4- i need you to simplify the code for me as you can 5- i need to ask you simple Questions like what data structure did you use, why this data structure not other, and lastly i need the Pros and Cons for the selected data structure.
