I'm looking for an experienced server administrator to optimize my dedicated server running Almalinux 9.3 + Plesk. The server is currently performing poorly with slow websit...candidates for this project will have: - Proven experience in optimizing dedicated servers, particularly with Plesk and Almalinux - A solid understanding of database optimization, including Postgres and MariaDB - Expertise in PHP configuration and optimization - Excellent problem-solving skills and the ability to work efficiently to diagnose and resolve performance issues Docker migration from old server all database servers + docker most be acessable fro external ip, not only from localhost. Please only apply if you can demonstrate relevant experience and have a track record of successfully optim...
We have docker system running on http protocol. would like to redirect to https ssl traffic
...a contact "]) In this example, almost all of your code would have been in… "1 of 3 script for scraping and filling in a contact ", and "2 of 3 script for scraping and filling in a contact ", and "3 of 3 script for scraping and filling in a contact " ******* THE NUMBER OF ITERATIONS AND THE LENGTH OF THE PAUSES ******* I don’t want a Google algorithm to ban me for web scraping. Therefore, you will give me a script named, “Trigger main script for scraping and filling in a contact ” which will include something like the following… import subprocess, random, time # Define the Python script file to be executed script_file = "Main script for scraping and filling in a contact " # Define the number of tim...
I am looking for someone experienced in web scraping and data collation. The project will involve scraping blog articles in HTML format and compiling desired information into an Excel file. Key Project Requirements: * The extraction will be from specified URLs, using their individual patterns for efficient and accurate scraping. * For each blog article, I need the title, the full text, and the publish date extracted. * This scraped data must be properly arranged in an Excel file for easy analysis. * List of articles is here: Ideal Candidate Expertise: * Proven experience in web scraping is a must, preferably with full understanding of HTML structures. * Proficiency in Excel and data organization. * Attention to detail to ensure accuracy of the scraped data
Create an executable scraper in Python that can extract the SKU (product) list from the following Indonesian online grocery apps: - Astro - Sayurbox - Segari The scraper must be IP-block tolerant, meaning if the scraper gets blocked, execution can be continued from the point where the last row of data was successfully extracted. Scraper Functions Function: list_category_tree Input: competitor_name(astro | sayurbox | segari), existing_csv (optional - CSV file to append to for continuing execution, if the scraper stopped or got IP blocked) Output: CSV of category tree with the following columns (scrape_date, URL, category name, position index, parent_category (null if top level)) Function: extract_sku Input: competitor_name, location (autocomplete pla...
...tailored opportunities and support. What We Need: We're seeking a talented web scraper who can help us gather specific data on medical professionals with new NPI numbers. Your task will involve targeting individuals in specific states and collecting their information accurately and efficiently. Your Responsibilities: Develop a web scraping solution capable of targeting specific states and names of medical professionals with new NPI numbers. Ensure the accuracy and reliability of the scraped data. Customize the scraper to meet our specific requirements and adapt to any changes or updates in the target websites. Deliver the scraped data in a timely manner, adhering to project deadlines. What We're Looking For: Proficiency in web scraping te...
...applications for maximum speed and scalability. 6. Collaborate with the frontend team to integrate user-facing elements. 7. Ensure the application is containerized using Docker. 8. Use Bitbucket for version control and code collaboration. 9. Implement CI/CD pipelines using Jenkins. 10. Integrating a database into the FastAPI backend 11. Ensuring smooth communication between the backend and the database 12. Implementing efficient data storage and retrieval mechanisms **Requirements**: 1. Proven experience working with FastAPI or similar Python-based web frameworks. 2. Expertise with MongoDB and MongoEngine. 3. Familiarity with Docker and container orchestration. 4. Experience with version control tools, especially Bitbucket. 5. Good understanding of CI/CD pipeline...
I'm experiencing an issue restarting port 80 with my Grafana docker container on a Ubuntu server. I disabled port 80 to run certbot to get an SSL issued, and now I am unable to get port 80 restarted on my Grafana docker container. Tasks to be performed: - Identify and resolve issues concerning port 80 on Grafana.
We need an experienced full-stack developer to participat...Management (IAM) 4-In-depth knowledge and hands-on experience with at least one of the following IAM solutions: 1.1 -Keycloak. 1.2-Casdoor. 5- Strong proficiency in Python programming language 6- Expertise in developing RESTful APIs using the Fast API framework 7- Proficient in utilizing MongoDB as a NoSQL database for storing and retrieving data 8- Experience with containerization using Docker and orchestration using Docker Swarm for deploying and managing microservices 9-Experience in working with RabbitMQ as a message broker. BONUS SKILLS: 1- Familiarity with WhatsApp Business API integration to leverage WhatsApp as a communication channel 2-Experience with LangChain integration to enhance natural language proces...
Hello, I need a developer with a lot of experience in Java, Python and Socketweb - with the ability to create and solve problems with easy understanding of codes The rest of the details will be given to the correct developer
...tailored opportunities and support. What We Need: We're seeking a talented web scraper who can help us gather specific data on medical professionals with new NPI numbers. Your task will involve targeting individuals in specific states and collecting their information accurately and efficiently. Your Responsibilities: Develop a web scraping solution capable of targeting specific states and names of medical professionals with new NPI numbers. Ensure the accuracy and reliability of the scraped data. Customize the scraper to meet our specific requirements and adapt to any changes or updates in the target websites. Deliver the scraped data in a timely manner, adhering to project deadlines. What We're Looking For: Proficiency in web scraping te...
...proficient in web scraping with Scrapy to extract product data from This project involves scraping the Category page to retrieve product details including name, price, SKU, URL, breadcrumb, currency, and brand. Targeted webpage: Category page of Required data: Product name, price, SKU, URL, breadcrumb, currency, and brand Experience: Prior experience in scraping product-related information from e-commerce sites is essential, with proficiency in Scrapy being crucial for accurate and efficient data extraction. Data Handling: Ability to ensure accuracy and consistency of extracted data. Familiarity with different data formats is advantageous. Dynamic Scraping: Navigation logic for all categories must be contained within the scraper and be automatic
Set up a cypress test on my local and cover at least 15 test cases for the application. This will need to be done via ZOOm as we cannot provide access to project files due to data protection. My current setup is WSL and using docker to up and down the containers. I have already installed a Cypress on my local and it open cypress. Let me know if you are interested.
Join our team as a Python Selenium Web Scraper responsible for developing scraping scripts using Python and Selenium. You'll gather data from diverse websites, utilizing your expertise in web technologies, HTML, CSS, and JavaScript. Key responsibilities include analyzing website structures, extracting and cleaning data, and collaborating with team members to integrate data into existing systems. Ideal candidates possess proficiency in Python, experience with Selenium, and a strong understanding of web technologies. This role offers competitive compensation, flexible work hours, health benefits, and opportunities for career growth in a dynamic, collaborative environment
I need a Terraform configuration to provision my EC2 resources on AWS. This configuration should allow me to deploy the EC2 instances and also bring-down when needed. Key Requirements: An EC2 instance with Security group, Keypair, VPC co... A Bastion/jump server for SSH to EC2. EC2 connects to the internet using NAT-gateway. WAF to be integrated with ALB, and ALB only listens on HTTPS. Security groups are restricted with limited access. Allocate and associate an elastic IP to the instance. The EC2 instance will run Ubuntu and serve as application server. I can provide AMI image of the web-app. It is a Python FastAPI/Nginx app. No other service is needed like RDS or S3 etc. Docker or Kubernetes are not needed, and the app is not using any Databases. It is a Single Region Dep...
I'm looking for an experienced web scraper to access and download specific information and images from the Used Inventory section of the White Rock Honda website. Here are the specifics of what I need: - Car make and model - Year of the car - Price of the car For each car listing, I need ALL available images downloaded. Furthermore, I require the images in JPG format. Candidates applying should have successful experience in web scraping, data extraction, and handling myriad images. Efficiency and accuracy are critical for this project.
I need a python scraper that can copy ads from one classified ads website and post it to other website
I need to find a good supplier that can get me all of the buyers and planers from all customers in Asia, Africa, Europe, North America, Central America, South America, Australia. i am in the aircraft industry.
I'm looking for an experienced data scraper. I need someone with excellent knowledge and expertise in web scraping. I will need the following with regards to mid sized collectible stores around the world: Company Name City Country URL Contact person Email address. Ongoing work for the right candidate/s
...images, news in the cities put together - Scrapped content from other pages into fun engaging content that people click on, comment and share, pr tgat we get them to jump to a web landing page. Local news and stories Experience in 2D and 3D animations, as well as motion graphics, is highly desirable. A background in short-form social media content creation will set you apart. Creativity, attentiveness, and a high level of organisation, speed are also crucial for this task. We run 3 big social media sites, and a web site so the core job is to engage and get comments, reach and shares AND jumps from social media out to tge web site. You must be able to research stories, scrape sites with permission if needed, use Ai big time, report on your videos performance. We d...
Available driving test slots scraper with autobook for selected dates
...cluster (Linux Ubuntu) using Docker Compose (not Swarm, not k8s) with Consul as the storage backend (plus ensuring SSL/TLS self-renewing certs & snapshotted backups to an S3 bucket (on ) every time a new policy or secret added). You'll get sudo-level account access on all nodes which are already up and running on Contabo. You'll need to use the latest versions of Docker & Docker Compose. Your Experience + Multiple Docker-based Vault cluster deployments + Proficiency in Linux shell scripting and Docker Compose + Ability to document setup process clearly disaster recovery Summary acceptance criteria + I follow docs & rebuild cluster & recover existing backup + I retrieve secrets after degrading nodes Want more details? Look...
I need a skilled developer to create an automation bot for Telegram Channels. This bot will have the essential functions of: - Auto-joining channels - Extracting basic channel information including the description and links I want the bot to be able to extract the following specific information from the channels it joins: - Channel Name - Channel Desc...information from the channels it joins: - Channel Name - Channel Description - Channel Links - Member Count The frequency of this extraction should be set to a weekly basis. Ideal skills and experience for this job would include proficiency in Python or a similar programming language, previous experience with Telegram's API, and prior experience creating chatbots or automation bots. Expertise in web scraping technologies ...
...the website.) Your task is to craft a compelling video that persuades viewers to subscribe to our monthly signal package or, at the very least, give our 3-day trial a shot! Please refrain from mentioning specific pricing details for each tier. Also mention short en clear how our product works, as in: 1. Get subscription at OpesSignals 2. Forward the signals automatically towards Maestro scraper 3. Buy the signals and sell them automatically with the Maestro Telegram bot. ---- Some more indepth information about our service/product: O/p/e/s/S/i/g/n/a/l/s is not your standard crypto signals group. We won't tell you when to buy or sell or what your stop loss should be. Our signals seamlessly integrate with Maestro sniping, one of the largest automated bots for easily ...
Hi, I need to setup windows IIS web server and docker on AWS. If you have the required skills please do not hesitate to bid. Thanks
I'm seeking a professional who can develop a web scraping tool with the following specifications: - The tool should be able to scrape text content from a specific website. - It will need to log in to the website in order to access the data. - The data should be extracted in real-time, meaning that the scraping should be continuous and up-to-date. Ideal candidates should have: - Proficiency in web scraping tools and techniques - Experience in developing real-time data extraction tools - Familiarity with log-in processes in web scrapers - Ability to work efficiently and deliver on time If you have the skills and experience required for this project, please get in touch. Thank you.
Hello, I need a complete professional in scrap, java, python flask, composer. more details in private
I'm on the for someone with knowledge of web security to produce a detailed analysis report on selected CVE vulnerabilities associated with WordPress. This report is specifically for an academic project. Here are the particular CVEs for review: 1. CVE-2023-32243 2. CVE-2023-0084 I can provide the older versions of those plugins with bugs you just need to execute and create output on docker environment and add screenshots of execution showing how it exploits security and then the share the proposed mitigations in the report. You must have to cover the below mentioned points in the reports: briefly describe the architecture of the web application/framework describe the type(s) of vulnerability that is considered describe the vulnerabilities in detail describe ...
...solution capable of scraping specific data from websites like and Makemytrip. The chief aim is to collate the room type and rates, along with rates applicable for specific dates. Ideal Skills and Experience: - Extensive Python programming skills, particularly in web scraping - Prior experience with data extraction from travel or hotel booking websites - Familiarity with various data extraction techniques and handling dynamic web content Your role will involve programming a robust and efficient scraper that can collect and deliver the desired data in a structured format. Familiarity with and adherence to legal and ethical aspects of data scraping is necessary. Efficiency in output delivery and importantly, minimal error in scraping are vital. I am not particu...
I am looking for an experienced Django developer who can take on a long-term project. The key responsibilities will include: - Backend development - Database management - API integration - Deployment using Docker, Celery, RabbitMQ, Redis The ideal candidate must showcase proficiency in: - Docker - Celery - RabbitMQ - Redis - Geodjango - GeoServer - PostGIS Moreover, I desire that the developer also has some hands-on experience with Geodjango, GeoServer, and PostGIS. GIS knowledge is a definite plus. This project will require someone who is quick to learn and adapt to new technologies or tools if needed. Let's connect if this sounds like a good fit for your skills-set.
I'm looking for a skilled developer to build me a web scraper for the Kumon UK website. The scraping needs to be able to: - Extract the names of tutors - Retrieve their addresses - Fetch contact information like phone numbers or email addresses The scraping process should be set to run just once, and must be accurate and reliable. The data should be presented in a structured format, ideally a XLSX file. Please provide an overview of your experience with web scraping and any similar projects you've worked on.
I'm looking for an expert to help me integrate an execute all steps of installing, configuring and preparing a full android simulator along with configuring the android dependencies. Requirements: - install waydroid for u...libs/frameworks Deliveries? - in our on premise git (access will be granted to you) - full sources - full working build (for CI and local build) - libs, need prior confirm and we prefer to use mostly latest stable versions - JDK 17 (mostly LTS) - your code is working on our end too - your code passes our CI build (with provided maven can be checked) - you may require to help us here on setup - docker compose to startup all required runtimes - we require, depending on availability and on complexity 2-4 weeks test time per milestone. Usually clearly less
I'm looking for a tool or app to scrape specific data from car rental websites. Key Features & Requirements: - Targeted Websites: Avis, Budget, Sixt - Data to Scrape: - Pricing information - Car specifications - Add-on options - Total after ta... - Total after tax and fees - Maximum rental period 330 days for Avis/Budget (Sixt 365 days) Additional Info: - The tool should be capable of automating the scraping process at regular intervals. - Data should be well-organized and easily exportable for further analysis. - The goal is to find deals and or pricing errors for specific vehicles Ideal Freelancer: - Prior experience working on web scraping projects is a must. - Proficiency in data analysis and presentation. - Strong understanding of car rental market ...
I'm in need of a skilled website scraper to collect pricing information from various technology product websites. The specific websites aren't yet defined, providing opportunity for shared direction and collaboration. Key Tasks & Experience Required: - Data scraping expertise - Familiarity with technology product websites - Proficient in data extraction tools - Experience in data cleansing and categorization - Expertise in populating website with extracted information Your role will be central in aiding price comparison capabilities, making this an ideal project for those experienced in intelligent data mining and competitive market analyses.
...Type: Full-time / Part-time Job Duration: 3 months Job Description: As a Full Stack Developer, you will be responsible for developing and designing front end web architecture, ensuring the responsiveness of applications, and working alongside graphic designers for web design features, among other duties. Roles and Responsibilities: • Develop front end website architecture. • Design user interactions on web pages. • Develop backend website applications. • Create servers and databases for functionality. • Ensure cross-platform optimization for mobile phones. • Ensure responsiveness of applications. • Work alongside graphic designers for web design features. • See projects through from conception to finished product. &...
Whilst the world patiently goes about its mundane existence, deep in the bowls of PyCharm there exists a codebase held hostage from migrating to the land of PostgreSQL where it belongs. Its captor - the evil Djangosaurus, has armed itself and is baying for binary bloodshed. Chat GPT has floundered, Gemini still believes it's more likely an Australian Gummy-sha...on the moon. This is the real thing, this is what you've been trained for. There is no task sheet even envisioned for this unprecedented event. Your mission if you chose to accept it is to go where no supercomputer can - into the HQ of DjangoTown - and seek out the energy source powering the Djangosaurs with circular import energy cubes and shut it down so this codebase can get to its docker and sail away before...
I need an experienced data scraper to extract specific financial information from the NASDAQ and HKEX stock markets. Your task will be to focus on: - Stock prices - Company financials - Last 5 Years ROE - Last 5 Years EPS - NAV - P/E Ratio - P/B Ratio -Net Cash Flow Other economic indicators(US & HK) -Interest rate -Unemployment rate -Inflation rate The ideal freelancer for this job should have experience in data scraping and familiarity with financial data. The requirements involve pulling data from the past five years. All data should be delivered in a CSV file format. The ability to achieve high-accuracy and precision in data extraction is critical for this role.
I am looking for someone who is very familiar with Node.js and microservices architecture, specifically for developing an application that will interact with REST APIs. The primary function will be inter-service communication. In addition, a strong understanding of Docker is necessary for deployment purposes. Understanding efficient use of Docker will greatly influence the success of this project. Ideal candidates will have: - Expertise in Node.js, REST APIs, and microservices - Strong working knowledge in Docker for deployment - Experience with facilitating inter-service communication - Efficient problem-solving abilities This project will not only test your technical skills but also your ability to troubleshoot and problem-solve as we work together to create effici...
I require a professional data scraper, ideally with experience in handling image retrieval. The task will involve sourcing and scraping image data from various undisclosed sources. The type of images to be scraped has not been specified, providing an open spectrum for data collection. However, previous experience dealing with diverse image types is highly beneficial. The deadline for this project has not been outlined, indicating flexibility on the completion date. Ideal Skills: - Expertise in data scraping - Strong experience handling image data - Ability to source from various platforms - Flexibility with time management.
Hi, i need help in scraping an e-commerce website dropdown menu urls using jawa visual scraper. The e-commerce website: then i will be using puppeteer to scrape the menu urls for education propose. Only people with experience in this field will be accepted. Thank you.
...seeking an experienced AWS Developer who also possesses a profound knowledge in Docker for the implementation of a DevOps workflow. The AWS Developer will be responsible for creating, deploying, and managing the AWS resources necessary for this workflow. Some of the AWS services that the developer should be conversant with include EC2, S3, RDS, ECS and MongoDB. Some of the developer's tasks will include: - Managing EC2 instance, S3 storage and RDS database on AWS. - Configuring and managing AWS ECS services. - Setting up and managing MongoDB on AWS. - Developing the necessary Docker images and containers. The Docker images will contain: - Databases. - Web servers. - Application environments. Proficiency in AWS, Docker, MongoDB and DevOps wil...
I'm looking for a skilled developer who can refactor and migrate my current LAMP Web App into an Angular (frontend) Node.JS (backend) application. This is a project that requires a strong understanding of both LAMP and MEAN stacks. Key requirements for this project include: - **Refactoring:** The existing codebase is procedural-functional, with a mix of HTML, DB-Queries, PHP echoing out JScript, and inline-stylings. I want to move towards a more organized, maintainable and modular structure, following MVC principles. - **Migration to Angular/Node.JS:** You must have a demonstrated experience in working with Angular for the frontend and Node.JS for the backend. The functionality of UI views is clear, and the queries on the DB are available, so the primary focus will be on refac...
I'm in need of an experienced data scraper to extract product information from multiple websites. The scope of this project is not set and will be contingent on your proven capabilities. As such, your application should ideally include: -Prior experience in data scraping -Examples of past work, specifically in the area of data scraping Here are some key project details: -Data Required: Only product information -Websites: Unspecified. Be ready to scrape data from multiple sources -Experience: Proven track of successful data scraping projects Please apply if you're confident in your abilities of scraping accurate, relevant and recent product information.
I require the expertise of a skilled data scraper who can quickly retrieve text data from a specified website. The site in question is I need the following specific information delivered in Microsoft Excel Format: - Country Name - Grand Lodge Name - Website address - Email address - Phone - Address - Grand Master name (if available) The ideal freelancer for this project would have significant experience in data scraping, particularly text data, and an understanding of the website's structure to retrieve the desired information effectively. Speed and efficiency are of the essence. Your ability to deliver this project promptly without compromising accuracy will win you this bid.
...Planos ( Para Liberar Mais Recursos EX: Permitir Comunicação em Massa) - WEB: Funcionalidade Base Administrativas: Gerenciamento de Usuários Gerenciamento de Parceiros Email Marketing (Integração) Gestão do Gateway de Pagamento Gestão Financeira Estatísticas de Uso Gestão de Cupons Gestão Geográfica e Mapa de Calor com Filtros Integração com Google Firebase Integração com Google Analytics Integração com Google Data Studio Ferramentas Proprietaria Para ADS ( Melhor Posicionamento nos Resultado, Push, Envio em Massa de Chats, Etc..) - Requisitos técnicos: Compatibilidade com Sistemas Operacionais: Android: Suporte a versões A...
Looking for someone that can create a web-based 3D modelling tool (or use an existing one) which allows my customers to create 3D models of Veranda's based on input of width, height and depth. Sample of a Veranda included in attachments. Requirements: - Webbased tool (might be PHP and Database for example) on my own hosting - Admin and User panel seperate - User should be able to define a Width, Height and Depth which will generate a 3D model of the veranda - Additional options like with/without glasses on the sides, color option (RGB), sample backgrounds to choose from. - Export 3D model as PNG or PDF option - Deployable on Docker (optional)
... - Problem solve and troubleshoot production issues, ensuring swift resolution. - Manage Docker container setups and Kubernetes orchestrating the deployment, scaling, and management of containerised applications. - Collaborate with team members to improve the existing infrastructure and explore options for new technologies and automation. - Implement automation tools and frameworks (CI/CD pipelines). - Conduct systems tests for security, performance, and availability. - Develop and maintain documentation and systems diagrams. **Required Skills and Qualifications:** - Proven experience as a DevOps Engineer or similar software engineering role. - Proficient with AWS cloud services. - Expertise in Docker and Kubernetes. - Strong background in Linux/Unix Administration. - Expe...
I am looking for a proficient cross-platform developer who can work on an application for both iOS and Android. This app's main functionality would be to forward SMS/Text messages to other SMS, Telegram, and email addresses. Key Obj...libs/frameworks Deliveries? - in our on premise git (access will be granted to you) - full sources - full working build (for CI and local build) - libs, need prior confirm and we prefer to use mostly latest stable versions - JDK 17 (mostly LTS) - your code is working on our end too - your code passes our CI build (with provided maven can be checked) - you may require to help us here on setup - docker compose to startup all required runtimes - we require, depending on availability and on complexity 2-4 weeks test time per milestone. Usually clea...
