Role & Responsibilities: ● Work with cloud engineers and customers to solve for big data problems by developing utilities for migration, storage and processing on AWS Cloud. ● Understand requirements from the Clients and delegate it to the offshore team ● To migrate ETL jobs from the existing AB Initio to AWS Cloud ● Design and build a cloud migration strategy. ● Build tools to ingest and jobs to process several terabytes per day. ● Design and develop next-gen storage and compute solutions for several large customers. ● Communicate with a wide set of teams, including Infrastructure,DevOps, and cloud customers. ● Build advanced tooling for automation, testing, monitoring, administration, and data operations across multiple cloud clusters. ● Use Continuous Integration and Continuo...
I am looking for a freelancer who can teach me how to create an ETL using free source software like Talend to update my MySQL database. The project requires the following skills and experience: - Expertise in ETL development using Talend or similar software - Strong knowledge of MySQL database - Proficiency in working with flat files, specifically CSV format - Ability to set up a weekly ETL process The project involves extracting and transforming data from flat files and updating the MySQL database. The ETL process should be executed weekly. The ideal freelancer should have experience in setting up ETLs using Talend or similar software and have strong knowledge of MySQL databases.
I am looking f...comparison between source (Sybase 17 db) and Destination (SQL Server db) must be part of the delivery. *********************************** Again, I encourage and open to use 3rd party conversion utilities such as Microsoft SSMA, ETL tools etc.. to manage this conversion. The main point is that this conversion will need to run on multiple Sybase databases (with the same schema). So the process must be repeatable and updatable. *********************************** Ideal Skills and Experience: - Experience with Sybase 17 and SQL Server 2019/2022 - Experience with ETL/ELT tools - Knowledge of database migration and conversion processes - Attention to detail and ability to ensure data integrity throughout the conversion process. Databases will be provided after...
We are Seeking a freelance with 6+ years of exp Skils Required : Any Cloud knowledge ( Azure, AWS, & Google cloud) - Data Bricks, Data Lake & Data Factory . also Pyspark or Scala , knowledge in ETL tools We are seeking an experienced Senior Data Engineer with experience in architecture, design, and development of highly scalable data integration and data engineering processes The Senior Consultant must have a strong understanding and experience with data & analytics solution architecture, including data warehousing, data lakes, ETL/ELT workload patterns, and related BI & analytics systems Strong in scripting languages like Python, Scala 6+ years hands-on experience with any Cloud platform Experience building on-prem data warehousing solutions. Experien...
...comerciales B2B. - Dominio de la configuración, personalización y desarrollo de Salesforce, utilizando Apex, Visualforce, Lightning Components y otras tecnologías relevantes. - Conocimientos profundos del modelo de datos de Salesforce, la seguridad y la configuración de compartición. - Experiencia con herramientas y metodologías de integración de Salesforce (por ejemplo, REST/SOAP APIs, herramientas ETL, middleware, etc.). - Familiaridad con metodologías y mejores prácticas de desarrollo ágil/Scrum. - Excelentes habilidades para resolver problemas, con la capacidad de analizar requisitos complejos y proponer soluciones eficientes en Salesforce. - Fuertes habilidades de comunicación, con la capacidad de c...
I am looking for an experienced Azure Data Warehouse specialist to help build a comprehensive, Azure Data Lake Gen2,...great opportunity for someone who is looking to develop their skills and expertise in Azure DWH solutions with a client who will be looking for quality data warehouses solutions that are both cost-effective and efficient. If you feel like you're up to the challenge, please let me know. Summary: The data will be retrieved from the already installed Data Lake Gen2 using Azure Data Factory by making ETL and a data warehouse will be established in Azure SQL DB. The project will be carried out only with the HR data of Contoso, which is ready-made ERP data. This is a demo run. and I would like it to be explained very briefly as a video recording or live. We can e...
...PowerBI nebo jiné nástroje pro vizualizaci dat a umíš vytvářet, aktualizovat a udržovat reporty. - Umíš interpretovat data a transformovat je v cenné informace, které ovlivní naše byznysová rozhodnutí správným směrem; umíš hledat řešení související s daty. - Nedělá ti problém vysvětlit složitý problém jak technickým, tak netechnickým lidem. - Máš předchozí zkušenosti s nástroji jako je Tableau, Qlikview nebo QuickSight? To je pro nás bonus! Pokud máš znalost Pythonu nebo R, je to velký přínos. ________ Nabízíme...
I am looking for an experienced Database Developer to help me with the implementation of an ETL process to work with my data. The purpose of the ETL process is to integrate, migrate, or warehouse my data, but I do not have any existing data sources. I need an ETL tool in place that is capable of handling medium complexity data transformations. The ideal candidate for this project will have experience with the Talend ETL tool, and be able to match my requirements within a reasonable amount of time.
Data Factory, Azure, ETL resource Project starting in 15days Desired Competencies (Technical/Behavioral Competency) Must-Have • Strong knowledge of data modelling, data warehousing and ETL framework • This role will be responsible for creating Data orchestration with Azure Data Factory Pipelines & Dataflows. Key role is to understand the business requirements and implement the requirements using Azure Data Factory • Knowledge of the following: • SQL queries • Azure Cloud services Good-to-Have Python, Azure Synapse, Azure Data Factory Role descriptions / Expectations from the Role • Understand business requirement and actively provide inputs from Data perspective • Understand the underlying data and flow of data. • Build simple ...
Convert Qlikview into excel with 2 charts
Convert Qlikview into excel with 2 charts
Convert Qlikview to excel power query, also to create 2 charts at excel based on Qlikview expressions.
I am looking for someone to create an ETL in Microsoft Azure to import a CSV file into Azure SQL Database. The project requires no data transformation -- just a straightforward import of the file as it is. The ideal candidate would have experience with Microsoft Azure and ETL processes. Some additional details about the project include: - File format: CSV - Data transformation: No transformation required - Destination: Azure SQL Database - Implementation and knowledge transfer to be done online If you are interested in this project, please submit your proposal and let me know your relevant skills and experience.
BI developer : SQL (advanced) (+optimizing stored procs, snowSQL, Performance tuning, troubleshooting) ETL/ELT process (advanced ) Reporting:Power BI (advanced ), Tableau
Quantori is a new company with a long history. We have over twenty years' experience in developing software for the pharmaceutical industry and driving a...Experience with Clouds (AWS preferable or GCP or Azure) - Good written and spoken English skills (upper-intermediate or higher) Nice to have: - Knowledge of web-based frameworks (Flask, Django, FastAPI) - Knowledge of and experience in working with Kubernetes - Experience in working with cloud automation and IaC provisioning tools (Terraform, CloudFormation, etc.) - Experience with Data Engineering / ETL Pipelines (Apache Airflow, Pandas, PySpark, Hadoop, etc.) - Good understanding of application architecture principles We offer: - Competitive compensation - Remote work - Flexible working hours - A team with an excellent...
...current on-premises Qlik Enterprise Edition to a cloud-based solution. Here is an overview of the project scope: Migration of Local Apps to the Cloud with Enhancements: Transfer existing Qlik Sense applications from the local environment to the cloud. Implement any necessary enhancements or optimizations during the migration process. Migration of On-Prem ETL to Automation on Cloud: Migrate our existing on-premises Extract, Transform, Load (ETL) processes to automated workflows on the cloud platform. Ensure seamless data integration and transformation during the migration. Set up data sources: Move data sources from local files to Azure blob storage or Azure SQL databases on the cloud. Establish robust and efficient data transfer mechanisms between Azure cloud serv...
...current on-premises Qlik Enterprise Edition to a cloud-based solution. Here is an overview of the project scope: Migration of Local Apps to the Cloud with Enhancements: Transfer existing Qlik Sense applications from the local environment to the cloud. Implement any necessary enhancements or optimizations during the migration process. Migration of On-Prem ETL to Automation on Cloud: Migrate our existing on-premises Extract, Transform, Load (ETL) processes to automated workflows on the cloud platform. Ensure seamless data integration and transformation during the migration. Set up data sources: Move data sources from local files to Azure blob storage or Azure SQL databases on the cloud. Establish robust and efficient data transfer mechanisms between Azure cloud services ...
Job Description: Senior ETL QA We are seeking a skilled and experienced Senior ETL QA (Extract, Transform, Load Quality Assurance) professional to join our team. As a Senior ETL QA, you will play a vital role in ensuring the accuracy, integrity, and reliability of our data integration processes. You will collaborate closely with cross-functional teams to design and execute comprehensive testing strategies, identify and resolve defects, and optimize ETL workflows. The ideal candidate will have a strong background in data validation, ETL testing methodologies, and a passion for delivering high-quality data-driven solutions. Responsibilities: 1. Develop and implement comprehensive test strategies and plans for ETL processes, ensuring end-to-end data q...
Job Description: Database Engineer (Informatica/ETL) We are seeking a highly skilled and motivated Database Engineer with expertise in Informatica and ETL (Extract, Transform, Load) processes to join our dynamic team. As a Database Engineer, you will play a crucial role in designing, implementing, and managing our complex database systems, ensuring optimal data integrity, performance, and security. You will collaborate closely with cross-functional teams to deliver scalable solutions and contribute to the success of our organization. Responsibilities: • Design, develop, and implement efficient and scalable database solutions using Informatica PowerCenter and other ETL tools. • Perform data extraction, transformation, and loading (ETL) processes, ensuri...
Add history functionality to existing ETL process in pyspark. Need to account for racing conditions on primary key.
I am looking for a skilled professional who can help me with my project titled "Informatica Cloud Services ETL jobs". I need someone who has experience in working with Relational Databases and can perform Aggregation transformations on the data. The extracted data needs to be loaded into a Data Warehouse. Ideal Skills and Experience: - Experience with Informatica Cloud Services - Knowledge of Relational Databases - Expertise in Aggregation transformations - Experience in loading data into a Data Warehouse If you possess the required skills and experience, please contact me to discuss this project further.
convert existing qlikview load script to powerbi (Not easy) must be comfortable with qlikview load script
I am looking for a freelancer to convert my QlikView data to Excel for the purpose of data analysis. I require customized formatting for the Excel file. The QlikView file is small and simple. Ideal skills and experience: - Proficiency in QlikView and Excel - Experience in data analysis and conversion - Attention to detail for customized formatting requirements
we are currently introducing an electronic technical logbook solution for all sorts of aviation sectors called REDiFLY. REDiFLY currently has a number of fleets under her belt in Europe and the middle east making it EASA certified and on its way to be GACA certified as well. we are looking for someone in the states to communicate with the airlines there and showcase our ele...and on its way to be GACA certified as well. we are looking for someone in the states to communicate with the airlines there and showcase our electronic tech log therefore making it known and used in the U.S aviation market. this individual will not only be paid for the job but also get a percentage of the sale for each deal he or she makes. in the attached files are more information about our ETL. website:
I am looking for a data engineer resume that showcases mid-level experience, with a focus on the finance industry. The ideal candidate should have experience in data warehousing, with a focus on projects related to data warehousing. Skills required include expertise in SQL, ETL tools, database design, and data modeling. The candidate should have a strong understanding of data warehousing concepts and be able to work collaboratively with business stakeholders and IT teams. Additionally, experience with cloud-based data warehousing solutions is a plus. The final product should be a visually appealing and well-organized resume showcasing relevant experience and skills.
... Justify the answer. c) Define the types of dimensions you have identified. d) For defined tables, fill them with some dummy data to more clearly reflect the implementation details. (eg 5-6 lines). 4. Explain how you will perform initial loading and delta loading. at least 2 possible transformations and give an example. (eg tables with relevant attributes and some data to explain the ETL process) Part 2: Tech Stack Determine the technological components (tools) needed to implement your solution. Analyze and justify your choice, including possible costs and the ability to adapt to future changes. Part of the assessment are: Provide examples of tables (attributes and related data) for points in the functional analysis section. Ability to present the paper within the specified t...
Hi, If you are looking for freelancer, I'm here for waiting for you! Please feel free to connect. About me: - Experienced Java Developer with 5 years of expertise in Spring-boot (Rest, Hibernate, Metrics,..), Java SE Java 8 & 11 (collections, multi thre...bus, IBM MQ) - SQL (POSTGRESQL, Oracle,...) and NO SQL (Couchbase, Mongo), Snowflake DB - OAUTH 2.0 for Azure and Google services - Selenium - Random fake data generation - API Testing (Rest, Soap) - Cloud services: AWS (S3, Dynamo DB, Cloud watch events, Lambda, Amazon MQ) and Azure (COSMOS DB ) - 3rd party/functional applications Automation - Notification system (Slack integration, email,..) - ETL testing for various databases, files including flat files, zip files, excel, JSON, XML, PDF using Apache spark, POI, PDF BOX...
I am seeking a skilled data engineer to help with my ETL pipeline and data analytics dashboard project. The ideal candidate should possess the following skills and experience: - Strong knowledge of SQL databases - Experience with ETL pipelines and data cleaning - Proficiency with data visualization tools - Ability to create a data analytics dashboard with the goal of visualizing data trends I am looking to build a real time analytics/visualization dashboard and would like to learn about how to set up ETL pipelines. The dashboard can be on anything using some, if not all of the technologies listed on the attached file. If there is a similar project that you have done in the past - that is fine, the focus here is that I would like to learn step by step on how to set up...
Ищем front-end специалиста, с хорошими навыками и опытом Vue 3 на part-time занятость (ориентировочно 10-15ч/нед, по мере поступления новых задач) в логистический стартап. Русскоязычная команда, переписка и созвоны на русском языке. Оплата почасовая, укажите свой рейт и ссылку на портфолио. Tech stack приложения: Product building: •Microservices architecture. Core api building: •Golang. ETL pipelines: •Python •Golang User interface: •Vue3 •Web socket RPC for real-time data and REST for communication with API Geographic data and routing: •OpenStreetMap Base database: •Postgresql •PostGis Messaging between components: •High performance distributed system NATS
I am looking for an experienced ETL/Informatica developer to help me with a data warehousing project. The project involves moderate complexity level of data sources and needs to be completed within 1-3 months. The ideal candidate should have the following skills and experience: Skills: - Strong knowledge of ETL and data warehousing concepts - Experience in Informatica PowerCenter - Ability to design and develop ETL mappings, workflows, and sessions - Expertise in SQL and relational databases Experience: - Minimum of 2 years of experience in ETL development - Previous experience in data warehousing projects - Experience in working with moderate complexity level of data sources If you have the required skills and experience, please submit your proposal with you...
...занятость ориентировочно 10ч/нед. Обязательно наличие опыта с WhatsApp и Telegram API integrations. Если есть опыт в Golang и Vue3, то рассмотрим на долгосрочное part-time сотрудничество. Есть еще несколько full-stack задач. О нас: Логистический стартап с украинскими корнями для рынка США. Tech stack приложения: Product building: •Microservices architecture. Core api building: •Golang. ETL pipelines: •Python •Golang User interface: •Vue3 •Web socket RPC for real-time data and REST for communication with API Geographic data and routing: •OpenStreetMap Base database: •Postgresql •PostGis Messaging between components: •High performance distributed system NATS
...1. Strong experience in Python programming language 2. Experience in working with PostgreSQL databases and SQLAlchemy 3. Familiarity with CSV file handling and data manipulation 4. Experience in working with large datasets and optimizing performance 5. Strong problem-solving skills and attention to detail 6. Excellent communication skills Preferred Skills: 1. Experience in data engineering and ETL processes 3. Knowledge of best practices in database design and optimization Project Timeline: The project should be completed within 4-6 days, starting from the date of the contract. The timeline can be adjusted based on the project scope and complexity. Communication: The developer will be required to provide regular updates on the project progress and communicate any issues or ...
The project involves building a web application that provides a unique solution to a specific industry, combining elements of AI-powered insights, dynamic data visualization, and integrated data sources. The application will feature a chat interface for user interaction and will require skills in ETL, NLP language processing , Node.js, , and PostgreSQL. To respect the confidential nature of this project, I would require a signed Non-Disclosure Agreement (NDA) before we delve deeper into the specifics. However, I can assure you that this project offers an opportunity to work on cutting-edge technologies and presents considerable room for creativity and innovation.
Hello I need a Tableau developer to hire for an hour,i would provide a dataset in excel of 2.7mb and do the task with a screenshot in the report you write as required .No etl is need on the data is it clean
I am seeking a skilled database developer who can create a NoSQL database for analytics purposes. The ideal candidate will have experience with Cassandra, as this is our preferred technology. Key requirements for the project include: - Developing a NoSQL databas...candidate will have experience with Cassandra, as this is our preferred technology. Key requirements for the project include: - Developing a NoSQL database for analytics purposes - Expertise in Cassandra and other NoSQL technologies - Ability to design and implement an efficient and scalable database - Strong understanding of data modeling and architecture - Familiarity with data warehousing and ETL processes If you have experience in these areas and can deliver a robust and reliable NoSQL database, please apply for thi...
...support and guidance on data engineering best practices - Collaborate with our team to develop and maintain data pipelines, ETL processes, and data storage solutions - Optimize and scale data infrastructure to ensure high performance and reliability - Debug and resolve data-related issues, and provide recommendations for improvements Skills Required: - Strong experience with Python for data engineering tasks - In-depth knowledge of AWS services, including EC2, S3, RDS, and Kinesis - Hands-on experience with Apache Kafka for real-time data streaming and processing - Proficiency in using Snowflake as a cloud-based data warehouse solution - Familiarity with data modeling, ETL processes, and data warehousing concepts - Excellent problem-solving skills and the ability to work ...
Need original datasets including the end product for - 1 PowerApps Application - 2 PowerAutomate flow - 3 Power BI Dashboards (HRM, Financial Performance and any other interes...product for - 1 PowerApps Application - 2 PowerAutomate flow - 3 Power BI Dashboards (HRM, Financial Performance and any other interesting insights) No need for customized data. Use what you have. Need proper README file afterward. This is to show skill (I've done several of these but time does not allow it today) Objective: Portfolio for a beginner/intermediate Business Analyst. Main task: Show ETL to end product and show integrations abilities between Power Applications and other applications. And Develop productivity flow for Power Automate. Emphasis in replicating what is used in Business. ...
I want to build an ETL pipeline using the Stocks data from Kaggle. Please read the attached document in its entirety to understand the requirements properly. I have worked on the project and have attached my files (ZIP file) and needs to be edited according to the requirements.
I am looking to hire a Freelancer to develop an SQL SSIS SSRS project. The project will involve using data from SQL Server databases as data sources. Additionally, I need the project to have ETL (Extract, Transform, Load) capabilities and reporting or analytics capabilities.
We need a short study of how to change from infobright database to another columnar database. We are using the (deprecated) communiity version of infobright. We have mysql as source and kettle as ETL. - Which s better to move to and why - How to move - Proof of concept Req - SQL based queries on the new one We need an experienced freelancer. Needs to have a good knowledge on column-oriented databases.
I'm looking for an experienced programmer to help me convert existing MSSQL scripts into Qlikview load scripts.
...candidates' knowledge of data warehousing, ETL processes, data modeling, and data architecture. ? Analyze problem-solving abilities and aptitude for handling complex data engineering challenges. ? Collaborate with our hiring team to understand role requirements and align interview criteria. ? Provide detailed feedback and recommendations on candidates' technical abilities and cultural fit. Required Technical Skills: ✅ Strong proficiency in Apache Kafka and its core concepts, such as producers, consumers, topics, and partitions. ✅ In-depth knowledge of Apache Spark and its various components, including Spark Core, Spark SQL, and Spark Streaming. ✅ Familiarity with data warehousing concepts and technologies, such as dimensional modeling and OLAP. ✅ Expertise in ETL...
...UK-EU team remotely (but, preferably from within the UK-EU region). The ideal candidate would have experience in selling either : 1. Cyber security services, including Vulnerability Assessment & Penetration Testing, Network Security Testing, Cloud Security Audits, Security Compliance Assurance among others. 2. Big Data Testing Services, including Data Migration Testing, Data Warehouse Testing, ETL Testing and Validation, Business Intelligence Reports Testing among others. We are searching for a partner who can be responsible for our business development of our cyber security and big data testing services and solutions to potential clients in the UK and EU regions. Additionally, the partner should be capable of selling our services across an Europe-wide region. If you th...
We need Data Engineer ETL and reporting or Talend experienced developer for a part time. We will give 25-28k per month
We need ETL and reporting experienced developer for a part time. We will give 20-25k per month
Create a QlikView application on top of either your ER or dimensional model database from assignments 1 or 2. The QlikView application should resolve the loops in the data model and should have at least 2 tabs in the front-end. Please ensure that you have some data populated in the MySQL database so that you can present the results in QlikView. Submission: - Provide the .qvw file along with a word document with your data model and front-end screenshots.
