Hadoop Jobs

Hi, I am looking for an expert in Hadoop Map Reduce for performing analysis and write report according to guidelines. Please check attachment before submitting proposal. Thanks

Looking for a person who can help me install a Hadoop

You are required to setup a multinode environment consisting of a master node and multiple worker nodes. You are also required to setup a client program that communicates with the nodes based on the types of operations requested by the user. The types of operations that expected for this project are: WRITE: Given an input file, split it into multiple partitions and store it across multiple worker nodes. READ: Given a file name, read the different partitions from different workers and display it to the user. MAP-REDUCE - Given an input file, a mapper file and a reducer file, execute a MapReduce Job on the cluster.

I am working on a YouTube dataset where I have to get 5 insight using spark, hive ,HDFS and Elastic search

I am looking for guy who is expert in spark, scala and sql.

Total Experience : 4+ years to 7 years Designation : Sr. Data Engineer Mandatory skills : Pyspark & EMR Location : Pune /Remote Job Description - 1) Hands-on experience with Python, Spark, EMR 2) Proficient understanding of distributed computing principles 3) Proficiency with Data Processing: HDFS, Hive, Spark, Scala/Python 4) Independent thinker, willing to engage, challenge and learn new technologies. 5) Understanding of the benefits of data warehousing, data architecture, data quality processes, data warehousing design, and implementation, 6) Table structure, fact and dimension tables, logical and physical database design, data modeling, reporting process metadata, and ETL processes. Requirements -- 1) Client-facing skills: Solid experience working with clients directly, to b...

Adventure works data movement from on Prem SQL server to S3 or snowflake using Apache nifi, talend or other etl tool Kafka etc