Need someone with Spark Scala, Hadoop and Hive Knowledge

Hello. I am an expert in Big Data analytics and have 3 years of experiences in this field. And I have been worked as a data analyst in big data project team and mastered data sources(Strucutred and undstructured data), data cleaning and data mining, ETL using Apache Spark(python,scala). I have much experiences in Datawarehousing with Hive and HBase and Apache Kafka. And I mastered Data visualization with Tableau,Pentaho,Grafana. So I think that I am perfectly fit to your project. If you want to hire me, please contact with me on chat. Thanks.

I have knowledge in software testing including web and mobile testing. I have handled 4 testing project. I have knowledge in automation testing including web and mobile using appium .

Hi, I have 8 years experience in IT industry and 3+ years of experience in big data technologies like spark, scala, Hadoop, kafka, Unix , hive, sql, junit etc. Would be a good fit for your requirement. Thanks, Kopal

Hello, I can help you in the project. Computer engineer expert in Big data. Throughout my professional career I have developed my expertise in implementing data storage, transformation and visualization solutions. Highlight the development of real-time flows and service APIs to help business needs. Going into detail about my professional career, I have the following experiences: Design of architectures based on distributions: Cloudera/Hortonwork and Azure Cloud. Distributed data storage and processing: DFS, Hive, Impala and Kudu. NoSQL Database: MongoDB, Couchbase, Cassandra. Data ingestion in Big Data environments: Apache Nifi, Flume, kafka. Processing data in memory in Batch processes and Streaming: Apache Spark. User Tools: Hue, Oozie and Sqoop. Indexing and information search: ELK, SOLR. Maching Learning Project Methodology for Models predictive. Programming languages: Java, Kotlin, Scala, Python, R, C++, C, VHDL, JavaScript, HTML, AngularJs. Knowledge in data processing libraries: Numpy, Pandas, sickit-learnig. Knowledge of network calculation tools Neural TensorFlow and Keras. Knowledge in Anaconda and Jupyter Notebook. Knowledge in Azure, Azure Data Factory, Databricks.

Currently working as Hadoop administrator on Cloudera distribution for 3 clusters ranges from POC clusters to PROD clusters. Involved in designing and deploying a multitude application utilising almost all of the AWS stack. Responsible for Cluster maintenance, commissioning and decommissioning Data nodes, Cluster Monitoring, Troubleshooting, Manage and review data backups, Manage & review Hadoop log files. Architecture design and implementation of hadoop deployment, configuration management, backup, and disaster recovery systems and procedures. Responsible for cluster availability and experienced on ON-call support Experienced in Setting up the project and volume setups for the new Hadoop projects. Involved in snapshots and HDFS data backup to maintain the backup of cluster data and even remotely. Experience in importing and exporting data from different database like MySQL, Oracle, RDBMS. Good Knowledge on Kerberos Security. Responsibilities Installing and configuring Linux Administration and monitoring Linux Installing, Upgrading and Managing Hadoop Yarn Clusters Configured Hadoop High Availabilty Mapreduce performance tuning Managing and reviewing Hadoop and HBase log files. Provisioning, installing, configuring, monitoring, and maintaining HDFS, Yarn, HBase, Flume, Sqoop, Oozie, Pig, Hive Recovering from node failures and troubleshooting common Hadoop cluster issues Scripting Hadoop package installation and configuration.