Looking for hadoop developer with spark,hive, experience

Highly effective Data Scientist/Data Engiener with over 25 years of experience. I have extensive Spark experience both in PySpark and Scala also in MLLib. TECHNICAL SKILLS • Big Data (Hortonworks and Cloudera) – Spark(PySpark, Scala), Kafka, Hive,Impala, NiFi, HDFS, Sqoop, Ranger, Yarn, Solr, SAM, Schema Registry, SuperSet • Language: Python, Scala, R, JavaScript • Data Visualization – Tableau, PowerBI, OBIEE, DOMO • Plunk & ELK Stack – ElasticSearch, Logstash, Filebeat, Kibana • AWS – S3, RefShift, DynamoDB, Athena, Kinesis, EMR, Aurora, Glue • Azure – Data Warehouse, Polybase, SQL Server, HDInsight, SSIS, SSAS • ETL – Informatica Power Centre, Informatica Big Data Management (BDM), SSIS • Data Science & Engineering – R / RStudio / SparkR Packages: dplyr, ggplot2, stringr, plyr, carrat, SparkR, NLP, tibble, TensorFlow, curl, Python / PySpark, MLLib • Libraries: MLLib, NumPy, SciPy, Pandas, Matplotlib, Seaborn, SciKit-Learn • DBMS / OLAP – Oracle, SQL Server, TeraData, MySQL, Postgres, Essbase, SSAS • Data Modelling – Kimball, Vault • Machine Learning / Statistical Modelling - Linear Regression, ?Logistic Regression, Classification and Regression Trees, Naive Bayes, ?K-Nearest Neighbors

Hi, I am very excited to work on this project, and I am formally submitting my proposal for consideration. I am sure you have received many proposals for this project, so allow me to present a few reasons why you should consider me. I am a hands-on Software Developer with 8+ years of application design, development, architecting and managing world class applications like Ecommerce market place, analytical engines and SAAS and Microservice architecture based products. Working on a world class Blockchain based Supplychain product. My technical experties are: Domain Experience: Data Management/Analytics, Ecommerce and Fintech and supply chain management Programing Languages : Java/J2EE, Python, Scala, NodeJS Frameworks : Spring, spring Boot, Spring Cloud, Hibernate Cloud Platforms : AWS, PCF and GCP with Docker with Swarm and Kuburnetes Webservices : REST, SOAP, Microservices RDBMS : SQL and PL/SQL NoSQL : MongoDB, Redis, Elasticsearch, Casandra, HBase, Neo4j.. Big Data Technologies - HDFS, MapReduce, Spark, Apache Kafka.. Note that I am specialised architect in Microservices architecture using Open source Netflix OSS suite, AWS services, Google Cloud Platform services. Final note: I am having very good experience in microservice architecture and Delivered best projects/products to my clients including one of the top investment banks in Singapore. Thanks, David.

Hello there , Im very experienced with the following skills i have 8 years experience in Java , for more details contact me.

We can doit Relevant Skills and Experience We are the best

Some projects description: One of them in which I have taken part is called agrafka, in English, it is translated to a safety pin. Safety Pin is a project based on Apache Spark Graphx. My responsibility was to code and do the implementation of graph measure called closeness centrality. Graph measure is the reciprocal of the sum of lengths of the shorter paths between the node and all nodes. After I get the graph measure, I have to provide the implementation to convert from RDD which is the resilient distributed datasets to graphframe. Then, I save this data to HDFS. Technologies: Apache Spark Graphx 2.3.0 Apache Hive 1.2 Apache Hadoop 2.7.3 Scala 2.11 GraphFrames Spark-Testing-Base The second project which was very interesting that I was a part of is called Similarity Join. Mainly, I have been responsible for bug fixes, maintenance and upgrade to Apache Spark 2.3.0. Generally, the Similarity Join uses Spark-LuceneRDD and converts a query result into data frame in order to save to HDSF. The task of Similarity Join was to compare two transferred title’s and return the score. The calculation is based on “Levenshtein distance" metric. Technologies; Apache Spark 2.3.0 Spark-LuceneRDD Scala 2.11 SBT 0.13 Apache Hive 1.2 Apache Hadoop 2.7.3 Spark-Testing-Base.

Hi , I am big data and java full stack developer having 5 year of experience . I have Build Any Source Using Apache Kakfa and Apache Spark core objective of this project is Get data from any source such as MySql/MongoDb/Cassandra etc and do some aggregation and then dump data into any user choice database I have acieved this using kafka connectors,Spark,Schema Registry ,Avro ,Spark Streaming I have some level of building micro services using reactive-framework(Micro services) in Kafka , I have build micro services kafka application in which data is taken from Hbase and in Using kafka streaming do some aggregation then dump data to the HBas

I have 3 yrs experience as a Big data hadoop developer. My Key skill is Spark,Hadoop,Hbase,Java. I have experience to handle world largest data source produced by mobile and telecom network.