spark scala nlp specialities to optimize my code

$2-8 USD / hour

クローズ

投稿日:

5年以上前

$2-8 USD / hour

Hi, I wrote a apache spark scala program to find tf-idf using corpus, It's hanging on at point near group by statement. I want someone can fix that issue. I have list of articles stored in s3 as parquet, so first I'm reading it as dataframe and creating n-grams and keeping it in one hand. On other hand, s3 has 10k posts (corpus) as parquet. I'm reading it as dataframe and keeping it. So now I want to find document frequency for each term (n-gram) against corpus [Removed by Freelancer.com Admin] I have written, I'm willing to share it to the right candidate Word2Vec knowledge is plus

Natural Language

Scala

Spark

プロジェクト ID: 18112853

プロジェクトについて

2個の提案

リモートプロジェクト

アクティブ 5年前

お金を稼ぎたいですか？

メールアドレス

Freelancerで入札する利点

予算と期間を設定してください

仕事で報酬を得る

提案をご説明ください

登録して仕事に入札するのは無料です

この仕事に2人のフリーランサーが、平均$5 USD/時間で入札しています

@RigelData

Hi, Hope you doing great. Rigeldata Solutions offers custom application development and maintenance services using Open Source Software (OSS) solutions. We have strong practice in Apache Spark, Apache NIFI, Kylo, Hive, Impala, GIT, Redis and SOLR, MySQL, Kafka, Jenkins, Docker and SQOOP. Our expertise in Big Data includes Scalable Data Processing & Storage, Data Integration, access & services Analytics, Dash-boarding & Alerting Real-time Insights & Ingestion. You can have a look in the sample Use cases our team have developed along with our COE team profile. We would like to request your contact information so accordingly we can introduce our company’s service offerings and also understand your requirement in more detail. We are looking forward to your response. Warm Regards, Ali Asst. Manager, Business Development Consulting Services Practice RigelData Solutions

$5 USD 40日以内