Find Jobs
Hire Freelancers

Build data extract and transformation tool -- 2

$250-750 USD

完了済み
投稿日: 8年以上前

$250-750 USD

完了時にお支払い
We are in need of a data extraction (E) + transformation (T) tool -- the importer -- that converts information stored in various file types (such as .csv, .xls, .xlsx, .mdb, .accdb, etc.) and structures (wide, long, dyadic, etc.) into a standardized .json format based on an already established data schema and built off an existing prototype. Information on the json data schema can be found here: [login to view URL] The data extraction ( E ) logic is how to generate the flow of events from data within each source file; and the data transformation ( T ) logic is how to serialize the data in the flow to separate JSON objects. The JSON output of the E+T tool will eventually be uploaded into a cloud-based data aggregation tool, aka. DataGator, that is currently under development. The full-fledged importer tool needs to be robust enough to identify different variants of standard data fields and records, including non-standard characters within the data as well as within the file names, and reformat and package these into the final .json format that the system, aka. DataGator, recognizes. We are looking for developers with expertise in Java and data processing. Familiarity with Jackson/Apache POI would also be advantageous. This project has the possibility of becoming a longer-term arrangement for the development of additional auxiliary components for the DataGator project. The final iteration of this tool will be included in a public rollout for the DataGator system. To facilitate candidate developers to understand our requirements, we have created a prototype of the importer tool. A working example is provided within the prototype that can convert a single .csv file to JSON output. The prototype of the importer tool can be found in our public GitHub repository, [login to view URL] The work that needs to be completed would be to extend this prototype both horizontally (i.e. extract data from other file types such as .xls, .xlsx, .mdb, .txt) and vertically (i.e. support data filtering, merging, and hierarchical extraction, i.e. selecting multiple work sheets within a single Excel files, one sheet in multiple Excel files, multiple sheets within multiple Excel files etc.). There are multiple modules that need to be constructed based on file types and additional functionality NOTE: This project is only for Module 2 (XLSX Extractor) and all additional modules will be completed under follow-on projects dependent on successful completion of Module #1. Module 1: Build E+T functionality for .xlsx file Module 2: Build E+T functionality for .xls file Module 3: Build E+T functionality for .mdb file Module 4: Build E+T functionality for .txt file Module 5: Allow for processing of multiple files Module 6: Create a Java GUI for client-side operation Note: The logic for multi-sheet xls / xlsx/mdb files can have three alternative options (i) extract data from one of the sheets (ii) extract data from multiple sheets and combine them into a single JSON object (iii) extract data from multiple sheets and output them as individual JSON objects. Our expectation is that Module 2 (XLSX Extractor) will be able to be completed within 3-4 days of being awarded the project and the freelancer is qualified to complete Modules 3 through 6. We have provided several sample files that will need to be converted to JSON format and eventually uploaded, however it must be understood that these sample files are not an exhaustive list of characters within a file or file structures. The ideal freelancer will be willing and able to identify potential issues that may arise as other users begin to use it and different file structures are loaded into the tool. We are looking for freelancers that are passionate about this project and interested in a longer term working relationship. Please reach out with any questions that you may have.
プロジェクト ID: 8970922

プロジェクトについて

16個の提案
リモートプロジェクト
アクティブ 8年前

お金を稼ぎたいですか?

Freelancerで入札する利点

予算と期間を設定してください
仕事で報酬を得る
提案をご説明ください
登録して仕事に入札するのは無料です
アワード者:
ユーザーアバター
I have 8 years experience in JAVA, J2EE and ready to work on this
$440 USD 10日以内
4.9 (96 レビュー)
6.7
6.7
この仕事に16人のフリーランサーが、平均$553 USDで入札しています
ユーザーアバター
Hello I am Java expert and interested in this project. I have reviewed your requirements and confident to handle this project perfectly. Please communicate to discuss further. Regards Anshu
$736 USD 25日以内
4.7 (419 レビュー)
7.4
7.4
ユーザーアバター
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
$590 USD 6日以内
5.0 (70 レビュー)
6.3
6.3
ユーザーアバター
Hi, I am an expert on C, C++, Java and Android based technologies. Please let me know if you are interested, so that we can discuss further. Thanks Paul
$400 USD 5日以内
5.0 (49 レビュー)
5.9
5.9
ユーザーアバター
I am an expert in delivering custom scripts and software willing to discuss further about the project needs
$526 USD 10日以内
4.9 (32 レビュー)
5.7
5.7
ユーザーアバター
hello, sir: c/c++/python expert worked for samsung & huawei maybe more details will be helpful a sample can be provided before hired. hope to get message from u ty
$277 USD 3日以内
4.9 (5 レビュー)
4.0
4.0
ユーザーアバター
this is a techniqual and lengthy work, that's why i am bidding high .
$1,234 USD 10日以内
5.0 (9 レビュー)
3.7
3.7
ユーザーアバター
I am a sun certified java programmer with over 10 yrs of architecture and development experience. I have worked on some major ETL related project where I have migrated terabytes of data (If required I can pass on specific references to the clients and projects). Also has part of REST webservice implementation I have done for a project I have worked JSON data-structures. This makes me the perfect match for this project. I believe you need a ETL framework with plug and play model for processing various kind of files and should have provision to add more files in future. As part of the delivery I will be setting up that framework in java which works on that design principle where new extractors,transformers and loaders can be hooked in. This will ensure that when a new kind of files has to to be process does not require change to existing code and can be integrated seamlessly. Code delivered will be as per java coding standards and will have JUnit classes as the proof of unit testing. Thanks in advance. Will wait to hear back form you.
$583 USD 10日以内
4.8 (9 レビュー)
3.8
3.8
ユーザーアバター
Hi, I'm an experienced software developer, I have excellent experience doing such projects. If you award me the bid, will complete the work within a few days for sure. I have lots of experience with JSON and generating files for Export. Please consider me for this project. I assure you excellent quality and precise data. Robins Joy
$250 USD 10日以内
5.0 (2 レビュー)
2.2
2.2
ユーザーアバター
Hi I have hands on experience in Jackson poi api in extracting data to various formats. I also worked on mule esb for transformations and routing of services. I implemented restful services using jersey and spring api in my previous projects. Hope I am fit for this job.
$500 USD 1日以内
5.0 (1 レビュー)
2.0
2.0
ユーザーアバター
Hello buyer, I have more than 7 years experience in web application development. I know Wordpress, Joomla, HTML5, CSS3, E-Commerce-Websites, PHP, MySQL and Responsive design. Lets discuss more on chat window. Thanks Durgesh
$250 USD 11日以内
0.0 (0 レビュー)
0.0
0.0
ユーザーアバター
If you'd like to see sample code please ask. In the mean time please look me up on linkedin I look forward to hearing from you.
$555 USD 10日以内
0.0 (0 レビュー)
0.0
0.0
ユーザーアバター
A proposal has not yet been provided
$500 USD 4日以内
0.0 (0 レビュー)
0.0
0.0
ユーザーアバター
A proposal has not yet been provided
$561 USD 8日以内
0.0 (0 レビュー)
0.0
0.0

クライアントについて

UNITED STATESのフラグ
Denver, United States
5.0
55
お支払い方法確認済み
メンバー登録日:1月 18, 2009

クライアント確認

ありがとうございます!無料クレジットを受け取るリンクをメールしました。
メールを送信中に問題が発生しました。もう一度お試しください。
登録ユーザー 投稿された仕事の合計
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
プレビューを読み込み中
位置情報へのアクセスが許可されました。
あなたのログインセッションの有効期限がきれ、ログアウトされました。もう一度ログインしてください。