Find Jobs
Hire Freelancers

dynamic CSV to SQL server import - automated using SSIS C#

₹1500-12500 INR

クローズ
投稿日: 6年以上前

₹1500-12500 INR

完了時にお支払い
Project Requirement: I want to create a solution to load a dynamic csv file to SQL table. Following requirements need to be met: 1. The input CSV/TXT file could have any number of columns. 2. Column Delimiter of input file could be comma(,), pipe (|), tab (<tab>), basically it could be different for different file but will be standard in a single file 3. Row delimiter could be [CR][LF] or [LF] or [CR] etc 4. The solution should load all the contents of this file to a SQL server table. (sql version could be 2012/2014 etc) 5. The destination table will be created based on the column names in the header row of the input file 6. All the destination table columns should have sql data type nvarchar(max) 7. Destination table should have PAGE type compression in SQL server 8. Preferably the solution should be a SSIS package or a programatically generated and executed SSIS that loads any files into a table it creates. 9. Solution should just accept a path to the CSV/TXT file and should be able to figure out everything else automatically (number of columns, create table and then load) 10. I should be able to use this to load to SQL 2012, SQL 2014, SQL 2016 Performance requirements 1. The input files I have are very heavy 50GB, 70GB, 80GB etc, so the solution needed should be able to work with such files and also load the the data quickly 2. I already have a few solutions: a) Load csv into a single column table and then parse the column names and data to a table will multiple columns, this process is too slow, so its not acceptable b) use C# script to read header row from csv file, create a table and then load the data using C#. This process is also slow So the requirement is to have the solution as fast as a BCP task in SSIS. I am able to build a static BCP where filename is provided, column structure is static, this works fast but need is to make this dynamic. Copyright requirement: 1. Cannot use any thing that is patented to someone 2. Cannot used a paid library, SSIS addon, every thing should be developed in house 3. you can simply use C#, SSIS, script component etc.... microsoft provided features, so there is no question of using anything copyrighted Documentation Requirements 1. Everything should provide should be documented, so it can be easily reproduced by me on a new installation of SQL/SSIS/Visual Studio etc 2. Code needs to be commented, so every line to code has an explanation
プロジェクト ID: 16256939

プロジェクトについて

16個の提案
リモートプロジェクト
アクティブ 6年前

お金を稼ぎたいですか?

Freelancerで入札する利点

予算と期間を設定してください
仕事で報酬を得る
提案をご説明ください
登録して仕事に入札するのは無料です
この仕事に16人のフリーランサーが、平均₹9,413 INRで入札しています
ユーザーアバター
Hi, I have gone through your REQUIREMENT. I can help you in this as I have much EXPERIENCE in Asp.net, C#, MVC, JSON Web services , ATOM Web services. Can we discuss the REQUIREMENT in detail? We work on different platform like:- . Website designing/ website developing(Asp.net, C#, html, css) .server side scripting language(php) .wordpress Asp.net C# MVC Wordpress Html CSS Web Development and Web Designing. JSON Web services ATOM Web services E-commerce Web development
₹10,000 INR 20日以内
4.9 (17 レビュー)
5.0
5.0
ユーザーアバター
I have 8 + years of experience of working on SSIS & SQL server based technologies. I have completed these typed of projects in the past .
₹13,333 INR 6日以内
5.0 (4 レビュー)
4.9
4.9
ユーザーアバター
I have ready package to load a file and import data , i will do for all files as well if you would like to take it . please let me know
₹8,888 INR 2日以内
4.9 (22 レビュー)
4.6
4.6
ユーザーアバター
Please review my profile. https://www.freelancer.com/u/vw7590795vw.html I have 8 years and 3 months experience in SQL and 5 years and 5 months experience in SSRS, SSIS. Please let me know more details and when we will start. Sky pe: jikenjd
₹6,500 INR 5日以内
5.0 (25 レビュー)
4.3
4.3
ユーザーアバター
A proposal has not yet been provided
₹13,333 INR 10日以内
4.4 (9 レビュー)
3.7
3.7
ユーザーアバター
A proposal has not yet been provided
₹12,500 INR 3日以内
0.0 (0 レビュー)
0.0
0.0
ユーザーアバター
A proposal has not yet been provided
₹9,288 INR 5日以内
0.0 (0 レビュー)
0.0
0.0
ユーザーアバター
I have worked similar project where i have to load hedis measures. It is a healthcare quality measure project.
₹6,666 INR 3日以内
0.0 (0 レビュー)
0.0
0.0
ユーザーアバター
I am currently a Business Intelligence Consultant, where I work with ETL and also with reports and Dashboards. With ETL I work with SSIS, where to read the data of a text file to load in a table of SQL, to me it is quiet, probably what will give more work is the question of the file being mutito heavy, but already I worked with tables where they had 100 million records. I am available.
₹8,888 INR 10日以内
0.0 (0 レビュー)
0.0
0.0
ユーザーアバター
Hi... It's Easy to do this work in normal form when we insert data from any type of file like (CSV,text,docx) to database....But when we insert 50GB of data it mean it carry lots of rows ... and lots of time... so don't worry I will do this work in proper way ... Now I tell something about myself I'm Akash and I'm software developer (.net Specialist) I currently working on CBS(Core banking solution) project . in that project Also have same cases when we insert lots of customers data from Database to file and file to Database... so I have good experience for how we do your work... I'm already done this job.. Thanks..
₹8,888 INR 3日以内
0.0 (0 レビュー)
0.0
0.0

クライアントについて

INDIAのフラグ
India
0.0
0
メンバー登録日:2月 5, 2013

クライアント確認

ありがとうございます!無料クレジットを受け取るリンクをメールしました。
メールを送信中に問題が発生しました。もう一度お試しください。
登録ユーザー 投稿された仕事の合計
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
プレビューを読み込み中
位置情報へのアクセスが許可されました。
あなたのログインセッションの有効期限がきれ、ログアウトされました。もう一度ログインしてください。