Senior Data Engineer

Data Pipelines • SQL • BI • Virtualization • ML • Cloud





If you are here to check my portfolio application, the Web Scrapping Data Collection and Notification App,
please go to apps.zaferdurmaz.com





w/ Hands on experience

Designing and developing solutions for Information Technology systems

image text View & Download Resume

the most up to date version...


Professional Experience Summary

15+ years of experience in IT field, using different programming languages to developing solutions for IT. Experience with Azure Cloud and various Windows and Linux hosting platforms. Extensive hands-on experience with object-oriented programming languages. Experience with data virtualization & reporting tools like PowerBI, Tableau, SSRS, MS Excel etc. Experience with MS Visio, creating flowcharts and diagrams for applications and/or processes. Hands-on SQL Server database maintenance and administration experience (scheduling jobs, backups, restore) Experience with complete life cycle of SSIS Packages (Developing, Deploying, Scheduling, Troubleshooting and monitoring) for performing Data transfers and ETL jobs across different data sources and destinations. Fluent experience with generating complex Transact SQL (T-SQL) queries, Sub queries, Co-related sub queries, Dynamic SQL queries as needed. (Stored Procedures, views, ad-hoc reports etc.) Datawarehouse design, implementation, data processing, reporting experience. Experienced in improving SQL Server performance by using index tuning wizards, performance tuning methods, execution plans and profilers, query analysis and paramaterization, code optimization

Experience

May 2015 – Present --- Certified IT Developer (Senior SQL/BI Developer, DevOps Engineer) at DCAS/NYC
Did research and analysis, working closely with business users to optimize integrated data flow in new Datawarehouse and later involved in report design requirement gathering. Created documentation (ETL data mapping, data dictionary, database diagrams etc.) Developed and deployed SSIS packages for ETL from OLTP and various sources to staging and staging to Data warehouse using Lookup, Derived Columns, Condition Split. Created database objects including tables, triggers, views, stored procedures, Indexes and Functions. Worked on improving SQL Server performance by using index tuning wizards, performance tuning methods, execution plans and profilers, query analysis and paramaterization, code optimization Designed dashboard reports pulling data from new reports. Generating, developing and testing new permanent business reports based on given business rules. Generating and developing SQL for new ad-hoc reports Administered database, handling tasks like maintenance, scheduling jobs, backups, restore, database user management, version upgrades etc. Experience with complete life cycle of SSIS Packages (Developing, Deploying, Scheduling, Troubleshooting and monitoring) for performing Data transfers and ETL jobs across different data sources and destinations. Generated ad-hoc reports using T-SQL queries, Sub queries, Co-related sub queries, Dynamic SQL queries as needed. (Stored Procedures, views, ad-hoc reports etc.) Experienced in improving SQL Server performance by using index tuning wizards, performance tuning methods, execution plans and profilers, query analysis and paramaterization, code optimization Designed, developed, deployed and scheduled ETL projects. Documented and clarified business requirements of existing processes. Created Power Pivot reports for business users. Worked on a POC project on Azure Cloud computing processing and automating of solar data from IoT devices to cloud database. Processed over 50 million rows of data to database from text files and created PowerBI analysis reports for business users to export with custom filters. Worked on a project calculating billing data for future predictions to prevent error billing. Assisted Machine Learning/Google TensorFlow processing imlementation.
Dec 2014 - May 2015 --- Senior Developer / BI Expert at DCAS/Spruce Technology
Worked on existing Crystal Reports to make sure they are running and giving same results after switching to new database structure, asserted versioning with effective start and effective end date for each record. Created new stored procedures and functions to retrieve same data as they are running against legacy database. Altered, updated and tested billing data load process, related tables and stored procedures to reflect needed business changes. Worked on uploading digitally received billing files to server and processing them to production tables. Worked on a project which needs data transformation with encrypt and decrypt data requirement, built SSIS package for the data extract and transformation. Worked on a SSIS project that requires FTP access and email notification for the process details. Wrote C# script to handle read files via FTP and emailing process. Researched possible MongoDB implementation use cases and did a presentation for IT users to consider in their existing or future projects.
Oct 2009 – Dec 2014 --- Software Developer at NYC HRA / QED National
Developed a new system to process SRO Billing payments, using SQL SSIS Made analysis on database and finds out data issues, prepares necessary queries to make production database more stable and accurate. Designed and develops customized reports upon manager’s requests. Converted existing DTS packages to SSIS packages. Converted SQL Server 2000 stored procedures to SQL Server 2005 stored procedures and makes sure they all return the right data as they returned before. Generated fixed width and comma separated files using previously built systems and makes sure they are transferred related servers. Checked database if previously scheduled tasks are running fine or not, find out the problem for the tasks failed. And makes sure the scheduled database task is running fine as before. Built scheduled tasks to track changes on critical tables in the system. Worked on a project which calculates Social Worker Performance and returns a detailed report. Generated Batch Files and writes scripts to transfer, rename and backup files between servers. Optimized performance through proper database design and coding standards, as well as tuning of existing procedures, indexes and aggregations. Involved in extracting the data using SSIS from OLTP to OLAP ETL Processing and reporting. (Extract, Transform, Load) Leaded an iPad web application project (Inspection Module for larger application) Generated density map and ad-hoc query reports Handled Data Migration for new projects.
Jan 2007 – Oct 2009 --- C# .NET Application Developer at NYC HRA/HASA
Participates in a project developing multiple ASP.NET Web applications using C# in .NET 2.0 and Microsoft SQL Server 2005 as a back-end storage. Created database schemas, stores procedures, triggers, data transformation packages, and indexing using SQL Server. Designed and implemented software libraries (APIs) to be used in different system interfaces such as web and windows applications and services. Used NUnit for unit testing and set proper configuration management. Designed multi-tiered and distributes applications with special consideration to application security. Built SSIS Projects to migrate data from Oracle database to SQL Server database.
Feb 2005 – Jan 2006 --- Database & Report Developer at Local Print Newspaper
Assisted in design of a subscriber database to store and reuse subscriber’s data, Evaluated and modified tables, queries, and reports for company’s requirements Created daily reports that were optimized for business performance and print house Improved efficiency of databases by employing database techniques such as indexing, normalization, Did regularly scheduled backups, and backed up the database immediately after implementing changes to the database structure. Tested previously developed statements, queries and documented these for future use.
June 2002 – Jan 2004 --- Jr. Systems Analyst at Federal Electric
Helped Sr. Systems Analyst with tasks, by gathering required information, onsite data, current system status reports etc. during new ERP system implementation, Leaded data collection from running system for ERP implementation and presented collected data to the management. Observed and reported system errors to improve system performance and efficiency, Did flow charting, specifications for the programmers and developers to explain the existing system. Did “work study” at manufacturing department to calculate and improve processing time and found out shorter processing time for critical processes. Assisted during installation of required hardware (computer and network systems), prepared their initial documentation.
​​



Education



Training & Certifications

Microsoft Certified Professonal ( Certification No: F260-7315 ) at Microsoft Microsoft Specialist – Programming in C# ( Certification No: F260-7317 ) at Microsoft MongoDB Training at New York City Angular 6 Training at New York City PowerBI Design Development at Microsoft Technology Center, NY Scrum Training at Citywide Learning & Development, NY Application Lifecycle Management at Citywide Learning & Development, NY ADO.NET Training at Metrotech Center Brooklyn, NY ASP.NET 2.0 Training at Metrotech Center Brooklyn, NY

Quick Contact


References

References will be provided upon request...


Technical Skills


Languages T-SQL, Python, C#, CSS, Javascript, Typescript, PHP, DAX
Database & Tools - MS SQL Server Management Studio, Oracle, MS Access, MongoDB
- SQL Profiler, Query Analyzer, SQLite, MySQL, SQLite, phpMyAdmin (Web Based), MySQL Workbench
- RedGate Tools ( SQL Backup, Data Compare, SQL Compare, Dependency Tracker, SQL Toolbelt )
ETL Tools SSIS (SQL Server Integration Services), MS Data Import
Reporting & Data Virtualization SSDT (SQL Server Data Tools / BIDS), SSRS (SQL Server Reporting Services), SSAS, Power BI, Tableau, Crystal Reports
Platforms MS Visual Studio, MS TFS / Source Safe, MS Visual Studio Code, PyCharm, Windows, Azure Cloud, Linux, cPanel, Eclipse, Notepad++
Other Machine Learning, MS Project, MS Visio, MC CRM Dynamics, Various FTP Clients, Batch Processing, Kleopatra (Open PGP), MS Office, Logo Unity ERP, AutoCAD, Photoshop, GIMP, Joomla, Wordpress