Responsibilities:- Translate business requirements for integration data sources into enterprise DataLake including:o Gathering requirements from stakeholderso Write and maintain technical specification for solution o Build POC to demonstrate key features and basic functional of the designo Works with the Dev and QA team in implementationo Present the solution at design the review sessions- Design, implement and support ETL processes using Apache Spark based custom ETL solution (Sqoop, Spark) - Design data model for transactional and fact layers of existing data lake- Design DQ processes including freshness, completeness, accuracy, consistency and integrity for ODS, DDS and DM layer tables of the DWH - Build monitoring for custom solution - define and gather metrics, design dashboards - Lead the Hadoop migration process between Datacenters for our team.

Responsibilities:- Develop role-based security model and implement it for enterprise data lake- Implement Data Discovery / Data Lineage software- Create naming convention for data lake objects - sources, HDFS folders, hive tables, column attributes, ETL Processes and etc.- Develop enterprise ETL Framework for unification of data ingestion tasks- Develop architecture of DQ solution for data lake and choose set of metrics for monitoring of ETL processes - Design data model for Detail Data Storage / Common Data Mart layers- Making RFI for varies of RDMS/MPP solutions for storing data marts data based on business functional and nonfunctional requirements - Create signaling system to track DSA violation issues - Provide fast integration of new source systems using NIFI and Apache Spark to existing Data lake

Responsibilities- Design and develop the architecture roadmap for big data platforms, including data modelling, data security, master data management etc.- Design data models, ETL processes for high volume data systems, distributed data processing systems, and data marts.- Work with teams in the overall IT solution, with the responsibility to ensure successful data design and implementation.- Gather requirements from product owners, data analysts/scientists, data engineers, IT and user communities.- Responsible for data profiling, data analysis, data specification, data flow mappings, and business logic documentation associated with new or modified data capture requirements.- Suggest optimal data schema and storage options based on the context of the problem being solved.- Identify and resolve data integration issues (DQ, SLA\DSA breach) using various data architecture concepts and techniques- Solve query and execution engine optimization issues, suggest optimal solutions and configuration settings- Design hardware specification for entire solutions

Started in 2010 as junior MS SQL Developer in a new reporting team of financial company. Finished on the position of a BI Team Lead combined with system senior developer / architect role in a part of DWH.Responsibilities in manager / architect role included:- Create technical specification based on business analyst / customer requests;- Estimate design and development duration and tasks assignment among the team;- Test and personal assessment;- Design and approve enterprise architectural solutions in a part of DWH;- Supervise DWH operating processes 24/7 via RDP if necessary;- Review CV and job interview candidates into BI team.Responsibilities in developer role included: - Development and support constantly evolving enterprise Business Intelligence (BI) solution with Data Warehouse (DWH) on MSSQL with overall volume more than 2 TB;- Design, create and maintain SSIS ETL packages for retrieving data from MSSQL, PostgreSQL, Oracle, enterprise and external file storages, web services and etc (more than 1500 packages);- Create rich, flexible, dynamic RS reports/dashboards with any degree of complexity stylized for enterprise design requirements (made by me and my team more than 400 items);- Develop OLAP cubes (Tabular and Multidimensional modes) - more than 15 databases;Reports and OLAP cubes were made for different internal customers from leasing, banking and insurance divisions, including: accounting, finance, risk management, personnel department, internal and financial security department, sales department, collection department, call center as well as internal reports of the IT department;- Design and development enterprise Master Data Management system based on SSIS;- Create monitoring system to observe and supervise ETL and other processes inside DWH with service desk email error delivery feature; DWH automatic data consistency control system.

General responsibilities on this position included:- Design and develop a DWH system architecture from scratch based on MS SQL 2008 RDMS;This system was a basic platform for developing a distributive management system of nomenclatural products;- Develop customized solutions based on created platform;- Create rich dynamic reports upon that solutions bases on MS Reporting Services;- Build OLAP Cubes;- Plan and develop a migration solution between existing and new system;- Integrate other side solutions to created, export / import data; - Basic database administration (replication, backup, index managing and etc.)- Customize solutions for work with big table – partition schema management, bulk insert / switch partition task;Achievements on this position included:- Created platform allowed to perform fast implementation of nomenclature management solutions for many customers;- OLAP cubes improved report building time and allowed analytics to investigate all enterprise data in one place using only MS Excel;- Migration from MS SQL 2005 to 2008 allowed to implement faster CTE logic which significantly simplified hierarchy management.

General responsibilities on this role included:- Work on a fixed communication billing system as junior developer in CRM Team;- Develop stored procedures and create database structure objects;- Migration from PL\SQL (Oracle 9i) to T-SQL (MSSQL SQL Server 2005);- Query optimization for big volume tables;- Review of T-SQL code;- Create documentation for created functionality;- Reverse engineering from existing T-SQL code.Achievements on this position included:- Got first experience during work on such big project, communicated with many other IT teams: business analytics, system architecture, testing and etc.;- Migrated hundreds of Pl/SQL procedures to T-SQL.

General responsibilities on this position included:- Develop various modules in server-client ERP system: core, salary, personal management, supply management and etc.;- Write documentation;- Implement solutions on customer side including business trips.