* Developed and implement Big Data Solutions using Apache Spark and Python (PySpark) * Worked with Microsoft Azure cloud technologies to implement SaaS model * Developed customize Parser modules to parse in-coming data using Python * Developed automation scripts to support well defined processes using Python and Shell scripting * Designed ETL jobs in Spark for better processing unit * Implemented Security practices using Key Vault on Microsoft Azure platform * Performed analysis of vast data stores and uncover insights * Lead and coached a team of 4 juniors * Defined and created processes for CI-CD environment * Key Accomplishments * Achieved Best Team Award – Dec 2017

* Client: National Payments Corporation of India Responsibilities: * Lead and mentor group of Big Data Engineers * Domain research and Client requirement study * Client interaction Hardware-side: * Plan and design hardware requirement based on the size of problem space * Help client setup the infrastructure as per requirement * Co-ordinate with hardware vendors for procurement, deployment and support * Administration and management of the hardware Software-side: * Deploy and install Hadoop cluster (Cloudera / Hortonworks Distribution) * Transfer data from multiple data source systems to Hadoop Cluster using different channels Ex: Apapce Sqoop, Apache Flume, Apache Kafka etc. * Develop scripts for automation of the Data transfer * Create Hive/HBase Database and tables for transforming raw data into usable format * Create Hive Queries for generating aggregated data-sets usable for analysis

Around 3 years of experience in software development in Banking and Finance Domain.Hands on experience on UNIX and Linux Platforms, Perl Scripting, Shell Scripting and Oracle. Rich exposure to System Development Life Cycle (SDLC). Strong Object Oriented concepts for software design and implementation. Experience in developing the Reconciliation applications using Perl/Shell Scripting and SQL DeveloperExperience in migration of platforms. Strong interpersonal and communication skills with an ability to lead a team and keep them motivated. Show less

* Understanding and reviewing current systems * Take major part in data ingestion activities * Handled key volume structured & unstructured data in batch and real time modes * Plan and design hardware requirement based on the size of problem space- Deploy and setup Hadoop cluster (Hortonworks Distribution) on Cloud (Microsoft Azure)- Develop Python / Shell scripts for automation * Ingest data from multiple data source systems to Hadoop Cluster using different channels * Demonstrate POC for various client as per there requirements * Rich exposure to Agile methodologyWorked around with majority of the components within Hadoop Ecosystem HDFS, HBase, Hive, Apache Oozie, Apache Storm, Apache Kafka etc. Show less