Kamalakannan Palaniappan

is working from home. 🏡

Angestellt, Lead Azure Data Engineer, Cognizant Technology Solutions, India

Coimbatore, Indien

Über mich

Azure Lead Data Engineer with 13 years of experience in building Enterprise wide Cloud data warehousing and on-premise solutions • 5 years of experience in huge volume data processing with Azure Data Factory, Azure Data bricks, PySpark and Azure storage services – SQL, Blob storage and ADLS Gen2 • 3 years of experience in Re-engineering IBM Data Stage Jobs into Azure Data Factory pipelines and Azure Data bricks notebooks • 4 years of experience in CI/CD with GitHub for ADF batch pipelines by managing Azure Resource Manager (ARM) template and Parameter JSON files • 8 years of experience in building on-premises data warehousing solution - DataStage, SQL, Unix Shell Scripting and DB2 • Managing 4 data Integration projects with team strength of 15 to 20 team members • Increased cost to profit ratio from 25% to 60% for past 2 years with very minimal attrition rate • Coordinated in Upskilling of more than 50 members in Azure Data Engineering and PySpark.

Fähigkeiten und Kenntnisse

Azure Data Factory
Azure Data Bricks
Azure Data Lake Storage
Pyspark
Azure SQL Database
DataStage
ETL-Process
SQL
Agile Software Development
GitHub
Data Analytics
Data Integration
Shell Scripting
Python
DevOps
Kubernetes
Generative AI
Machine Learning
Commitment
Team work
Responsible
Leadership

Werdegang

Berufserfahrung von Kamalakannan Palaniappan

  • Bis heute 1 Jahr und 10 Monate, seit Sep. 2022

    Lead Azure Data Engineer

    Cognizant Technology Solutions, India

    Managing 4 cloud data Integration projects with 20 team members. Responsible for resource fulfilment, revenue forecasting, Project tracking, Sprint planning, Story maintenance, Upskill training coordination.

  • 2 Jahre und 2 Monate, Juli 2020 - Aug. 2022

    Senior Azure Data Engineer

    Cognizant Technology Solutions, India

    Managing team of 10 members, Hiring Manager, on boarding, mentoring, technical guidance, upskill training co ordinator, team members performance appraiser, managing resources in project teams

  • 1 Jahr und 11 Monate, Aug. 2018 - Juni 2020

    Azure Data Engineer

    Cognizant Technology Solutions, India

    Created ETL batch Data pipelines using Azure Data Factory, ETL cleaning and transformations using Azure Data bricks with Pyspark and SparkSQL. CI/CD with GitHub

  • 10 Monate, Okt. 2017 - Juli 2018

    Team Leader DataStage

    Cognizant Technology Solutions, India

    Lead team of 5 team members, assigning project as Stories in each sprint, Agile sprint planning, Story grooming, Story tracking in RTC, Requirements clarification with Client and onsite lead, prepare detailed design and code migration.

  • 3 Jahre und 3 Monate, Juli 2014 - Sep. 2017

    Senior DataStage Developer

    Cognizant Technology Solutions, India

    Developed ETL using pipelines using DataStage to process more than 4.5 billion rows. Data Analysis with SQL and Job execution with Unix Shell scripting.

  • 3 Jahre und 2 Monate, Mai 2011 - Juni 2014

    DataStage Developer

    Cognizant Technology Solutions, India

    Developed ETL Data Integration pipelines using DataStage. SQL for Data analysis and Job execution with Unix Shell scripting.

Sprachen

  • Englisch

    Gut

  • Deutsch

    Grundlagen

21 Mio. XING Mitglieder, von A bis Z