Lead Azure Data Engineer

  • Pune
  • Persistent Systems

About Position


As a Lead Azure Data Engineer, you will oversee the design and implementation of data solutions on Microsoft Azure, ensuring they meet scalability, performance, and security standards. Your role involves leading a team of data engineers, managing data integration projects, optimizing data architectures, and guiding strategic decisions to align with business objectives and technological advancements.

Role : Lead Azure Data Engineer

Location : All PSL Locations

Experience : 9-14years

Job Type : FTE

What You'll Do


  • Strong experience developing data solutions using Azure Data services including ADF, ADLS, Azure SQL, Azure Databricks, Microsoft Fabric, Azure Data Lake, AAS, Azure Storage, Power BI, ABS, Synapse, and other services within the Azure data framework.
  • Lead workshops with many teams to define data ingestion, validation, mining, engineering, modelling, visualization, AI, and analytics.
  • Strong understanding on Azure data services security practices
  • Develop architectural solutions/designs to project execution teams for implementation.
  • Experience with on-prem Microsoft technologies like SQL Server, SSIS, SSAS is a plus.
  • Own and aggressively drive forward specific areas of Azure technology development & architecture.
  • Lead the technical planning & requirements gathering phases including estimate, develop, test, manage projects, architect, and deliver complex projects.
  • Determine Project and solution estimation and participate/recommend team structure definition.
  • Participate in design sessions, demos and prototype sessions, testing and training workshops with business users and other IT associates.
  • Support multiple Agile Scrum teams with planning, scoping, and creation of technical solutions for the new product capabilities, through to continuous delivery to production.
  • Provide end to end vision and hands on experience with Azure Cloud Platform

Expertise You'll Bring

  • 8-12 years’ experience in one of the deep technical specializations in SQL DW, Azure Data Factory, Azure Databricks & Microsoft Fabric.
  • Strong Hand-on experience in Azure Data Factory, Azure DevOps CI/CD, Azure Logic Apps flow, Azure Data Lake, Azure Synapse, Azure Databricks, Microsoft Fabric, PySpark, GitHub.
  • Experience in ETL/Pipeline Development using tools such as Azure Databricks/Apache Spark and Azure Data Factory with development expertise on batch and Realtime data integration.
  • Design and Develop Data Processing
  • Advanced Analytics including Azure Synapse Analytics, Azure Data Bricks, data visualization tools.
  • Experience in programming using Scala or Python
  • Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL
  • Enterprise-scale technical experience with cloud and hybrid infrastructures, architecture designs, database migrations, and technology management.
  • Hands-on experience on the Application migration from on premises to Azure cloud
  • Azure Professional Data Engineering Certification
  • Bachelors’ or Maters’ Degree in computer science

Benefits


  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  • Annual health check-ups
  • Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Our company fosters a values-driven and people-centric work environment that enables our employees to:

  • Accelerate growth, both professionally and personally
  • Impact the world in powerful, positive ways, using the latest technologies
  • Enjoy collaborative innovation, with diversity and work-life wellbeing at the core
  • Unlock global opportunities to work and learn with the industry’s best

Let’s unleash your full potential at Persistent

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”