Lead Engineer - Data [T500-**]

  • Hyderabad
  • Inspire

We are looking for a Lead Data Engineer for the Enterprise Data Organization to design, build and manage data pipelines (Data ingestion, data transformation, data distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will require to possess strong technical, analytical, programming and critical thinking skills.


Duties and Responsibilities:

  • Work closely with Product owners / managers to understand the business needs
  • Collaborate with architects, data modelers and other team members to design technical details of data engineering jobs / processes to fulfillment business needs
  • Lead sessions with data engineers and provide necessary guidance to solve technical challenges
  • Develop new and/or enhance existing data processing (Data Ingest, Data Transformation, Data Store, Data Management, Data Quality) components
  • Actively contribute towards setting up and refining data engineering best practices
  • Help data engineers adhere to coding standards, best practices, etc. and produce production deployable code that is robust, scalable and reusable
  • Support and troubleshoot the data environments, tune performance, etc.
  • Document technical artifacts for developed solutions
  • Good interpersonal skills; comfort and competence in dealing with different teams within the organization. Requires an ability to interface with multiple constituent groups and build sustainable relationships.
  • Versatile, creative temperament, ability to think out-of-the box while defining sound and practical solutions. Ability to master new skills
  • Familiar with Agile practices and methodologies


Education Requirements Min / Preferred Education Level Description:

  • Minimum 4 Year / Bachelor’s Degree A bachelor's degree in computer science, data science, information science or related field, or equivalent work


Years Of Experience Minimum Years of Experience Maximum Years of Experience Comments:

  • 8-10 years of experience in a Data Engineering role


Knowledge, Skills, and Abilities:

  • Advanced SQL queries, scripts, stored procedures, materialized views, and views (5+ yrs experience)
  • Focus on ELT to load data into database and perform transformations in database (5+ yrs experience)
  • Ability to use analytical SQL functions
  • Snowflake experience a plus.
  • Experience building dimensional Data marts, Data lakes and warehouses. (5+ yrs experience)
  • Cloud Data Warehouse solutions experience (Snowflake, Azure DW, or Redshift); data modeling, analysis, programming – (3+ years' experience with one or more cloud platforms)
  • Experience with DevOps models utilizing a CI/CD tool (2+ yrs experience)
  • Work in hands-on Cloud environment in Azure Cloud Platform (ADLS, Blob)
  • Talend, Apache Airflow or TWS, Azure Data Factory, and BI tools like Tableau preferred (3+ years experience with one or more)
  • Analyze data models