Lead Engineer - Data [T500-**]

  • Hyderabad
  • Inspire

Job Summary:

We are looking for a Lead Data Engineer for the Enterprise Data Organization to design, build and manage data pipelines (Data ingestion, data transformation, data distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will require to possess strong technical, analytical, programming and critical thinking skills.


Responsibilities:

  • Work closely with Product owners/managers to understand the business needs
  • Collaborate with architects, data modelers and other team members to design technical details of data engineering jobs / processes to fulfillment business needs
  • Lead sessions with data engineers and provide necessary guidance to solve technical challenges
  • Develop new and / or enhance existing data processing (Data Ingest, Data Transformation, Data Store, Data Management, Data Quality) components
  • Actively contribute towards setting up and refining data engineering best practices
  • Help data engineers adhere to coding standards, best practices, etc. and produce production deployable code that is robust, scalable and reusable
  • Support and troubleshoot the data environments, tune performance, etc.
  • Document technical artifacts for developed solutions
  • Good interpersonal skills; comfort and competence in dealing with different teams within the organization. Requires an ability to interface with multiple constituent groups and build sustainable relationships.
  • Versatile, creative temperament, ability to think out-of-the box while defining sound and practical solutions. Ability to master new skills.
  • Familiar with Agile practices and methodologies


Knowledge and Abilities:

  • Advanced SQL queries, scripts, stored procedures, materialized views, and views (5+ yrs experience)
  • Focus on ELT to load data into database and perform transformations in database (5+ yrs experience)
  • Ability to use analytical SQL functions
  • Snowflake experience a plus.
  • Experience building dimensional Data marts, Data lakes and warehouses. (5+ yrs experience)
  • Cloud Data Warehouse solutions experience (Snowflake, Azure DW, or Redshift); data modeling, analysis, programming - (3+ years' experience with one or more cloud platforms)
  • Experience with DevOps models utilizing a CI/CD tool (2+ yrs experience)
  • Work in hands-on Cloud environment in Azure Cloud Platform (ADLS, Blob)
  • Talend, Apache Airflow, Azure Data Factory