Azure Data engineer

  • Pune
  • Trigyn Technologies
Job Description: Trigyn has an opportunity Azure Data Engineer. This resource will work at our client sites in Mumbai/Pune/Chennai/Bangalore/Hyderabad.Job Responsibilities:Azure Data engineer to deliver the new Data Strategy and Data Governance projects. The resource must have experience in Incorta and Oracle Cloud and be highly skilled in SQL and ETL data pipeline development and will be responsible for the design and implementation of the set of automated ETL pipelines to extract data from different sources like Oracle Cloud, ServiceNow, Salesforce, SQL databases and Data Lake. •Work with the team (technical Lead/Architect/other team members) and customer focal point to understand the business need and design/implement the technical data management solution.•Design and implement Data Solutions based on given requirements, especially using Incorta and Microsoft Azure cloud stack.•Design and implement complex ELT/ETL processes using Incorta, Azure Data Factory and PySpark, among others.•Implement and optimize complex transformations on different data sources such as JSON, XML, Excel and CSV Files.•Design and implement Data Lakes and Delta Lakes.•Improve system performance by conducting tests, troubleshooting, and integrating new elements.•Design, implement and maintain Azure DevOps pipelines for CI/CD. Mandatory Technical Skills•Microsoft Azure platform expertise.•Incorta Data platform expertise.•Microsoft Azure platform Data services expert knowledge•Proven experience working with Incorta, Data Factory, Logic Apps, Azure Functions, Databricks, Synapse and Azure DevOps.•Proven experience with Oracle Business Intelligence Cloud Connector (BICC) and Universal Content Management (UCM).•Python, PySPark, Spark SQL, T-SQL expert knowledge and experience•Proven experience working with Data Lakes and Delta lakes•Proven experience writing complex transformations and ingestion pipelines using SQL, SparkSQL and PySpark.•Proven experience working with relational database engines such as SQL Server and Oracle.•Proven experience building CI/CD pipelines in Azure using, at least, scripting and ARM templates.•Experience with Project Management methodologies (PRINCE2/PMP, SCRUM, Agile methodology)•Excellent technical documentation skills, and ability to deliver technical trainings•Customer-centric approach to delivery and problem-solving skills•AI/ML knowledge is a plus•Business intelligence knowledge is a plus• Required certifications:•Azure Data Engineer Associate Desirable certifications:•Master’s university degree in Computer Science, Computer Engineering, Information Technology is a plus•Any other Azure certification on Data management or Azure solutions Architect is a plus