Azure Data Lake Senior Engineer

  • Chennai
  • Saint Gobain

1/ Azure Data Lake Architecture :

Architect, design, and implement scalable and efficient data solutions utilizing Azure Data Lake Storage and related services.

2/ ETL Pipeline Development:

Lead the development of end-to-end ETL pipelines, ensuring seamless data movement, transformation and loading within the Azure Data Lake environment.

3/ Data Modelling and Integration:

Design and implement effective data models and integration strategies to support business requirements and analytical needs.

4/ Azure Services Integration:

Integrate Azure Data Lake with other Azure services, such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics, to create comprehensive data processing workflows.

5/ Performance Optimization:

Optimize data storage, retrieval, and processing for maximum performance and efficiency within the Azure Data Lake ecosystem.

6/ Data Security and Governance:

Implement robust data security measures, including role-based access control (RBAC), encryption, and compliance with data governance policies.

7/ Collaboration:

Collaborate with cross-functional teams, data analysts, and business stakeholders to understand requirements and deliver effective data solutions.

8/ Monitoring and Maintenance:

Establish monitoring mechanisms and perform routine maintenance tasks to ensure the health and reliability of the Azure Data Lake environment.

9/ Documentation:

Create and maintain comprehensive documentation for data processes, architecture, and solutions within the Azure environment.

10/ Mentorship:

Provide mentorship and guidance to junior members of the data engineering team, fostering a culture of continuous learning.

Requirements:

A/ Azure Expertise:

Proven experience in designing and implementing data solutions using Azure Data Lake Storage and related Azure services.

B/ Technical Skills:

Proficient in data modeling, ETL processes, and programming languages (e.g., Python, C#) within the Azure ecosystem.

C/ Big Data Technologies:

Experience with Big Data technologies such as Apache Spark and Hadoop within the Azure environment.

D/ Problem Solving:

Strong analytical and problem-solving skills, with the ability to address complex data engineering challenges in the Azure Data Lake context.

E/ Communication Skills:

Excellent communication and collaboration skills, with the ability to convey technical concepts to non-technical stakeholders.

F/ Leadership:

Proven leadership experience in guiding and mentoring a team of data engineers in an Azure-centric environment.

Apply now

Other job offers that may interest you

Java full stack
ChennaiTechstar GroupYesterday
.. We use our time tested onsite/offsite/offshore Delivery Model to effect savings in development costs and time. In the short time since its inception, TechStar has built up an enviable list of clients. It has styled its relationship with large enterprise accounts through long-term contracts involving .. read more
Process executive for chennai
ChennaiInfosys BpmToday
.. listening skills Ability to quickly and efficiently assimilate process knowledge. Effective probing & analysing skills and capable of doing a multi-tasking of voice & data entry. Should be comfortable working from office. Being proactive and show the utmost respect for customer’s time. Good time management .. read more
Senior mean stack developer
MylaporeTrdfin Support Services Pvt LtdYesterday
.. ensure smooth user experiences. Utilize advanced Angular features to build interactive and dynamic user interfaces, integrating seamlessly with backend services. Conduct code reviews for junior developers, ensuring adherence to Angular best practices. Mentor junior developers, fostering their growth .. read more
Cobol programmer
ChennaiHexaware TechnologiesToday
.. Years Notice period: Immediate to 15 Days Job description: 1) Cobol400 (60%) 2)SQLRPGLE and SQL joins 3) RPGLE/RPG 4) DB2/400 DB2 related Mainframe 5) CLP/CLLE 6) Project delivery model - Initial questions before scheduling interview. 7) Waterfall or Scrum/Agile ,ask whether they are in Development projects .. read more
Java full stack developer
ChennaiTech MahindraYesterday
.. Location:- Hyderabad ll Chennai Employment Type:- Full Time Experience Required:- 3+ years Job Description Java, spring boot & microservices is mandatory with Reactjs Maximum 30 days joiners will be preferred. Interested candidates can share resume with AK**@techmahindra.com along with Current CTC .. read more
Business manager
ChennaiMinimalistToday
.. . Build and maintain strong relationships with key customers, including Healthcare providers, pharmacies, and distributors, to drive product adoption and .. to identify opportunities for product differentiation and market expansion. Build and maintain strong relationships with key customers, including healthcare .. read more
Functional consultant - dynamics f&o
ChennaiPreludesysToday
.. formulate requirement documents, design and implement D365FO. Eligibility Criteria: Minimum 5 years of experience with D365FO- Finance & Projects Module. Experience in presentation, documentation, stakeholder management, Business analysis. Have completed minimum of 2 end to end D365 FO implementations .. read more
Static equipment engineer
ChennaiWoodYesterday
.. Chemical and O&U projects Proficient at producing designs, Mechanical data sheet, requisitions, TBEs and document reviews for a wide range of static equipment. Review and approve vendor documents Coordinate with external / Internal clients Coordinate with vendors and interface with other Engineering .. read more
Machine learning/gen ai engineer
ChennaiHcltech2 days ago
.. using Python libraries like Pandas, Scikit-Learn, Numpy, NLTK, Spacy and Scipy is required Utilize software development tools such as Git, JIRA, and Jenkins. Support AI application deployments in cloud environments using Docker and Kubernetes, and cloud platforms like AWS, Azure, or GCP. Introductory .. read more
Etl testing - 10+ years - chennai
ChennaiTekgence Inc2 days ago
.. implement, and execute automated test scripts, ensuring the integrity and accuracy of our data-centric systems.(e. g. – ETL Talend, Hadoop, PySpark, Pl/ Sql etc.) Years of experience needed – years of experience working as a Test Engineer or similar role years of experience working with Test Automation .. read more
Genesys platform engineer
ChennaiKloudportal ™ Saas | Product MarketingYesterday
.. opportunities for innovation and differentiation. • Act as the primary point of contact for platform-related inquiries, escalations, and decision-making, both internally and externally. Foster a culture of collaboration, accountability, and excellence within the platform team, promoting knowledge sharing .. read more
Frontend developer
ChennaiGreatifyYesterday
.. product. Approaching a problem with the designer’s eye and user experience in mind and delivering nothing but wows. Implementing the requirements on time with extreme quality. Making it work first and eventually making it better. Continually learning the advancements in technology and being updated .. read more
Search engine optimization team lead
ChennaiLennox2 days ago
.. analyze and report using Google Analytics, Google Search Console and SEO industry tools Do extensive keyword research to align with our SEO strategy & business goals Keep current with Google algorithm updates Monitor project status and work closely with developers/BAs 10 - 12 years of experience in SEO .. read more
Software test lead - hil & agile methodologies (safe)
ChennaiZf Group2 days ago
.. automation engineer in safety critical systems , will be a good fit to the team. Technical Expertise: • Electrical/Electronics, Mechanical, Mechatronics Engineering, Physics or a related field required. 7+ years of professional hands-on experience with Matlab/Simulink, Simulink-RT Modelling, Labview .. read more
Sap abap programmer
ChennaiZakappsYesterday
.. Services, and builds products that solve business problems in the Retail, media, and advertising industry. ZakApps specializes and executes projects .. Availability: Should be able to join within 30 days Unique Features of the position: 1 to 2 Business Travel every year to the Client Location – UK / .. read more
Senior research engineer - embedded software
ChennaiSaint Gobain Research India2 days ago
.. customer project, customer platform and function development · Experience in model based development and auto coding tools (MATLAB/ SIMULINK) · Hands on working on preparation of System level test cases for functional testing. · Experience and Hands on working on the SW development process compliant .. read more
Senior accountant
ChennaiLakshmi By VaniYesterday
.. with all relevant tax laws and regulations. Provide guidance and support to junior accounting staff, fostering their professional development and growth. Stay informed about changes in accounting standards and regulations, and ensure the company's accounting practices remain up-to-date and compliant .. read more
Financial planning analyst
ChennaiEvidenYesterday
.. the same time. At month end, you will be responsible for budget, projection, and actual variance commentary. Desired Candidate Profile: Location-Chennai-Siruseri Master Degree in Finance/CA/CMA 5-10 years' of relevant experience Willingness to work in UK/US Shift Flexi to work from Office Immediate Joiner/Lesser .. read more
Senior embedded software engineer
ChennaiMeril Healthcare Private LimitedYesterday
.. open source software Automated unit and regression testing Location: Meril Healthcare Pvt. Ltd, IIT research park, Chennai. Shift: General shift, Monday to .. RTC (chip) peripherals and communication protocols. experience on motor Driver development, Joysticks, HMI interface. experience on NFC, RFID, WIFI, .. read more
Senior software engineer
ChennaiLtimindtreeToday
.. observable. Experience in working with Scrum and being a strong Scrum Practitioner. Nice To have- an understanding of Redux. Experience on Spring Boot is an added advantage. Strong Debugging and Troubleshooting Expertise (for performance analysis/troubleshoot/code debugging). Experience in HTML, CSS .. read more
Sap project manager
ChennaiLtimindtreeToday
.. requirements. Will perform a variety of tasks including coordinating all resources and stakeholders, planning and setting milestones, assigning responsibilities and monitoring, summarizing and communicating the progress of the project. - The person should have strong inter-personal skills to manage conflicts .. read more
Graphic design specialist (1-2 years experience)
ChennaiExperienzingToday
.. specialize in helping businesses create and maintain a strong connection between their brand and their audience. Through our expertise in content strategy, digital awareness, and communication, we help our clients reach their customers and create meaningful brand experiences. Our services include extensive .. read more
Senior core asp.net fs developer - chennai
ChennaiHtc Global ServicesToday
.. and efficiency. with unit testing and familiarity with RDBMS and NoSQL databases. in RESTful interfaces and Microservice concepts. analytical and problem-solving skills. with software architectures, algorithms, and engineering principles. with software development methodologies, such as Agile or Scrum .. read more
Accountant - dubai (united arab emirates)
ChennaiTop Tree Human Resources Consultancy LlcYesterday
.. ad-hoc reports for various business needs Prepare tax documents Compile and analyze financial statements Manage budgeting and forecasting Qualifications Bachelor's degree in Accounting or related field Ability to interpret and analyze financial statements and periodicals Fluency in Microsoft Office suite .. read more
Background verification executive(bgv)
ChennaiLtimindtree2 days ago
.. candidature. Background verification is the process of looking up and compiling employment screening, education screening, criminal and court record checks, address checks, reference checks and many more of an individual. The role of an ANALYST is to ensure that the appropriate background check(s) are .. read more
Software engineer (c++ developer)
ChennaiGenYesterday
.. and celebrated for who they are in a meaningful and exciting atmosphere. Gen is an equal employment opportunity employer. Employment decisions are based on merit, experience, and business needs. If this sounds like you—Gen has a dynamic, supportive culture with core values that celebrate diversity .. read more
Workday-finance functional consultant
ChennaiHexaware TechnologiesYesterday
.. Support and Enhancement Able to understand the inbound and outbound Integration process. Ability to understand and identify business needs and translate it to a technical solution. Ability to analyze and resolve user concerns and educate users on resolutions. Excellent communication and interpersonal .. read more
Tele-caller (0-3 years)
ChennaiGreat Indian SweetsYesterday
.. and the expertise of our local chefs, we provide unmatched taste and panache, packaged specially for your family celebrations. All our sweets are made with premium quality raw materials, following traditional processes and original recipes, making them the best gifting option for your loved ones. Role .. read more
Wtx developer
ChennaiLive ConnectionsToday
.. - Creating WTX Systems, Maps, Typetrees and MDQ - Unix Shell scripting - Oracle PL/SQL development Specific Qualifications (if required) - Knowledge and experience in the financial services domain - Good understanding of software development life cycle and Agile/iterative methodology - Prior experience .. read more