AWS Data Engineer - Manager

  • Hyderabad
  • Pwc
Description & SummaryA career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge. As part of our Data Engineering team, you will create data pipelines and data structures utilizing modern data technology, engineering process, and languages. You will be responsible for helping organizations migrate and modernize data platforms in support of enterprise analytics, intelligent applications, and machine learning initiatives.At PwC - AC, as an AWS Manger, the candidate will interact with Offshore Manager/ Onsite Business Analyst to understand the requirements and the candidate is responsible for end-to-end implementation of Cloud data engineering solutions like Enterprise Data lake, Data hub in AWS. The candidate should have strong experience in AWS cloud technology. Strong in planning and organization skills. Ability to work as cloud developer/lead on an agile team and provide automated cloud solutions.Years of Experience: Candidates with 8-12 years of hands on experiencePosition Requirements: Must Have:Experience in architecting and delivering highly scalable, distributed, cloud-based enterprise data solutionsStrong expertise in end-to-end implementation of Cloud data engineering solutions like Enterprise Data lake, Data hub in AWSProficient in Lambda or Kappa ArchitecturesShould be aware of Data Management concepts and Data ModellingStrong AWS hands-on expertise with a programming background preferably Python/ScalaGood knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatoryStrong experience in AWS compute services like AWS EMR, Glue and storage services like S3, Redshift & DynamodbGood experience with any one of the AWS Streaming Services like AWS Kinesis, AWS SQS and AWS MSKTroubleshooting and Performance tuning experience in Spark framework - Spark core, Sql and Spark StreamingGood knowledge of Application DevOps tools (Git, CI/CD Frameworks) - Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code CommitExperience with AWS CloudWatch, AWS Cloud Trail, AWS Account Config, AWS Config RulesGood knowledge in AWS Security and AWS Key managementStrong understanding of Cloud data migration processes, methods and project lifecycleGood analytical & problem-solving skillsGood communication and presentation skillsDesired Knowledge / Skills:Experience in building stream-processing systems, using solutions such as Storm or Spark-Streaming Experience in Big Data ML toolkits, such as Mahout, SparkML, or H2OKnowledge in PythonWorked in Offshore / Onsite EngagementsExperience in one of the flow tools like Airflow, Nifi or LuigiExperience in AWS services like STEP & LambdaKnowledge in Azure Cloud ServicesExperience in Azure Cloud ServiceProfessional and Educational Background:BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBACertification:Amazon Web Services (AWS) certifications (AWS certified Data Engineer is recommended). Additional Information:Travel Requirements: Travel to client locations may be required as per project requirements.Line of Service: AdvisoryHorizontal: Technology ConsultingDesignation: ManagerLocation: Bangalore, IndiaAt PwC - AC, as an AWS Manger, the candidate will interact with Offshore Manager/ Onsite Business Analyst to understand the requirements and the candidate is responsible for end-to-end implementation of Cloud data engineering solutions like Enterprise Data lake, Data hub in AWS. The candidate should have strong experience in AWS cloud technology. Strong in planning and organization skills. Ability to work as cloud developer/lead on an agile team and provide automated cloud solutions.Years of Experience: Candidates with 8-12 years of hands on experiencePosition Requirements: Must Have:Experience in architecting and delivering highly scalable, distributed, cloud-based enterprise data solutionsStrong expertise in end-to-end implementation of Cloud data engineering solutions like Enterprise Data lake, Data hub in AWSProficient in Lambda or Kappa ArchitecturesShould be aware of Data Management concepts and Data ModellingStrong AWS hands-on expertise with a programming background preferably Python/ScalaGood knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatoryStrong experience in AWS compute services like AWS EMR, Glue and storage services like S3, Redshift & DynamodbGood experience with any one of the AWS Streaming Services like AWS Kinesis, AWS SQS and AWS MSKTroubleshooting and Performance tuning experience in Spark framework - Spark core, Sql and Spark StreamingGood knowledge of Application DevOps tools (Git, CI/CD Frameworks) - Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code CommitExperience with AWS CloudWatch, AWS Cloud Trail, AWS Account Config, AWS Config RulesGood knowledge in AWS Security and AWS Key managementStrong understanding of Cloud data migration processes, methods and project lifecycleGood analytical & problem-solving skillsGood communication and presentation skillsDesired Knowledge / Skills:Experience in building stream-processing systems, using solutions such as Storm or Spark-Streaming Experience in Big Data ML toolkits, such as Mahout, SparkML, or H2OKnowledge in PythonWorked in Offshore / Onsite EngagementsExperience in one of the flow tools like Airflow, Nifi or LuigiExperience in AWS services like STEP & LambdaKnowledge in Azure Cloud ServicesExperience in Azure Cloud ServiceProfessional and Educational Background:BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBACertification:Amazon Web Services (AWS) certifications (AWS certified Data Engineer is recommended). Additional Information:Travel Requirements: Travel to client locations may be required as per project requirements.Line of Service: AdvisoryHorizontal: Technology ConsultingDesignation: ManagerLocation: Bangalore, IndiaEducation Degrees/Field of Study required:Degrees/Field of Study preferred:Certifications Required SkillsOptional SkillsDesired Languages Travel RequirementsNot SpecifiedAvailable for Work Visa Sponsorship? NoGovernment Clearance Required? NoJob Posting End Date