Senior Data Engineer

  • Gurugram
  • Jobbyy Business Solutions

Position : Sr. Data Engineer

Location : Gurugram

Organisation : A Global leader in consulting.


We are looking for a senior AWS Azure data engineer to join our data team and help us design, build, and maintain scalable and reliable data pipelines and solutions. He will work with various data sources and platforms, such as SQL, NoSQL, Kafka, Spark, Hadoop, and AWS and Azure cloud services. He will also collaborate with data analysts, data scientists, and business stakeholders to ensure data quality, security, and accessibility.


Responsibilities

  • Design, develop, and test data pipelines and solutions using AWS and Azure cloud services, such as S3, Lambda, Glue, Kinesis, Redshift, Databricks, Synapse, Data Factory, etc.
  • Optimize data pipelines and solutions for performance, scalability, reliability, and cost-efficiency.
  • Implement data quality checks, data governance, and data security best practices.
  • Monitor, troubleshoot, and debug data issues and incidents.
  • Document data architectures, data models, data dictionaries, and data flows.
  • Research and evaluate new data technologies and trends.
  • Mentor and coach junior data engineers.


Qualifications

  • Bachelor's degree in computer science, engineering, or related field.
  • At least 6 to 9 years of experience as a data engineer or similar role.
  • Proficient in SQL and Python/Scala/Java.
  • Hands-on experience with AWS and Azure cloud services for data engineering.
  • Hands-on experience with data processing frameworks and tools, such as Kafka, Spark, Hadoop, etc.
  • Knowledge of data warehousing, data lake, and data modeling concepts and techniques.
  • Knowledge of data quality, data governance, and data security standards and practices.
  • Excellent communication, collaboration, and problem-solving skills.
  • Certification in AWS or Azure data engineering is a plus.


Preferred: Knowledge of pharma industry, experience with cloud computing services (AWS, Azure)