Software Engineer

  • Hyderabad
  • Cgi

AWS, Python, Spark, Data Bricks Developer with 3 to 5 years of experience:

Must-Have:

* Advanced proficiency in Python for data processing and analytics.

* In-depth experience with Apache Spark and Databricks for big data processing.

* Extensive knowledge of AWS services (Glue, Lambda, SQS, DynamoDB) for building and orchestrating data pipelines.

* Expertise in Kafka for real-time data processing and streaming.

* Strong experience with Kubernetes, including EKS, for container orchestration and deployment.

* Solid understanding of RESTful API development and best practices.

* Proficiency in SQL for complex query development and database management.

* Experience in designing, implementing, and maintaining ETL processes in AWS environment.

* Strong architectural knowledge of cloud-native solutions and microservices architectures.

* Familiarity with additional AWS services (e.g., S3, EC2, IAM) and best practices for cloud security.

* Understanding of Agile methodologies and experience working in Agile teams.


Nice-Have:

* Experience with CI/CD pipelines and infrastructure as code (Terraform, CloudFormation).