Idexcel - Data Engineer - Spark/Kafka

  • Mangalore
  • Idexcel
Job Description : Role : DATA Engineer BASIC QUALIFICATIONS : - Bachelor's degree, or equivalent experience, in Computer Science, Engineering, Mathematics or a related field - 5 years' experience of Data platform implementation, including 3 years of hands-on experience in implementation and performance tuning Spark/Kinesis/Kafka implementations. - The ideal candidate will have extensive experience with design, development and operations that leverages deep knowledge in the use of services like Amazon Kinesis, Apache Kafka, Apache Spark, Amazon EMR, NoSQL technologies and other 3rd parties. - 5 years of IT platform implementation experience. - Experience developing software code in one or more programming languages (Java, JavaScript, Python, etc.) - Current hands-on implementation experience required. PREFERRED QUALIFICATIONS : - Masters or PhD in Computer Science, Physics, Engineering or Math. - Hands on experience working on large-scale data science/data analytics projects. - Ability to lead effectively across organizations. - Hands-on experience with Data Analytics technologies such as AWS, Spark, Spark SQL, Python - Implementing AWS services in a variety of distributed computing, enterprise environments. - Proficiency with at least one the languages such as Python/Node.JS or Java. - Experience defining system architectures and exploring technical feasibility trade-offs. - 3 years experiences developing cloud software services and an understanding of design for scalability, performance and reliability. - Experience working on a code base with many contributors. - Ability to prototype and evaluate applications and interaction methodologies. - Experience with AWS technology stack. (