Data Engineer (Spark, GCP/AWS, SQL))

  • Pune
  • Atyeti Inc

Atyeti is a Global Managed Service provider, winner of the Inc 500 Award for fastest growing IT companies, with offices in US, UK, Switzerland, Singapore, Hong Kong, Malaysia, and India. We own and execute end to end projects in the Investment Banking world with clients such as Credit Suisse, Goldman Sachs, Bank Of America, CIMB, HSBC to name a few, for more info visit www.atyeti.com


We are currently looking for a Data Engineers to join us


Location - Pune or Hyderabad (Hybrid)


Required Skills:

Python, Spark, Airflow, Databricks, GCP, AWS, Snowflake, Map Reduce, Cascading, Spark, HBase, Oozie, Hive, File formats(Avro, ORC), and Debugging & Performance tuning of big data/Spark application.


The resource will architect and design platforms to run at scale in the cloud leveraging the below technologies or other related ones.


Skills –

  • Bachelor’s degree in computer science, information systems, or other related field or equivalent work experience.
  • 5+ years of high-tech industry and/or IT work experience in Big Data project hands on development and solution engineering roles.
  • Experience with Big Query, Big Data, and Spark, HBase, Hive.
  • Hands on experience in Snowflakes, Databricks.
  • Exposure to cloud (AWS, GCP).
  • Have worked on debugging & performance tuning of data/spark application.
  • Experience in architect and design platforms to run at scale in the cloud leveraging.
  • Experience working with large datasets and manipulating schemas.
  • Experience with working on projects in multiple technological and business environments simultaneously.
  • Able to work independently with minimal supervision.
  • Excellent communication skills – written, verbal, presentation and interpersonal.
  • Willing to learn new skills and implement new technologies.
  • Must demonstrate excellent troubleshooting and problem assessment/solving skills.
  • Well organized, disciplined and able to manage time and priorities effectively.
  • Excellent communication skills. Shows judgement when communicating with different seniority levels, different cultural backgrounds, and different stakeholders.
  • Organized and a logical problem solver. Uses data to make decisions. Provide thought leadership and logical best practices