.. and interfaces. Work responsibilities: Collaborate closely with clients to comprehend and define end-user requirements for commodities trading, risk management, and operational processes. Develop comprehensive solution designs based on client needs and industry best practices. Lead and manage the implementation .. read more
The experience range we are looking for is 6 to 9 years of experience . Please apply according to the experience criteria . We are looking for shorter notice periods on priority .
Immediate to 15 days notice is much appreciated and prioritised.
Data Engineer :
Responsibilities:
• Design and implement robust, scalable data models and data storage solutions on AWS .
• Develop and maintain ETL (Extract, Transform, Load) processes and data pipelines that are highly optimized for performance and reliability, using Python and SQL.
• Ensure data quality and integrity by implementing data security, privacy, and compliance policies in line with industry standards.
• Optimize data retrieval, if necessary develop dashboards, reports, and visualizations for business stakeholders.
• Stay abreast of industry trends and advancements in data engineering technologies, applying best practices to continuous improvement of data services.
• Provide mentorship and guidance to junior data engineers and team members.
Required Skills and Qualifications:
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Over 6 years of experience as a Data Engineer or in a similar role, with a proven track record of deploying large-scale data processing and analytics solutions.
• Strong expertise in AWS cloud services related to data engineering (e.g., S3, Redshift, RDS, EMR, Glue, Athena).
• Proficient in Python programming for data processing and automation.
• Deep understanding of SQL and experience with relational databases, query authoring, as well as working familiarity with a variety of databases.
• Experience building and optimizing data pipelines, architectures, and data sets.
• Familiarity with data pipeline and workflow management tools.
• Strong analytical skills with the ability to identify, analyze, and interpret trends or patterns in complex data sets.
• Excellent communication and collaboration skills to effectively work with cross-functional teams.