.. with cloud-based data warehousing solutions Google Big Query. • Implement data governance policies and procedures to ensure data quality and consistency. • Design and develop data models that support data-driven applications and services. • Troubleshoot and resolve issues related to the data pipeline .. read more
Are you looking for value-adding and impactful work?
Do you want to make a difference with your expertise?
With us, you’ll be able to make it happen.
NCS is a leading technology services firm, operating across Asia Pacific in over 20 countries, providing services and solutions in consulting, digital services, technology, and more.
We believe in utilizing the power of technology to make extraordinary things happen and to create lasting impact and value for our people, communities, and partners. Our diverse 12,000-strong workforce has delivered a wealth of large-scale, mission-critical, and multi-platform projects for governments and enterprises in Singapore and the APAC region.
What we do
We drive our passion for harnessing technology.
We bring people and technology together.
We advance communities and transform industries.
We’re searching for an Integration Sr. Data Engineer to be part of our diverse team of talent here at NCS!
If you believe in going above and beyond, want to exemplify the best, and wish to bring people and technology together like never before, then we would love to talk with you!
Key Responsibilities and Result :
- Enhance, optimize, and maintain existing data ingestion, transformation, and extraction pipelines and assets built for reporting and analytics on Cloud(Azure + Databricks) and Big Data(Cloudera ) platforms.
- Work with the Product Owner to understand the priorities and OKRs for the quarter and gather detailed requirements from the initiative owners or program sponsor as per the Epics planned to be delivered in the quarter.
- Build new and optimized data pipelines, and assets to meet the end-user requirements. The Data pipelines must adhere to all the architecture, design, and engineering principles.
- Design the data pipelines and assets to meet non-functional requirements (Security, reliability, performance, maintainability, scalability, and usability). Most importantly, they should be designed to be to keep the computing cost low on the Cloud.
- Data wrangling, Data profiling, and data analysis for new datasets ingested from source systems and derived/built from existing datasets with the on-premises and cloud-native tools
- Functionally understand the Data assets working with various SMEs and apply the transformation rules required to build the target data asset.
- Coordinate with other teams for planning, design, governance, engineering and release management of processes and ensure timely and accurate delivery of data and services.
Job Requirements:
- degree in maths, statistics, computer science, information management, finance or economics
- years’ experience working in Data Engineering
- + years of experience leading a team of 2-3 Data Engineers
- in building fully automated end-to-end data pipelines using on-premises or cloud-based data platforms.
- experience – Azure-based analytics/reporting pipeline
- Hands-on experience with scheduling tools like Airflow, Control M, etc.
- Hands-on delivery of solutions for Reporting and Analytics use cases.
- Hands-On with advanced SQL on Data Warehouse, Big Data and Data Bricks
- Experience in data profiling, source-target mappings, ETL development, SQL optimization, testing, and implementation.
- Experience working on Cloud DWs
- Knowledgeable in Big Data tools like Spark (python/Scala), Hive, Impala, Hue, and storage (e.g., HDFS, HBase)
- Knowledge of working with Azure Databricks.
- Knowledge of working with Azure Databricks.
- Knowledgeable in CICD processes – Bitbucket/GitHub, Jenkins, Nexus etc.
- Knowledgeable in managing structured and unstructured data types like JSON, xml, Avro
- Track record of implementing databases and data access middleware and high-volume batch and (near) real-time processing
About NCS Group:
We want to create the extraordinary and to impact millions of people every day.
We believe in building a talent-led delivery model to enable our best people to lead, and to support them with the right structure, processes, and tools to ensure that our clients are delivered top-quality services.
We want to invest in you!
Great work is never done alone, and that’s why we also believe in creating a collaborative work environment to bring people with different expertise and talent together.
We create opportunities for our people to grow in our organization with well-defined career tracks and specializations to ensure that our people and talent can continuously deliver new value for our clients.
We’re here to make the extraordinary happen.
Learn more at ncs.co and our LinkedIn Career site.
- All profiles are handled with the highest level of confidentiality.