Data Engineer

Want to be a part of our team? The Data Engineer is responsible for the transformation of data into a structured format that can be easily analysed in a query or report. The role is responsible for developing structured data sets that can be reused or compliment other data sets and reports. The individual analyses the data sources and data structure and will design and develop data models to support the analytics requirements of the business which includes management / operational / predictive / data science capabilities.Working at NTTThe Data Engineer is tasked with transforming data into a format that can be easily analysed, by developing, maintaining and testing infrastructures for data generation. Additionally the Data Engineer will design and implement data pipelines and accompanying architecutres to apply models and transformations built by the data scientist.Key roles and responsibilities:Provide detailed advice regarding data applications and executing specialised tasksCreate Databricks optimised for performance and to structure data to enable analysis thereofProvide support and assistance on data initiatives and ensure optimal data delivery architecture in support of client projectBuild the infrastructure for optimal extraction and transformation of data from a wide variety of data sourcesDesign and develop scalable ETL packages from the business source systemsDevelop the ETL routines in order to populate data from sourcesBuild test scenarios to enable testing and validation to support accuracy of data transformationEnable and run data migrations across different databases and different serversDefine and implement data stores based on system and consumer requirementsAssess, analyse, develop, document and implement changes based on requests for changeAssess and analyse release componentsModelling tests in coordination with testers maintaining and administering the tools and methodsEnsuring information exchange with configuration managementEnsure release processes and procedures are maintainedInvestigates operational needs and problems, and opportunities, contributing to the recommendation of improvements in automated and non-automated components of new or changed processes and organisationDefines and manages scoping, requirements definition and prioritisation activities for changesInvestigates, manages and applies authorised requests for changes to base-lined requirements, in line with the change management policyInterprets installation standards to meet project needs and produces database components as requiredEvaluate potential solutions, demonstrating, installing and commissioning selected productsApply ethical and robust techniques in the transformation of data from one format to another, in line with organisational policies and proceduresCollaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the companyImplement processes and systems to monitor data quality, ensuring production data is accuratePerforms data analysis required to troubleshoot data related issues and assist in the resolution of data issuesTest the reliability and performance of each part of new and/or existing systemsDeploying machine learning models into the production environmentKnowledge, skills and attributesMaintains knowledge of specific specialisms related to Data EngineeringDemonstrate the ability to plan and organiseAnalytical mind and business acumenProgramming in Python with demonstrable understanding of software developmentProblem-solving aptitudeWorking knowledge or Power BI to create reports, dashboards and measuresKnowledge of augmented analytics, data visulation, data virtualisation and data governance solutions and implementationsExcellent problem solving and troubleshooting skillsHighly process orientated with great documentation skillsStrong working and conceptual knowledge of building and maintaining physical and logical data modelsStrong analytical skills related to working with unstructured datasetsAbility to manipulate, process and extract value from large, disconnected datasetsStrong project management and organisational skillsAbility to work under pressure and meet deadlinesSolid understanding of database design principlesExcellent oral and written communication skills with a keen sense of customer serviceAbility to manage and communicate data warehouse plans to internal clientsWorking understanding of major cloud platform provider (at least one of Azure, AWS, Google etc)Academic qualifications and certifications:Relevant qualification (Bachelor’s in computer science, information technology or applied math or statistics) Relevant certification/s, e.g. Certified Data engineer, Certified Professional, etc)Experience required:Proven experience working with data engineering, data mining within a fast-paced environmentExperience in building modern data analytics solutions tha delivers insight from complex data setsSolid Programming experience in PythonGood experience working with SQL, MySQL databases and Microsoft SQLExperience working in internet technologies, e.g. Saas, Iaas and PaasExperience with big data tools like Hadoop, Cassandra, Storm, EtcExperience with writing scripts using scripting language (Perl, bash, Shell, Scripting, Python, etc.)Experience in automation, scripting and proven examples of successful implementationExperience with architecture and design of secure, high available and scalable systemsExperience building modern data analytics solutions that delivers insights from large and complex data setsExperience with architecture and design of secure, highly available and scalable systemsExperience working in internet technologies#dimensiondatacareersSkills SummaryBig Data Solutions, Business Analysis, Data Analysis, Data Analytics, DATABASICS, Data Lake, Data Modeling, Data Structures, Unstructured DataWhat will make you a good fit for the role? Workplace type: Equal Opportunity EmployerNTT is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, color, sex, religion, national origin, disability, pregnancy, marital status, sexual orientation, gender reassignment, veteran status, or other protected category