Data Engineer

The Data Engineer’s role is to work with the stake holders and project teams to ensure data needs/requirements are captured and fulfilled. This role would require a service-oriented mentality, high sense of ownership of the problems and requests assigned, focus on managing and resolving issues and establishing and maintaining communications with stake holders to keep them updated.

Essential Functions

• and architects large, complex sets of data that meet business and technical requirements
• designs and implements well-architected, data-centric solutions including:
• infrastructure for greater scalability
• data delivery
• manual processes
• and maintains strategies on data consolidation.
• data models and defines the structure, attributes and nomenclature of data elements.
• a strong grasp of ETL process and development
• Architects and builds Data ODS, Warehouse, and standard systems
• required infrastructure for optimal extraction, transformation and loading of data from various data sources.
• analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics.
• with stakeholders including data, design, product and executive teams and assists them with maximizing the impact of their data.
• requests and needs on data analysis and report management.
• with application development, product owners, and business stake holders to achieve business results.
• in development and creation of Data warehouses
• Performance Tuning and Query Optimization, using Performance Monitor, SQL Profiler and other related monitoring and troubleshooting tools.
• a strong knowledge of how indexes, index management, integrity checks, configuration, patching
• and troubleshoots SQL Code (stored procs, functions, tables, views, triggers, indexes, constraints)
• new data sources for adherence to the organization's quality standards and ease of integration
• database performance by identifying and resolving production and application development problems; calculating optimum values for parameters; evaluating, integrating, and installing new releases; completing maintenance; answering user questions.
• database support by coding utilities, responding to user questions, and resolving problems.
• job knowledge by participating in educational opportunities; reading professional publications; maintaining personal networks; participating in professional organizations.
• information systems and organization mission by completing related results as needed.
• functions to provide custom functionality as per the requirements.
• best practices around database reporting and Business Intelligence tools

Additional Specific Duties and Responsibilities

• monitors, and communicates technical risk factors, issues, status, and results to IT management.
• in design walk-throughs and database script/code reviews

Required Qualifications

• with database design and architecture – both SQL and NoSQL experience in the Cloud (AWS or Azure in particular)
• with data warehousing – leverage big data in a meaningful manner, Snowflake experience a plus.
• with data transformation and ingestion – unifying large datasets into usable/accessible destinations (AWS Glue, Azure Data Factory)
• of data processing/buffering – proven experience dealing with high volumes of business-critical data.
• of operational automation tooling – data deployment automation tools
• of high availability architecting – focus on redundancy, fail-over, and resilience.
• understanding of estimation techniques
• in Business MIS, or Computer Science (or equivalent work experience)
• years’ experience in database administration of development
• years’ experience in technology or finance fields
• in SQL or other database technology
• understanding of database structures, theories, principles, and practices
• database tuning and troubleshooting experience.
• with data processing flowcharting techniques
• understanding of the organization’s goals and objectives
• of applicable data privacy practices and laws
• written and oral communication skills
• technical documentation skills
• interpersonal skills
• to conduct research into database issues, standards and products as required
• to present ideas in user-friendly language
• self-motivated and directed.
• attention to detail.
• analytical and problem-solving abilities
• to effectively prioritize and execute tasks in a high-pressure environment.
• customer service orientation
• working in a team-oriented, collaborative environment