IT Architect Manager Senior (Data Engineering Chapter Lead)

  • Pune
  • Fis
Position Type : Full time Type Of Hire : Experienced (relevant combo of work and education) Education Desired : Bachelor of Engineering Travel Percentage : 0%About the team:      We are a part of WorldPay, who invented payment facilitation, enabling technology companies to provide integrated payment solutions, significantly expanding access to modern payment methods to SMBs, and rejuvenating end-user experience.     We are Payrix – a modern platform that provides Payfac as a service with a full suite of payments and risk management services built for vertical SaaS companies. With Payrix, SaaS providers can embed payments and financial services in their native experience and add a new revenue stream in a few weeks. We have a strong product-market fit and a clear moat that has resulted in an exponential growth of 100% YoY and the trend will continue.About the role:This role will be responsible for leading the design and architecture of our data platform to serve the financial reporting and reconciliation, forecasting, and data delivery needs of our internal as well as external customers. The person will work on transforming our current data architecture into highly scalable/resilient architecture while supporting high product velocity and customer asks. This role will review and oversee data engineering across multiple teams and will be responsible for encouraging standards and improving best practices related to data pipelines.  The platform is complex with multiple functionalities and presents a great opportunity to learn about embedded payments and payfac-as-a-service capabilities.ResponsibilitiesTechnical LeadershipProvide expertise and guidance in big data technologies.Extend and optimize our data lake: improve query performance and integrate more data sources.Build ETL pipelines for our various data-driven services for our clients.Build ETL pipelines and data materializations for internal data-driven reporting for historical analysis, risk assessment, projections, financial forecasting, etc.Participate in the development and communication of data strategy and roadmaps across the technology organization to support product portfolio and business strategy.Define high-level migration plans to address the gaps between the current and future state.Lead the analysis of the technology environment to detect critical deficiencies and recommend improvement solutions.Promote the reuse of data assets, including the management of the data catalog for reference.Ensure that our data lake architecture and data catalog/dictionary are fully documented.Help build user guides for writing efficient queries to utilize the data lake maximally.Day-to-day governance for giving access to different parts of the data lake to different users after assessing their needs in coordination with infosec.Ensure that all ETL code and configuration are properly maintained in the version control.Drive digital innovation by leveraging innovative new technologies and approaches to renovate, extend, and transform the existing core data assets, including SQL-based, NoSQL-based, and Cloud-based data platforms.Identify and improve parts of the platform to make it more robust and scalable.Advise Payrix’s leadership on key technology and product roadmap considerations.Align our technical decisions with Payrix’s broad strategic initiatives, while also advocating for needs specific to emerging new businesses.Team LeadershipDotted line responsibility for a distributed data engineering team (both full-time and contractors) while remaining hands-on.Collaborate with and support the business intelligence team.Collaborate with and support the data science team.Mentor data engineers and software engineers in data principles, patterns, processes, and practices.Project ManagementPrioritize projects based on customer and internal needs in consultation with product management, engineering, operations, and finance departments.Support teams as they deliver.Support the needs of business intelligence, financial reporting, and data science teams.Data InfrastructureBuild, implement and support data infrastructure extending the existing one.Maintain different data materializations to speed up reporting needs.Ensure reliable operations of various CDC and ETL pipelines.Define, track, and guarantee Service Level Objectives.Manage large and complex data sets that meet functional and non-functional business requirements.Watch over Data Lake's operating expenses and strive to reduce them.Design and oversee implementation of operational infrastructure related to the data pipelinesDesired Skills and ExperienceTechnical SkillsProgramming Languages: Python, Java, Scala, C#, SQLStorage: HDFS, AWS S3Data Platforms: DataBricks, SnowFlake, RedShiftData Lakes: Apache Hudi, Delta LakeRelational Databases: Postgres, MySQLNoSQL Databases: DynamoDB, MongoDBDistributed Data Processing Engines: Apache Spark, Apache Flink, AWS EMRQuery Engines: Apache Presto, AWS AthenaChange Data Capture Solutions: Debezium, Qlik, FivtranBusiness Intelligence: QuickSight, Tableau, DBT, Power BIStreaming: Kafka, RabbitMQ, ActiveMQData Governance: AWS LakeFormationData Science and ML: NumPy, SciPy, Pandas, TensorFlow, PyTorch, SageMakerStorage Formats: Arrow, Parquet, AVROServerless Computing: AWS Lambda, Step FunctionsOther AWS Services: IAM, RAM, EC2Data Modeling & Architecture Patterns: Dimensional Modeling, Star Schema, Data Vault, Lake House ArchitectureSoft SkillsCommunication: Effectively communicate with both technical and non-technical stakeholders. Clear explanations and cross-department collaborationCollaboration: Working closely with the mission-oriented product development teams where individual data engineers may be embedded.Problem-solving: Having an eye for detail and the ability to solve complex problems efficiently.Adaptability: Being adaptable to learn and integrate new tools and technologies as the tech landscape keeps evolving.Critical Thinking: Analyzing situations, making informed decisions, and anticipating challenges.Risk Management: Understanding risk factors related to data quality, security, and compliance.Negotiation: Ability to advocate for data engineering needs and influence decision-makingManagement Skills:Leadership: Guiding and motivating the team, setting goals, and ensuring alignment with organizational objectives.Project Management: Managing projects, timelines, and resources effectively.Strategic Thinking: Aligning data engineering efforts with broader business strategies.Cost Management: Managing data engineering infrastructure costs efficiently.Change Leadership: Guiding teams through organizational changes and technological shifts.Experience:BS degree in engineering – computer science or related field15+ years of successful and applicable hands-on experience in data engineering including end-to-end design and implementation.5+ years of proven track record of managing or leading data engineering teams in designing and implementing efficient data models for large-scale datasets.5+ years of hands-on experience with AWS cloud platformGood understanding of network and data security architectureGood experience in data lake architecture, governance, and implementationAdded bonus if you have:Fintech or payments/banking product development experienceExperience in working in a start-up environment.What we offer you:A career at Payrix/WORLDPAY is more than just a job. It’s the change that shapes the future of fintech. At Payrix, we offer you:A voice in the future of fintechAlways-on learning and developmentCollaborative work environmentOpportunities to give backCompetitive salary and benefitsPrivacy StatementFIS is committed to protecting the privacy and security of all personal information that we process in order to provide services to our clients. For specific information on how FIS protects personal information online, please see the .Sourcing ModelRecruitment at FIS works primarily on a direct sourcing model; a relatively small portion of our hiring is through recruitment agencies. FIS does not accept resumes from recruitment agencies which are not on the preferred supplier list and is not responsible for any related fees for resumes submitted to job postings, our employees, or any other part of our company.#pridepass