Data Infrastructure Engineer (R**)

  • Bengaluru
  • Fox Corporation
OVERVIEW OF THE COMPANYFox CorporationUnder the FOX banner, we produce and distribute content through some of the world’s leading and most valued brands, including: FOX News Media, FOX Sports, FOX Entertainment, FOX Television Stations and Tubi Media Group. We empower a diverse range of creators to imagine and develop culturally significant content, while building an organization that thrives on creative ideas, operational expertise and strategic thinking.JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated solutions that help bring data to life. You have experience building and maintaining ETLs, data pipelines, and data models. Beyond your strong technical skills, you are a collaborator who is a passionate advocate for empowering and enlightening others with the power of data to help turn information into knowledge and actionable insights.A SNAPSHOT OF YOUR RESPONSIBILITIESDrive and participate in the definition, the direction, and the development of the FOX Data platformWork with internal stakeholders, data engineers and data science team to scope the requirements, evaluate business needs and objectivesDesign and develop highly scalable, reliable, extensive, and maintainable Data Processing FrameworksEstablish and implement best engineering practices such as architectural design, unit and regression testing, test-driven development, pair programming, and continuous integration frameworksAssist with process improvement with a customer focused, progressive mindsetUnderstand data classification and adhere to the information protection and privacy restrictions on dataProficient in containerization technologies, including Docker, and container orchestration with KubernetesExperience with Terraform, CloudFormation and CDKExperience with Building CICD Frameworks using Jenkins, GitHubActions for Automated DeploymentsMaintain Git lab Repositories, Handling Releases and Branching activitiesWHAT YOU WILL NEED5+ years as a professional Database Infrastructure engineer with experience in production scale platformsStrong experience with distributed data architectures and big data processing technologies (Spark, EMR, Hadoop, Hive)Strong experience with Configuration Management, Continues integration and DevOpsExpert knowledge of AWS Analysis services like Redshift, Glue, Athena, Lake FormationStrong knowledge on Python or similar scripting languageStrong experience with Realtime Frameworks, collection, and processing Realtime data using kinesis Data Streams, KCL, KDA and FirehosesStrong understanding of AWS security services including KMS, CloudTrail, STSStrong understanding of Kinesis/Glue frameworks and Spark Streaming for building Realtime analyticsExpert in CICD framework, Preferably GitHubActions, Jenkins and GitHub for version controllingExpert knowledge on Blue/Green Deployment for Lambda and Microservices Expert Knowledge on Elastic Containers and Elastic Container ServicesDiscerning appreciation of best practices in designing data lakes/lake houses, mentoring junior members, peer review and recommendationProven ability to deliver high quality, production ready codeExpert understanding of the agile software development life cycleStrong customer service and communication skills (verbal and written) to effectively interact with a diverse team of people across business and engineeringBachelor’s degree in computer scienceNICE TO HAVE, BUT NOT A DEALBREAKERExperience with Snowflake and Delta Lake technologies is a plus#Ll-SS1#Ll-HybridLearn more about Fox Tech at #foxtech