Staff Big data Devops Engineer

  • Hyderabad
  • Servicenow
Job Description   The Big Data team plays a critical and strategic role in ensuring that ServiceNow can exceed the availability and performance SLAs of the ServiceNow Platform powered Customer instances - deployed across the ServiceNow cloud and Azure cloud.  Our mission is to: Deliver  state of the art Monitoring, Analytics and Actionable Business Insights  by employing  new tools, Big Data systems, Enterprise Data Lake, AI, and Machine Learning methodologies  that  improve efficiencies across a variety of functions in the company: Cloud Operations, Customer Support, Product Usage Analytics, Product Upsell Opportunities  enabling to have a   significant impact both on the top-line and bottom-line growth. The Big Data team is responsible for: Collecting, storing, and providing real-time access to large amount of data Provide real-time analytic tools and reporting capabilities for various functions including: Monitoring, alerting, and troubleshooting Machine Learning, Anomaly detection and Prediction of P1s Capacity planning Data analytics and deriving Actionable Business Insights Rotational oncall over weekends What you get to do in this role Responsible for deploying, production monitoring, maintaining and supporting of Big Data infrastructure, Applications on ServiceNow Cloud and Azure environments. Architect and drive the end-end Big Data deployment automation from vision to delivering the automation of Big Data foundational modules (Cloudera CDP), prerequisite components and Applications leveraging Ansible, Puppet, Terraform, Jenkins, Docker, Kubernetes to deliver end-end deployment automation across all ServiceNow environments. Automate Continuous Integration / Continuous Deployment (CI/CD) data pipelines for applications leveraging tools such as Jenkins, Ansible, and Docker. Linux, Bash and Python scripting are mandatory Performance tuning and troubleshooting of various Hadoop components and other data analytics tools in the environment: HDFS, YARN, Hive, HBase, Spark, Kafka, RabbitMQ, Impala, Kudu, Redis, Hue, Kerberos, Tableau, Grafana, MariaDB, and Prometheus. Provide production support to resolve critical Big Data pipelines and application issues and mitigating or minimizing any impact on Big Data applications. Collaborate closely with Site Reliability Engineers (SRE), Customer Support (CS), Developers, QA and System engineering teams in replicating complex issues leveraging broad experience with UI, SQL, Full-stack and Big Data technologies. Responsible for enforcing data governance policies in Commercial and Regulated Big Data environments.     Qualifications To be successful in this role you have: 9+ years of overall experience with at least 6+ years as a Big Data DevOps / Deployment Engineer Demonstrated expert level experience in delivering end-end deployment automation leveraging Puppet, Ansible, Terraform, Jenkins, Docker, Kubernetes or similar technologies. Deep understanding of Hadoop/Big Data Ecosystem. Good knowledge in Querying and analyzing large amount of data on Hadoop HDFS using Hive and Spark Streaming and working on systems like HDFS, YARN, Hive, HBase. Spark, Kafka, RabbitMQ, Impala, Kudu, Redis, Hue, Tableau, Grafana, MariaDB, and Prometheus. Experience securing Hadoop stack with SSL, Ranger, LDAP, Kerberos KDC Experience supporting CI/CD pipelines on Cloudera on Native cloud and Azure/AWS environments Good knowledge of Perl, Python, Bash, Groovy and Java. In-depth knowledge of Linux internals (RHEL 7.x/8.x) and shell scripting Ability to learn quickly in a fast-paced, dynamic team environment Additional Information ServiceNow is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status or any other category protected by law. At ServiceNow, we lead with flexibility and trust in our distributed world of work. Click here to learn about our work personas: flexible, remote and required-in-office. If you require a reasonable accommodation to complete any part of the application process, or are limited in the ability or unable to access or use this online application process and need an alternative method for applying, you may contact us at talent.acquisition@servicenow.com  for assistance. For positions requiring access to technical data subject to export control regulations, including Export Administration Regulations (EAR), ServiceNow may have to obtain export licensing approval from the U.S. Government for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by the U.S. Government. Please Note: Fraudulent job postings/job scams are increasingly common. Click here to learn what to watch out for and how to protect yourself. All genuine ServiceNow job postings can be found through the ServiceNow Careers site .   From Fortune. 2022 Fortune Media IP Limited All rights reserved. Used under license. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of, ServiceNow.