Senior Data Architect

  • Gurugram
  • Fareportal
Title: Sr. Data Engineering Architect Location: Gurgaon, IN Type: Hybrid, In-Office Job Description Who We Are: Fareportal is a travel technology company powering a next-generation travel concierge service. Utilizing its innovative technology and company owned and operated global contact centres, Fareportal has built strong industry partnerships providing customers access to over 500 airlines, a million lodgings, and hundreds of car rental companies around the globe. With a portfolio of consumer travel brands including CheapOair and OneTravel, Fareportal enables consumers to book-online, on mobile apps for iOS and Android, by phone, or live chat. Fareportal provides its airline partners with access to a broad customer base that books high-yielding international travel and add-on ancillaries. HIGHLIGHTS: is the number 1 privately held online travel company in flight volume. partners with over 500 airlines, 1 million lodgings, and hundreds of car rental companies worldwide. annual sales exceeded $5 billion. sees over 150 million unique visitors annually to our desktop and mobile sites. with its global workforce of over 2,600 employees, is strategically positioned with 9 offices in 6 countries and headquartered in New York City. Role Description We are looking for a Senior Data Engineer to join our team. You will be handling hundreds of millions of events per day, responsible for creating and supporting data infrastructures that will drive our business. Data Engineers are at the heart of how Fareportal works and they are part software engineer and part database expert. You will focus on creating and supporting large scale pipelines that we deploy to power our analytics, recommendation, pricing or other systems. The ideal candidate will participate in the design and implementation of the entire data pipeline, from project ideation, figuring out which data to capture and store, coming up with architectures, to creating the final data flows and monitoring. We are passionate about making data-driven decisions and you will have the opportunity to shape the team’s direction and create large impact. Our team loves Python and Scala (and is not afraid of Functional Programming) and we strongly encourage DevOps approaches. Responsibilities Support our data modelling efforts to ensure we are capturing the data needed to improve our modelling and analytic capabilities. Develop and maintain data applications in Python and / or Scala across various data formats and architectures, including: SQL, Clickhouse, MongoDB, AWS S3, Azure App Insights, csv, JSON, parquet, Protobuf Airflow, Docker, Bash, SFTP, AWS Lambda, ECS Evaluate and ensure data integrity across various formats through mature, high quality, well organized application code with fully developed unit and integration testing and telemetry Our ideal candidate: Who You Are You are smart and love to build systems that are well tested as well as flexible You like being around smart people who will challenge you on a daily basis. You love to ramp up on new technologies to build awesome things with us! Passionate about working with large unstructured and structured data sets and developing new approaches to relevance problems You like to share your knowledge and guide other fellow data engineers and scientists Required Qualifications 8+ years’ experience developing, maintaining, and testing big data pipelines with Bachelors of Engineering or relevant educational background. A strong technical advocate with a background in Python or Scala + SQL. Preferably familiar with both on-prem and cloud data systems, for example, AWS or Azure; SQL and NoSQL Experience with shell scripting and Unix command line, as well as virtual environments. Strong understanding of data modeling and ETL / ELT best practices Preferred Qualifications Experience with CI/CD infrastructure and a strong supporter of unit / integration testing Experience with Docker, VMs and container technologies (ie Kubernetes) Disclaimer This job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee. Fareportal reserves the right to change the job duties, responsibilities, expectations or requirements posted here at any time at the Company’s sole discretion, with or without notice.