Data Engineering - Big Data GCP

  • Noida
  • Treyas Infotech And Consulting Pvt Ltd

JOB DESCRIPTION :


As Manager, Data Engineering, you will be responsible for translating client requirements

into design, architecting, and implementing GCP Cloud-based big data solutions for clients.

Your role will be focused on delivering high-quality solutions by independently driving

design discussions related to Data Ingestion, Transformation & Consumption, Data Storage

and Computation Frameworks, Performance Optimizations, Infrastructure, Automation &

Cloud Computing, and Data Governance & Security. The role requires a hands-on

technologist with expertise in Big Data solution architecture and with a strong programming

background in Java / Scala / Python.

Your Impact:

  • Provide technical leadership and hands-on implementation role in the areas of data engineering including data ingestion, data access, modeling, data processing, visualization, design, and implementation.
  • Lead a team to deliver high quality big data technologies-based solutions on GCP Cloud.

Manage functional &

  • nonfunctional scope and quality.
  • Help establish standard data practices like governance and address other non-functional issues like data security, privacy, and quality.
  • Manage and provide technical leadership to a data program implementation based on the requirement using agile technologies.
  • Participate in workshops with clients and align client stakeholders to optimal solutions.
  • Consulting, Soft Skills, Thought Leadership, Mentorship etc.
  • People management, contributing to hiring and capability building.

QUALIFICATIONS


  • Overall 8+ years of IT experience with 3+ years in Data related technologies, and expertise of 1+ years in data-related GCP Cloud services and delivered at least 1 project as an architect.
  • Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions on GCP Cloud.
  • Expert in programming languages like Java/ Scala and good to have Python
  • Expert in at least one distributed data processing framework: Spark (Core, Streaming, SQL), Storm or Flank.
  • Expert in Hadoop eco-system with GCP cloud distribution and worked at least on one or more big data ingestion tools (Sqoop, Flume, NiFI, etc), distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub, etc.) and good to know traditional tools like Informatica, Talend, etc.
  • Should have worked on any NoSQL solutions like Mongo DB, Cassandra, HBase, etc, or Cloud-based NoSQL offerings like DynamoDB, Big Table, etc.
  • Good Exposure in development with CI / CD pipelines. Knowledge of containerization, orchestration, and Kubernetes engine would be an added advantage. Set Yourself Apart With:
  • Certification on GCP cloud platform or big data technologies.
  • Strong analytical and problem-solving skills.
  • Excellent understanding of data technologies landscape/ecosystem.

Apply now

Other job offers that may interest you

Customer relations officer - russian language
NoidaGedu Global Education (india)Yesterday
.. Requirements - Customer Relations Officer (CRO) MNC,Noida. Preferred requirements: -International Call Centre Experience. B2C/B2B sales experience in Study Abroad/Higher Education/ Overseas Counselling /Online Studies/Ed-tech Firms/ International Students Recruitment/Overseas Sales, etc. Excellent English .. read more
Chief manager - new business development
NoidaTata Aig General Insurance Company LimitedToday
.. excel in this position, you should possess: Bachelor's degree in Business Administration, Finance, Insurance, or related field; MBA preferred. Proven experience in .. Tata AIG, you will: Identify and prospect potential clients, strategic partners, and business opportunities within the insurance industry, aligned with .. read more
Corporate relations manager
NoidaMotherland Hospital2 days ago
.. Mother and Childcare Hospital in Noida, dedicated to providing exceptional Healthcare services with compassion, expertise, and innovation. We are committed to .. marketing initiatives to promote Motherland Hospital as a preferred Healthcare destination. Key Responsibilities: 1. Develop and execute corporate .. read more
Graphic content curator
NoidaCloudhire2 days ago
.. role in enhancing our brand identity and engaging our audience. Key Responsibilities: Graphic Design: Create eye-catching graphics for the company's websites, apps, and social media channels Design engaging visuals, including photos, illustrations, infographics, and videos, that align with our brand .. read more
Contract specialist- oil & gas
NoidaConsult Shekhar PandeyYesterday
.. equipment. -- Support to punctual M & amp; A initiatives. - Support to procurement and engineering teams in their negotiations with suppliers. - Managing real estate aspect of development (offices and demo plants). - Support to the institutional funding team in securing grants and loans from EU and national .. read more
Sap abap developer
NoidaCoforgeToday
.. and data and conduct or participate in non-functional and functional testing (e.g., unit testing, system testing, integration testing, etc.). • Develop and review RICEFW objects, programs and configurations to verify consistency and conformance with established programming and industry standards, guidelines .. read more
Project manager
NoidaAppinventivYesterday
.. Manager at Appinventiv located in Noida. As a Project Manager, you will be responsible for leading and managing projects, ensuring timely delivery, coordinating logistics, and overseeing inspections. You will also be responsible for expediting project timelines and managing the logistics of the project .. read more
Senior manager accounts
NoidaAaj Enterprises2 days ago
.. skills. The job requires tomanage the complete accounting of the organization on Zoho books along with tax compliances with a team of 3-5 employees. Duties and Responsibility · Manage the company's financial accounting, monitoring, and reporting systems on Zoho books · Responsible for timely invoicing .. read more
Credit card specialist
NoidaGenpact2 days ago
.. for the role of Disputes and Chargeback ( VISA MASTERCARD ) The Disputes Investigations Specialist is responsible for the timely review of fraud and/or non-fraud card disputes for an issuing financial institution. The Disputes Investigations Specialist will be responsible for reviewing customer transaction .. read more
Graphic designer
NoidaAmpmYesterday
.. Illustrator ● Proficient in design software (e.g., InDesign and Balsamiq) ● Strong aesthetic skills with the ability to combine various colors, fonts, and layouts. ● Attention to visual details. ● Ability to meet deadlines and collaborate with a team. ● BSc degree in Design, Visual Arts, or .. read more
Sales business development manager
NoidaWachme2 days ago
.. role requires conducting market research, identifying potential customers, and developing effective sales strategies. Qualifications Strong sales and business development skills Excellent communication and negotiation skills Experience in lead generation and customer relationship management Knowledge .. read more
Business development manager - lending/ fleets (ev financing)
NoidaPeoplegeneToday
.. Solid understanding of Financial services sales. Experience in the Vehicle financing of Electric Vehicle ecosystem will be preferred. • Excellent verbal & written communication & presentation skills • Good network among targeted OEMs/ e- mobility/ Two-Wheelers manufacturers We offer an innovative .. read more
Client solutions partner
NoidaAmity Institute Of Training E Development AitdToday
.. team, you will develop training assets that range from classroom, virtual, self-paced & digital as per the client requirement. This includes identifying training needs, conducting Learning Needs Analysis, writing high-level design, creating prototypes, developing content using prescribed tools, maintaining .. read more
Email marketing specialist
NoidaEmpor MarcomYesterday
.. clients and internal marketing initiatives. Ensure marketing message is conveyed clearly and delivered properly to prospects. Ensure messages are sent in proper form and template. Proofread emails for clarity, grammar, and spelling. Develop a personalization strategy. Include specific graphics, incentives .. read more
Cloud assessment leads
NoidaHcltech2 days ago
.. manipulation to derive 6R disposition reports independently. You should have above average hands-on experience preparing disposition reports on MS excel and MS PowerPoint. Role requirements are as follows: Should have good understanding of Application & its core infrastructure components like, storage .. read more
Business development executive
NoidaPlanetrk2 days ago
.. where ambition meets opportunity, and drive your sales career to new heights. BDA, BDE, BDC, Associate, Sales employee, Sales job, sales job in Gurugram, sales job in Gurgaon, Sales Executive, Business Development Cousellor, Inside Sales Executive, Sales job for Fresher, Sales Counsellor, Business Development .. read more
Network infrastructure management
NoidaNtt Data, Inc.2 days ago
.. management to develop and execute network improvement strategies. Mentor and provide technical guidance to junior team members. Participate in knowledge-sharing sessions and contribute to team skill development. Qualifications: Bachelor's degree in Telecommunications, Network Engineering, or a related .. read more
Business development manager
NoidaInvoayYesterday
.. businesses and their customers in the personal wellness services and modern Retail industry. Our comprehensive business ERP platform helps business owners .. and CRM software Experience in the personal wellness services or modern Retail industry is a plus Bachelor's degree in Business Administration, Marketing, .. read more
Devops automation engineer
NoidaNxp SemiconductorsToday
.. in computer science, information technology or related field. Experience as DevOps engineer with strong automation skills in the AWS cloud as well as on premises. Strong automation skills preferable using Ansible, Python as well as AWS CloudFormation. Certification with RedHat and AWS would be plus .. read more
Techno/functional implementation specialist
NoidaOracleToday
.. business needs that cannot be addressed through standard configurations. Assist in data migration from legacy systems to Oracle Fusion Applications, ensuring data accuracy and integrity. Integrate Oracle Fusion Applications with other systems within the organization’s IT landscape, such as SCM, ERP .. read more
Business development executive
NoidaWappnet Systems Pvt. Ltd.Yesterday
.. achieving sales targets, particularly in international markets. Strong communication and negotiation skills. Ability to work independently and as part of a team. Excellent organizational and time management skills. Fluent in English; proficiency in additional languages is a plus. What We Offer: Competitive .. read more
Cx - oracle field service cloud(toa) technical consultant
NoidaOracle2 days ago
.. player 9. Customer focused 10. Confident and decisive 11. Values Expertise (maintaining professional expertise in own discipline) 12. Enthusiasm 13. Flexibility 14. Organizational skills 15. Values and enjoys coaching/knowledge transfer ability 16. Values and enjoys teaching technical courses Note: Shift .. read more
Integration developer
NoidaStudy GroupToday
.. potential. With university partnerships and a variety of face-to-face, online, and hybrid study programmes, we can provide students with the resources and guidance they need to succeed. Our global network of offices and university partnerships ensure that students receive the best educational services .. read more
Senior java developer
NoidaVolansys (an Acl Digital Company)Today
.. adhering to best practices. Utilize service discovery and API gateway to manage communication between microservices. Leverage WebSocket programming to establish real-time two-way communication channels. Ensure secure communication through proper implementation of HTTP protocols (REST) and encryption .. read more
New product development - beverages - am/dm
NoidaJubilant Foodworks Ltd.Yesterday
.. customer and quality at the center of everything o Interpersonal skills o Effective problem solving by breaking down a big opportunity o Good follow-up skills Equal Opportunity Employment: Jubilant FoodWorks is proud to be an equal opportunity employer and we are committed to diversity and inclusion .. read more
Process developer
NoidaGenpactYesterday
.. Minimum qualifications Candidate should have at least 0-3 years’ experience performing Banking/Dispute Investigations in the debit and/or credit card industry Keen attention to detail & risk identification Basic knowledge of Banking Industry & Regulatory Environment with in-depth knowledge of Regulations .. read more
Domain trainee - treasury
NoidaGenpactYesterday
.. relevant experience Excellent Excel skills required Good written and verbal communication skills Preferred qualifications B.com. / M.com. Understanding of closing process for an insurance P&C company Accounting experience in the Insurance sector desired Good understanding of Insurance dynamics with Treasury/ .. read more
Search engine optimization specialist
NoidaShramin Jobs2 days ago
.. campaigns is a definite bonus. While not mandatory, the ability to understand and potentially contribute to PPC efforts would be highly valued. Benefits: ● Competitive salary and benefits package. ● Opportunity to work for a leading online recruitment platform in India. ● Dynamic and fast-paced .. read more
Financial planning analyst
NoidaGenpactToday
.. and Written) Location: Noida Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity .. read more
Content writer (it) - noida
NoidaCyfutureToday
.. content according to project deadlines. Partner with senior team members and managers to define priorities, plan the time required to complete tasks, and identify appropriate tooling needed to complete assignments. Requirements Bachelor's degree in English, Journalism, or a related field. Strong writing .. read more