Data Engineer

  • Hyderabad
  • Allegis Global Solutions

We have an opening with one of our Top Global Product Banking client as a direct payroll for Associate/Sr.Associate Data Engineer role @ Hyderabad Location.

Mode-Hybrid

Mandate skills-Spark Core, Spark-SQL – Mandatory | PySpark( Good to Have)

Java and Scala Programming

Hands-on Data Warehouse concepts and Change Data Capture (CDC and SCD Types)

Should be able to understand the complex transformation logic and translate it to Spark-SQL queries

Experience-4yrs-9.5yrs


Requirements

• 3 to 9.5 years hands on experience on Spark Core, Spark-SQL, Scala-Programming and Streaming datasets in Big Data platform

• Should have extensive working experience in Hive and other components of Hadoop eco system (HBase, Zookeeper, Kafka and Flume)

• Should be able to understand the complex transformation logic and translate them to Spark-SQL queries

• Unix Shell Scripting and setting up CRON jobs

• Should have worked on Cloudera distribution framework, Oozie Workflow (or any Scheduler), Jenkins (or any version controller)

• Prior experience in Consumer Banking Domain is an advantage

• Prior experience in agile delivery method is an advantage

• Excellent understanding of technology life cycles and the concepts and practices required to build big data solutions

• Familiar with Data Warehouse concepts and Change Data Capture (CDC and SCD Types)

• Core Java skillset, Micro services understanding is an added advantage. Airflow is plus to have

• Good Knowledge and experience in any database (Teradata or Data Lake or Oracle or SQL Server) is a plus

• Bachelor of Engineering, Bachelor of Technology, MCA (or equivalent master’s degree)

Interested candidates Please share the Updated CV to skumawat@allegisglobalsolutions.com


Please fill below details if interested with above role :

Total Experience:

Relevant experience:

CTC:

ECTC:

Notice Period:

Banking/BFSI domain:

Should be available for F2F Interview in Hyderabad on 25th May/26th May (Yes or No)-:

Apply now

Other job offers that may interest you

Sr principal software engineer
HyderabadOracleToday
.. develop messaging systems with pub-sub and queue architecture patterns. You must be passionate about building distributed messaging cloud services running on Oracle cloud infrastructure. The role also requires hands-on experience with open-source messaging substrates and working with multiple messaging .. read more
Technical recruiter
HyderabadQuess Corp Limited2 days ago
.. strategies. Qualifications: Bachelor's degree in Human Resources, Business Administration, or a related field. 1-4 years of experience in IT recruitment, with a .. process. Negotiate contract terms and compensation packages with candidates, following company guidelines and client requirements. Provide exceptional .. read more
Mobile application developer
HyderabadAtisfy2 days ago
.. Familiarity with Angular frontend development would be an added advantage Familiarity with data visualization (widgets such as charts, graphs, tables, etc.,) frameworks like ngx-chart, Highcharts, etc., Working knowledge of SCM with strong emphasis on Git and proper Git Flow Excellent verbal communication .. read more
Dot net core developer
HyderabadSynechronYesterday
.. C/AL Development Environment Familiarity with AL (Application Language) and Visual Studio Code for Business Central development Understanding of data migration tools and techniques to migrate data from NAV to Business Central. Ability to integrate Business Central with other systems and services using .. read more
Design draftsperson
HyderabadOricaYesterday
.. our rigorous safety standards. Utilize your expertise to create detailed Construction drawings and specifications across various engineering disciplines. .. industry standards and regulations. Proven experience in creating detailed Construction drawings and specifications for fixed and mobile plants. Excellent .. read more
Sdet ( nodejs+automation) || hyderabad || valuelabs
HyderabadValuelabsToday
.. in distributed services ecosystem • Understanding of containerization, experienced in Dockers , Kubernetes. • Exposed to API gateway integrations like 3Scale. • Understanding of Single-Sign-on or token based authentication (Rest, JWT, oAuth) • Possess expert knowledge of task/message queues including .. read more
Bench sales recruiters
HyderabadViron Technologies IncYesterday
.. at the forefront of emerging technologies and ensuring your business remains competitive and ready for the future. Role Description This is a full-time on-site role as a Bench Sales Recruiter at Viron Technologies INC. As a Bench Sales Recruiter, you will be responsible for full-life cycle recruiting .. read more
Hiring for bilingual qa
HyderabadTech MahindraYesterday
.. accordance with client specific reporting standards using client specific templates. Experience of defect tracking tools like JIRA, Conduct Defect triage meetings and following up on the defect closures Relevant Experience 8-10 years of IT experience and understanding of SDLC. QA Testing and UAT experience .. read more
Staff engineer [t500-**]
HyderabadTjx Global It IndiaYesterday
.. 12 years of software engineering experience Hands-on experience with Oracle Retail applications (RMS, RPM, ReSA, REIM) along with good technical and .. languages using: Unix shell scripting. Experience in database query language such as: Oracle Experience in DevOps tools including JIRA, Confluence, BitBucket .. read more
Manager / senior manager – strategic partnerships & alliances
HyderabadQualizealToday
.. projects, and co-selling opportunities. Partnership Management : Oversee and manage existing partnerships to ensure successful collaboration and drive mutual growth. Performance Monitoring and Reporting : Track and measure the performance of partnerships against predefined KPIs. Continuously evaluate .. read more
Senior quality analyst with loan origination systems (los)
HyderabadInfolobToday
.. for writing and executing manual and automation test scripts and tracking defects MUST HAVES: Loan Origination Experience Underwriting experience Strong in SQL Queries Auto Finance or Mortgage Industry or Financial Industry background. Job Duties Need a strong resource who has hands on experience working .. read more
Sr. full stack developer- react & node
HyderabadCloudhireToday
.. of applications through appealing visual design Develop and manage well-functioning databases and applications Write effective APIs Test software to ensure responsiveness and efficiency Troubleshoot, debug and upgrade software Create security and data protection settings Build features and applications .. read more
Oracle hcm payroll and advance benefits functional consultant
HyderabadWinfo SolutionsYesterday
.. as a primary functional consultant. Candidates must have a minimum of 6 years’ relevant experience. Candidate must be able to design security and roles for the users of above modules. Candidate must have working knowledge of project management tools like JIRA, ServiceNow etc. Candidate should be able .. read more
Software quality engineer ii [t500-**]
HyderabadFedex AccYesterday
.. 's degree in computer science, engineering, information systems, or business Administration and/or equivalent formal training or work experience. Two (2) years .. into automated test scripts. Present progress and results of automated testing efforts to appropriate teams Continuously improve upon the productivity .. read more
Senior java software engineer
HyderabadPortlYesterday
.. tools (Maven, Gradle), version control systems (Git), and continuous integration/continuous deployment (CI/CD) pipelines. Familiarity with containerization technologies such as Docker and container orchestration platforms like Kubernetes. Knowledge of cloud platforms (AWS, Azure, or GCP) and their services .. read more
Senior cloud security engineer
HyderabadHighradiusToday
.. to provision and manage cloud resources in a consistent and scalable manner. This includes defining and automating security compliance checks and processes using tools like AWS Config or Azure Policy and applying security controls and policies as code to ensure security is integrated into the cloud infrastructure .. read more
Senior immigration specialist / associate paralegal
HyderabadTek Leaders IncToday
.. possess sound Knowledge on LCA filing on DOL site, I-129, RFE response, OPT/s I-20, end to end GC processing, I-539 etc. Preparing briefs and other legal documents. Knowledge of immigration forms, how to fill them out, and how to file them. Strong organizational skills to manage multiple cases at different .. read more
Interior designer
HyderabadLivera Designers And DevelopersToday
.. , Fixtures, and Equipment). Qualifications Space Planning, Architecture, and Construction Drawings skills Experience in interior design and FF&E Creative .. Ability to work effectively in a team Excellent communication and interpersonal skills Bachelor's degree in Interior Design, Architecture, or related field .. read more
Bmc engineer || immediate joiners || hyderabad
HyderabadValuelabsToday
.. Greetings from Valuelabs ! Hope you all are doing safe and well !! We are Hiring for Hiring || BMC Engineer || Immediate Joiners || Hyderabad Experience: 5+ Years Timings: Regular Shift (Singapore Time zone) Location: Hyderabad/Indore WFO - 5 days Valuelabs Head Office Job Type: Full Time CTC: Best in .. read more
Games publisher experts-consultant
HyderabadPtwToday
.. support to its game developers, which may include such things as development tool licensing, use of publisher-owned proprietary tools, localization, and/or porting Conducts quality assurance testing Promotes, advertises, manufactures, sells and distributes the games it publishes Provides technical and .. read more
Sap cpi integration developer
HyderabadRecann2 days ago
.. designing, developing, and maintaining integration solutions using SAP Cloud Platform Integration (CPI). You’ll collaborate with cross-functional teams, analyze business requirements, and create seamless connections between various systems and applications. Responsibilities: develop, and implement .. read more
Senior data scientist
HyderabadFinbotsaiYesterday
.. visualization and develop appropriate models Familiarity with advanced statistical procedures and implement them into Production grade software modules Cross-validate models to ensure their generalizability across various products Develop and document non-technical reports that detail the successes and .. read more
Software engineer iv- c++ developer
HyderabadNcr VoyixToday
.. of services, NCR VOYIX enables nearly 550 million transactions daily across Retail, financial, travel, hospitality, telecom and technology, and small business. .. the industry? You can as a Software Engineer within CFR (Convenience-Fuel-Retail) Division of NCR VOYIX. The CFR Solutions team cater to the top brands in .. read more
Business intelligence analyst
HyderabadRandstad Sourceright2 days ago
.. Project Management and/or process improvement experience highly preferred ● MI/Business Intelligence/Data Science/Analytics background is essential ● Working in complex multinational organizations which would preferably be in HR Staffing or Outsourcing ● Experience in the recruitment industry (e.g .. read more
Information technology sales manager
HyderabadPalni IncYesterday
.. goals and objectives. and cultivate prospect relationships by initiating communication and building follow-up communication in order to move opportunities through the sale funnel. and analyse sale pipelines and reports to ensure sales pipeline to consistently meet monthly/quarterly revenue goals. with .. read more
Html developer
HyderabadVarun Digital Media2 days ago
.. HTML5 developer who is motivated to combine the art of design with the art of programming. Responsibilities will include the translation of the UI/UX design wireframes to actual code that will produce visual elements of the application. You will work with the UI/UX designer and bridge the gap between .. read more
Digital marketing manager
HyderabadAci InfotechYesterday
.. Process Automation, Data & Analytics, and DevSecOps have been successful in enhancing business performance and delivering tangible value to our clients. Role Description This is a full-time hybrid role for a Digital Marketing Manager at ACI INFOTECH. The Digital Marketing Manager will be responsible .. read more
Digital design - senior staff architect (16+yrs of expereince)
HyderabadSilicon LabsToday
.. Reviewing micro-architectural specifications Skills You Will Need Minimum Qualifications: Demonstrated experience in building SoC interconnect, smart caches, and memory systems Demonstrated experience in defining and designing high-complexity designs (accelerators, processors, bus-fabric, DMA, complex .. read more