Data Engineer - Gen AI - Associate 2

  • Hyderabad
  • Pwc
Description : GenAI Data Engineer - Associate PwC US - Acceleration Center is seeking an enthusiastic and emerging GenAI Data Engineer to join our team at the Associate level. This role is ideal for individuals passionate about data engineering and eager to develop their skills in GenAI technologies. As an Associate GenAI Data Engineer, you will contribute to developing and maintaining data pipelines, implementing machine learning models, and optimizing data infrastructure for our GenAI projects under the guidance of more experienced team members.Responsibilities:Assist in the design, development, and maintenance of data pipelines and ETL processes for GenAI projects.Work closely with data scientists and software engineers to support the implementation of machine learning models and algorithms.Help optimize data infrastructure and storage solutions to ensure efficient data processing.Gain experience with event-driven architectures to enable real-time data processing and analysis.Learn and assist with containerization technologies like Kubernetes and Docker for deployment and scalability.Support the development and maintenance of data lakes for managing large volumes of structured and unstructured data.Contribute to the integration of LLM frameworks (such as Langchain and Semantic Kernel) for advanced language processing and analysis.Collaborate with cross-functional teams to support the design and implementation of solution architectures for GenAI projects.Utilize cloud computing platforms such as Azure or AWS under supervision for data processing, storage, and deployment.Participate in monitoring and troubleshooting of data pipelines and systems to ensure smooth operations.Stay informed about the latest advancements in GenAI technologies and assist in recommending innovative solutions to enhance data engineering processes.Engage with cross-functional teams to help understand business requirements and contribute to translating them into technical solutions.Assist in documenting data engineering processes, methodologies, and best practices.Requirements:Bachelor’s degree in Computer Science, Data Science, or a related field.1-3 years of relevant experience, ideally with some exposure to GenAI projects.Basic programming skills in Python.Familiarity with data processing frameworks like Apache Spark or similar.Understanding of SQL and basic database management systems.Some knowledge of event-driven architectures and real-time data processing.Exposure to containerization technologies like Kubernetes and Docker.Awareness of data lakes and basic data lake management principles.Some familiarity with LLM frameworks such as Langchain and Semantic Kernel.Experience with cloud computing platforms such as Azure or AWS is a plus.Strong analytical and problem-solving skills.Good communication and collaboration abilities.Ability to work in a fast-paced and dynamic environment.Nice to Have Skills:Exposure to additional technologies such as Databricks, Azure AI Search, Azure OpenAI, Azure Event Hub, Azure Data Lake Storage, AWS Open Search, AWS Bedrock, AWS Event Bridge, AWS S3, Azure Key Vault,DataDog, and Splunk.If you are early in your data engineering career and enthusiastic about GenAI technologies, join PwC US - Acceleration Center as an Associate GenAI Data Engineer. Here, you will develop your skills and contribute to innovative projects in a supportive and collaborative work environment.Education Degrees/Field of Study required:Degrees/Field of Study preferred:Certifications Required SkillsOptional SkillsDesired Languages Travel RequirementsNot SpecifiedAvailable for Work Visa Sponsorship? NoGovernment Clearance Required? NoJob Posting End Date