Aws Emr 4 to 9 Years Pan India
7 days ago
**Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.** **Job Description**: **- Setting up and managing EMR clusters for processing large-scale data using frameworks like Apache Hadoop, Apache Spark, Apache Hive, etc.** - **Configuring EMR clusters based on specific requirements, including choosing the appropriate instance types, storage configurations, and software settings.**: - **Implementing and optimizing data processing workflows on EMR clusters, leveraging distributed computing frameworks for tasks such as data **cleansing **, transformation, and analysis.**: - **Writing scripts and code to interact with EMR clusters, often using languages like Python, Java, or Scala, to develop and execute data processing jobs.**: - **Integrating EMR with other AWS services, such as Amazon S3 for storage, AWS Glue for ETL (Extract, Transform, Load), AWS Lambda and other complementary services to create end-to-end data pipelines.**: - **Optimizing cluster performance by fine-tuning configurations, adjusting resource allocation, and implementing best practices for efficient data processing.**: - **Implementing monitoring solutions to track cluster performance and troubleshoot issues, ensuring the reliability and availability of the big data processing environment.**: - **Implementing security measures to **protect **data within EMR clusters, configuring access controls, encryption, and ensuring compliance with security policies.**: - **Implementing automation for cluster provisioning, scaling, and decommissioning to streamline operations and improve efficiency.**: - **Overall, an AWS EMR role requires a combination of cloud computing knowledge, big data processing expertise, scripting/coding **skills **, and a good understanding of data engineering principles.**: - **AWS certifications, such as the "AWS Solution Architect - Associate" or relevant certifications demonstrating expertise in cloud computing, are often preferred.**: - **Good communication **skills **to interact with cross-functional teams, **understand **business requirements, and effectively convey technical information.**: - **Ability to collaborate with data engineers, data scientists, and other stakeholders in a team-oriented environment. **Primary Skill**: - **AWS Infrastructure Management**: - **EMR**: - **EMR infrastructure automation using IaC tools like Terraform **Secondary Skill**: - **Good Communication Skills** **Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fuelled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.
-
Aws Emr 4 to 9 Years Pan India
1 week ago
Chennai, Tamil Nadu, India Capgemini Engineering Full timeChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of...
-
Aws Dataengineer 6 to 8 Years Pan India
7 days ago
Chennai, Tamil Nadu, India Capgemini Full time**Job Description**: - Hands on industry experience in design and coding from scratch in AWS Glue-Pyspark with services like - S3, DynamoDB, StepFunctions etc. - Hands on industry experience in design and coding from scratch in Snowflake. - Experience in Pyspark/Snowflake 1 to 3 years with overall around 5 years of experience in building data/analytics...
-
Spark + Aws Emr
7 days ago
Chennai, Tamil Nadu, India Cognizant Full time**Job Summary** **Responsibilities** - Develop and maintain data pipelines using Apache Airflow to ensure efficient data processing and workflow automation. - Utilize Hive for data warehousing solutions ensuring data is stored and queried effectively. - Write and optimize SQL queries to manage and manipulate data across various databases. - Implement and...
-
Aws Data Architect
2 weeks ago
Chennai, Tamil Nadu, India Whitefield Careers Full time**AWS Principal Data Architect - Hadoop Migration** We are seeking an experienced AWS Principal Data Architect to lead the migration of Hadoop DWH workloads from on-premise to AWS EMR. As an AWS Data Architect, you will be a recognized expert in cloud data engineering, developing solutions designed for effective data processing and warehousing requirements...
-
Aws DevOps
1 week ago
Chennai, Tamil Nadu, India Cognizant Full time**AWS Devops** 1. Need SA (5+ experience) with AWS DevOps experience. 2. Experience with AWS services like IAM, S3, Lambda, EC2, ECS, CloudWatch, CloudFormation,EC2,EBS,S3,EMR,IAM,GLUE,ATHENA,VPC, SUBNET, SG, RDS,Etc. 3. Experience with Docker and Kubernetes. 4. Experience with security best practices (e.g. using IAM Roles, KMS, etc.). 5. Experience in...
-
Aws DevOps 3 to 6 Years Pan India
1 week ago
Chennai, Tamil Nadu, India Capgemini Full timeChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of...
-
Java Developer- Pan India
7 days ago
Chennai, Mumbai, Pune, India Infosys Full time ₹ 15,00,000 - ₹ 25,00,000 per yearSkills: SRE, AWS Devops, Azure DevopsEducation: B.TECH, B.Sc, BCAYear of Experience : 3-15 YrsLocation : Pan India
-
Cyber Security- Pan India
2 weeks ago
Chennai, Tamil Nadu, India Diverse Lynx Full timeHiring for Cyber Security- pAN iNDIA Monitor security systems and analyze security events to detect threats and anomalies Conduct regular vulnerability assessments and penetration testing Implement and manage security tools and technologies e g firewalls IDS IPS SIEM antivirus DLP Develop document and enforce security policies procedures and standards...
-
AWS Data Engineer
4 days ago
tamil nadu, India Tata Consultancy Services Full timeRole AWS Data EngineerRequired Technical Skill Set AWS Redshift, Glue, PySparkDesired Experience Range 4-10 YearsLocation of Requirement Chennai/PuneDesired Competencies (Technical/Behavioral Competency)Must-Have • Strong hands-on experience in Python programming and PySpark• Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda)• Experience...
-
Data Architect 9 to 14 Years Pan India
3 days ago
Chennai, Tamil Nadu, India Capgemini Invent Full time**Capgemini Invent**: Capgemini Invent is the digital innovation, consulting and transformation brand of the Capgemini Group, a global business line that combines market leading expertise in strategy, technology, data science and creative design, to help CxOs envision and build what’s next for their businesses. **Your role**: - You act as a contact...