Cloudera Data Engineer

2 days ago

Mumbai Metropolitan Region, India Mastek Full time

Job Title: Senior Cloudera Data Engineer

Location: India

Job Type: Full-time

Experience Level: Mid-Senior (8-9 years)

Department: Data Engineering


Job Summary: We are seeking a highly skilled and motivated Senior Cloudera Data Engineer with 8 to 9 years of experience to design, develop, and maintain data pipelines and infrastructure on the Cloudera platform. The ideal candidate will have a strong background in data engineering, hands-on experience with Cloudera tools, and a deep understanding of big data architectures alongside expertise on informatica toolset such as Informatica DEI, Informatica Powercentre.

Key Responsibilities:

  • Design, develop, and maintain scalable and robust data pipelines and ETL processes using Cloudera tools and frameworks (e.g., HDFS, Hive, Impala, HBase, Spark, Flink).
  • Design, development , and implementation of complex ETL processes using Informatica PowerCenter.
  • Utilize Informatica DEI for integrating, transforming, and managing large volumes of data across various data platforms, including Hadoop, Spark, and other big data technologies.
  • Collaborate with data architects, data scientists, and business stakeholders to understand requirements and deliver solutions that meet their needs.
  • Optimize and tune performance of data processing jobs, ensuring efficient resource usage and fast execution times.
  • Implement and enforce best practices for data integration, data quality, data security, and governance.
  • Monitor, troubleshoot, and resolve data pipeline and infrastructure issues promptly, ensuring high availability and reliability.
  • Develop and maintain documentation related to data pipelines, processes, and infrastructure.
  • Stay up to date with the latest industry trends, technologies, and best practices in big data and cloud computing.
  • Provide technical guidance and mentorship to junior data engineers within the team.

Qualifications:

  • Bachelor’s or master’s degree in computer science, Information Technology, Data Science, or a related field.
  • 8-9 years of professional experience in data engineering, with a significant focus on Cloudera platforms.

Strong experience of working on support engagements for cloudera data platform

  • Strong hands-on experience with Cloudera tools and technologies such as Hadoop, Hive, Impala, HBase, Spark, Flink, and Kafka.
  • Experience in Design, development , and implementation of complex ETL processes using Informatica PowerCenter.
  • Experience in Utilizing Informatica DEI for integrating, transforming, and managing large volumes of data across various data platforms, including Hadoop, Spark, and other big data technologies.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Solid understanding of data modelling, data warehousing concepts, and big data architectures.
  • Experience with cloud platforms (e.g., AWS, Azure, GCP) and containerization (e.g., Docker, Kubernetes) is a plus.
  • Proven track record of successfully designing and implementing large-scale data processing systems.
  • Excellent problem-solving, analytical, and critical thinking skills.
  • Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.

Preferred Skills:

  • Experience with machine learning and data science workflows.
  • Knowledge of SQL and NoSQL databases.
  • Familiarity with DevOps practices and CI/CD pipelines.
  • Industry certifications related to big data and Cloudera platforms.

Benefits:

  • Competitive salary and performance-based bonuses.
  • Comprehensive health, dental, and vision insurance.
  • Retirement savings plan with company match.
  • Professional development opportunities and educational reimbursement.
  • Flexible work hours and remote work options.
  • Inclusive and collaborative work environment.

  • Cloudera Data Engineer

    1 day ago

    Mumbai Metropolitan Region, India Mastek Full time

    Job Title: Senior Cloudera Data EngineerLocation: IndiaJob Type: Full-timeExperience Level: Mid-Senior (8-9 years)Department: Data EngineeringJob Summary: We are seeking a highly skilled and motivated Senior Cloudera Data Engineer with 8 to 9 years of experience to design, develop, and maintain data pipelines and infrastructure on the Cloudera platform. The...

  • Senior Big Data Expert with Cloudera CDP Solutions

    3 weeks ago

    Mumbai, Maharashtra, India Seventh Contact Hiring Solutions Full time

    Unlock Your Career Potential as a Senior Big Data ExpertAbout the Role:We are seeking an experienced Senior Big Data Expert to join our team at Seventh Contact Hiring Solutions. This is a fantastic opportunity to work with cutting-edge Cloudera CDP solutions and drive business growth in the big data space.Key Responsibilities:Lead large-scale data projects...

  • Data Warehouse Engineer

    2 weeks ago

    Mumbai, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Data Engineering Leader for Big Data Solutions

    2 weeks ago

    Mumbai, Maharashtra, India Smartavya Analytica Private Limited Full time

    We are seeking a seasoned technical expert to lead our client engagements in developing data strategies and implementing cutting-edge data solutions. This role demands a balance of client consulting, architecture, and hands-on build expertise to drive large-scale Cloudera Data Platform (CDP) implementations within the Data Analytics domain.The ideal...

  • Data Strategist for Big Data and Analytics

    1 week ago

    Mumbai, Maharashtra, India Smartavya Analytica Private Limited Full time

    About the Role:We are seeking a seasoned Senior Technical Hadoop Cloudera Consultant / Architect to spearhead client engagements, craft data strategies, and implement cutting-edge data solutions. This position demands a perfect blend of client consulting, architecture, and hands-on build expertise to drive large-scale Cloudera Data Platform (CDP)...

  • GCP Data Engineer

    4 weeks ago

    mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: - In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable - Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB - Solid...

  • GCP Data Engineer

    2 months ago

    Mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB Solid...

  • GCP Data Engineer

    2 months ago

    mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of...

  • Gcp data engineer

    2 months ago

    Mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ Big Table Must have proficient experience in GCP Databases : Bigtable / Spanner / Cloud SQL / Alloy DB Solid...

  • GCP Data Engineer

    1 month ago

    Mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:- In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable- Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB- Solid understanding of...

  • Gcp data engineer

    1 month ago

    Mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ Big TableMust have proficient experience in GCP Databases : Bigtable / Spanner / Cloud SQL / Alloy DBSolid understanding of...

  • Hadoop Administrator

    1 day ago

    Mumbai Metropolitan Region, India Smartavya Analytica Private Limited Full time

    We are seeking an experienced Hadoop Administrator to manage and support our Hadoop ecosystem with 5+ Years of Experience. The ideal candidate will have strong expertise in Hadoop cluster administration, excellent troubleshooting skills, and a proven track record of maintaining and optimizing Hadoop environments.Location: MumbaiKey Responsibilities:Install,...

  • Hadoop Administrator

    2 days ago

    Mumbai Metropolitan Region, India Smartavya Analytica Private Limited Full time

    We are seeking an experienced Hadoop Administrator to manage and support our Hadoop ecosystem with 5+ Years of Experience. The ideal candidate will have strong expertise in Hadoop cluster administration, excellent troubleshooting skills, and a proven track record of maintaining and optimizing Hadoop environments. Location: Mumbai Key Responsibilities: ...

  • GCP Data Engineer

    2 months ago

    mumbai, India Quantiphi Full time

    Designation: Data Engineer Experience Level: 4-16 Years Location: Mumbai/Bangalore/Trivandrum Role & Responsibilities: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB Solid understanding of...

  • GCP Data Engineer

    2 months ago

    Mumbai, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of...

  • Big Data Infrastructure Specialist

    2 weeks ago

    Mumbai Metropolitan Region, India Smartavya Analytica Private Limited Full time

    About the RoleWe are seeking an experienced Hadoop Administrator to manage and support our Hadoop ecosystem with 5+ years of experience. The ideal candidate will have strong expertise in Hadoop cluster administration, excellent troubleshooting skills, and a proven track record of maintaining and optimizing Hadoop environments.The successful candidate will be...

  • Hadoop Administrator Lead

    1 week ago

    Mumbai Metropolitan Region, India Smartavya Analytica Private Limited Full time

    About the RoleWe are seeking a seasoned Hadoop Administrator to lead and support our large-scale Hadoop ecosystem with over 5 years of experience.Key Responsibilities:Hadoop Cluster Administration: Install, configure, and manage Hadoop clusters, including HDFS, YARN, Hive, HBase, and other ecosystem components.Cluster Performance Management: Monitor and...

  • Chief Data Engineer

    4 weeks ago

    Mumbai, Maharashtra, India United Overseas Bank Full time

    Job DescriptionThis challenging role is seeking a seasoned Data Engineer with expertise in cloud computing to lead the development and implementation of large-scale data warehouse and analytics platforms for our global operations.About the Role:- Design, develop, and deploy scalable data architectures on cloud-based platforms such as Cloudera CDH/CDP.-...

  • Lead Data Architect

    2 months ago

    Mumbai, India Quantiphi Full time

    Overall Experience: 8-15 years Role: Data Engineer Location: Bangalore/Mumbai/Trivandrum (Hybrid) Role Description & Requirements: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB Solid...

  • Lead data architect

    2 months ago

    Mumbai, India Quantiphi Full time

    Overall Experience: 8-15 years Role: Data Engineer Location: Bangalore/Mumbai/Trivandrum (Hybrid) Role Description & Requirements: In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ Big Table Must have proficient experience in GCP Databases : Bigtable / Spanner / Cloud SQL / Alloy DB Solid...