Cloudera Data Engineer

3 days ago

Pune, Maharashtra, India Lumiq Full time ₹ 9,00,000 - ₹ 12,00,000 per year
Data Engineer - Cloudera
Location: Pune & Mumbai

Mode: 5 Days WFO

Who we are

We are a leading Data and Analytics company helping enterprises across industries solve their complex data challenges. Our expertise lies in building next-gen data platforms and solutions that enable organizations to unlock the full potential of their data.

We partner with enterprises globally to design scalable, reliable, and secure data solutions. With a strong culture of ownership, innovation, and continuous learning, we empower our teams to deliver outcomes that make a real business impact.

Job Description

We are seeking a highly skilled Data Engineer to join our dynamic team. You will be responsible for designing, developing, and optimizing data pipelines and workflows using modern big data and cloud-native tools. This role requires hands-on expertise in PySpark, SQL, workflow orchestration, and working with distributed data platforms like Cloudera.

Key Responsibilities
  • Design, build, and maintain scalable ETL/ELT data pipelines using PySpark and Airflow.
  • Work with Cloudera ecosystem (Hadoop, Hive, Impala) to manage and optimize big data workflows.
  • Develop and optimize SQL queries for large-scale data processing and analytics.
  • Collaborate with cross-functional teams to gather requirements and deliver reliable data solutions.
  • Ensure high performance, reliability, and scalability of data workflows.
  • Troubleshoot and resolve data pipeline issues in production environments.
  • Stay current with emerging tools and best practices in data engineering.
Qualifications
  • Minimum 5 years of experience as a Data Engineer.
  • Strong expertise in PySpark, SQL, and Airflow.
  • Hands-on experience with Cloudera Hadoop ecosystem (HDFS, Hive, Impala).
  • Strong problem-solving skills and ability to optimize workflows for performance.
Must Have Skills
  • PySpark
  • Airflow
  • SQL
  • Cloudera (Hadoop, Impala/Hive)
Good to Have Skills
  • Apache NiFi
  • DBT
  • Cloudera Certification
What Do You Get
  • Opportunity to work with cutting-edge big data and cloud technologies.
  • Competitive salary packages.
  • Health and wellness benefits.
  • Exposure to enterprise-scale data engineering challenges.
  • Learning and certification sponsorships.

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Binary Star SearchX Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Description : - Minimum 5 years of experience in data analytics field - Experience with Azure/AWS Databricks - Experience in building and optimizing data pipelines, architectures and data sets - Excellent experience in Scala or Python, PySpark and SQL - Ability to troubleshoot and optimize complex queries on the Spark platform -...

  • Product Data Analyst- Data Engineering

    7 days ago

    Pune, Maharashtra, India ZF Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    What you can look forward to as Product Data Analyst- Data Engineering:End-to-End Project Ownership: Drive and manage analytics initiatives from concept to deployment, ensuring high-quality, timely deliverables with minimal supervision.Engineering Best Practices: Apply structured software development principles, including version control (e.g., Git), CI/CD,...

  • Hiring For Data Engineer/Senior Data Engineer For MNC

    2 weeks ago

    Pune, Maharashtra, India Futurz Staffing Solutions Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    Note- Associate "Already applied in NCS, will not be eligible"Role & responsibilitiesEssential for this role:Education and Qualifications:• Bachelors degree in IT, Computer Science, Software Engineering, Business Analytics or equivalent.• Minimum seven plus years of experience in data analytics field• Experience with Azure/AWS Databricks• Experience...

  • Big Data Engineer

    1 week ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Location – Pune/ChennaiExp - 6 to 9RequirementsTechnology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)Knowledge/Experience (Must):· 6-9 years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and eventbased messaging.· Relational and NoSQL database integration...

  • Big Data Engineer

    2 days ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Location – Pune/ChennaiExp - 6 to 9Technology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)Knowledge/Experience (Must):· 6-9 years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and eventbased messaging.· Relational and NoSQL database integration and data...

  • Big Data Engineer

    1 week ago

    Pune, Maharashtra, India Coforge Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala.Experience Required: 3 to 6 YearsJob Locations: Pune, Hyderabad, Greater Noida Only.Send your CV to: For queries, contact via WhatsApp: Key Responsibilities:-• Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale,...

  • Data Engineer

    3 days ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Lead Software Engineer

    3 days ago

    Pune, Maharashtra, India Mastercard Full time ₹ 12,00,000 - ₹ 25,00,000 per year

    Lead Software Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and AirflowTitle and SummaryLead Software Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and AirflowWho is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy...

  • Big Data Developer

    3 days ago

    Pune, Maharashtra, India Emergys Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience: 5 to 7 yearsLocation: Pune, KothrudJob Description:Must Have:Proficiency in at least one of the following programming languages: Java/Scala/PythonGood understanding of SQLExperience of development and deployment of at least one end-to-end data storage/processing pipelineStrong Experience in Spark development with batch and streamingIntermediate...

  • Data Operations Engineer

    4 days ago

    Pune, Maharashtra, India Mars Data Insights Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Title: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...