Senior Data Engineer

5 hours ago

Pune Maharashtra India, Maharashtra EXL Full time

Key Responsibilities:

• Develop high quality, secure and scalable data pipelines using spark, Scala/Python/Java on Hadoop or object storage like MinIO.

• Leverage technologies and solutions to innovate with increasingly large data sets. • Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration.

• Understand, implement and enforce Software development standards and engineering principles in the Big Data space.

• Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.

• Perform assigned tasks and production incident independently.


Must Have:

• 5-9 years of experience in Data Warehouse/Data Lake/Lake House related projects in product or service-based organization

• Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment handling petabyte scale data.

• Solid Experience of building complex data pipelines through Spark with Scala/Python/Java on Hadoop or Object storage

• Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge.

• Proficient in working within an Agile/Scrum framework, including creating user stories with well-defined acceptance criteria, participating in sprint planning and reviews

• Write and maintain Unix shell scripts, Oracle SQL, PL/SQL, and perform SQL tuning.

• Optimize and troubleshoot Spark applications for performance, scalability, and fault tolerance

• Use Git-based version control systems and CI/CD pipelines (e.g., Jenkins).

• Implement and manage HIVE external tables, partitions, and various file formats.

• Work across on-premises and cloud environments (AWS, Azure, Databricks).

• Strong experience with Hadoop ecosystem and Cloudera Data Platform (CDP).

Experience of building Nifi pipelines.


Preferred

• Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan

• Strong communication skills - both verbal and written.

• Ability to multi-task across multiple projects, interface with external / internal resources

. • Proactive, detail-oriented and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results

• Willingness to quickly learn and implement new technologies, participate POC to explore best solution for the problem statement

• Experience working diverse and geographically distributed project teams.


Skills & Qualifications: Bachelor’s degree in information systems, Information Technology, Computer Science or Engineering or equivalent work experience.

  • Data Privacy Consultant

    5 hours ago

    Pune, Maharashtra, India, Maharashtra Data > Nuance. Full time

    About Data>Nuance Data>Nuance is a global privacy, data protection, and AI governance consultancy, trusted by 1,000+ organizations worldwide.We operate across Barcelona, Bangalore, and Dubai (expanding soon), with a dedicated team of data protection, governance, and regulatory specialists.We specialize in:Outsourced DPO ServicesData Protection Consultancy &...

  • Senior Data Engineer

    5 hours ago

    Pune, Maharashtra, India, Maharashtra eClerx Full time

    About the Role:We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep expertise in SQL, Snowflake, Looker, and Google Cloud Platform (GCP), paired with strong analytical and stakeholder management skills. This role will...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Jet2 Travel Technologies Pvt Ltd. Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Job Title –Senior Developer - Data EngineeringJob Type –Permanent Relevant Experience – 7+yearsof experience in the field of Datawarehouse, Data Engineering, Big Data, Cloud & Analytics, Data VisualizationReports into –Team Lead - Data EngineeringJob Description:We, at Jet2 (UK's third largest airlines and the largest tour operator), have set up a...

  • Senior Data Engineer

    3 days ago

    Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior Data EngineerSenior Data EngineersBuild and maintain data pipelines to support AI initiatives. Ensure data quality, integrity, and availability.Design and build ETL/ELT pipelinesSQL/NoSQL, Spark/Kafka, Airflow, ETL/ELT pipeline development; data governance, schema enforcementVector databases (Milvus, Pinecone), data lineage toolsDesign and build...

  • Senior Data Analyst

    3 days ago

    Pune, Maharashtra, India Hevo Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Hevo: Hevo ) is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics. Hevo powers data analytics for 2000+ data-driven companies across multiple industry verticals, including , Postman, ThoughtSpot, Jawa Motorcycles. By automating complex data...

  • Senior Data Engineer

    1 week ago

    Pune, Maharashtra, India Real Jobs Consulting Services Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Company DescriptionReal Jobs Consulting Services is a reputable firm in the placement domain of Gurgaon, known for providing high-class placement services. Our services include HR consultancy, placement consultancy, manpower recruitment, domestic placement, career consultancy, and work at home services. Our team of expert consultants leverages the business...

  • Senior Data Engineer

    3 days ago

    Pune, Maharashtra, India Cortex Consultants Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Data Engineer (Snowflake, Azure/AWS, Hadoop, Hive, Python, Databases) Experience: 5 to 8 years Location: Pune and Chennai, India Job Description: We are seeking an experienced and talented Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data...

  • Senior Data Engineer

    3 days ago

    Pune, Maharashtra, India TalentXo Full time ₹ 14,08,000 - ₹ 17,92,000 per year

    Role & ResponsibilitiesWe are seeking a highly experienced Senior Data Engineer with strong architectural capability, excellent optimisation skills, and deep hands-on experience in modern data platforms. The ideal candidate will have advanced SQL skills, strong expertise in Databricks, and practical experience working across cloud environments such as AWS...

  • Senior Data Engineer

    5 hours ago

    Mumbai, Maharashtra, India, Maharashtra Zeza Technologies Full time

    About Us: Zeza is a vibrant team of programmers, data engineers, and data scientists passionate about innovation. We specialize in using data to drive business growth, solve complex challenges, and optimize operations. Through advanced analytics, AI, and machine learning, we transform raw data into actionable insights, helping businesses make informed...

  • Senior Data Engineer

    5 days ago

    Pune, Maharashtra, India Principal Global Services Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    ResponsibilitiesJob Title: Senior Developer - DataExperience:4-7 yrsRole OverviewWe are looking for a Senior Data Engineer with 5+ years of experience in data engineering to lead the design, development, and maintenance of data architecture and pipelines. The candidate will provide technical leadership, mentor junior engineers, and drive best practices while...