Senior Data Engineer

4 weeks ago


BangaloreKolkataPune, India Nilasu consulting Full time

Summary :

- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.

- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.

- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable data solutions.

Responsibilities :

- Design, develop, and implement data pipelines for data ingestion, transformation, and loading using Python and Spark/PySpark.

- Optimize Spark jobs for performance and scalability to handle large datasets.

- Utilize working knowledge of Scala or Java with object-oriented principles and design patterns to contribute to complex data processing tasks (if applicable).

- Manage and maintain data pipelines on Hadoop infrastructure.

- Develop and integrate RESTful APIs for data access and consumption.

- Automate data processing workflows using DevOps tools like Git, Maven, Jenkins, or Azure DevOps.

- Apply Agile development methodologies and collaborate effectively with cross-functional teams (data scientists, analysts, developers).

- Troubleshoot and fix performance issues across the codebase and database queries.

- Document data pipelines and processes for maintainability and knowledge sharing.

- Stay up-to-date with the latest advancements in big data technologies and tools.

Qualifications :

- At least 6 years of experience as a Data Engineer or a related role.

- Strong expertise in Python programming and proficiency in Spark/PySpark for large-scale data processing.

- Working knowledge of Scala or Java with object-oriented principles and design patterns (a plus).

- Experience with Linux environments and Hadoop infrastructure.

- Experience working with RESTful APIs for data exchange.

- Familiarity with DevOps tools like Git, Maven, Jenkins, or Azure DevOps.

- Understanding of Agile development methodologies and practices.

- Excellent problem-solving and analytical skills.

- Strong written and verbal communication skills to collaborate effectively with stakeholders.

- Passion for learning and implementing new technologies.

- Ability to thrive in a fast-paced and dynamic environment.

(ref:hirist.tech)

  • Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Senior Data Engineer

    2 weeks ago


    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    1 month ago


    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...


  • bangalore, India Abha Engineer Full time

    We are looking for a Senior Mechanical EngineerRoles are described below.1. Manpower Planning.2. Preparing of Project Cost.3. Schedule wise work execution.4. As Drawing & quality work execution.5. Client & Third Party Manage.6. Working Team Manage & Review.7. Reporting to Management.8. ROB & FOB Fabrication & Erection Work Knowledge.

  • Senior Data Scientist

    2 weeks ago


    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based...

  • Senior Data Scientist

    1 month ago


    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    2 weeks ago


    bangalore, India Giant Eagle GCC Full time

    Sr Data Engineer Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest food...

  • Senior Data Engineer

    2 weeks ago


    Pune, India timesjobs Full time

    Senior Data EngineerPosition: Senior Data EngineerExperience: 8 yearsJob Location: PuneSkills Required:Developing, maintaining, and documenting reliable and scalable data infrastructure and data products in complex environmentsDevelopment experience in one or more object-oriented programming languages (e.g., Py-spark, Python, Java, C )Experience of working...

  • Senior Data Engineer

    3 weeks ago


    Kolkata, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineeringPrimary responsibilities would include:Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India timesjobs Full time

    Senior Data EngineerPosition: Senior Data EngineerExperience: 8 yearsJob Location: PuneSkills Required:Developing, maintaining, and documenting reliable and scalable data infrastructure and data products in complex environmentsDevelopment experience in one or more object-oriented programming languages (e.g., Py-spark, Python, Java, C )Experience of working...

  • Senior Data Engineer

    4 weeks ago


    Pune, India Siemens Energy Full time

    Senior Data EngineerAbout the RoleLocationIndia Maharashtra Pune Company Siemens Energy Industrial Turbomachinery India Private Limited Organization Transformation of Industry Business Unit Compression Full / Part time Full-time Experience Level Mid-level Professional Profile Overview: Title: Senior Data Engineer Location: Pune, India Role Description:...

  • Senior Data Engineer

    4 weeks ago


    Pune, India Lear Full time

    Job Description: Senior Data Engineer (Palantir Foundry)As aSenior Data Engineerat Lear, you will take a leadership role in designing, building, and maintaining robust data pipelines within the Foundry platform. Your expertise will drive the seamless integration of data and analytics, ensuring high-quality datasets and supporting critical decision-making...

  • Senior Data Engineer

    1 month ago


    pune, India Siemens Energy Full time

    Senior Data Engineer About the Role Location India Maharashtra Pune Company Siemens Energy Industrial Turbomachinery India Private Limited Organization Transformation of Industry Business Unit Compression Full / Part time Full-time Experience Level Mid-level Professional Profile Overview: Title: Senior Data Engineer Location: Pune,...

  • Senior Data Engineer

    1 month ago


    Pune, India Siemens Energy Full time

    Senior Data Engineer About the Role Location India Maharashtra Pune Company Siemens Energy Industrial Turbomachinery India Private Limited Organization Transformation of Industry Business Unit Compression Full / Part time Full-time Experience Level Mid-level Professional Profile Overview: Title: Senior Data Engineer Location: Pune, India Role...

  • Senior Data Engineer

    2 weeks ago


    Pune, India Procore Technologies Full time

    Job DescriptionWe are looking for a highly skilled and experiencedSenior Data Engineerto join our team and help us build and maintain an advanced data platform designed to facilitate data-driven decision-making in the construction industry. TheSenior Data Engineerintegrates data from multiple sources, including third parties, to provide a unified and...


  • bangalore, India Dexian India Full time

    Job Description:We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in data engineering, ETL processes, dashboarding, and data warehousing, with a focus on building high-quality, high-volume data pipelines. If you are passionate about leveraging data to drive...

  • Senior Data Engineer

    1 month ago


    pune, India Lear Full time

    Job Description: Senior Data Engineer (Palantir Foundry) As a Senior Data Engineer at Lear, you will take a leadership role in designing, building, and maintaining robust data pipelines within the Foundry platform. Your expertise will drive the seamless integration of data and analytics, ensuring high-quality datasets and supporting critical...

  • Senior Data Engineer

    1 month ago


    Pune, India Lear Full time

    Job Description: Senior Data Engineer (Palantir Foundry) As a Senior Data Engineer at Lear, you will take a leadership role in designing, building, and maintaining robust data pipelines within the Foundry platform. Your expertise will drive the seamless integration of data and analytics, ensuring high-quality datasets and supporting critical decision-making...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Kolkata/Pune, IN Nilasu consulting Full time

    Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

  • Senior Data Engineer

    1 month ago


    bangalore, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...