Senior Data Engineer

3 weeks ago

Kolkata, India Nilasu consulting Full time

Summary :

- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.

- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.

- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable data solutions.

Responsibilities :

- Design, develop, and implement data pipelines for data ingestion, transformation, and loading using Python and Spark/PySpark.

- Optimize Spark jobs for performance and scalability to handle large datasets.

- Utilize working knowledge of Scala or Java with object-oriented principles and design patterns to contribute to complex data processing tasks (if applicable).

- Manage and maintain data pipelines on Hadoop infrastructure.

- Develop and integrate RESTful APIs for data access and consumption.

- Automate data processing workflows using DevOps tools like Git, Maven, Jenkins, or Azure DevOps.

- Apply Agile development methodologies and collaborate effectively with cross-functional teams (data scientists, analysts, developers).

- Troubleshoot and fix performance issues across the codebase and database queries.

- Document data pipelines and processes for maintainability and knowledge sharing.

- Stay up-to-date with the latest advancements in big data technologies and tools.

Qualifications :

- At least 6 years of experience as a Data Engineer or a related role.

- Strong expertise in Python programming and proficiency in Spark/PySpark for large-scale data processing.

- Working knowledge of Scala or Java with object-oriented principles and design patterns (a plus).

- Experience with Linux environments and Hadoop infrastructure.

- Experience working with RESTful APIs for data exchange.

- Familiarity with DevOps tools like Git, Maven, Jenkins, or Azure DevOps.

- Understanding of Agile development methodologies and practices.

- Excellent problem-solving and analytical skills.

- Strong written and verbal communication skills to collaborate effectively with stakeholders.

- Passion for learning and implementing new technologies.

- Ability to thrive in a fast-paced and dynamic environment.

(ref:hirist.tech)

  • Senior Engineer

    7 hours ago

    kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...

  • Senior Associate Specialist

    4 days ago

    Kolkata, India NTT DATA Full time

    Job Description Want to be a part of our team?The Senior Associate Critical Facilities Operations and Maintenance Engineer is a developing role and is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This role helps to design, plan, install, and /...

  • Senior Engineer

    3 weeks ago

    Kolkata, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Senior Engineer

    3 weeks ago

    kolkata, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help...

  • Senior Engineer

    4 weeks ago

    Kolkata, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Senior Engineer

    4 weeks ago

    kolkata, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help...

  • Senior Engineer

    4 days ago

    Kolkata, India NTT DATA Full time

    Job DescriptionWant to be a part of our team?Provides technical support to field engineers, technicians, and product support personnel who are diagnosing, troubleshooting, repairing, and debugging complex electro/mechanical equipment, computer systems, complex software, or networked and/or wireless systems.Responds to situations where first-line product...

  • Senior Engineer

    4 days ago

    kolkata, India NTT DATA Full time

    Job Description Want to be a part of our team? Provides technical support to field engineers, technicians, and product support personnel who are diagnosing, troubleshooting, repairing, and debugging complex electro/mechanical equipment, computer systems, complex software, or networked and/or wireless systems.Responds to situations where first-line...

  • Principal Consultant-Data Bricks Senior Engineer

    4 weeks ago

    Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Senior Data Integration Engineer

    1 month ago

    Kolkata, India LIN Lexmark Int'l India Pvt. Ltd. Full time

    Description/Responsibilities:The candidate will work in Global IT as a Senior Data Integration Engineer will be responsible for collaborating with global business users and other IT teams. The candidate is expected to understand key business objectives and IT delivery capabilities to provide fully integrated solutions in cloud Platform. The candidate will...

  • Senior Data Integration Engineer

    5 days ago

    Kolkata, West Bengal, India LIN Lexmark Int'l India Pvt. Ltd. Full time

    /Responsibilities:The candidate will work in Global IT as a Senior Data Integration Engineer will be responsible for collaborating with global business users and other IT teams. The candidate is expected to understand key business objectives and IT delivery capabilities to provide fully integrated solutions in cloud Platform. The candidate will take the lead...

  • Senior Data Integration Engineer

    6 days ago

    Kolkata, West Bengal, India LIN Lexmark Int'l India Pvt. Ltd. Full time

    Description /Responsibilities: The candidate will work in Global IT as a Senior Data Integration Engineer will be responsible for collaborating with global business users and other IT teams. The candidate is expected to understand key business objectives and IT delivery capabilities to provide fully integrated solutions in cloud Platform. The candidate...

  • Senior Data Integration Engineer

    1 month ago

    kolkata, India LIN Lexmark Int'l India Pvt. Ltd. Full time

    Description /Responsibilities: The candidate will work in Global IT as a Senior Data Integration Engineer will be responsible for collaborating with global business users and other IT teams. The candidate is expected to understand key business objectives and IT delivery capabilities to provide fully integrated solutions in cloud Platform. The...

  • Senior Data Integration Engineer

    1 month ago

    Kolkata, India LIN Lexmark Int'l India Pvt. Ltd. Full time

    Description /Responsibilities: The candidate will work in Global IT as a Senior Data Integration Engineer will be responsible for collaborating with global business users and other IT teams. The candidate is expected to understand key business objectives and IT delivery capabilities to provide fully integrated solutions in cloud Platform. The candidate...

  • Senior Data Integration Engineer

    3 weeks ago

    kolkata, India LIN Lexmark Int'l India Pvt. Ltd. Full time

    Description /Responsibilities: The candidate will work in Global IT as a Senior Data Integration Engineer will be responsible for collaborating with global business users and other IT teams. The candidate is expected to understand key business objectives and IT delivery capabilities to provide fully integrated solutions in cloud Platform. The...

  • Senior Data Integration Engineer

    3 weeks ago

    Kolkata, India LIN Lexmark Int'l India Pvt. Ltd. Full time

    Description /Responsibilities: The candidate will work in Global IT as a Senior Data Integration Engineer will be responsible for collaborating with global business users and other IT teams. The candidate is expected to understand key business objectives and IT delivery capabilities to provide fully integrated solutions in cloud Platform. The candidate...

  • Receptionist/ Back-office Executive

    2 weeks ago

    Kolkata, India Glacier Engineer Full time

    **Responsibilities**: - Manage and maintain records and data in an organized and efficient manner - Process paperwork and documentation accurately and in a timely manner - Assist with scheduling appointments and managing calendars - Coordinate with other departments to ensure timely completion of tasks and projects - Perform general office duties such as...

  • Data Engineer

    5 days ago

    Kolkata, West Bengal, India Randstad India Full time

    One of our esteemed clients is looking for a Data Engineer in Bangalore. Responsibilities: Design and automate crucial data pipelines to seamlessly integrate with downstream analytics and production systems. Collaborate with cross-functional teams to incorporate new functionalities into existing data pipelines, including lower test environments for...

  • Senior Software Engineer-Data Engineer

    3 weeks ago

    Kolkata, India CliniSys Full time

    Essential FunctionsExtract data from on-prem databases using appropriate tools and techniques.Transform and clean the data to ensure its suitability for PowerBI analysis.Build and maintain data pipelines for regular data refresh in PowerBI.Monitor and maintain Azure Synapse pipelines for on-prem data extraction and transformation.Collaborate with analysts to...

  • Manager- Data center operations

    5 days ago

    Kolkata, West Bengal, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...