Senior Data Engineer

Found in: Talent IN 2A C2 - 2 weeks ago


Kolkata, India Nilasu consulting Full time

Summary :

- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.

- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.

- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable data solutions.

Responsibilities :

- Design, develop, and implement data pipelines for data ingestion, transformation, and loading using Python and Spark/PySpark.

- Optimize Spark jobs for performance and scalability to handle large datasets.

- Utilize working knowledge of Scala or Java with object-oriented principles and design patterns to contribute to complex data processing tasks (if applicable).

- Manage and maintain data pipelines on Hadoop infrastructure.

- Develop and integrate RESTful APIs for data access and consumption.

- Automate data processing workflows using DevOps tools like Git, Maven, Jenkins, or Azure DevOps.

- Apply Agile development methodologies and collaborate effectively with cross-functional teams (data scientists, analysts, developers).

- Troubleshoot and fix performance issues across the codebase and database queries.

- Document data pipelines and processes for maintainability and knowledge sharing.

- Stay up-to-date with the latest advancements in big data technologies and tools.

Qualifications :

- At least 6 years of experience as a Data Engineer or a related role.

- Strong expertise in Python programming and proficiency in Spark/PySpark for large-scale data processing.

- Working knowledge of Scala or Java with object-oriented principles and design patterns (a plus).

- Experience with Linux environments and Hadoop infrastructure.

- Experience working with RESTful APIs for data exchange.

- Familiarity with DevOps tools like Git, Maven, Jenkins, or Azure DevOps.

- Understanding of Agile development methodologies and practices.

- Excellent problem-solving and analytical skills.

- Strong written and verbal communication skills to collaborate effectively with stakeholders.

- Passion for learning and implementing new technologies.

- Ability to thrive in a fast-paced and dynamic environment.

(ref:hirist.tech)
  • Senior Data Engineer

    Found in: Whatjobs IN C2 - 1 week ago


    Kolkata, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineeringPrimary responsibilities would include:Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...

  • Senior Data Engineer

    Found in: Talent IN 2A C2 - 2 weeks ago


    Kolkata, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineering Primary responsibilities would include:   Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...

  • Senior Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago


    kolkata, India FinArb Consulting Full time

    Responsibilities We are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineering   Primary responsibilities would include:     Investigate source data systems to build comprehensive data models to serve as Single Source of Truth Design and implement flexible, robust & scalable ETL...

  • Senior Data Engineer

    Found in: Appcast Linkedin IN C2 - 2 weeks ago


    Greater Kolkata Area, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineering Primary responsibilities would include:   Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...

  • Specialist Data center operations

    Found in: Talent IN 2A C2 - 3 weeks ago


    Kolkata, India NTT DATA Full time

    The role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...

  • Specialist Data center operations

    Found in: Appcast Linkedin IN C2 - 3 weeks ago


    Kolkata, India NTT DATA Full time

    The role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...

  • Senior Data Engineer

    Found in: Adzuna IN C2 - 2 weeks ago


    Bangalore/Kolkata/Pune, IN Nilasu consulting Full time

    Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

  • Senior Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago


    Bangalore,Kolkata,Pune, India Nilasu consulting Full time

    Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

  • Senior Process Engineer

    Found in: Whatjobs IN C2 - 3 weeks ago


    Kolkata, India Gem Drytech Systems LLP Full time

    Company Description GEM Drytech Systems LLP is a leading industrial dryer manufacturing company based in Kolkata, India. The company is committed to providing a wide array of products, including food and chemical dryers, blanchers. With an extended supply chain and an experienced sales team, GEM Drytech Systems exports its products to countries all over the...

  • Senior Principal Consultant

    Found in: Whatjobs IN C2 - 23 hours ago


    Kolkata, India Genpact Full time

    A Data Architectwho can design and implement data modernization solutions in the cloud is responsible for developing and implementing data architecture strategies for organizations transitioning their data systems to the cloud. They collaborate with stakeholders to understand business requirements and translate them into scalable, secure, and high-performing...

  • Senior DevOps Engineer

    Found in: Whatjobs IN C2 - 1 week ago


    Kolkata, India Indus Net Technologies Ltd Full time

    We are looking for a Senior DevOps Engineer to manage the software development process and create an automated delivery pipeline that assists in building software more efficiently. The responsibilities of a DevOps Engineer include assessing, supporting, and implementing high-quality information technology architecture.Responsibilities:1. Build & Release...

  • Software Engineer-Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago


    Kolkata, India CliniSys Full time

    Essential FunctionsExtract data from on-prem databases using appropriate tools and techniques.Transform and clean the data to ensure its suitability for PowerBI analysis.Build and maintain data pipelines for regular data refresh in PowerBI.Monitor and maintain Azure Synapse pipelines for on-prem data extraction and transformation.Collaborate with analysts to...

  • Senior Specialist

    Found in: beBee S IN - 4 weeks ago


    Kolkata - MT, India LTIMindtree Full time

    " Analyze the existing data models and identify the relations.""Bachelor’s Degree in Computer Science or a related discipline• 5+ years of applicable engineering experience• Experience in GCP, Big Query""Bachelor’s Degree in Computer Science or a related discipline• 5+ years of applicable engineering...

  • Senior Project Engineer

    Found in: beBee jobs IN - 3 weeks ago


    Kolkata, West Bengal, India ABB Full time

    Senior Project Engineer - Metals ProcessTake your next career step at ABB with a global team that is energizing the transformation of society and industry to achieve a more productive, sustainable future.At ABB, we have the clear goal of driving diversity and inclusion across all dimensions: gender, LGBTQ+, abilities, ethnicity and generations. Together, we...

  • Position-97-Senior Software Engineer

    Found in: Whatjobs IN C2 - 1 week ago


    Kolkata, India Client of Estalvis Advisors Private Limited Full time

    Job Title: Senior Software EngineerLocation : KolkataCTC: 14 LacsJob Description :We are seeking a talented Senior Software Engineer to join an innovative team. The ideal candidate will have a strong background in object-oriented web development, along with expertise in object-oriented architecture and design (OOAD) with primary development skills in PHP,...

  • Position-97-Senior Software Engineer

    Found in: Talent IN 2A C2 - 1 week ago


    Kolkata, India Client of Estalvis Advisors Private Limited Full time

    Job Title: Senior Software Engineer Location: KolkataCTC: 14 Lacs Job Description:We are seeking a talented Senior Software Engineer to join an innovative team. The ideal candidate will have a strong background in object-oriented web development, along with expertise in object-oriented architecture and design (OOAD) with primary development skills in PHP,...

  • Senior Data Analyst

    Found in: Whatjobs IN C2 - 2 weeks ago


    kolkata, India Energy Aspects Ltd Full time

    Energy Aspects currently have an exciting opportunity available for a Senior Data Analyst to join the Data team, based out of our Kolkata office, dedicated to supporting our energy research desks. The role will play a central role in the build-out of our data offerings and key databases. You will be required to quickly take on an array of responsibilities...

  • Senior Data Analyst

    Found in: Talent IN C2 - 3 weeks ago


    Kolkata, India Energy Aspects Ltd Full time

    Energy Aspects currently have an exciting opportunity available for a Senior Data Analyst to join the Data team, based out of our Kolkata office, dedicated to supporting our energy research desks.The role will play a central role in the build-out of our data offerings and key databases. You will be required to quickly take on an array of responsibilities and...

  • Senior DevOps Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago


    kolkata, India Indus Net Technologies Ltd Full time

    We are looking for a Senior DevOps Engineer to manage the software development process and create an automated delivery pipeline that assists in building software more efficiently. The responsibilities of a DevOps Engineer include assessing, supporting, and implementing high-quality information technology architecture.  Responsibilities: 1. Build & Release...

  • Senior DevOps Engineer

    Found in: Talent IN C2 - 2 weeks ago


    Kolkata, India Indus Net Technologies Ltd Full time

    We are looking for a Senior DevOps Engineer to manage the software development process and create an automated delivery pipeline that assists in building software more efficiently. The responsibilities of a DevOps Engineer include assessing, supporting, and implementing high-quality information technology architecture. Responsibilities:1. Build & Release...