Senior Data Engineer
Found in: Talent IN 2A C2 - 2 weeks ago
Summary :
- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.
- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.
- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable data solutions.
Responsibilities :
- Design, develop, and implement data pipelines for data ingestion, transformation, and loading using Python and Spark/PySpark.
- Optimize Spark jobs for performance and scalability to handle large datasets.
- Utilize working knowledge of Scala or Java with object-oriented principles and design patterns to contribute to complex data processing tasks (if applicable).
- Manage and maintain data pipelines on Hadoop infrastructure.
- Develop and integrate RESTful APIs for data access and consumption.
- Automate data processing workflows using DevOps tools like Git, Maven, Jenkins, or Azure DevOps.
- Apply Agile development methodologies and collaborate effectively with cross-functional teams (data scientists, analysts, developers).
- Troubleshoot and fix performance issues across the codebase and database queries.
- Document data pipelines and processes for maintainability and knowledge sharing.
- Stay up-to-date with the latest advancements in big data technologies and tools.
Qualifications :
- At least 6 years of experience as a Data Engineer or a related role.
- Strong expertise in Python programming and proficiency in Spark/PySpark for large-scale data processing.
- Working knowledge of Scala or Java with object-oriented principles and design patterns (a plus).
- Experience with Linux environments and Hadoop infrastructure.
- Experience working with RESTful APIs for data exchange.
- Familiarity with DevOps tools like Git, Maven, Jenkins, or Azure DevOps.
- Understanding of Agile development methodologies and practices.
- Excellent problem-solving and analytical skills.
- Strong written and verbal communication skills to collaborate effectively with stakeholders.
- Passion for learning and implementing new technologies.
- Ability to thrive in a fast-paced and dynamic environment.
-
Senior Data Engineer
Found in: Whatjobs IN C2 - 1 week ago
Kolkata, India FinArb Consulting Full timeResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software engineeringPrimary responsibilities would include:Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...
-
Senior Data Engineer
Found in: Talent IN 2A C2 - 2 weeks ago
Kolkata, India FinArb Consulting Full timeResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software engineering Primary responsibilities would include: Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...
-
Senior Data Engineer
Found in: Whatjobs IN C2 - 2 weeks ago
kolkata, India FinArb Consulting Full timeResponsibilities We are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software engineering Primary responsibilities would include: Investigate source data systems to build comprehensive data models to serve as Single Source of Truth Design and implement flexible, robust & scalable ETL...
-
Senior Data Engineer
Found in: Appcast Linkedin IN C2 - 2 weeks ago
Greater Kolkata Area, India FinArb Consulting Full timeResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software engineering Primary responsibilities would include: Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...
-
Specialist Data center operations
Found in: Talent IN 2A C2 - 3 weeks ago
Kolkata, India NTT DATA Full timeThe role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...
-
Specialist Data center operations
Found in: Appcast Linkedin IN C2 - 3 weeks ago
Kolkata, India NTT DATA Full timeThe role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...
-
Senior Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Bangalore/Kolkata/Pune, IN Nilasu consulting Full timeSummary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...
-
Senior Data Engineer
Found in: Whatjobs IN C2 - 2 weeks ago
Bangalore,Kolkata,Pune, India Nilasu consulting Full timeSummary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...
-
Senior Process Engineer
Found in: Whatjobs IN C2 - 3 weeks ago
Kolkata, India Gem Drytech Systems LLP Full timeCompany Description GEM Drytech Systems LLP is a leading industrial dryer manufacturing company based in Kolkata, India. The company is committed to providing a wide array of products, including food and chemical dryers, blanchers. With an extended supply chain and an experienced sales team, GEM Drytech Systems exports its products to countries all over the...
-
Senior Principal Consultant
Found in: Whatjobs IN C2 - 23 hours ago
Kolkata, India Genpact Full timeA Data Architectwho can design and implement data modernization solutions in the cloud is responsible for developing and implementing data architecture strategies for organizations transitioning their data systems to the cloud. They collaborate with stakeholders to understand business requirements and translate them into scalable, secure, and high-performing...
-
Senior DevOps Engineer
Found in: Whatjobs IN C2 - 1 week ago
Kolkata, India Indus Net Technologies Ltd Full timeWe are looking for a Senior DevOps Engineer to manage the software development process and create an automated delivery pipeline that assists in building software more efficiently. The responsibilities of a DevOps Engineer include assessing, supporting, and implementing high-quality information technology architecture.Responsibilities:1. Build & Release...
-
Software Engineer-Data Engineer
Found in: Whatjobs IN C2 - 2 weeks ago
Kolkata, India CliniSys Full timeEssential FunctionsExtract data from on-prem databases using appropriate tools and techniques.Transform and clean the data to ensure its suitability for PowerBI analysis.Build and maintain data pipelines for regular data refresh in PowerBI.Monitor and maintain Azure Synapse pipelines for on-prem data extraction and transformation.Collaborate with analysts to...
-
Senior Specialist
Found in: beBee S IN - 4 weeks ago
Kolkata - MT, India LTIMindtree Full time" Analyze the existing data models and identify the relations.""Bachelor’s Degree in Computer Science or a related discipline• 5+ years of applicable engineering experience• Experience in GCP, Big Query""Bachelor’s Degree in Computer Science or a related discipline• 5+ years of applicable engineering...
-
Senior Project Engineer
Found in: beBee jobs IN - 3 weeks ago
Kolkata, West Bengal, India ABB Full timeSenior Project Engineer - Metals ProcessTake your next career step at ABB with a global team that is energizing the transformation of society and industry to achieve a more productive, sustainable future.At ABB, we have the clear goal of driving diversity and inclusion across all dimensions: gender, LGBTQ+, abilities, ethnicity and generations. Together, we...
-
Position-97-Senior Software Engineer
Found in: Whatjobs IN C2 - 1 week ago
Kolkata, India Client of Estalvis Advisors Private Limited Full timeJob Title: Senior Software EngineerLocation : KolkataCTC: 14 LacsJob Description :We are seeking a talented Senior Software Engineer to join an innovative team. The ideal candidate will have a strong background in object-oriented web development, along with expertise in object-oriented architecture and design (OOAD) with primary development skills in PHP,...
-
Position-97-Senior Software Engineer
Found in: Talent IN 2A C2 - 1 week ago
Kolkata, India Client of Estalvis Advisors Private Limited Full timeJob Title: Senior Software Engineer Location: KolkataCTC: 14 Lacs Job Description:We are seeking a talented Senior Software Engineer to join an innovative team. The ideal candidate will have a strong background in object-oriented web development, along with expertise in object-oriented architecture and design (OOAD) with primary development skills in PHP,...
-
Senior Data Analyst
Found in: Whatjobs IN C2 - 2 weeks ago
kolkata, India Energy Aspects Ltd Full timeEnergy Aspects currently have an exciting opportunity available for a Senior Data Analyst to join the Data team, based out of our Kolkata office, dedicated to supporting our energy research desks. The role will play a central role in the build-out of our data offerings and key databases. You will be required to quickly take on an array of responsibilities...
-
Senior Data Analyst
Found in: Talent IN C2 - 3 weeks ago
Kolkata, India Energy Aspects Ltd Full timeEnergy Aspects currently have an exciting opportunity available for a Senior Data Analyst to join the Data team, based out of our Kolkata office, dedicated to supporting our energy research desks.The role will play a central role in the build-out of our data offerings and key databases. You will be required to quickly take on an array of responsibilities and...
-
Senior DevOps Engineer
Found in: Whatjobs IN C2 - 2 weeks ago
kolkata, India Indus Net Technologies Ltd Full timeWe are looking for a Senior DevOps Engineer to manage the software development process and create an automated delivery pipeline that assists in building software more efficiently. The responsibilities of a DevOps Engineer include assessing, supporting, and implementing high-quality information technology architecture. Responsibilities: 1. Build & Release...
-
Senior DevOps Engineer
Found in: Talent IN C2 - 2 weeks ago
Kolkata, India Indus Net Technologies Ltd Full timeWe are looking for a Senior DevOps Engineer to manage the software development process and create an automated delivery pipeline that assists in building software more efficiently. The responsibilities of a DevOps Engineer include assessing, supporting, and implementing high-quality information technology architecture. Responsibilities:1. Build & Release...