Data Engineer
2 weeks ago
Key Deliverables :
1. Implement data ingestion processes to extract data from various sources, including databases, APIs, and streaming platforms.
2. Develop and maintain Extract, Transform, Load (ETL) pipelines using AWS Glue, AWS Lambda, or custom scripts.
3. Perform data cleansing activity such as removing spaces, upper/lower, drop duplicate data, Renaming columns, etc.
4. Data Transformation with PySpark, Python and SQL.
5. Configure and optimize storage systems such as Amazon S3, Amazon Redshift, or Amazon DynamoDB to meet performance, scalability, and cost requirements.
6. Performance tuning of long running PySpark or SQL queries.
7. Monitor data pipelines, storage systems, and processing jobs to identify performance bottlenecks, data quality issues, and potential failures.
8. Optimize data processing workflows and infrastructure configurations to improve performance, reliability, and cost efficiency.
Role Requirements :
1. Bachelor's degree in Computer Science, Information Technology, or a related field.
2. Proven experience of 3+ years Data Engineer, preferably with hands-on experience in designing and implementing data solutions on AWS/Azure
3. Knowledge of Technical Skills such as PySpark, Python, SQL, AWS data Services (Glue, S3, EMR, Lambda and Redshift)
4. Good to have data visualization experience using python or any BI tools.
5. Strong knowledge of data security and compliance frameworks (e.g., GDPR, HIPAA) and implementation on AWS
-
Data Engineer
3 days ago
mumbai, India SparkNet Innovations Full timeCompany DescriptionSparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in data engineering, AI consulting, and advanced data science, SparkNet transforms...
-
Data Engineer
3 days ago
Mumbai, India SparkNet Innovations Full timeCompany Description SparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in data engineering, AI consulting, and advanced data science, SparkNet transforms...
-
Data Engineer
3 days ago
Mumbai, India SparkNet Innovations Full timeCompany Description SparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in data engineering, AI consulting, and advanced data science, SparkNet transforms...
-
Data Engineer
3 days ago
mumbai, India SparkNet Innovations Full timeCompany Description SparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in data engineering, AI consulting, and advanced data science, SparkNet transforms...
-
Data Engineer
6 days ago
Mumbai, India Newfold Digital Full timeData EngineerJOB DESCRIPTIONNewfold Digital is looking for a seasoned Data Engineer. This role will participate in all aspects of the development lifecycle, from scoping and requirements to solutioning, implementation and support. The ideal candidate would have extensive experience developing and supporting a DW service comprised of multiple Data Warehouses...
-
Data Engineer
4 weeks ago
Mumbai, India Antal International Full timeJob DescriptionData Engineer Job Responsibilities:· Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.· Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering...
-
Data Engineer
4 weeks ago
Mumbai, India Searce Technologies Inc Full timeabout the roleData Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions.key responsibilitiesAs a Data Engineer, you are a full-stack data engineer that...
-
Data Engineer
1 month ago
mumbai, India Antal International Full timeJob Description Data Engineer Job Responsibilities: · Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity. · Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and...
-
Data Engineer
1 month ago
Mumbai, India Searce Technologies Inc Full timeabout the role Data Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions. key responsibilities As a Data Engineer, you are a full-stack...
-
Data Engineer
1 month ago
mumbai, India Searce Technologies Inc Full timeabout the role Data Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions. key responsibilities As a Data Engineer, you are a...
-
Data Engineer
1 week ago
Mumbai, India Newfold Digital Full timeData Engineer JOB DESCRIPTION Newfold Digital is looking for a seasoned Data Engineer. This role will participate in all aspects of the development lifecycle, from scoping and requirements to solutioning, implementation and support. The ideal candidate would have extensive experience developing and supporting a DW service comprised of multiple Data...
-
Data Engineer
1 week ago
mumbai, India Newfold Digital Full timeData Engineer JOB DESCRIPTION Newfold Digital is looking for a seasoned Data Engineer. This role will participate in all aspects of the development lifecycle, from scoping and requirements to solutioning, implementation and support. The ideal candidate would have extensive experience developing and supporting a DW service comprised of multiple Data...
-
Data Engineer
4 weeks ago
Mumbai, India Puma Energy Full timeMain Purpose:Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake.Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make well-informed...
-
Data Engineer
1 month ago
mumbai, India Anicalls (Pty) Ltd Full timeCandidate should have: Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborate Strong experience in CICD technologies including Python, SQL, Airflow, and Git in a cloud setting Understanding of ELK stack is a plus for logging and reporting purposes...
-
Data Engineer
1 month ago
Mumbai, India Puma Energy Full timeMain Purpose: Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake. Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make well-informed...
-
Data Engineer
1 month ago
mumbai, India Puma Energy Full timeMain Purpose: Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake.Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make...
-
Data Engineer
2 weeks ago
mumbai, India Virtusa Full timeData Engineer - CREQ187220 Description 6-8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security...
-
Data Engineer
2 weeks ago
Mumbai, India Virtusa Full timeData Engineer - CREQ187220 Description 6-8 years of relevant work experience showing growth as a Data Engineer. Hands On programming experience Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. Experience of performance optimization in Batch and Real time processing applications Expertise in Data Governance and Data Security...
-
Data Engineer
2 weeks ago
navi mumbai, India Manufacturing MNC Full timeLocation-Navi Mumbai- PreferredBangaloreRequirement-Looking for Data Engineer with SAP experience3-5 years of ExperienceBachelors or master's in technology or engineeringStrong knowledge on Data Engineering aspectsImplementing methods to improve data reliability and quality.Combining raw information from different sources to create consistent and...
-
Data Engineer
4 weeks ago
Mumbai, India The Nielsen Company Full timeAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...