Data Engineer
3 months ago
Location :- Gurgaon / Bangalore
Notice :- Immediate Joiners Only
Skills:- AWS , Spark , Python , Glue , S3 , Redshift etc..
Experience:- 4+ Years
Position Overview:
We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with AWS Glue, Apache Airflow, Kafka, SQL, Python and DataOps tools and technologies. Knowledge of SAP HANA & Snowflake is a plus. This role is critical for designing, developing, and maintaining our client’s data pipeline architecture, ensuring the efficient and reliable flow of data across the organization.
Key Responsibilities:
Design, Develop, and Maintain Data Pipelines:Develop robust and scalable data pipelines using AWS Glue, Apache Airflow, and other relevant technologies.Integrate various data sources, including SAP HANA, Kafka, and SQL databases, to ensure seamless data flow and processing.Optimize data pipelines for performance and reliability.Data Management and Transformation:Design and implement data transformation processes to clean, enrich, and structure data for analytical purposes.Utilize SQL and Python for data extraction, transformation, and loading (ETL) tasks.Ensure data quality and integrity through rigorous testing and validation processes.Collaboration and Communication:Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs.Collaborate with cross-functional teams to implement DataOps practices and improve data life cycle management.Monitoring and Optimization:Monitor data pipeline performance and implement improvements to enhance efficiency and reduce latency.Troubleshoot and resolve data-related issues, ensuring minimal disruption to data workflows.Implement and manage monitoring and alerting systems to proactively identify and address potential issues.Documentation and Best Practices:Maintain comprehensive documentation of data pipelines, transformations, and processes.Adhere to best practices in data engineering, including code versioning, testing, and deployment procedures.Stay up-to-date with the latest industry trends and technologies in data engineering and DataOps.
Required Skills and Qualifications:
Technical Expertise:Extensive experience with AWS Glue for data integration and transformation.Proficient in Apache Airflow for workflow orchestration.Strong knowledge of Kafka for real-time data streaming and processing.Advanced SQL skills for querying and managing relational databases.Proficiency in Python for scripting and automation tasks.Experience with SAP HANA for data storage and management.Familiarity with Data Ops tools and methodologies for continuous integration and delivery in data engineering.Preferred Skills:Knowledge of Snowflake for cloud-based data warehousing solutions.Experience with other AWS data services such as Redshift, S3, and Athena.Familiarity with big data technologies such as Hadoop, Spark, and Hive.Soft Skills:Strong analytical and problem-solving skills.Excellent communication and collaboration abilities.Detail-oriented with a commitment to data quality and accuracy.Ability to work independently and manage multiple projects simultaneously.
-
Data Engineer
2 weeks ago
Delhi, India Pacific Data Integrators Full timeJob OverviewWe are seeking a skilledData Engineerto join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in MS...
-
Data Engineer
2 weeks ago
Delhi, India Pacific Data Integrators Full timeJob OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...
-
ITI Data | PySpark Data Engineer
3 weeks ago
delhi, India ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark...
-
Pyspark data engineer
3 weeks ago
Delhi, India ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a Py Spark...
-
PySpark Data Engineer
3 weeks ago
Delhi, India ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark...
-
Data Platform Engineer
3 weeks ago
Delhi, India OSD Data Services Full timeData Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
Data platform engineer
3 weeks ago
Delhi, India OSD Data Services Full timeData Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...
-
Data Platform Engineer
3 weeks ago
Delhi, India OSD Data Services Full timeData Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
Pacific Data Integrators | Data Engineer
11 hours ago
delhi, India Pacific Data Integrators Full timeJob OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...
-
AWS Data Engineer
4 months ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
2 months ago
delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
Aws data engineer
2 months ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
ITI Data | PySpark Data Engineer
3 weeks ago
Delhi, India ITI Data Full timeLocation:IndiaType: Full-timeExperience: 10 – 13 yearsFunctions: Consulting, Finance, Information Technology, Big Data EngineeringIndustries: Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions developer...
-
PySpark Data Engineer
3 weeks ago
Delhi, India ITI Data Full timeLocation:IndiaType: Full-timeExperience: 10 – 13 yearsFunctions: Consulting, Finance, Information Technology, Big Data EngineeringIndustries: Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions developer...
-
Delhi, India OSD Data Services Full timeData Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
Data Engineer
2 weeks ago
Delhi, Delhi, India Pacific Data Integrators Full timePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. This role involves designing and optimizing data pipelines, ensuring seamless movement of data across systems, and supporting data initiatives with strong technical expertise.
-
Data Unveil | Quality Assurance Engineer
3 weeks ago
delhi, India Data Unveil Full timeAbout us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success.Position Title: QA...
-
Data Unveil | Quality Assurance Engineer
3 weeks ago
Delhi, India Data Unveil Full timeAbout us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success.Position Title: QA...
-
Data Dynamics | Storage Solutions Architect
3 weeks ago
delhi, India Data Dynamics Full timeCompany Description Data Dynamics is a global leader in enterprise data management, focusing on Digital Trust and Data Democracy. Trusted by over 300 organizations, including 25% of the Fortune 20, Data Dynamics is committed to creating a transparent, unified, and empowered data ecosystem. The company's AI-powered self-service data management software...
-
Delhi, India Anicca Data Science Solutions Full timeJob descriptionAnicca Data is seeking a motivated Software Engineer who is eager to tackle complex challenges and apply their skills to innovative solutions. This role will primarily focus on developing code to manage large-scale data and working with intricate data structures. The successful candidate will contribute to existing codebases or create...
