Senior Data Engineer
3 weeks ago
Responsibilities
- Design, build, and maintain scalable and reliable data pipelines to support real-time and batch processing requirements.
- Manage, monitor, and optimize workflows in Apache Airflow to ensure data quality and integrity.
- Develop and integrate data flows using Apache NiFi for seamless data ingestion and transformation.
- Work extensively with Apache Kafka for data streaming and messaging across various data sources.
- Implement data processing solutions using PySpark and Spark Scala to handle large-scale datasets and complex transformations.
- Write efficient code in Python and Java to automate data workflows and support data engineering needs.
- Utilize shell scripting for operational tasks and automation within the data environment.
- Collaborate with cross-functional teams to understand data requirements and provide optimized data engineering solutions.
- Ensure data security, compliance, and performance by following best practices in big data and distributed systems.
- Continuously improve the performance, scalability, and reliability of data processing pipelines.
Qualifications
- Experience in cloud environments (AWS, GCP, Azure) with big data components is a plus.
- Experience with version control tools (e.g., Git) and CI/CD practices in data engineering.
- Strong analytical, problem-solving, and communication skills.
-
delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
2 days ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
2 days ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...
-
Senior data integration engineer
11 hours ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Engineer
4 weeks ago
Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time**Job Title:** Senior Data Engineer - Databricks Expert**About Eucloid Data Solutions Pvt Ltd**Eucloid Data Solutions Pvt Ltd is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning, and Data engineering. Our team supports various business applications by developing data...
-
Senior Data Engineer
1 month ago
Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full timeAbout the Role:Eucloid Data Solutions Pvt Ltd is seeking a highly skilled Senior Data Engineer to join our Data Platform team. The successful candidate will have hands-on expertise in Databricks and will be responsible for designing and building data infrastructure to support various business applications.Key Responsibilities:Design, implementation, and...
-
Senior Data Engineer
1 month ago
Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full timeAbout Eucloid Data SolutionsEucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. We offer bespoke, full stack and data-driven approach to solve highly complex and large-scale business problems for some of the biggest Fortune 500...
-
Senior data engineer
3 weeks ago
Delhi, India IO Associates - UKEU Full timeJob Title: Senior Data EngineerLocation: MohaliSalary: up to 30 LPAi O Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, Py Spark, Synapse, ADF, ADLS Gen2, and Azure...
-
Senior Data Engineer
3 weeks ago
delhi, India iO Associates - UKEU Full timeJob Title: Senior Data EngineerLocation: MohaliSalary: up to 30 LPAiO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse, ADF, ADLS Gen2, and Azure...
-
Lead data engineer
2 weeks ago
Delhi, India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Senior Data Engineer
2 weeks ago
Delhi, Delhi, India Muoro Full timeJob Title: Senior Data EngineerAbout the Role:We are looking for a skilled Data Engineer to help us build and maintain our data infrastructure. The ideal candidate will have a strong background in data engineering and experience working with AWS data services.Key Responsibilities:Design and build large-scale enterprise data solutions using AWS data...
-
Senior Data Engineer
2 months ago
Delhi, India ValueLabs Full timeDear Aspirants,We at ValueLabs have an Opening for Senior Azure Data Engineer role. Below is the JD for the same.Role: Sr Data EngineerExperience: 5+ YearsPreferable Immediate JoinersThe Azure Data Engineer is responsible for the design, development, and maintenance of data pipelines, data warehouses, and data lakes for the organization. This role requires...
-
Senior Data Engineer
3 weeks ago
delhi, India Varcus infinity Full timeJob Title: Senior Data EngineerLocation: India (Permanent Work From Home)Salary: ₹30 - ₹40 LPA (flexible for exceptional candidates based on experience)Experience Level: Minimum 5 years, with preference for candidates with e-commerce experience(Note: Candidate must be available to work in PST time zone and able to join within a month.)About the Role:We...
-
AWS Data Engineer
3 weeks ago
delhi, India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 weeks ago
delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
3 months ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
Senior Data Engineer
3 weeks ago
Delhi, Delhi, India TVARIT Full timeAbout UsTVARIT GmbH is a renowned developer of innovative solutions in the field of artificial intelligence (AI) for the manufacturing, automotive, and process industries. Our software products empower our customers to make informed decisions, for instance, in predictive maintenance, OEE optimization, and quality prediction. We have a strong portfolio of...
-
Senior Data Engineer
3 weeks ago
delhi, India Synechron Full timeGood-day,We have an immediate opportunity for the Senior Data EngineerJob Role: Senior Data EngineerJob Location: Bangalore BCITExperience- 7 to 10 yearsNotice : upto 15 Days .About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to...
-
Senior data engineer
3 weeks ago
Delhi, India Synechron Full timeGood-day,We have an immediate opportunity for the Senior Data EngineerJob Role: Senior Data EngineerJob Location: Bangalore BCITExperience- 7 to 10 yearsNotice : upto 15 Days.About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to...
-
Senior Data Engineer
6 days ago
Delhi, Delhi, India Interspence Solutions Full timeAbout the Job :Company Overview :We are Interspence Solutions, a leading IT consulting and support services provider in the manufacturing and process industry. We have entered into a long-term contract with a Major US-based Oil & Gas company to provide skilled IT resources and services under their IT leadership team direction.We are transforming our business...