Senior Data Engineer

3 weeks ago


delhi, India Linuxpect Private Limited Full time
We are seeking an experienced and skilled Senior Data Engineer with 5 to 10 years of hands-on experience in building and managing data pipelines and big data infrastructure. The ideal candidate will have a strong technical background in data engineering tools, big data ecosystems, and programming languages. This role will focus on designing, implementing, and optimizing complex data workflows using Apache Airflow, Apache NiFi, Kafka, PySpark, Spark Scala, and other key technologies. Candidates with a strong background in Python, Java, and shell scripting are highly preferred.
Responsibilities
- Design, build, and maintain scalable and reliable data pipelines to support real-time and batch processing requirements.
- Manage, monitor, and optimize workflows in Apache Airflow to ensure data quality and integrity.
- Develop and integrate data flows using Apache NiFi for seamless data ingestion and transformation.
- Work extensively with Apache Kafka for data streaming and messaging across various data sources.
- Implement data processing solutions using PySpark and Spark Scala to handle large-scale datasets and complex transformations.
- Write efficient code in Python and Java to automate data workflows and support data engineering needs.
- Utilize shell scripting for operational tasks and automation within the data environment.
- Collaborate with cross-functional teams to understand data requirements and provide optimized data engineering solutions.
- Ensure data security, compliance, and performance by following best practices in big data and distributed systems.
- Continuously improve the performance, scalability, and reliability of data processing pipelines.
Qualifications
- Experience in cloud environments (AWS, GCP, Azure) with big data components is a plus.
- Experience with version control tools (e.g., Git) and CI/CD practices in data engineering.
- Strong analytical, problem-solving, and communication skills.

  • delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...


  • Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Engineer

    4 weeks ago


    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    **Job Title:** Senior Data Engineer - Databricks Expert**About Eucloid Data Solutions Pvt Ltd**Eucloid Data Solutions Pvt Ltd is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning, and Data engineering. Our team supports various business applications by developing data...

  • Senior Data Engineer

    1 month ago


    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About the Role:Eucloid Data Solutions Pvt Ltd is seeking a highly skilled Senior Data Engineer to join our Data Platform team. The successful candidate will have hands-on expertise in Databricks and will be responsible for designing and building data infrastructure to support various business applications.Key Responsibilities:Design, implementation, and...

  • Senior Data Engineer

    1 month ago


    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About Eucloid Data SolutionsEucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. We offer bespoke, full stack and data-driven approach to solve highly complex and large-scale business problems for some of the biggest Fortune 500...

  • Senior data engineer

    3 weeks ago


    Delhi, India IO Associates - UKEU Full time

    Job Title: Senior Data EngineerLocation: MohaliSalary: up to 30 LPAi O Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, Py Spark, Synapse, ADF, ADLS Gen2, and Azure...

  • Senior Data Engineer

    3 weeks ago


    delhi, India iO Associates - UKEU Full time

    Job Title: Senior Data EngineerLocation: MohaliSalary: up to 30 LPAiO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse, ADF, ADLS Gen2, and Azure...

  • Lead data engineer

    2 weeks ago


    Delhi, India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Senior Data Engineer

    2 weeks ago


    Delhi, Delhi, India Muoro Full time

    Job Title: Senior Data EngineerAbout the Role:We are looking for a skilled Data Engineer to help us build and maintain our data infrastructure. The ideal candidate will have a strong background in data engineering and experience working with AWS data services.Key Responsibilities:Design and build large-scale enterprise data solutions using AWS data...

  • Senior Data Engineer

    2 months ago


    Delhi, India ValueLabs Full time

    Dear Aspirants,We at ValueLabs have an Opening for Senior Azure Data Engineer role. Below is the JD for the same.Role: Sr Data EngineerExperience: 5+ YearsPreferable Immediate JoinersThe Azure Data Engineer is responsible for the design, development, and maintenance of data pipelines, data warehouses, and data lakes for the organization. This role requires...

  • Senior Data Engineer

    3 weeks ago


    delhi, India Varcus infinity Full time

    Job Title: Senior Data EngineerLocation: India (Permanent Work From Home)Salary: ₹30 - ₹40 LPA (flexible for exceptional candidates based on experience)Experience Level: Minimum 5 years, with preference for candidates with e-commerce experience(Note: Candidate must be available to work in PST time zone and able to join within a month.)About the Role:We...

  • AWS Data Engineer

    3 weeks ago


    delhi, India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 weeks ago


    delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    3 months ago


    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • Senior Data Engineer

    3 weeks ago


    Delhi, Delhi, India TVARIT Full time

    About UsTVARIT GmbH is a renowned developer of innovative solutions in the field of artificial intelligence (AI) for the manufacturing, automotive, and process industries. Our software products empower our customers to make informed decisions, for instance, in predictive maintenance, OEE optimization, and quality prediction. We have a strong portfolio of...

  • Senior Data Engineer

    3 weeks ago


    delhi, India Synechron Full time

    Good-day,We have an immediate opportunity for the Senior Data EngineerJob Role: Senior Data EngineerJob Location: Bangalore BCITExperience- 7 to 10 yearsNotice : upto 15 Days .About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to...

  • Senior data engineer

    3 weeks ago


    Delhi, India Synechron Full time

    Good-day,We have an immediate opportunity for the Senior Data EngineerJob Role: Senior Data EngineerJob Location: Bangalore BCITExperience- 7 to 10 yearsNotice : upto 15 Days.About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to...


  • Delhi, Delhi, India Interspence Solutions Full time

    About the Job :Company Overview :We are Interspence Solutions, a leading IT consulting and support services provider in the manufacturing and process industry. We have entered into a long-term contract with a Major US-based Oil & Gas company to provide skilled IT resources and services under their IT leadership team direction.We are transforming our business...