Senior data engineer

2 weeks ago

India Linuxpect Private Limited Full time

We are seeking an experienced and skilled Senior Data Engineer with 5 to 10 years of hands-on experience in building and managing data pipelines and big data infrastructure. The ideal candidate will have a strong technical background in data engineering tools, big data ecosystems, and programming languages. This role will focus on designing, implementing, and optimizing complex data workflows using Apache Airflow, Apache Ni Fi, Kafka, Py Spark, Spark Scala, and other key technologies. Candidates with a strong background in Python, Java, and shell scripting are highly preferred. Responsibilities Design, build, and maintain scalable and reliable data pipelines to support real-time and batch processing requirements. Manage, monitor, and optimize workflows in Apache Airflow to ensure data quality and integrity. Develop and integrate data flows using Apache Ni Fi for seamless data ingestion and transformation. Work extensively with Apache Kafka for data streaming and messaging across various data sources. Implement data processing solutions using Py Spark and Spark Scala to handle large-scale datasets and complex transformations. Write efficient code in Python and Java to automate data workflows and support data engineering needs. Utilize shell scripting for operational tasks and automation within the data environment. Collaborate with cross-functional teams to understand data requirements and provide optimized data engineering solutions. Ensure data security, compliance, and performance by following best practices in big data and distributed systems. Continuously improve the performance, scalability, and reliability of data processing pipelines. Qualifications Experience in cloud environments (AWS, GCP, Azure) with big data components is a plus. Experience with version control tools (e.g., Git) and CI/CD practices in data engineering. Strong analytical, problem-solving, and communication skills.

  • Senior Data Engineer

    1 month ago

    India iO Associates - UKEU Full time

    Job Title: Senior Data Engineer Location: Mohali Salary: Negotiable on the current package iO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse,...

  • Lead data engineer

    3 days ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Senior Data Engineer

    2 weeks ago

    India iO Associates - UKEU Full time

    Job Title: Senior Data Engineer Location: Mohali Salary: up to 30 LPA iO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse, ADF, ADLS...

  • Lead Data Engineer

    1 week ago

    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Lead Data Engineer

    1 week ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Senior data engineer

    2 weeks ago

    India Synechron Full time

    Good-day, We have an immediate opportunity for the Senior Data Engineer Job Role: Senior Data Engineer Job Location: Bangalore BCIT Experience- 7 to 10 years Notice : upto 15 Days. About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and...

  • Senior data engineer

    1 month ago

    India Recmatrix Consulting Full time

    Job Title: Senior Data Engineer Location: Remote within India Employment Type: Contract Experience Level: 6+ years Position Overview: We are seeking a Senior Data Warehouse Engineer to join our Digital Business team. This role involves building and managing data warehouses to support various business functions such as Sales, Marketing, and...

  • Senior Data Engineer

    2 months ago

    india ValueLabs Full time

    Dear Aspirants, We at ValueLabs have an Opening for Senior Azure Data Engineer role. Below is the JD for the same. Role: Sr Data Engineer Experience: 5+ Years Preferable Immediate Joiners The Azure Data Engineer is responsible for the design, development, and maintenance of data pipelines, data warehouses, and data lakes for the organization. This role...

  • AWS Data Engineer

    3 weeks ago

    india ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    2 weeks ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Senior data infrastructure engineer

    2 weeks ago

    India SourceBae Full time

    Job Role Senior Data Infrastructure Engineer Experience 5+ years Location: Remote Duration:3 - 6 months Job Description Title: Senior Data Infrastructure Engineer About the role As a Senior Data Infrastructure engineer, you will be working with Data Engineering, Analyst and Operations teams to build and maintain a secure, scalable and...

  • Senior Data Engineer

    2 weeks ago

    India Varcus infinity Full time € 30,00,000 - € 40,00,000

    Job Title: Senior Data Engineer Location: India (Permanent Work From Home) Salary: ₹30 - ₹40 LPA (flexible for exceptional candidates based on experience) Experience Level: Minimum 5 years, with preference for candidates with e-commerce experience (Note: Candidate must be available to work in PST time zone and able to join within a month.) ...

  • Senior Data Engineer

    2 weeks ago

    india Varcus infinity Full time

    Job Title: Senior Data Engineer   Location: India (Permanent Work From Home)   Salary: ₹30 - ₹40 LPA (flexible for exceptional candidates based on experience)   Experience Level: Minimum 5 years, with preference for candidates with e-commerce experience   (Note: Candidate must be available to work in PST time zone and able to join within a...

  • Senior Data Engineer

    2 weeks ago

    india Synechron Full time

    Good-day,We have an immediate opportunity for the Senior Data Engineer Job Role: Senior Data EngineerJob Location: Bangalore BCITExperience- 7 to 10 yearsNotice : upto 15 Days .About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to...

  • Senior Data Engineer

    3 weeks ago

    India Linuxpect Private Limited Full time

    We are seeking an experienced and skilled Senior Data Engineer with 5 to 10 years of hands-on experience in building and managing data pipelines and big data infrastructure. The ideal candidate will have a strong technical background in data engineering tools, big data ecosystems, and programming languages. This role will focus on designing, implementing,...

  • Senior Data Engineer

    3 weeks ago

    india Linuxpect Private Limited Full time

    We are seeking an experienced and skilled Senior Data Engineer with 5 to 10 years of hands-on experience in building and managing data pipelines and big data infrastructure. The ideal candidate will have a strong technical background in data engineering tools, big data ecosystems, and programming languages. This role will focus on designing, implementing,...

  • Senior Data Engineer

    3 weeks ago

    India Linuxpect Private Limited Full time

    We are seeking an experienced and skilled Senior Data Engineer with 5 to 10 years of hands-on experience in building and managing data pipelines and big data infrastructure. The ideal candidate will have a strong technical background in data engineering tools, big data ecosystems, and programming languages. This role will focus on designing, implementing,...